2024-05-08T09:10:38.397 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T09:10:38.397 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --description rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} --verbose --archive /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039 --name teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/orig.config.yaml 2024-05-08T09:10:38.430 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T09:10:38.513 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039 branch: squid description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7696039' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 6145 sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnX+L4lRtdCsUTRboj4pJM37ubDTVtneaHt67eSCD3xEbOKlr/UZEjtHR8HRQgHrKBVg9fx8XEuEOT3iXnWwyw= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7IjatQTIah0Tca7C2JXut6A07HkAY98pEyCSFKAm8Yabw+ZRp1ZtfaNXVdyCKtkSM0gFsBighxGDMnG/05hq8= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-07_21:40:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T09:10:38.514 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/qa; will attempt to use it 2024-05-08T09:10:38.514 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/qa/tasks 2024-05-08T09:10:38.515 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T09:10:38.516 INFO:teuthology.task.internal:Checking packages... 2024-05-08T09:10:38.540 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc' 2024-05-08T09:10:38.541 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T09:10:38.541 INFO:teuthology.packaging:ref: None 2024-05-08T09:10:38.541 INFO:teuthology.packaging:tag: None 2024-05-08T09:10:38.541 INFO:teuthology.packaging:branch: squid 2024-05-08T09:10:38.541 INFO:teuthology.packaging:sha1: 96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-08T09:10:38.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-05-08T09:10:38.736 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2515.g96805dcf 2024-05-08T09:10:38.738 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T09:10:38.777 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T09:10:38.777 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T09:10:38.836 INFO:teuthology.task.internal:Saving configuration 2024-05-08T09:10:38.851 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T09:10:38.941 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T09:10:38.968 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 09:05:45.956184', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnX+L4lRtdCsUTRboj4pJM37ubDTVtneaHt67eSCD3xEbOKlr/UZEjtHR8HRQgHrKBVg9fx8XEuEOT3iXnWwyw='} 2024-05-08T09:10:38.997 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 09:05:45.958070', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7IjatQTIah0Tca7C2JXut6A07HkAY98pEyCSFKAm8Yabw+ZRp1ZtfaNXVdyCKtkSM0gFsBighxGDMnG/05hq8='} 2024-05-08T09:10:38.997 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T09:10:39.036 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-05-08T09:10:39.037 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-05-08T09:10:39.037 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T09:10:39.124 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5cb6ec7e50>, signals=[15]) 2024-05-08T09:10:39.125 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T09:10:39.133 INFO:teuthology.task.internal:Opening connections... 2024-05-08T09:10:39.133 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-05-08T09:10:39.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:10:39.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:10:39.230 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:10:39.305 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T09:10:39.312 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-05-08T09:10:39.330 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-05-08T09:10:39.331 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-05-08T09:10:39.388 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T09:10:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-05-08T09:10:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T09:10:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T09:10:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T09:10:39.389 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-05-08T09:10:39.416 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2024-05-08T09:10:39.434 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2024-05-08T09:10:39.434 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2024-05-08T09:10:39.491 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="CentOS Stream" 2024-05-08T09:10:39.491 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="9" 2024-05-08T09:10:39.491 INFO:teuthology.orchestra.run.smithi161.stdout:ID="centos" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE="rhel fedora" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="9" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:PLATFORM_ID="platform:el9" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:ANSI_COLOR="0;31" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:LOGO="fedora-logo-icon" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://centos.org/" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T09:10:39.492 INFO:teuthology.orchestra.run.smithi161.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T09:10:39.492 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2024-05-08T09:10:39.516 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T09:10:39.525 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T09:10:39.530 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T09:10:39.530 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-05-08T09:10:39.532 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2024-05-08T09:10:39.549 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T09:10:39.556 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T09:10:39.556 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-05-08T09:10:39.589 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2024-05-08T09:10:39.669 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T09:10:39.726 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T09:10:39.743 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-08T09:10:39.743 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-08T09:10:39.743 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T09:10:39.744 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T09:10:39.760 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:10:39.761 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-05-08T09:10:39.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:10:39.762 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-05-08T09:10:39.818 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-437.el9.x86_64 2024-05-08T09:10:39.818 INFO:teuthology.task.kernel:Running kernel on smithi161: 5.14.0-437.el9.x86_64 2024-05-08T09:10:39.818 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum install -y kernel 2024-05-08T09:10:39.820 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-437.el9.x86_64 2024-05-08T09:10:39.820 INFO:teuthology.task.kernel:Running kernel on smithi045: 5.14.0-437.el9.x86_64 2024-05-08T09:10:39.820 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum install -y kernel 2024-05-08T09:10:42.195 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-08T09:10:42.907 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.1 MB 00:01 2024-05-08T09:10:46.004 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 7.0 MB/s | 19 MB 00:02 2024-05-08T09:10:46.574 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 19 MB 00:02 2024-05-08T09:10:50.825 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-08T09:10:51.071 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.2 MB 00:01 2024-05-08T09:10:52.475 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-05-08T09:10:52.756 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-08T09:10:55.476 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-05-08T09:10:56.143 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 6.5 MB/s | 21 MB 00:03 2024-05-08T09:11:00.910 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-05-08T09:11:01.282 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-05-08T09:11:02.991 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T09:11:02.991 INFO:teuthology.orchestra.run.smithi045.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T09:11:03.088 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:11:03.093 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:11:03.094 INFO:teuthology.orchestra.run.smithi045.stdout:Install 4 Packages 2024-05-08T09:11:03.095 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:03.095 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 78 M 2024-05-08T09:11:03.095 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 123 M 2024-05-08T09:11:03.095 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:11:03.247 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-08T09:11:03.247 INFO:teuthology.orchestra.run.smithi161.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-08T09:11:03.340 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: kernel x86_64 5.14.0-444.el9 baseos 484 k 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core x86_64 5.14.0-444.el9 baseos 15 M 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules x86_64 5.14.0-444.el9 baseos 34 M 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core x86_64 5.14.0-444.el9 baseos 28 M 2024-05-08T09:11:03.350 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout:Install 4 Packages 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 78 M 2024-05-08T09:11:03.351 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 123 M 2024-05-08T09:11:03.352 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:11:03.691 INFO:teuthology.orchestra.run.smithi161.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 1.6 MB/s | 484 kB 00:00 2024-05-08T09:11:04.194 INFO:teuthology.orchestra.run.smithi045.stdout:(1/4): kernel-5.14.0-444.el9.x86_64.rpm 469 kB/s | 484 kB 00:01 2024-05-08T09:11:04.308 INFO:teuthology.orchestra.run.smithi161.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 17 MB/s | 15 MB 00:00 2024-05-08T09:11:04.934 INFO:teuthology.orchestra.run.smithi161.stdout:(3/4): kernel-modules-core-5.14.0-444.el9.x86_6 23 MB/s | 28 MB 00:01 2024-05-08T09:11:04.961 INFO:teuthology.orchestra.run.smithi045.stdout:(2/4): kernel-core-5.14.0-444.el9.x86_64.rpm 8.6 MB/s | 15 MB 00:01 2024-05-08T09:11:05.267 INFO:teuthology.orchestra.run.smithi161.stdout:(4/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 18 MB/s | 34 MB 00:01 2024-05-08T09:11:05.267 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:11:05.268 INFO:teuthology.orchestra.run.smithi161.stdout:Total 41 MB/s | 78 MB 00:01 2024-05-08T09:11:05.703 INFO:teuthology.orchestra.run.smithi045.stdout:(3/4): kernel-modules-5.14.0-444.el9.x86_64.rpm 13 MB/s | 34 MB 00:02 2024-05-08T09:11:05.944 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:11:06.276 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:11:06.276 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:11:06.695 INFO:teuthology.orchestra.run.smithi045.stdout:(4/4): kernel-modules-core-5.14.0-444.el9.x86_6 11 MB/s | 28 MB 00:02 2024-05-08T09:11:06.695 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:11:06.695 INFO:teuthology.orchestra.run.smithi045.stdout:Total 22 MB/s | 78 MB 00:03 2024-05-08T09:11:07.223 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:11:07.223 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:11:07.401 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:11:07.804 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:11:07.804 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:11:08.764 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:11:08.764 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:11:09.639 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:11:10.252 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T09:11:10.351 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:11.324 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:11:11.964 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-core-5.14.0-444.el9.x86_64 1/4 2024-05-08T09:11:12.060 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:13.021 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:13.146 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:14.872 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:15.017 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:17.896 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:18.040 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:20.093 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:20.145 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:22.757 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:25.240 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:52.019 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:52.057 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:52.422 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:52.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T09:11:52.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:52.423 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:53.253 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:11:53.607 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T09:11:53.686 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.686 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T09:11:53.686 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T09:11:53.686 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T09:11:53.686 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T09:11:53.687 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-05-08T09:11:53.687 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi161.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T09:11:53.687 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T09:11:53.736 INFO:teuthology.orchestra.run.smithi161.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:53.737 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T09:11:53.737 DEBUG:teuthology.orchestra.run.smithi161:> sudo rpm -qi grub2-tools 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Name : grub2-tools 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Epoch : 1 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Version : 2.06 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Release : 68.el9 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Architecture: x86_64 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Group : Unspecified 2024-05-08T09:11:53.767 INFO:teuthology.orchestra.run.smithi161.stdout:Size : 8264254 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:License : GPLv3+ 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Packager : builder@centos.org 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Vendor : CentOS 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Summary : Support tools for GRUB. 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:Description : 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T09:11:53.768 INFO:teuthology.orchestra.run.smithi161.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T09:11:53.769 INFO:teuthology.orchestra.run.smithi161.stdout:hardware devices. 2024-05-08T09:11:53.769 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:11:53.769 INFO:teuthology.orchestra.run.smithi161.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T09:11:53.770 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T09:11:53.770 INFO:teuthology.task.kernel:Updating grub on smithi161 to boot 5.14.0-444.el9.x86_64 2024-05-08T09:11:53.770 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T09:11:54.432 INFO:teuthology.orchestra.run.smithi161.stderr:Generating grub configuration file ... 2024-05-08T09:11:55.894 INFO:teuthology.orchestra.run.smithi161.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T09:11:55.911 INFO:teuthology.orchestra.run.smithi161.stderr:done 2024-05-08T09:11:55.913 DEBUG:teuthology.orchestra.run.smithi161:> mktemp 2024-05-08T09:11:55.934 INFO:teuthology.orchestra.run.smithi161.stdout:/tmp/tmp.8FriKAaddc 2024-05-08T09:11:55.935 DEBUG:teuthology.orchestra.run.smithi161:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.8FriKAaddc 2024-05-08T09:11:56.000 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0666 /tmp/tmp.8FriKAaddc 2024-05-08T09:11:56.083 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:56.124 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-modules-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:56.135 DEBUG:teuthology.orchestra.remote:smithi161:/tmp/tmp.8FriKAaddc is 6KB 2024-05-08T09:11:56.183 DEBUG:teuthology.orchestra.run.smithi161:> rm -fr /tmp/tmp.8FriKAaddc 2024-05-08T09:11:56.197 DEBUG:teuthology.orchestra.run.smithi161:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T09:11:56.266 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T09:11:56.266 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T09:11:56.266 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T09:11:56.266 INFO:teuthology.orchestra.run.smithi161.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T09:11:56.267 DEBUG:teuthology.orchestra.run.smithi161:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T09:11:56.422 DEBUG:teuthology.orchestra.run.smithi161:> sudo shutdown -r now 2024-05-08T09:11:56.593 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: kernel-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:56.593 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-5.14.0-444.el9.x86_64 1/4 2024-05-08T09:11:56.593 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-core-5.14.0-444.el9.x86_64 2/4 2024-05-08T09:11:56.593 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-5.14.0-444.el9.x86_64 3/4 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : kernel-modules-core-5.14.0-444.el9.x86_64 4/4 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-core-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: kernel-modules-core-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:57.392 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:11:57.722 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T09:11:57.799 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.799 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T09:11:57.800 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-444.el9.x86_64 2024-05-08T09:11:57.800 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-08T09:11:57.800 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-08T09:11:57.800 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-08T09:11:57.800 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2024-05-08T09:11:57.800 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q kernel | sort -rV | head -n 1 2024-05-08T09:11:57.851 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-5.14.0-444.el9.x86_64 2024-05-08T09:11:57.852 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-444.el9.x86_64 2024-05-08T09:11:57.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 68.el9 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2024-05-08T09:11:57.889 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8264254 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2024-05-08T09:11:57.890 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:11:57.891 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T09:11:57.892 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T09:11:57.892 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 5.14.0-444.el9.x86_64 2024-05-08T09:11:57.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T09:11:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2024-05-08T09:11:59.966 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T09:12:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:done 2024-05-08T09:12:00.006 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-05-08T09:12:00.021 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.eBcyHqwvqA 2024-05-08T09:12:00.022 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eBcyHqwvqA 2024-05-08T09:12:00.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.eBcyHqwvqA 2024-05-08T09:12:00.235 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.eBcyHqwvqA is 6KB 2024-05-08T09:12:00.282 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.eBcyHqwvqA 2024-05-08T09:12:00.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T09:12:00.359 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T09:12:00.360 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T09:12:00.360 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T09:12:00.360 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64.conf 2024-05-08T09:12:00.361 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-444.el9.x86_64 2024-05-08T09:12:00.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2024-05-08T09:12:26.459 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-05-08T09:12:26.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:12:26.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:12:30.510 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-08T09:12:30.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:12:30.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:12:44.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-05-08T09:12:48.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-05-08T09:12:53.833 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:12:53.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:12:56.894 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-05-08T09:12:57.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:12:57.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:13:08.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:13:08.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:13:27.327 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.161 2024-05-08T09:13:42.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:13:42.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:13:42.690 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-05-08T09:13:43.210 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:13:43.210 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-444.el9.x86_64"... 2024-05-08T09:13:43.211 DEBUG:teuthology.orchestra.run.smithi161:> uname -r 2024-05-08T09:13:43.264 INFO:teuthology.orchestra.run.smithi161.stdout:5.14.0-444.el9.x86_64 2024-05-08T09:13:43.265 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T09:13:43.265 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T09:13:43.265 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T09:13:44.266 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-05-08T09:13:44.266 DEBUG:teuthology.orchestra.run.smithi161:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T09:13:44.357 INFO:teuthology.orchestra.run.smithi161.stdout:ttyS1 2024-05-08T09:13:44.389 DEBUG:teuthology.parallel:result is None 2024-05-08T09:13:57.931 DEBUG:teuthology.orchestra.remote:timed out 2024-05-08T09:14:09.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:14:09.933 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:14:10.283 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-05-08T09:14:10.673 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:14:10.673 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-444.el9.x86_64"... 2024-05-08T09:14:10.673 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-05-08T09:14:10.691 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-444.el9.x86_64 2024-05-08T09:14:10.691 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-444.el9.x86_64 vs 5.14.0-444.el9.x86_64 2024-05-08T09:14:10.691 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T09:14:10.691 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T09:14:11.692 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-08T09:14:11.692 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-08T09:14:11.776 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2024-05-08T09:14:11.811 DEBUG:teuthology.parallel:result is None 2024-05-08T09:14:11.812 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T09:14:11.821 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T09:14:11.821 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T09:14:11.824 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T09:14:11.845 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T09:14:11.851 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T09:14:11.861 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T09:14:11.861 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T09:14:11.883 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T09:14:11.980 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T09:14:11.987 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T09:14:11.987 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T09:14:11.990 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T09:14:12.025 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T09:14:12.029 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T09:14:12.036 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T09:14:12.041 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T09:14:12.043 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T09:14:12.050 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T09:14:12.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T09:14:12.085 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T09:14:12.113 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T09:14:12.122 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T09:14:12.122 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T09:14:12.154 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T09:14:12.172 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T09:14:12.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T09:14:12.303 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T09:14:12.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T09:14:12.431 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:14:12.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T09:14:12.499 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T09:14:12.544 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T09:14:12.597 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T09:14:12.679 DEBUG:teuthology.orchestra.run.smithi161:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T09:14:12.724 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:14:12.724 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T09:14:12.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-05-08T09:14:12.792 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2024-05-08T09:14:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T09:14:12.885 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T09:14:13.262 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T09:14:13.270 INFO:teuthology.task.internal:Starting timer... 2024-05-08T09:14:13.270 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T09:14:13.279 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T09:14:13.287 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-05-08T09:14:13.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-05-08T09:14:13.336 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-05-08T09:14:13.338 DEBUG:teuthology.orchestra.run.smithi161:> sudo service auditd rotate 2024-05-08T09:14:13.416 INFO:teuthology.orchestra.run.smithi161.stdout:Rotating logs: 2024-05-08T09:14:13.418 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T09:14:13.418 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-05-08T09:14:13.451 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-05-08T09:14:13.452 DEBUG:teuthology.orchestra.run.smithi161:> /usr/sbin/getenforce 2024-05-08T09:14:13.490 INFO:teuthology.orchestra.run.smithi161.stdout:Permissive 2024-05-08T09:14:13.491 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi161.front.sepia.ceph.com': 'permissive'} 2024-05-08T09:14:13.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T09:14:13.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:14:13.522 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T09:14:13.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:14:13.557 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T09:14:13.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-05-08T09:14:13.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo /usr/sbin/setenforce permissive 2024-05-08T09:14:13.624 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T09:14:13.633 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-08T09:14:13.639 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-08T09:14:13.855 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T09:14:13.897 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T09:14:13.898 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi161.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T09:18:15.286 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com')] 2024-05-08T09:18:15.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:18:15.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:18:15.371 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-05-08T09:18:15.451 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-05-08T09:18:15.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:18:15.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T09:18:15.526 DEBUG:teuthology.orchestra.run.smithi161:> true 2024-05-08T09:18:15.602 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi161.front.sepia.ceph.com' 2024-05-08T09:18:15.602 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T09:18:15.612 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T09:18:15.612 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T09:18:15.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T09:18:15.615 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T09:18:15.615 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T09:18:15.643 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T09:18:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T09:18:15.670 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T09:18:15.684 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-05-08T09:18:15.685 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T09:18:15.696 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-05-08T09:18:15.709 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: ntpd: command not found 2024-05-08T09:18:15.711 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T09:18:15.720 INFO:teuthology.orchestra.run.smithi161.stdout:506 Cannot talk to daemon 2024-05-08T09:18:15.725 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T09:18:15.734 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T09:18:15.748 INFO:teuthology.orchestra.run.smithi161.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T09:18:15.793 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.796 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.815 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-05-08T09:18:15.818 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T09:18:15.818 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-05-08T09:18:15.819 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.819 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.819 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.819 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:18:15.820 INFO:teuthology.run_tasks:Running task install... 2024-05-08T09:18:15.828 DEBUG:teuthology.task.install:project ceph 2024-05-08T09:18:15.828 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}} 2024-05-08T09:18:15.828 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'} 2024-05-08T09:18:15.828 INFO:teuthology.task.install:Using flavor: default 2024-05-08T09:18:15.834 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T09:18:15.834 INFO:teuthology.task.install:extra packages: [] 2024-05-08T09:18:15.834 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'tag': None, 'wait_for_package': False} 2024-05-08T09:18:15.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-08T09:18:15.837 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'tag': None, 'wait_for_package': False} 2024-05-08T09:18:15.837 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-08T09:18:15.979 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/ 2024-05-08T09:18:15.979 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2515.g96805dcf 2024-05-08T09:18:16.049 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/ 2024-05-08T09:18:16.050 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2515.g96805dcf 2024-05-08T09:18:16.146 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T09:18:16.147 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:18:16.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T09:18:16.155 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/squid/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T09:18:16.155 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:18:16.155 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T09:18:16.173 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T09:18:16.173 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T09:18:16.180 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-05-08T09:18:16.181 DEBUG:teuthology.orchestra.run.smithi161:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T09:18:16.240 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T09:18:16.246 DEBUG:teuthology.orchestra.run.smithi161:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T09:18:16.317 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T09:18:16.321 DEBUG:teuthology.orchestra.run.smithi161:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T09:18:16.382 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-05-08T09:18:16.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-05-08T09:18:16.385 INFO:teuthology.orchestra.run.smithi161.stdout:check_obsoletes = 1 2024-05-08T09:18:16.387 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum clean all 2024-05-08T09:18:16.619 INFO:teuthology.orchestra.run.smithi161.stdout:54 files removed 2024-05-08T09:18:16.625 INFO:teuthology.orchestra.run.smithi045.stdout:54 files removed 2024-05-08T09:18:16.647 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-radosgw 2024-05-08T09:18:16.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw 2024-05-08T09:18:17.319 INFO:teuthology.orchestra.run.smithi161.stdout:ceph packages for x86_64 208 kB/s | 83 kB 00:00 2024-05-08T09:18:17.361 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 198 kB/s | 83 kB 00:00 2024-05-08T09:18:17.762 INFO:teuthology.orchestra.run.smithi161.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-05-08T09:18:17.795 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 30 kB/s | 11 kB 00:00 2024-05-08T09:18:18.179 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 5.6 kB/s | 1.9 kB 00:00 2024-05-08T09:18:18.179 INFO:teuthology.orchestra.run.smithi161.stdout:ceph source packages 5.1 kB/s | 1.9 kB 00:00 2024-05-08T09:18:19.004 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.1 MB 00:00 2024-05-08T09:18:20.020 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.1 MB 00:01 2024-05-08T09:18:24.588 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 19 MB 00:03 2024-05-08T09:18:30.672 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.2 MB 00:02 2024-05-08T09:18:32.281 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-05-08T09:18:33.500 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-08T09:18:36.838 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:16 2024-05-08T09:18:38.958 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-05-08T09:18:41.451 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:18:41.459 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:18:41.459 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:18:41.459 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:18:41.459 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 10 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.4 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.4 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 21 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 25 k 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 746 k 2024-05-08T09:18:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 500 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.3 M 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 45 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 135 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 162 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 321 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 298 k 2024-05-08T09:18:41.461 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 99 k 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:Install 30 Packages 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 2 Packages 2024-05-08T09:18:41.462 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:18:41.463 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 60 M 2024-05-08T09:18:41.463 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:18:42.493 INFO:teuthology.orchestra.run.smithi045.stdout:(1/32): ceph-base-19.0.0-2515.g96805dcf.el9.x86 6.4 MB/s | 5.4 MB 00:00 2024-05-08T09:18:42.535 INFO:teuthology.orchestra.run.smithi045.stdout:(2/32): ceph-selinux-19.0.0-2515.g96805dcf.el9. 607 kB/s | 25 kB 00:00 2024-05-08T09:18:42.626 INFO:teuthology.orchestra.run.smithi045.stdout:(3/32): libcephfs2-19.0.0-2515.g96805dcf.el9.x8 8.0 MB/s | 746 kB 00:00 2024-05-08T09:18:42.693 INFO:teuthology.orchestra.run.smithi045.stdout:(4/32): libradosstriper1-19.0.0-2515.g96805dcf. 7.3 MB/s | 500 kB 00:00 2024-05-08T09:18:42.830 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-08T09:18:43.093 INFO:teuthology.orchestra.run.smithi045.stdout:(5/32): librgw2-19.0.0-2515.g96805dcf.el9.x86_6 13 MB/s | 5.3 MB 00:00 2024-05-08T09:18:43.127 INFO:teuthology.orchestra.run.smithi045.stdout:(6/32): python3-ceph-argparse-19.0.0-2515.g9680 1.3 MB/s | 45 kB 00:00 2024-05-08T09:18:43.185 INFO:teuthology.orchestra.run.smithi045.stdout:(7/32): python3-ceph-common-19.0.0-2515.g96805d 2.3 MB/s | 135 kB 00:00 2024-05-08T09:18:43.244 INFO:teuthology.orchestra.run.smithi045.stdout:(8/32): python3-cephfs-19.0.0-2515.g96805dcf.el 2.7 MB/s | 162 kB 00:00 2024-05-08T09:18:43.311 INFO:teuthology.orchestra.run.smithi045.stdout:(9/32): python3-rados-19.0.0-2515.g96805dcf.el9 4.7 MB/s | 321 kB 00:00 2024-05-08T09:18:43.378 INFO:teuthology.orchestra.run.smithi045.stdout:(10/32): python3-rbd-19.0.0-2515.g96805dcf.el9. 4.4 MB/s | 298 kB 00:00 2024-05-08T09:18:43.437 INFO:teuthology.orchestra.run.smithi045.stdout:(11/32): python3-rgw-19.0.0-2515.g96805dcf.el9. 1.7 MB/s | 99 kB 00:00 2024-05-08T09:18:43.721 INFO:teuthology.orchestra.run.smithi045.stdout:(12/32): ceph-radosgw-19.0.0-2515.g96805dcf.el9 5.0 MB/s | 10 MB 00:02 2024-05-08T09:18:44.312 INFO:teuthology.orchestra.run.smithi045.stdout:(13/32): ceph-common-19.0.0-2515.g96805dcf.el9. 7.9 MB/s | 21 MB 00:02 2024-05-08T09:18:44.438 INFO:teuthology.orchestra.run.smithi045.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 107 kB/s | 107 kB 00:01 2024-05-08T09:18:44.447 INFO:teuthology.orchestra.run.smithi161.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-05-08T09:18:44.730 INFO:teuthology.orchestra.run.smithi045.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 159 kB/s | 160 kB 00:01 2024-05-08T09:18:45.088 INFO:teuthology.orchestra.run.smithi045.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 58 kB/s | 45 kB 00:00 2024-05-08T09:18:45.668 INFO:teuthology.orchestra.run.smithi045.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 539 kB/s | 662 kB 00:01 2024-05-08T09:18:45.797 INFO:teuthology.orchestra.run.smithi045.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 281 kB/s | 292 kB 00:01 2024-05-08T09:18:45.914 INFO:teuthology.orchestra.run.smithi045.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 51 kB/s | 42 kB 00:00 2024-05-08T09:18:46.251 INFO:teuthology.orchestra.run.smithi161.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-08T09:18:46.456 INFO:teuthology.orchestra.run.smithi045.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 54 kB/s | 36 kB 00:00 2024-05-08T09:18:46.556 INFO:teuthology.orchestra.run.smithi045.stdout:(21/32): qatlib-24.02.0-1.el9.x86_64.rpm 249 kB/s | 221 kB 00:00 2024-05-08T09:18:46.606 INFO:teuthology.orchestra.run.smithi045.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 68 kB/s | 47 kB 00:00 2024-05-08T09:18:46.848 INFO:teuthology.orchestra.run.smithi045.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 108 kB/s | 26 kB 00:00 2024-05-08T09:18:46.907 INFO:teuthology.orchestra.run.smithi045.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 686 kB/s | 309 kB 00:00 2024-05-08T09:18:47.007 INFO:teuthology.orchestra.run.smithi045.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 674 kB/s | 67 kB 00:00 2024-05-08T09:18:47.073 INFO:teuthology.orchestra.run.smithi045.stdout:(26/32): liboath-2.6.7-2.el9.x86_64.rpm 215 kB/s | 49 kB 00:00 2024-05-08T09:18:47.192 INFO:teuthology.orchestra.run.smithi045.stdout:(27/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.4 MB/s | 839 kB 00:00 2024-05-08T09:18:47.241 INFO:teuthology.orchestra.run.smithi045.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-08T09:18:47.349 INFO:teuthology.orchestra.run.smithi045.stdout:(29/32): libarrow-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 4.4 MB 00:00 2024-05-08T09:18:47.392 INFO:teuthology.orchestra.run.smithi045.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-05-08T09:18:47.575 INFO:teuthology.orchestra.run.smithi045.stdout:(31/32): librados2-19.0.0-2515.g96805dcf.el9.x8 10 MB/s | 3.4 MB 00:00 2024-05-08T09:18:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:(32/32): librbd1-19.0.0-2515.g96805dcf.el9.x86_ 7.4 MB/s | 3.1 MB 00:00 2024-05-08T09:18:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:18:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:Total 9.5 MB/s | 60 MB 00:06 2024-05-08T09:18:47.890 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:18:47.932 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:18:47.932 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:18:48.601 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:18:48.601 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:18:50.031 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:18:50.110 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T09:18:50.139 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T09:18:50.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T09:18:50.186 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T09:18:50.219 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T09:18:50.439 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T09:18:50.496 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T09:18:50.895 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T09:18:50.948 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:18:51.042 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:18:51.130 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 8/34 2024-05-08T09:18:51.158 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/34 2024-05-08T09:18:51.221 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/34 2024-05-08T09:18:51.249 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T09:18:51.303 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9. 11/34 2024-05-08T09:18:51.357 INFO:teuthology.orchestra.run.smithi161.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-05-08T09:18:51.372 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 12/34 2024-05-08T09:18:51.393 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 13/34 2024-05-08T09:18:51.449 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 13/34 2024-05-08T09:18:51.484 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T09:18:51.595 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T09:18:51.634 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T09:18:51.694 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T09:18:51.724 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T09:18:51.753 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T09:18:51.786 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T09:18:52.119 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T09:18:52.157 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 22/34 2024-05-08T09:18:52.249 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 22/34 2024-05-08T09:18:52.279 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 23/34 2024-05-08T09:18:52.323 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T09:18:52.822 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T09:18:52.851 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 26/34 2024-05-08T09:18:52.915 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 26/34 2024-05-08T09:18:52.996 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 27/34 2024-05-08T09:18:53.029 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x8 28/34 2024-05-08T09:18:53.725 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 10 M 2024-05-08T09:18:53.743 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrading: 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: librados2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.4 M 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.4 M 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 21 M 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 25 k 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 746 k 2024-05-08T09:18:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 500 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2 x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 5.3 M 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 45 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 135 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 162 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 321 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 298 k 2024-05-08T09:18:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 99 k 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout:Installing weak dependencies: 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout:Install 30 Packages 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout:Upgrade 2 Packages 2024-05-08T09:18:53.746 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:18:53.747 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 60 M 2024-05-08T09:18:53.747 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:18:55.184 INFO:teuthology.orchestra.run.smithi161.stdout:(1/32): ceph-radosgw-19.0.0-2515.g96805dcf.el9. 9.8 MB/s | 10 MB 00:01 2024-05-08T09:18:55.218 INFO:teuthology.orchestra.run.smithi161.stdout:(2/32): ceph-selinux-19.0.0-2515.g96805dcf.el9. 757 kB/s | 25 kB 00:00 2024-05-08T09:18:55.309 INFO:teuthology.orchestra.run.smithi161.stdout:(3/32): libcephfs2-19.0.0-2515.g96805dcf.el9.x8 8.0 MB/s | 746 kB 00:00 2024-05-08T09:18:55.368 INFO:teuthology.orchestra.run.smithi161.stdout:(4/32): libradosstriper1-19.0.0-2515.g96805dcf. 8.4 MB/s | 500 kB 00:00 2024-05-08T09:18:55.398 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:18:55.442 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:18:55.710 INFO:teuthology.orchestra.run.smithi161.stdout:(5/32): librgw2-19.0.0-2515.g96805dcf.el9.x86_6 16 MB/s | 5.3 MB 00:00 2024-05-08T09:18:55.802 INFO:teuthology.orchestra.run.smithi161.stdout:(6/32): ceph-base-19.0.0-2515.g96805dcf.el9.x86 3.2 MB/s | 5.4 MB 00:01 2024-05-08T09:18:55.819 INFO:teuthology.orchestra.run.smithi161.stdout:(7/32): python3-ceph-argparse-19.0.0-2515.g9680 415 kB/s | 45 kB 00:00 2024-05-08T09:18:55.852 INFO:teuthology.orchestra.run.smithi161.stdout:(8/32): python3-ceph-common-19.0.0-2515.g96805d 2.6 MB/s | 135 kB 00:00 2024-05-08T09:18:55.878 INFO:teuthology.orchestra.run.smithi161.stdout:(9/32): python3-cephfs-19.0.0-2515.g96805dcf.el 2.7 MB/s | 162 kB 00:00 2024-05-08T09:18:55.920 INFO:teuthology.orchestra.run.smithi161.stdout:(10/32): python3-rados-19.0.0-2515.g96805dcf.el 4.7 MB/s | 321 kB 00:00 2024-05-08T09:18:55.945 INFO:teuthology.orchestra.run.smithi161.stdout:(11/32): python3-rbd-19.0.0-2515.g96805dcf.el9. 4.3 MB/s | 298 kB 00:00 2024-05-08T09:18:55.987 INFO:teuthology.orchestra.run.smithi161.stdout:(12/32): python3-rgw-19.0.0-2515.g96805dcf.el9. 1.5 MB/s | 99 kB 00:00 2024-05-08T09:18:56.031 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:18:56.071 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 30/34 2024-05-08T09:18:56.145 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 30/34 2024-05-08T09:18:56.146 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T09:18:56.146 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T09:18:56.146 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:18:56.189 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:18:56.363 INFO:teuthology.orchestra.run.smithi161.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 256 kB/s | 107 kB 00:00 2024-05-08T09:18:56.471 INFO:teuthology.orchestra.run.smithi161.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 418 kB/s | 45 kB 00:00 2024-05-08T09:18:56.496 INFO:teuthology.orchestra.run.smithi161.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 315 kB/s | 160 kB 00:00 2024-05-08T09:18:56.688 INFO:teuthology.orchestra.run.smithi161.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2024-05-08T09:18:56.797 INFO:teuthology.orchestra.run.smithi161.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 390 kB/s | 42 kB 00:00 2024-05-08T09:18:57.056 INFO:teuthology.orchestra.run.smithi161.stdout:(18/32): ceph-common-19.0.0-2515.g96805dcf.el9. 7.2 MB/s | 21 MB 00:02 2024-05-08T09:18:57.081 INFO:teuthology.orchestra.run.smithi161.stdout:(19/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.1 MB/s | 662 kB 00:00 2024-05-08T09:18:57.106 INFO:teuthology.orchestra.run.smithi161.stdout:(20/32): qatlib-24.02.0-1.el9.x86_64.rpm 714 kB/s | 221 kB 00:00 2024-05-08T09:18:57.215 INFO:teuthology.orchestra.run.smithi161.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-05-08T09:18:57.423 INFO:teuthology.orchestra.run.smithi161.stdout:(22/32): qatlib-service-24.02.0-1.el9.x86_64.rp 98 kB/s | 36 kB 00:00 2024-05-08T09:18:57.515 INFO:teuthology.orchestra.run.smithi161.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 755 kB/s | 309 kB 00:00 2024-05-08T09:18:57.533 INFO:teuthology.orchestra.run.smithi161.stdout:(24/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 238 kB/s | 26 kB 00:00 2024-05-08T09:18:57.557 INFO:teuthology.orchestra.run.smithi161.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-05-08T09:18:57.583 INFO:teuthology.orchestra.run.smithi161.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-05-08T09:18:57.708 INFO:teuthology.orchestra.run.smithi161.stdout:(27/32): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-05-08T09:18:57.742 INFO:teuthology.orchestra.run.smithi161.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 839 kB 00:00 2024-05-08T09:18:57.767 INFO:teuthology.orchestra.run.smithi161.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 1.0 MB/s | 192 kB 00:00 2024-05-08T09:18:57.825 INFO:teuthology.orchestra.run.smithi161.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-05-08T09:18:58.059 INFO:teuthology.orchestra.run.smithi161.stdout:(31/32): librbd1-19.0.0-2515.g96805dcf.el9.x86_ 11 MB/s | 3.1 MB 00:00 2024-05-08T09:18:58.426 INFO:teuthology.orchestra.run.smithi161.stdout:(32/32): librados2-19.0.0-2515.g96805dcf.el9.x8 5.2 MB/s | 3.4 MB 00:00 2024-05-08T09:18:58.430 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:18:58.430 INFO:teuthology.orchestra.run.smithi161.stdout:Total 13 MB/s | 60 MB 00:04 2024-05-08T09:18:58.530 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:18:58.566 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:18:58.566 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:18:59.176 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:18:59.177 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:00.576 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:00.659 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-05-08T09:19:00.689 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-05-08T09:19:00.723 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-05-08T09:19:00.745 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T09:19:00.769 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-05-08T09:19:00.955 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T09:19:01.010 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-05-08T09:19:01.343 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-05-08T09:19:01.466 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:19:01.560 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:19:01.649 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 8/34 2024-05-08T09:19:01.676 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/34 2024-05-08T09:19:01.731 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 9/34 2024-05-08T09:19:01.768 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-05-08T09:19:01.811 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9. 11/34 2024-05-08T09:19:01.882 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 12/34 2024-05-08T09:19:01.903 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 13/34 2024-05-08T09:19:01.967 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 13/34 2024-05-08T09:19:02.002 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-05-08T09:19:02.121 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-05-08T09:19:02.153 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-05-08T09:19:02.194 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-05-08T09:19:02.226 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-05-08T09:19:02.256 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-05-08T09:19:02.288 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-05-08T09:19:02.613 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-05-08T09:19:02.660 INFO:teuthology.orchestra.run.smithi161.stdout: Upgrading : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 22/34 2024-05-08T09:19:02.749 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 22/34 2024-05-08T09:19:02.781 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 23/34 2024-05-08T09:19:02.816 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-05-08T09:19:03.290 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-05-08T09:19:03.320 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 26/34 2024-05-08T09:19:03.392 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 26/34 2024-05-08T09:19:03.468 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 27/34 2024-05-08T09:19:03.498 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x8 28/34 2024-05-08T09:19:05.781 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:19:05.828 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:19:06.217 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:19:06.217 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-05-08T09:19:06.217 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-05-08T09:19:06.217 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-05-08T09:19:06.218 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-05-08T09:19:06.218 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-05-08T09:19:06.218 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2024-05-08T09:19:06.218 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-05-08T09:19:06.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:06.381 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 29/34 2024-05-08T09:19:06.423 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 30/34 2024-05-08T09:19:06.500 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 30/34 2024-05-08T09:19:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T09:19:06.500 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T09:19:06.500 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:06.533 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:19:07.197 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 32/34 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 32/34 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T09:19:07.225 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:07.227 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T09:19:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T09:19:07.442 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 1/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 3/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 4/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 5/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 6/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:19:08.585 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9. 8/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x8 9/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 10/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 11/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 12/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 13/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T09:19:08.586 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T09:19:08.587 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T09:19:08.588 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 33/34 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.388 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T09:19:09.389 INFO:teuthology.orchestra.run.smithi045.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:09.390 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:09.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-test 2024-05-08T09:19:10.371 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:32 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:10.498 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 48 M 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 163 k 2024-05-08T09:19:10.499 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout:Install 4 Packages 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:10.500 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 49 M 2024-05-08T09:19:10.501 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 207 M 2024-05-08T09:19:10.501 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:10.871 INFO:teuthology.orchestra.run.smithi045.stdout:(1/4): libcephsqlite-19.0.0-2515.g96805dcf.el9. 716 kB/s | 163 kB 00:00 2024-05-08T09:19:11.554 INFO:teuthology.orchestra.run.smithi045.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 334 kB/s | 305 kB 00:00 2024-05-08T09:19:11.596 INFO:teuthology.orchestra.run.smithi045.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 88 kB/s | 64 kB 00:00 2024-05-08T09:19:13.030 INFO:teuthology.orchestra.run.smithi045.stdout:(4/4): ceph-test-19.0.0-2515.g96805dcf.el9.x86_ 20 MB/s | 48 MB 00:02 2024-05-08T09:19:13.032 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:13.033 INFO:teuthology.orchestra.run.smithi045.stdout:Total 19 MB/s | 49 MB 00:02 2024-05-08T09:19:13.062 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:13.085 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:13.085 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:13.474 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:13.474 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:14.013 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:14.106 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T09:19:14.147 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T09:19:14.173 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 3/4 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /sys 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /proc 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /mnt 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /var/tmp 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /home 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /root 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout:skipping the directory /tmp 2024-05-08T09:19:16.045 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:17.012 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 32/34 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 32/34 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T09:19:17.037 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:17.039 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T09:19:17.123 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-05-08T09:19:17.123 INFO:teuthology.orchestra.run.smithi161.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:18.276 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 1/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 3/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 4/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 5/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_6 6/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 7/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9. 8/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x8 9/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 10/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 11/34 2024-05-08T09:19:18.277 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 12/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 13/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-05-08T09:19:18.278 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 31/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-05-08T09:19:18.279 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 33/34 2024-05-08T09:19:19.002 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-05-08T09:19:19.002 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:19.002 INFO:teuthology.orchestra.run.smithi161.stdout:Upgraded: 2024-05-08T09:19:19.002 INFO:teuthology.orchestra.run.smithi161.stdout: librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-radosgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-selinux-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T09:19:19.003 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: librgw2-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-common-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T09:19:19.004 INFO:teuthology.orchestra.run.smithi161.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T09:19:19.005 INFO:teuthology.orchestra.run.smithi161.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T09:19:19.005 INFO:teuthology.orchestra.run.smithi161.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T09:19:19.005 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:19.005 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:19.045 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 3/4 2024-05-08T09:19:19.125 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 4/4 2024-05-08T09:19:19.416 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-test 2024-05-08T09:19:19.991 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:28 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 48 M 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:19:20.113 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 163 k 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout:Install 4 Packages 2024-05-08T09:19:20.114 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:20.115 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 49 M 2024-05-08T09:19:20.115 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 207 M 2024-05-08T09:19:20.115 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:20.353 INFO:teuthology.orchestra.run.smithi161.stdout:(1/4): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 305 kB 00:00 2024-05-08T09:19:20.378 INFO:teuthology.orchestra.run.smithi161.stdout:(2/4): libcephsqlite-19.0.0-2515.g96805dcf.el9. 721 kB/s | 163 kB 00:00 2024-05-08T09:19:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-05-08T09:19:21.436 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 4/4 2024-05-08T09:19:21.436 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 1/4 2024-05-08T09:19:21.436 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2/4 2024-05-08T09:19:21.436 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T09:19:21.723 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:21.724 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:22.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph 2024-05-08T09:19:22.591 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:00:44 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:22.720 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:22.722 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:22.722 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 6.6 k 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 2.4 M 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 1.5 M 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 249 k 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 4.7 M 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 17 M 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T09:19:22.723 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T09:19:22.724 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T09:19:22.725 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout:Install 36 Packages 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 30 M 2024-05-08T09:19:22.726 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 107 M 2024-05-08T09:19:22.727 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:22.737 INFO:teuthology.orchestra.run.smithi161.stdout:(4/4): ceph-test-19.0.0-2515.g96805dcf.el9.x86_ 19 MB/s | 48 MB 00:02 2024-05-08T09:19:22.739 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:22.740 INFO:teuthology.orchestra.run.smithi161.stdout:Total 19 MB/s | 49 MB 00:02 2024-05-08T09:19:22.767 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:19:22.788 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:19:22.788 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:19:23.154 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:19:23.154 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:23.323 INFO:teuthology.orchestra.run.smithi045.stdout:(1/36): ceph-19.0.0-2515.g96805dcf.el9.x86_64.r 37 kB/s | 6.6 kB 00:00 2024-05-08T09:19:23.498 INFO:teuthology.orchestra.run.smithi045.stdout:(2/36): ceph-mgr-19.0.0-2515.g96805dcf.el9.x86_ 4.3 MB/s | 1.5 MB 00:00 2024-05-08T09:19:23.718 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:23.802 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-05-08T09:19:23.853 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-05-08T09:19:23.889 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 3/4 2024-05-08T09:19:24.448 INFO:teuthology.orchestra.run.smithi045.stdout:(3/36): ceph-osd-19.0.0-2515.g96805dcf.el9.x86_ 18 MB/s | 17 MB 00:00 2024-05-08T09:19:24.515 INFO:teuthology.orchestra.run.smithi045.stdout:(4/36): ceph-mon-19.0.0-2515.g96805dcf.el9.x86_ 3.9 MB/s | 4.7 MB 00:01 2024-05-08T09:19:24.566 INFO:teuthology.orchestra.run.smithi045.stdout:(5/36): ceph-mds-19.0.0-2515.g96805dcf.el9.x86_ 1.7 MB/s | 2.4 MB 00:01 2024-05-08T09:19:24.591 INFO:teuthology.orchestra.run.smithi045.stdout:(6/36): ceph-mgr-modules-core-19.0.0-2515.g9680 1.7 MB/s | 249 kB 00:00 2024-05-08T09:19:24.724 INFO:teuthology.orchestra.run.smithi045.stdout:(7/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-05-08T09:19:24.750 INFO:teuthology.orchestra.run.smithi045.stdout:(8/36): python3-ply-3.11-14.el9.noarch.rpm 671 kB/s | 106 kB 00:00 2024-05-08T09:19:24.775 INFO:teuthology.orchestra.run.smithi045.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.6 MB/s | 135 kB 00:00 2024-05-08T09:19:24.817 INFO:teuthology.orchestra.run.smithi045.stdout:(10/36): python3-cryptography-36.0.1-4.el9.x86_ 4.9 MB/s | 1.2 MB 00:00 2024-05-08T09:19:24.850 INFO:teuthology.orchestra.run.smithi045.stdout:(11/36): python3-requests-2.25.1-8.el9.noarch.r 1.2 MB/s | 125 kB 00:00 2024-05-08T09:19:24.901 INFO:teuthology.orchestra.run.smithi045.stdout:(12/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.7 MB/s | 215 kB 00:00 2024-05-08T09:19:25.626 INFO:teuthology.orchestra.run.smithi045.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 48 kB/s | 35 kB 00:00 2024-05-08T09:19:25.784 INFO:teuthology.orchestra.run.smithi045.stdout:(14/36): lua-5.4.4-4.el9.x86_64.rpm 195 kB/s | 188 kB 00:00 2024-05-08T09:19:25.810 INFO:teuthology.orchestra.run.smithi045.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 180 kB/s | 172 kB 00:00 2024-05-08T09:19:25.893 INFO:teuthology.orchestra.run.smithi045.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 269 kB/s | 22 kB 00:00 2024-05-08T09:19:26.327 INFO:teuthology.orchestra.run.smithi045.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 349 kB/s | 151 kB 00:00 2024-05-08T09:19:26.361 INFO:teuthology.orchestra.run.smithi045.stdout:(18/36): python3-pytz-2021.1-5.el9.noarch.rpm 69 kB/s | 51 kB 00:00 2024-05-08T09:19:26.494 INFO:teuthology.orchestra.run.smithi045.stdout:(19/36): python3-toml-0.10.2-6.el9.noarch.rpm 59 kB/s | 42 kB 00:00 2024-05-08T09:19:26.661 INFO:teuthology.orchestra.run.smithi045.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-05-08T09:19:26.753 INFO:teuthology.orchestra.run.smithi045.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 438 kB/s | 172 kB 00:00 2024-05-08T09:19:26.845 INFO:teuthology.orchestra.run.smithi045.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 58 kB/s | 11 kB 00:00 2024-05-08T09:19:26.995 INFO:teuthology.orchestra.run.smithi045.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 73 kB/s | 18 kB 00:00 2024-05-08T09:19:27.095 INFO:teuthology.orchestra.run.smithi045.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 92 kB/s | 23 kB 00:00 2024-05-08T09:19:27.154 INFO:teuthology.orchestra.run.smithi045.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 544 kB/s | 358 kB 00:00 2024-05-08T09:19:27.237 INFO:teuthology.orchestra.run.smithi045.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 80 kB/s | 19 kB 00:00 2024-05-08T09:19:27.346 INFO:teuthology.orchestra.run.smithi045.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 78 kB/s | 20 kB 00:00 2024-05-08T09:19:27.479 INFO:teuthology.orchestra.run.smithi045.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 142 kB/s | 46 kB 00:00 2024-05-08T09:19:27.655 INFO:teuthology.orchestra.run.smithi045.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 189 kB/s | 79 kB 00:00 2024-05-08T09:19:27.713 INFO:teuthology.orchestra.run.smithi045.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 70 kB/s | 16 kB 00:00 2024-05-08T09:19:27.897 INFO:teuthology.orchestra.run.smithi045.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 494 kB/s | 272 kB 00:00 2024-05-08T09:19:27.947 INFO:teuthology.orchestra.run.smithi045.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 153 kB/s | 36 kB 00:00 2024-05-08T09:19:27.972 INFO:teuthology.orchestra.run.smithi045.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 283 kB/s | 90 kB 00:00 2024-05-08T09:19:28.231 INFO:teuthology.orchestra.run.smithi045.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 77 kB/s | 20 kB 00:00 2024-05-08T09:19:28.364 INFO:teuthology.orchestra.run.smithi045.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 491 kB/s | 230 kB 00:00 2024-05-08T09:19:28.445 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 3/4 2024-05-08T09:19:28.520 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 4/4 2024-05-08T09:19:28.623 INFO:teuthology.orchestra.run.smithi045.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 632 kB/s | 427 kB 00:00 2024-05-08T09:19:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:28.627 INFO:teuthology.orchestra.run.smithi045.stdout:Total 5.1 MB/s | 30 MB 00:05 2024-05-08T09:19:28.776 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:28.821 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:28.821 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:29.299 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:29.300 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:30.568 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:30.617 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T09:19:30.656 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T09:19:30.686 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T09:19:30.761 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T09:19:30.802 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T09:19:30.835 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T09:19:30.842 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 4/4 2024-05-08T09:19:30.842 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 1/4 2024-05-08T09:19:30.842 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2/4 2024-05-08T09:19:30.842 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-05-08T09:19:30.932 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T09:19:31.017 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T09:19:31.063 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T09:19:31.097 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T09:19:31.103 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-test-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: libcephsqlite-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:31.104 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:31.127 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T09:19:31.162 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T09:19:31.195 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T09:19:31.227 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T09:19:31.271 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T09:19:31.305 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T09:19:31.343 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T09:19:31.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph 2024-05-08T09:19:31.420 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T09:19:31.572 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T09:19:31.654 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T09:19:31.705 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T09:19:31.776 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T09:19:31.835 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T09:19:31.907 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T09:19:31.994 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:40 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:32.108 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T09:19:32.125 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout: ceph x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 6.6 k 2024-05-08T09:19:32.128 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 2.4 M 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 1.5 M 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 249 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 4.7 M 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 17 M 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T09:19:32.129 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T09:19:32.130 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout:Install 36 Packages 2024-05-08T09:19:32.131 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:32.132 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 30 M 2024-05-08T09:19:32.132 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 107 M 2024-05-08T09:19:32.132 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:32.156 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T09:19:32.238 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T09:19:32.335 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T09:19:32.371 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T09:19:32.495 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T09:19:32.659 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9. 31/36 2024-05-08T09:19:32.689 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 32/36 2024-05-08T09:19:32.716 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 32/36 2024-05-08T09:19:32.717 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:32.717 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T09:19:32.717 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T09:19:32.717 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T09:19:32.717 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:33.006 INFO:teuthology.orchestra.run.smithi161.stdout:(1/36): ceph-19.0.0-2515.g96805dcf.el9.x86_64.r 28 kB/s | 6.6 kB 00:00 2024-05-08T09:19:33.148 INFO:teuthology.orchestra.run.smithi161.stdout:(2/36): ceph-mds-19.0.0-2515.g96805dcf.el9.x86_ 6.2 MB/s | 2.4 MB 00:00 2024-05-08T09:19:33.290 INFO:teuthology.orchestra.run.smithi161.stdout:(3/36): ceph-mgr-19.0.0-2515.g96805dcf.el9.x86_ 2.9 MB/s | 1.5 MB 00:00 2024-05-08T09:19:33.390 INFO:teuthology.orchestra.run.smithi161.stdout:(4/36): ceph-mgr-modules-core-19.0.0-2515.g9680 2.4 MB/s | 249 kB 00:00 2024-05-08T09:19:33.566 INFO:teuthology.orchestra.run.smithi161.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-05-08T09:19:33.949 INFO:teuthology.orchestra.run.smithi161.stdout:(6/36): ceph-osd-19.0.0-2515.g96805dcf.el9.x86_ 21 MB/s | 17 MB 00:00 2024-05-08T09:19:34.000 INFO:teuthology.orchestra.run.smithi161.stdout:(7/36): python3-cryptography-36.0.1-4.el9.x86_6 2.8 MB/s | 1.2 MB 00:00 2024-05-08T09:19:34.083 INFO:teuthology.orchestra.run.smithi161.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 1.6 MB/s | 135 kB 00:00 2024-05-08T09:19:34.142 INFO:teuthology.orchestra.run.smithi161.stdout:(9/36): python3-ply-3.11-14.el9.noarch.rpm 554 kB/s | 106 kB 00:00 2024-05-08T09:19:34.234 INFO:teuthology.orchestra.run.smithi161.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 2.3 MB/s | 215 kB 00:00 2024-05-08T09:19:34.257 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 33/36 2024-05-08T09:19:34.287 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 33/36 2024-05-08T09:19:34.287 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:34.288 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T09:19:34.288 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T09:19:34.288 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T09:19:34.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:34.301 INFO:teuthology.orchestra.run.smithi161.stdout:(11/36): python3-requests-2.25.1-8.el9.noarch.r 575 kB/s | 125 kB 00:00 2024-05-08T09:19:34.749 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 34/36 2024-05-08T09:19:34.768 INFO:teuthology.orchestra.run.smithi161.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 353 kB/s | 188 kB 00:00 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 34/36 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T09:19:34.775 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:34.826 INFO:teuthology.orchestra.run.smithi161.stdout:(13/36): python3-mako-1.1.4-6.el9.noarch.rpm 328 kB/s | 172 kB 00:00 2024-05-08T09:19:34.901 INFO:teuthology.orchestra.run.smithi161.stdout:(14/36): ceph-mon-19.0.0-2515.g96805dcf.el9.x86 2.5 MB/s | 4.7 MB 00:01 2024-05-08T09:19:34.918 INFO:teuthology.orchestra.run.smithi161.stdout:(15/36): python3-markupsafe-1.1.1-12.el9.x86_64 231 kB/s | 35 kB 00:00 2024-05-08T09:19:34.935 INFO:teuthology.orchestra.run.smithi161.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-05-08T09:19:35.008 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 35/36 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 35/36 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T09:19:35.034 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:35.094 INFO:teuthology.orchestra.run.smithi161.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 954 kB/s | 151 kB 00:00 2024-05-08T09:19:35.100 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 36/36 2024-05-08T09:19:35.119 INFO:teuthology.orchestra.run.smithi161.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-05-08T09:19:35.145 INFO:teuthology.orchestra.run.smithi161.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 866 kB/s | 43 kB 00:00 2024-05-08T09:19:35.211 INFO:teuthology.orchestra.run.smithi161.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 5.3 MB/s | 358 kB 00:00 2024-05-08T09:19:35.262 INFO:teuthology.orchestra.run.smithi161.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 213 kB/s | 11 kB 00:00 2024-05-08T09:19:35.287 INFO:teuthology.orchestra.run.smithi161.stdout:(22/36): python3-toml-0.10.2-6.el9.noarch.rpm 108 kB/s | 42 kB 00:00 2024-05-08T09:19:35.304 INFO:teuthology.orchestra.run.smithi161.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 423 kB/s | 18 kB 00:00 2024-05-08T09:19:35.329 INFO:teuthology.orchestra.run.smithi161.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 820 kB/s | 172 kB 00:00 2024-05-08T09:19:35.346 INFO:teuthology.orchestra.run.smithi161.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 461 kB/s | 19 kB 00:00 2024-05-08T09:19:35.372 INFO:teuthology.orchestra.run.smithi161.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 467 kB/s | 20 kB 00:00 2024-05-08T09:19:35.388 INFO:teuthology.orchestra.run.smithi161.stdout:(27/36): python3-jaraco-collections-3.0.0-8.el9 229 kB/s | 23 kB 00:00 2024-05-08T09:19:35.414 INFO:teuthology.orchestra.run.smithi161.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 690 kB/s | 46 kB 00:00 2024-05-08T09:19:35.439 INFO:teuthology.orchestra.run.smithi161.stdout:(29/36): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-05-08T09:19:35.456 INFO:teuthology.orchestra.run.smithi161.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 937 kB/s | 79 kB 00:00 2024-05-08T09:19:35.481 INFO:teuthology.orchestra.run.smithi161.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 244 kB/s | 16 kB 00:00 2024-05-08T09:19:35.506 INFO:teuthology.orchestra.run.smithi161.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-05-08T09:19:35.548 INFO:teuthology.orchestra.run.smithi161.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 389 kB/s | 36 kB 00:00 2024-05-08T09:19:35.574 INFO:teuthology.orchestra.run.smithi161.stdout:(34/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 6.2 MB/s | 427 kB 00:00 2024-05-08T09:19:35.599 INFO:teuthology.orchestra.run.smithi161.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 397 kB/s | 20 kB 00:00 2024-05-08T09:19:35.624 INFO:teuthology.orchestra.run.smithi161.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-05-08T09:19:35.626 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:35.626 INFO:teuthology.orchestra.run.smithi161.stdout:Total 8.6 MB/s | 30 MB 00:03 2024-05-08T09:19:35.768 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:19:35.808 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:19:35.808 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:19:36.239 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:19:36.239 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:36.831 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 36/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 1/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 3/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 4/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 5/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9. 6/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T09:19:36.832 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T09:19:36.833 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T09:19:36.834 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T09:19:37.501 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:37.569 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-05-08T09:19:37.602 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-05-08T09:19:37.629 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T09:19:37.695 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T09:19:37.696 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T09:19:37.697 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T09:19:37.698 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:37.698 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:37.701 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-05-08T09:19:37.737 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-05-08T09:19:37.769 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-05-08T09:19:37.879 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-05-08T09:19:37.966 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-05-08T09:19:38.005 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-05-08T09:19:38.041 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-05-08T09:19:38.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-base 2024-05-08T09:19:38.072 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-05-08T09:19:38.105 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-05-08T09:19:38.138 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-05-08T09:19:38.179 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-05-08T09:19:38.213 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-05-08T09:19:38.248 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-05-08T09:19:38.286 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-05-08T09:19:38.360 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-05-08T09:19:38.498 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-05-08T09:19:38.578 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-05-08T09:19:38.631 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-05-08T09:19:38.660 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:00 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:38.669 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-05-08T09:19:38.727 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-05-08T09:19:38.744 INFO:teuthology.orchestra.run.smithi045.stdout:Package ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:19:38.782 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-05-08T09:19:38.788 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:38.789 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:19:38.789 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:38.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install cephadm 2024-05-08T09:19:38.974 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-05-08T09:19:39.023 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-05-08T09:19:39.101 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-05-08T09:19:39.190 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-05-08T09:19:39.230 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-05-08T09:19:39.356 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-05-08T09:19:39.454 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:01 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:39.512 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9. 31/36 2024-05-08T09:19:39.541 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 32/36 2024-05-08T09:19:39.567 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 32/36 2024-05-08T09:19:39.567 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:39.567 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T09:19:39.568 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T09:19:39.568 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T09:19:39.568 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:39.581 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:39.582 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 763 k 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 763 k 2024-05-08T09:19:39.583 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 769 k 2024-05-08T09:19:39.584 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:cephadm-19.0.0-2515.g96805dcf.el9.noarch.rpm 1.7 MB/s | 763 kB 00:00 2024-05-08T09:19:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:40.032 INFO:teuthology.orchestra.run.smithi045.stdout:Total 1.7 MB/s | 763 kB 00:00 2024-05-08T09:19:40.033 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:40.038 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:40.038 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:40.044 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:40.045 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:40.121 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:40.583 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:40.672 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:40.991 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 33/36 2024-05-08T09:19:41.019 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 33/36 2024-05-08T09:19:41.020 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:41.020 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T09:19:41.020 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T09:19:41.020 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T09:19:41.020 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:41.074 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:41.312 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:41.312 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:41.467 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 34/36 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 34/36 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T09:19:41.491 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:41.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T09:19:41.718 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 35/36 2024-05-08T09:19:41.742 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 35/36 2024-05-08T09:19:41.742 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:41.742 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T09:19:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T09:19:41.743 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T09:19:41.743 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:41.805 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 36/36 2024-05-08T09:19:42.182 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:04 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:42.312 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 145 k 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 145 k 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 435 k 2024-05-08T09:19:42.313 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:42.664 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-immutable-object-cache-19.0.0-2515.g96805d 413 kB/s | 145 kB 00:00 2024-05-08T09:19:42.665 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:42.665 INFO:teuthology.orchestra.run.smithi045.stdout:Total 412 kB/s | 145 kB 00:00 2024-05-08T09:19:42.665 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:42.674 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:42.674 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:42.734 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:42.734 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:42.899 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:42.957 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:42.984 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:42.984 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T09:19:42.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 36/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 1/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 3/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 4/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 5/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9. 6/36 2024-05-08T09:19:43.490 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-05-08T09:19:43.491 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-05-08T09:19:43.492 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-05-08T09:19:43.493 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-05-08T09:19:43.872 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:43.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:43.873 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:43.873 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:43.873 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:43.873 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:44.102 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mds-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mon-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:44.418 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-osd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T09:19:44.419 INFO:teuthology.orchestra.run.smithi161.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:44.420 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:44.692 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:06 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:44.776 INFO:teuthology.orchestra.run.smithi045.stdout:Package ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:19:44.820 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:44.821 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:19:44.821 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:44.848 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-base 2024-05-08T09:19:44.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T09:19:45.417 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:54 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:45.481 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:07 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:45.497 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-base-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:19:45.538 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:45.539 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:19:45.539 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:45.603 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install cephadm 2024-05-08T09:19:45.611 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 3.5 M 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 32 k 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 16 k 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T09:19:45.613 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout:Install 12 Packages 2024-05-08T09:19:45.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:45.615 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 8.6 M 2024-05-08T09:19:45.615 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 103 M 2024-05-08T09:19:45.615 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:46.164 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:55 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:46.287 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:46.287 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 763 k 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 763 k 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 769 k 2024-05-08T09:19:46.288 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:46.377 INFO:teuthology.orchestra.run.smithi045.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2515.g96 111 kB/s | 32 kB 00:00 2024-05-08T09:19:46.394 INFO:teuthology.orchestra.run.smithi045.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2515.g968 54 kB/s | 16 kB 00:00 2024-05-08T09:19:46.469 INFO:teuthology.orchestra.run.smithi045.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 3.5 MB/s | 269 kB 00:00 2024-05-08T09:19:46.512 INFO:teuthology.orchestra.run.smithi045.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-05-08T09:19:46.576 INFO:teuthology.orchestra.run.smithi161.stdout:cephadm-19.0.0-2515.g96805dcf.el9.noarch.rpm 2.6 MB/s | 763 kB 00:00 2024-05-08T09:19:46.577 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:46.577 INFO:teuthology.orchestra.run.smithi161.stdout:Total 2.6 MB/s | 763 kB 00:00 2024-05-08T09:19:46.577 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:19:46.582 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:19:46.582 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:19:46.588 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:19:46.588 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:46.595 INFO:teuthology.orchestra.run.smithi045.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2515.g96805dc 7.0 MB/s | 3.5 MB 00:00 2024-05-08T09:19:46.665 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:46.970 INFO:teuthology.orchestra.run.smithi045.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 52 kB/s | 19 kB 00:00 2024-05-08T09:19:47.091 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:47.179 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:47.229 INFO:teuthology.orchestra.run.smithi045.stdout:(7/12): protobuf-compiler-3.14.0-13.el9.x86_64. 1.1 MB/s | 863 kB 00:00 2024-05-08T09:19:47.262 INFO:teuthology.orchestra.run.smithi045.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 730 kB/s | 548 kB 00:00 2024-05-08T09:19:47.371 INFO:teuthology.orchestra.run.smithi045.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 284 kB/s | 31 kB 00:00 2024-05-08T09:19:47.496 INFO:teuthology.orchestra.run.smithi045.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-05-08T09:19:47.543 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:47.638 INFO:teuthology.orchestra.run.smithi045.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.1 MB/s | 2.0 MB 00:00 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/1 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout: cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:47.778 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:(12/12): python3-grpcio-tools-1.46.7-10.el9.x86 251 kB/s | 144 kB 00:00 2024-05-08T09:19:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:Total 3.9 MB/s | 8.6 MB 00:02 2024-05-08T09:19:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:47.989 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-immutable-object-cache 2024-05-08T09:19:48.089 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:48.089 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:48.563 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:57 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:48.689 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 145 k 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:48.690 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:19:48.691 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 145 k 2024-05-08T09:19:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 435 k 2024-05-08T09:19:48.691 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:48.694 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:48.765 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T09:19:48.800 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T09:19:48.848 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T09:19:48.876 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T09:19:48.924 INFO:teuthology.orchestra.run.smithi161.stdout:ceph-immutable-object-cache-19.0.0-2515.g96805d 623 kB/s | 145 kB 00:00 2024-05-08T09:19:48.925 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:48.925 INFO:teuthology.orchestra.run.smithi161.stdout:Total 619 kB/s | 145 kB 00:00 2024-05-08T09:19:48.925 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:19:48.933 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:19:48.933 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:19:48.978 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T09:19:48.990 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:19:48.990 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:49.109 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T09:19:49.137 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:49.200 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:49.208 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T09:19:49.226 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:49.226 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:19:49.226 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T09:19:49.226 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:49.266 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T09:19:49.293 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T09:19:49.325 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9 10/12 2024-05-08T09:19:50.149 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf. 1/1 2024-05-08T09:19:50.149 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:50.149 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:50.149 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-immutable-object-cache-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:19:50.150 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:50.150 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:50.380 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr 2024-05-08T09:19:50.425 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el 11/12 2024-05-08T09:19:50.467 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 12/12 2024-05-08T09:19:50.949 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:00:59 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:51.032 INFO:teuthology.orchestra.run.smithi161.stdout:Package ceph-mgr-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:19:51.074 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:51.075 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:19:51.075 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:51.140 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-dashboard 2024-05-08T09:19:51.703 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:00 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 12/12 2024-05-08T09:19:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el 1/12 2024-05-08T09:19:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 2/12 2024-05-08T09:19:51.719 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9 3/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T09:19:51.720 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T09:19:51.827 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:51.828 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:51.828 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 3.5 M 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 32 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 16 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T09:19:51.829 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout:Install 12 Packages 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:51.830 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 8.6 M 2024-05-08T09:19:51.831 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 103 M 2024-05-08T09:19:51.831 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:52.031 INFO:teuthology.orchestra.run.smithi045.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:52.032 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:19:52.245 INFO:teuthology.orchestra.run.smithi161.stdout:(1/12): ceph-grafana-dashboards-19.0.0-2515.g96 166 kB/s | 32 kB 00:00 2024-05-08T09:19:52.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T09:19:52.345 INFO:teuthology.orchestra.run.smithi161.stdout:(2/12): ceph-prometheus-alerts-19.0.0-2515.g968 56 kB/s | 16 kB 00:00 2024-05-08T09:19:52.571 INFO:teuthology.orchestra.run.smithi161.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 3.1 MB/s | 1.0 MB 00:00 2024-05-08T09:19:52.596 INFO:teuthology.orchestra.run.smithi161.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.0 MB/s | 269 kB 00:00 2024-05-08T09:19:52.738 INFO:teuthology.orchestra.run.smithi161.stdout:(5/12): ceph-mgr-dashboard-19.0.0-2515.g96805dc 5.1 MB/s | 3.5 MB 00:00 2024-05-08T09:19:52.763 INFO:teuthology.orchestra.run.smithi161.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 3.2 MB/s | 548 kB 00:00 2024-05-08T09:19:52.805 INFO:teuthology.orchestra.run.smithi161.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 290 kB/s | 19 kB 00:00 2024-05-08T09:19:52.855 INFO:teuthology.orchestra.run.smithi161.stdout:(8/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 22 MB/s | 2.0 MB 00:00 2024-05-08T09:19:52.857 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:14 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:19:52.880 INFO:teuthology.orchestra.run.smithi161.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.9 MB/s | 144 kB 00:00 2024-05-08T09:19:52.906 INFO:teuthology.orchestra.run.smithi161.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 611 kB/s | 31 kB 00:00 2024-05-08T09:19:52.931 INFO:teuthology.orchestra.run.smithi161.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-05-08T09:19:52.983 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:19:52.984 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 7.4 M 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T09:19:52.985 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:Install 12 Packages 2024-05-08T09:19:52.986 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:19:52.987 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 38 M 2024-05-08T09:19:52.987 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 209 M 2024-05-08T09:19:52.987 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:19:53.431 INFO:teuthology.orchestra.run.smithi161.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-05-08T09:19:53.433 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:53.433 INFO:teuthology.orchestra.run.smithi161.stdout:Total 5.4 MB/s | 8.6 MB 00:01 2024-05-08T09:19:53.482 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:19:53.498 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:19:53.498 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:19:53.676 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:19:53.676 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:19:54.029 INFO:teuthology.orchestra.run.smithi045.stdout:(1/12): ceph-mgr-diskprediction-local-19.0.0-25 12 MB/s | 7.4 MB 00:00 2024-05-08T09:19:54.088 INFO:teuthology.orchestra.run.smithi045.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 33 kB 00:00 2024-05-08T09:19:54.270 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:19:54.347 INFO:teuthology.orchestra.run.smithi045.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 209 kB/s | 195 kB 00:00 2024-05-08T09:19:54.348 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-05-08T09:19:54.392 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-05-08T09:19:54.397 INFO:teuthology.orchestra.run.smithi045.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 368 kB/s | 18 kB 00:00 2024-05-08T09:19:54.438 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-05-08T09:19:54.456 INFO:teuthology.orchestra.run.smithi045.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 605 kB/s | 35 kB 00:00 2024-05-08T09:19:54.470 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-05-08T09:19:54.522 INFO:teuthology.orchestra.run.smithi045.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 723 kB/s | 803 kB 00:01 2024-05-08T09:19:54.569 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-05-08T09:19:54.598 INFO:teuthology.orchestra.run.smithi045.stdout:(7/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.9 MB/s | 3.0 MB 00:00 2024-05-08T09:19:54.656 INFO:teuthology.orchestra.run.smithi045.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-05-08T09:19:54.698 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-05-08T09:19:54.790 INFO:teuthology.orchestra.run.smithi045.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 1.8 MB/s | 250 kB 00:00 2024-05-08T09:19:54.791 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-05-08T09:19:54.843 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-05-08T09:19:54.871 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-05-08T09:19:54.902 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9 10/12 2024-05-08T09:19:55.040 INFO:teuthology.orchestra.run.smithi045.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 8.1 MB/s | 4.7 MB 00:00 2024-05-08T09:19:55.532 INFO:teuthology.orchestra.run.smithi045.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-05-08T09:19:55.807 INFO:teuthology.orchestra.run.smithi045.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-05-08T09:19:55.808 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:19:55.809 INFO:teuthology.orchestra.run.smithi045.stdout:Total 13 MB/s | 38 MB 00:02 2024-05-08T09:19:55.942 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el 11/12 2024-05-08T09:19:55.970 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 12/12 2024-05-08T09:19:56.181 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:19:56.209 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:19:56.209 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:19:56.663 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:19:56.663 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 12/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el 1/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noa 2/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9 3/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-05-08T09:19:57.283 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-05-08T09:19:57.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-05-08T09:19:57.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-05-08T09:19:57.284 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-05-08T09:19:57.445 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:19:57.517 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T09:19:57.556 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-grafana-dashboards-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:57.579 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-prometheus-alerts-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:57.580 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:19:57.661 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T09:19:57.707 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T09:19:57.843 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-diskprediction-local 2024-05-08T09:19:57.892 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T09:19:57.922 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T09:19:58.006 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T09:19:58.411 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:07 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:19:58.533 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:19:58.534 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-05-08T09:19:58.534 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:19:58.534 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 7.4 M 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T09:19:58.535 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:======================================================================================= 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:Install 12 Packages 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:19:58.536 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 38 M 2024-05-08T09:19:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 209 M 2024-05-08T09:19:58.537 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:19:58.702 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T09:19:58.825 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T09:19:59.499 INFO:teuthology.orchestra.run.smithi161.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 344 kB/s | 195 kB 00:00 2024-05-08T09:19:59.607 INFO:teuthology.orchestra.run.smithi161.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-05-08T09:19:59.816 INFO:teuthology.orchestra.run.smithi161.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 907 kB/s | 803 kB 00:00 2024-05-08T09:19:59.950 INFO:teuthology.orchestra.run.smithi161.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 137 kB/s | 18 kB 00:00 2024-05-08T09:20:00.058 INFO:teuthology.orchestra.run.smithi161.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 325 kB/s | 35 kB 00:00 2024-05-08T09:20:00.178 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T09:20:00.367 INFO:teuthology.orchestra.run.smithi161.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-05-08T09:20:00.484 INFO:teuthology.orchestra.run.smithi161.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 2.0 MB/s | 244 kB 00:00 2024-05-08T09:20:01.254 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T09:20:01.275 INFO:teuthology.orchestra.run.smithi161.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-25 3.2 MB/s | 7.4 MB 00:02 2024-05-08T09:20:01.280 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 12/12 2024-05-08T09:20:01.792 INFO:teuthology.orchestra.run.smithi161.stdout:(9/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 2.7 MB/s | 4.7 MB 00:01 2024-05-08T09:20:01.818 INFO:teuthology.orchestra.run.smithi161.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 463 kB/s | 250 kB 00:00 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 12/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 1/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T09:20:03.888 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T09:20:03.889 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T09:20:04.306 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:04.307 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:04.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-rook 2024-05-08T09:20:04.709 INFO:teuthology.orchestra.run.smithi161.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-05-08T09:20:05.278 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:27 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:05.343 INFO:teuthology.orchestra.run.smithi161.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.0 MB/s | 5.1 MB 00:04 2024-05-08T09:20:05.343 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:05.344 INFO:teuthology.orchestra.run.smithi161.stdout:Total 5.6 MB/s | 38 MB 00:06 2024-05-08T09:20:05.409 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:05.410 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:05.410 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:20:05.410 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 49 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T09:20:05.411 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout:Install 13 Packages 2024-05-08T09:20:05.412 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:05.413 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 2.2 M 2024-05-08T09:20:05.413 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 26 M 2024-05-08T09:20:05.413 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:05.702 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:05.728 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:05.729 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:05.948 INFO:teuthology.orchestra.run.smithi045.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 96 kB/s | 26 kB 00:00 2024-05-08T09:20:05.972 INFO:teuthology.orchestra.run.smithi045.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 66 kB/s | 19 kB 00:00 2024-05-08T09:20:05.998 INFO:teuthology.orchestra.run.smithi045.stdout:(3/13): ceph-mgr-rook-19.0.0-2515.g96805dcf.el9 155 kB/s | 49 kB 00:00 2024-05-08T09:20:06.154 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:06.154 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:06.324 INFO:teuthology.orchestra.run.smithi045.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 453 kB/s | 159 kB 00:00 2024-05-08T09:20:06.373 INFO:teuthology.orchestra.run.smithi045.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 522 kB/s | 222 kB 00:00 2024-05-08T09:20:06.432 INFO:teuthology.orchestra.run.smithi045.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 494 kB/s | 54 kB 00:00 2024-05-08T09:20:06.600 INFO:teuthology.orchestra.run.smithi045.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 463 kB/s | 279 kB 00:00 2024-05-08T09:20:06.874 INFO:teuthology.orchestra.run.smithi045.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 64 kB/s | 32 kB 00:00 2024-05-08T09:20:06.900 INFO:teuthology.orchestra.run.smithi045.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 32 kB/s | 15 kB 00:00 2024-05-08T09:20:06.946 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:07.008 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-05-08T09:20:07.049 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-05-08T09:20:07.148 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-05-08T09:20:07.166 INFO:teuthology.orchestra.run.smithi045.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 222 kB/s | 59 kB 00:00 2024-05-08T09:20:07.192 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-05-08T09:20:07.350 INFO:teuthology.orchestra.run.smithi045.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 489 kB/s | 90 kB 00:00 2024-05-08T09:20:07.375 INFO:teuthology.orchestra.run.smithi045.stdout:(12/13): python3-google-auth-2.29.0-1.el9.noarc 266 kB/s | 206 kB 00:00 2024-05-08T09:20:07.378 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-05-08T09:20:07.407 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-05-08T09:20:07.491 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-05-08T09:20:08.151 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-05-08T09:20:08.193 INFO:teuthology.orchestra.run.smithi045.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 793 kB/s | 1.0 MB 00:01 2024-05-08T09:20:08.196 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:08.196 INFO:teuthology.orchestra.run.smithi045.stdout:Total 810 kB/s | 2.2 MB 00:02 2024-05-08T09:20:08.269 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:08.278 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-05-08T09:20:08.285 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:08.285 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:08.382 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:08.382 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:08.936 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:09.123 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T09:20:09.187 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T09:20:09.242 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T09:20:09.287 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T09:20:09.337 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T09:20:09.434 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T09:20:09.530 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T09:20:09.545 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T09:20:09.598 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T09:20:10.362 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T09:20:10.410 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T09:20:10.453 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T09:20:10.510 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T09:20:10.538 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 13/13 2024-05-08T09:20:10.553 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-05-08T09:20:10.581 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 12/12 2024-05-08T09:20:11.339 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 13/13 2024-05-08T09:20:11.339 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 1/13 2024-05-08T09:20:11.339 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T09:20:11.340 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T09:20:11.660 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T09:20:11.661 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T09:20:11.662 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T09:20:11.662 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T09:20:11.662 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T09:20:11.662 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:11.662 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:11.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T09:20:12.536 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:34 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:12.665 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 142 k 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T09:20:12.666 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout:Install 6 Packages 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:12.667 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 7.0 M 2024-05-08T09:20:12.668 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 33 M 2024-05-08T09:20:12.668 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:13.046 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 12/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805 1/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-05-08T09:20:13.047 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-05-08T09:20:13.095 INFO:teuthology.orchestra.run.smithi045.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 2.2 MB/s | 248 kB 00:00 2024-05-08T09:20:13.220 INFO:teuthology.orchestra.run.smithi045.stdout:(2/6): ceph-mgr-cephadm-19.0.0-2515.g96805dcf.e 604 kB/s | 142 kB 00:00 2024-05-08T09:20:13.304 INFO:teuthology.orchestra.run.smithi045.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 19 MB/s | 6.0 MB 00:00 2024-05-08T09:20:13.505 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-05-08T09:20:13.505 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T09:20:13.506 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:13.507 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:13.537 INFO:teuthology.orchestra.run.smithi045.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 182 kB/s | 58 kB 00:00 2024-05-08T09:20:13.596 INFO:teuthology.orchestra.run.smithi045.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 175 kB/s | 51 kB 00:00 2024-05-08T09:20:13.630 INFO:teuthology.orchestra.run.smithi045.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.0 MB/s | 548 kB 00:00 2024-05-08T09:20:13.630 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:13.631 INFO:teuthology.orchestra.run.smithi045.stdout:Total 7.2 MB/s | 7.0 MB 00:00 2024-05-08T09:20:13.705 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:13.716 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:13.717 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:13.820 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:13.820 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:13.911 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-rook 2024-05-08T09:20:14.134 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:14.312 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T09:20:14.383 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T09:20:14.491 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:23 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:14.614 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 49 k 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T09:20:14.615 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout:Install 13 Packages 2024-05-08T09:20:14.616 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:14.617 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 2.2 M 2024-05-08T09:20:14.617 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 26 M 2024-05-08T09:20:14.617 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:14.942 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T09:20:15.030 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T09:20:15.109 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T09:20:15.136 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 6/6 2024-05-08T09:20:15.232 INFO:teuthology.orchestra.run.smithi161.stdout:(1/13): ceph-mgr-rook-19.0.0-2515.g96805dcf.el9 266 kB/s | 49 kB 00:00 2024-05-08T09:20:15.307 INFO:teuthology.orchestra.run.smithi161.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 98 kB/s | 26 kB 00:00 2024-05-08T09:20:15.332 INFO:teuthology.orchestra.run.smithi161.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 67 kB/s | 19 kB 00:00 2024-05-08T09:20:15.649 INFO:teuthology.orchestra.run.smithi161.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 464 kB/s | 159 kB 00:00 2024-05-08T09:20:15.757 INFO:teuthology.orchestra.run.smithi161.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 423 kB/s | 222 kB 00:00 2024-05-08T09:20:15.783 INFO:teuthology.orchestra.run.smithi161.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 401 kB/s | 54 kB 00:00 2024-05-08T09:20:15.808 INFO:teuthology.orchestra.run.smithi161.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 586 kB/s | 279 kB 00:00 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 6/6 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/6 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T09:20:15.867 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T09:20:15.975 INFO:teuthology.orchestra.run.smithi161.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-05-08T09:20:16.000 INFO:teuthology.orchestra.run.smithi161.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 133 kB/s | 32 kB 00:00 2024-05-08T09:20:16.084 INFO:teuthology.orchestra.run.smithi161.stdout:(10/13): python3-google-auth-2.29.0-1.el9.noarc 904 kB/s | 206 kB 00:00 2024-05-08T09:20:16.142 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T09:20:16.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:16.142 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:16.143 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:16.176 INFO:teuthology.orchestra.run.smithi161.stdout:(11/13): python3-kubernetes-26.1.0-2.el9.noarch 5.1 MB/s | 1.0 MB 00:00 2024-05-08T09:20:16.201 INFO:teuthology.orchestra.run.smithi161.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 295 kB/s | 59 kB 00:00 2024-05-08T09:20:16.226 INFO:teuthology.orchestra.run.smithi161.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 632 kB/s | 90 kB 00:00 2024-05-08T09:20:16.229 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:16.229 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.4 MB/s | 2.2 MB 00:01 2024-05-08T09:20:16.296 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:16.311 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:16.311 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:16.395 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:16.397 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:16.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-fuse 2024-05-08T09:20:16.901 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:17.027 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:39 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:17.090 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-05-08T09:20:17.144 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-05-08T09:20:17.155 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 889 k 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:20:17.156 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Install 2 Packages 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 970 k 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 2.8 M 2024-05-08T09:20:17.157 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:17.207 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-05-08T09:20:17.245 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-05-08T09:20:17.286 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-05-08T09:20:17.379 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-05-08T09:20:17.432 INFO:teuthology.orchestra.run.smithi045.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 499 kB/s | 80 kB 00:00 2024-05-08T09:20:17.480 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-05-08T09:20:17.529 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-05-08T09:20:17.566 INFO:teuthology.orchestra.run.smithi045.stdout:(2/2): ceph-fuse-19.0.0-2515.g96805dcf.el9.x86_ 2.9 MB/s | 889 kB 00:00 2024-05-08T09:20:17.566 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:17.567 INFO:teuthology.orchestra.run.smithi045.stdout:Total 2.3 MB/s | 970 kB 00:00 2024-05-08T09:20:17.579 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:17.601 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:17.601 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:17.684 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:17.684 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:17.878 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:18.022 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T09:20:18.094 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2/2 2024-05-08T09:20:18.237 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-05-08T09:20:18.285 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-05-08T09:20:18.318 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-05-08T09:20:18.366 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-05-08T09:20:18.388 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 13/13 2024-05-08T09:20:18.812 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2/2 2024-05-08T09:20:18.812 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/2 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:19.060 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:19.145 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 13/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 1/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-05-08T09:20:19.146 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-05-08T09:20:19.147 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-05-08T09:20:19.147 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-05-08T09:20:19.147 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-05-08T09:20:19.147 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-05-08T09:20:19.147 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-05-08T09:20:19.328 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-volume 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-rook-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T09:20:19.453 INFO:teuthology.orchestra.run.smithi161.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:19.454 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:19.699 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-mgr-cephadm 2024-05-08T09:20:19.932 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:41 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:20.062 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 264 k 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:Install 2 Packages 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:20.063 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 341 k 2024-05-08T09:20:20.064 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 1.5 M 2024-05-08T09:20:20.064 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:20.269 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:29 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:20.304 INFO:teuthology.orchestra.run.smithi045.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 393 kB/s | 77 kB 00:00 2024-05-08T09:20:20.392 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 142 k 2024-05-08T09:20:20.393 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout:Install 6 Packages 2024-05-08T09:20:20.394 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 7.0 M 2024-05-08T09:20:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 33 M 2024-05-08T09:20:20.395 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:20.496 INFO:teuthology.orchestra.run.smithi045.stdout:(2/2): ceph-volume-19.0.0-2515.g96805dcf.el9.no 680 kB/s | 264 kB 00:00 2024-05-08T09:20:20.497 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:20.497 INFO:teuthology.orchestra.run.smithi045.stdout:Total 785 kB/s | 341 kB 00:00 2024-05-08T09:20:20.509 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:20.520 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:20.520 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:20.557 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:20.710 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:20.890 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T09:20:20.923 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2/2 2024-05-08T09:20:20.940 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2/2 2024-05-08T09:20:20.940 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:20:20.940 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T09:20:20.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:21.153 INFO:teuthology.orchestra.run.smithi161.stdout:(1/6): ceph-mgr-cephadm-19.0.0-2515.g96805dcf.e 410 kB/s | 142 kB 00:00 2024-05-08T09:20:21.403 INFO:teuthology.orchestra.run.smithi161.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 416 kB/s | 248 kB 00:00 2024-05-08T09:20:21.628 INFO:teuthology.orchestra.run.smithi161.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.1 MB/s | 548 kB 00:00 2024-05-08T09:20:21.688 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 1/2 2024-05-08T09:20:21.704 INFO:teuthology.orchestra.run.smithi161.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 680 kB/s | 51 kB 00:00 2024-05-08T09:20:21.729 INFO:teuthology.orchestra.run.smithi161.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 177 kB/s | 58 kB 00:00 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:21.976 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:22.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librados-devel 2024-05-08T09:20:22.906 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:44 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:23.033 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:23.034 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:23.034 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2024-05-08T09:20:23.034 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 127 k 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 127 k 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 456 k 2024-05-08T09:20:23.035 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:23.246 INFO:teuthology.orchestra.run.smithi045.stdout:librados-devel-19.0.0-2515.g96805dcf.el9.x86_64 602 kB/s | 127 kB 00:00 2024-05-08T09:20:23.246 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:23.247 INFO:teuthology.orchestra.run.smithi045.stdout:Total 598 kB/s | 127 kB 00:00 2024-05-08T09:20:23.247 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:23.253 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:23.253 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:23.319 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:23.320 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:23.477 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:23.580 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:23.995 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:24.274 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:24.274 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:24.274 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:24.275 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:24.275 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:24.275 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:24.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install libcephfs2 2024-05-08T09:20:25.155 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:47 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:25.236 INFO:teuthology.orchestra.run.smithi045.stdout:Package libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:25.282 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:25.283 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:25.283 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:25.337 INFO:teuthology.orchestra.run.smithi161.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 1.3 MB/s | 6.0 MB 00:04 2024-05-08T09:20:25.340 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:25.340 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.4 MB/s | 7.0 MB 00:04 2024-05-08T09:20:25.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install libcephfs-devel 2024-05-08T09:20:25.413 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:25.425 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:25.425 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:25.523 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:25.523 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:25.829 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:25.952 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:47 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:25.987 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-05-08T09:20:26.039 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-05-08T09:20:26.080 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:26.081 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:26.081 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2024-05-08T09:20:26.081 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:26.081 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:26.081 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 32 k 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 32 k 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 142 k 2024-05-08T09:20:26.082 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:26.326 INFO:teuthology.orchestra.run.smithi045.stdout:libcephfs-devel-19.0.0-2515.g96805dcf.el9.x86_6 130 kB/s | 32 kB 00:00 2024-05-08T09:20:26.326 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:26.327 INFO:teuthology.orchestra.run.smithi045.stdout:Total 129 kB/s | 32 kB 00:00 2024-05-08T09:20:26.327 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:26.331 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:26.331 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:26.354 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:26.354 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:26.436 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:26.543 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:26.567 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-05-08T09:20:26.651 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-05-08T09:20:26.713 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-05-08T09:20:26.742 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 6/6 2024-05-08T09:20:26.930 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:27.157 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:27.157 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:27.157 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:27.157 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:27.157 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:27.158 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:27.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librados2 2024-05-08T09:20:27.466 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 6/6 2024-05-08T09:20:27.466 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 1/6 2024-05-08T09:20:27.467 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-05-08T09:20:27.467 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-05-08T09:20:27.467 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-05-08T09:20:27.467 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-05-08T09:20:27.726 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-cephadm-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:27.727 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:27.953 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:27.988 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-fuse 2024-05-08T09:20:28.038 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:28.082 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:28.083 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:28.083 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:28.159 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install librbd1 2024-05-08T09:20:28.558 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:37 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:28.681 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:28.681 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:28.681 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:20:28.681 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:28.681 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 889 k 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout:Install 2 Packages 2024-05-08T09:20:28.682 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:28.683 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 970 k 2024-05-08T09:20:28.683 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 2.8 M 2024-05-08T09:20:28.683 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:28.753 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:28.836 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:28.879 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:28.880 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:28.880 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:28.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rados 2024-05-08T09:20:29.172 INFO:teuthology.orchestra.run.smithi161.stdout:(1/2): ceph-fuse-19.0.0-2515.g96805dcf.el9.x86_ 2.1 MB/s | 889 kB 00:00 2024-05-08T09:20:29.197 INFO:teuthology.orchestra.run.smithi161.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 179 kB/s | 80 kB 00:00 2024-05-08T09:20:29.198 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:29.198 INFO:teuthology.orchestra.run.smithi161.stdout:Total 1.8 MB/s | 970 kB 00:00 2024-05-08T09:20:29.210 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:29.232 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:29.232 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:29.310 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:29.311 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:29.491 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:29.563 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:29.624 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-05-08T09:20:29.646 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2/2 2024-05-08T09:20:29.690 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:29.691 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:29.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rgw 2024-05-08T09:20:30.359 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2/2 2024-05-08T09:20:30.359 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/2 2024-05-08T09:20:30.362 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:30.447 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:30.491 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:30.492 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:30.492 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:30.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-cephfs 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:30.630 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:30.921 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install ceph-volume 2024-05-08T09:20:31.170 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:53 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:31.255 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:31.299 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:31.300 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:31.300 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:31.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install python3-rbd 2024-05-08T09:20:31.497 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:40 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:31.625 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:31.625 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repository Size 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume noarch 2:19.0.0-2515.g96805dcf.el9 ceph-noarch 264 k 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Installing dependencies: 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout:Install 2 Packages 2024-05-08T09:20:31.626 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:31.627 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 341 k 2024-05-08T09:20:31.627 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 1.5 M 2024-05-08T09:20:31.627 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:31.852 INFO:teuthology.orchestra.run.smithi161.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 973 kB/s | 77 kB 00:00 2024-05-08T09:20:31.965 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:53 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:32.027 INFO:teuthology.orchestra.run.smithi161.stdout:(2/2): ceph-volume-19.0.0-2515.g96805dcf.el9.no 1.0 MB/s | 264 kB 00:00 2024-05-08T09:20:32.028 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:32.028 INFO:teuthology.orchestra.run.smithi161.stdout:Total 849 kB/s | 341 kB 00:00 2024-05-08T09:20:32.040 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:32.047 INFO:teuthology.orchestra.run.smithi045.stdout:Package python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:32.049 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:32.050 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:32.081 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:32.081 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:32.092 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:32.093 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-05-08T09:20:32.093 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:32.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-fuse 2024-05-08T09:20:32.226 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:32.412 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-05-08T09:20:32.455 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2/2 2024-05-08T09:20:32.471 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2/2 2024-05-08T09:20:32.472 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:20:32.472 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T09:20:32.472 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:32.757 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:54 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:32.885 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 85 k 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:32.886 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 85 k 2024-05-08T09:20:32.887 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 231 k 2024-05-08T09:20:32.887 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-fuse-19.0.0-2515.g96805dcf.el9.x86_64.rpm 408 kB/s | 85 kB 00:00 2024-05-08T09:20:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:33.096 INFO:teuthology.orchestra.run.smithi045.stdout:Total 405 kB/s | 85 kB 00:00 2024-05-08T09:20:33.097 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:33.104 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:33.104 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:33.171 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:33.171 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:33.212 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 1/2 2024-05-08T09:20:33.319 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:33.429 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:33.511 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-05-08T09:20:33.511 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:33.511 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:33.511 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-volume-2:19.0.0-2515.g96805dcf.el9.noarch 2024-05-08T09:20:33.512 INFO:teuthology.orchestra.run.smithi161.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T09:20:33.512 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:33.512 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:33.785 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:33.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados-devel 2024-05-08T09:20:34.047 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:34.047 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:34.047 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:34.047 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:34.048 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:34.048 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:34.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-mirror 2024-05-08T09:20:34.412 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:43 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:34.537 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 127 k 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 127 k 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 456 k 2024-05-08T09:20:34.538 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:librados-devel-19.0.0-2515.g96805dcf.el9.x86_64 407 kB/s | 127 kB 00:00 2024-05-08T09:20:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:34.850 INFO:teuthology.orchestra.run.smithi161.stdout:Total 406 kB/s | 127 kB 00:00 2024-05-08T09:20:34.851 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:34.856 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:34.899 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:56 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:34.919 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:34.920 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:35.028 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:35.029 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:35.029 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repo Size 2024-05-08T09:20:35.029 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:35.029 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:35.029 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 3.1 M 2024-05-08T09:20:35.030 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 13 M 2024-05-08T09:20:35.031 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:35.081 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:35.180 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:35.425 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-mirror-19.0.0-2515.g96805dcf.el9.x86_64.rpm 7.8 MB/s | 3.1 MB 00:00 2024-05-08T09:20:35.426 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:35.427 INFO:teuthology.orchestra.run.smithi045.stdout:Total 7.8 MB/s | 3.1 MB 00:00 2024-05-08T09:20:35.427 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:35.436 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:35.437 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:35.522 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:35.523 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:35.615 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:35.889 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:35.890 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:35.890 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:35.890 INFO:teuthology.orchestra.run.smithi161.stdout: librados-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:35.890 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:35.890 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:35.990 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:36.051 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T09:20:36.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:36.166 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs2 2024-05-08T09:20:36.751 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:45 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:36.833 INFO:teuthology.orchestra.run.smithi161.stdout:Package libcephfs2-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:36.876 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:36.877 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:36.877 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:36.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install libcephfs-devel 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:37.166 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:37.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install rbd-nbd 2024-05-08T09:20:37.514 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:46 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:37.639 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 32 k 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:37.640 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:20:37.641 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:37.641 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 32 k 2024-05-08T09:20:37.641 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 142 k 2024-05-08T09:20:37.641 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:37.812 INFO:teuthology.orchestra.run.smithi161.stdout:libcephfs-devel-19.0.0-2515.g96805dcf.el9.x86_6 186 kB/s | 32 kB 00:00 2024-05-08T09:20:37.812 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:37.813 INFO:teuthology.orchestra.run.smithi161.stdout:Total 184 kB/s | 32 kB 00:00 2024-05-08T09:20:37.813 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:37.816 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:37.816 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:37.840 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:37.841 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:37.921 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:38.017 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:38.042 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:02:00 ago on Wed 08 May 2024 09:18:38 AM UTC. 2024-05-08T09:20:38.167 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-05-08T09:20:38.168 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:38.168 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-05-08T09:20:38.168 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 171 k 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Install 1 Package 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 171 k 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Installed size: 494 k 2024-05-08T09:20:38.169 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-05-08T09:20:38.398 INFO:teuthology.orchestra.run.smithi045.stdout:rbd-nbd-19.0.0-2515.g96805dcf.el9.x86_64.rpm 752 kB/s | 171 kB 00:00 2024-05-08T09:20:38.398 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:38.398 INFO:teuthology.orchestra.run.smithi045.stdout:Total 747 kB/s | 171 kB 00:00 2024-05-08T09:20:38.398 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-05-08T09:20:38.400 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:38.407 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-05-08T09:20:38.407 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-05-08T09:20:38.474 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-05-08T09:20:38.474 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-05-08T09:20:38.616 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:38.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:38.617 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:38.617 INFO:teuthology.orchestra.run.smithi161.stdout: libcephfs-devel-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:38.617 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:38.617 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:38.636 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-05-08T09:20:38.732 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:38.789 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librados2 2024-05-08T09:20:39.156 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:39.357 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:48 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:39.388 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:39.389 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-05-08T09:20:39.389 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:39.389 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:39.389 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-05-08T09:20:39.437 INFO:teuthology.orchestra.run.smithi161.stdout:Package librados2-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:39.479 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:39.480 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:39.480 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:39.551 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install librbd1 2024-05-08T09:20:39.653 DEBUG:teuthology.parallel:result is None 2024-05-08T09:20:40.122 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:40.201 INFO:teuthology.orchestra.run.smithi161.stdout:Package librbd1-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:40.242 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:40.243 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:40.244 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:40.319 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rados 2024-05-08T09:20:40.896 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:49 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:40.983 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rados-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:41.027 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:41.029 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:41.029 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:41.098 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rgw 2024-05-08T09:20:41.700 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:50 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:41.784 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rgw-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:41.827 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:41.828 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:41.828 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:41.896 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-cephfs 2024-05-08T09:20:42.467 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:51 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:42.547 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-cephfs-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:42.593 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:42.593 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:42.594 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:42.652 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install python3-rbd 2024-05-08T09:20:43.229 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:43.310 INFO:teuthology.orchestra.run.smithi161.stdout:Package python3-rbd-2:19.0.0-2515.g96805dcf.el9.x86_64 is already installed. 2024-05-08T09:20:43.352 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:43.352 INFO:teuthology.orchestra.run.smithi161.stdout:Nothing to do. 2024-05-08T09:20:43.353 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:43.424 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-fuse 2024-05-08T09:20:43.995 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:52 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:44.116 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 85 k 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:44.117 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:20:44.118 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:44.118 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 85 k 2024-05-08T09:20:44.118 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 231 k 2024-05-08T09:20:44.118 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:44.498 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-fuse-19.0.0-2515.g96805dcf.el9.x86_64.rpm 224 kB/s | 85 kB 00:00 2024-05-08T09:20:44.499 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:44.499 INFO:teuthology.orchestra.run.smithi161.stdout:Total 223 kB/s | 85 kB 00:00 2024-05-08T09:20:44.499 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:44.506 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:44.506 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:44.569 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:44.569 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:44.709 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:44.812 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:45.150 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-fuse-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:45.432 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:45.649 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-mirror 2024-05-08T09:20:46.232 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:55 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:46.360 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout: Package Arch Version Repo Size 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 3.1 M 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:20:46.361 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:46.362 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 3.1 M 2024-05-08T09:20:46.362 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 13 M 2024-05-08T09:20:46.362 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:46.743 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-mirror-19.0.0-2515.g96805dcf.el9.x86_64.rpm 8.1 MB/s | 3.1 MB 00:00 2024-05-08T09:20:46.743 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:46.744 INFO:teuthology.orchestra.run.smithi161.stdout:Total 8.1 MB/s | 3.1 MB 00:00 2024-05-08T09:20:46.744 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:46.753 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:46.753 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:46.834 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:46.834 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:47.270 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:47.327 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T09:20:47.353 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-mirror-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:48.384 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:48.625 DEBUG:teuthology.orchestra.run.smithi161:> sudo yum -y install rbd-nbd 2024-05-08T09:20:49.205 INFO:teuthology.orchestra.run.smithi161.stdout:Last metadata expiration check: 0:01:58 ago on Wed 08 May 2024 09:18:51 AM UTC. 2024-05-08T09:20:49.328 INFO:teuthology.orchestra.run.smithi161.stdout:Dependencies resolved. 2024-05-08T09:20:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:49.329 INFO:teuthology.orchestra.run.smithi161.stdout: Package Architecture Version Repository Size 2024-05-08T09:20:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:49.329 INFO:teuthology.orchestra.run.smithi161.stdout:Installing: 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd x86_64 2:19.0.0-2515.g96805dcf.el9 ceph 171 k 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction Summary 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:================================================================================ 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:Install 1 Package 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:Total download size: 171 k 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:Installed size: 494 k 2024-05-08T09:20:49.330 INFO:teuthology.orchestra.run.smithi161.stdout:Downloading Packages: 2024-05-08T09:20:49.638 INFO:teuthology.orchestra.run.smithi161.stdout:rbd-nbd-19.0.0-2515.g96805dcf.el9.x86_64.rpm 556 kB/s | 171 kB 00:00 2024-05-08T09:20:49.639 INFO:teuthology.orchestra.run.smithi161.stdout:-------------------------------------------------------------------------------- 2024-05-08T09:20:49.639 INFO:teuthology.orchestra.run.smithi161.stdout:Total 553 kB/s | 171 kB 00:00 2024-05-08T09:20:49.639 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction check 2024-05-08T09:20:49.647 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction check succeeded. 2024-05-08T09:20:49.647 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction test 2024-05-08T09:20:49.710 INFO:teuthology.orchestra.run.smithi161.stdout:Transaction test succeeded. 2024-05-08T09:20:49.710 INFO:teuthology.orchestra.run.smithi161.stdout:Running transaction 2024-05-08T09:20:49.866 INFO:teuthology.orchestra.run.smithi161.stdout: Preparing : 1/1 2024-05-08T09:20:49.961 INFO:teuthology.orchestra.run.smithi161.stdout: Installing : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:50.367 INFO:teuthology.orchestra.run.smithi161.stdout: Running scriptlet: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:50.634 INFO:teuthology.orchestra.run.smithi161.stdout: Verifying : rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 1/1 2024-05-08T09:20:50.634 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:50.634 INFO:teuthology.orchestra.run.smithi161.stdout:Installed: 2024-05-08T09:20:50.634 INFO:teuthology.orchestra.run.smithi161.stdout: rbd-nbd-2:19.0.0-2515.g96805dcf.el9.x86_64 2024-05-08T09:20:50.634 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:50.635 INFO:teuthology.orchestra.run.smithi161.stdout:Complete! 2024-05-08T09:20:50.890 DEBUG:teuthology.parallel:result is None 2024-05-08T09:20:50.891 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-08T09:20:51.142 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T09:20:51.169 INFO:teuthology.orchestra.run.smithi045.stdout:19.0.0-2515.g96805dcf.el9 2024-05-08T09:20:51.169 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2515.g96805dcf.el9 2024-05-08T09:20:51.170 INFO:teuthology.task.install:The correct ceph version 19.0.0-2515.g96805dcf is installed. 2024-05-08T09:20:51.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=96805dcf909541c4ca9a1e90258de8ae5b6fa1bc 2024-05-08T09:20:51.322 DEBUG:teuthology.orchestra.run.smithi161:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T09:20:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:19.0.0-2515.g96805dcf.el9 2024-05-08T09:20:51.344 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2515.g96805dcf.el9 2024-05-08T09:20:51.344 INFO:teuthology.task.install:The correct ceph version 19.0.0-2515.g96805dcf is installed. 2024-05-08T09:20:51.346 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T09:20:51.346 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:51.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T09:20:51.379 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:51.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T09:20:51.409 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T09:20:51.410 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:51.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T09:20:51.449 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T09:20:51.517 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:51.517 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T09:20:51.542 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T09:20:51.608 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T09:20:51.608 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:51.609 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T09:20:51.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T09:20:51.706 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:51.706 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T09:20:51.730 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T09:20:51.795 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T09:20:51.796 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:51.796 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T09:20:51.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T09:20:51.892 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:51.892 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T09:20:51.916 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T09:20:51.982 INFO:teuthology.run_tasks:Running task ceph... 2024-05-08T09:20:52.067 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-08T09:20:52.067 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2024-05-08T09:20:52.070 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2024-05-08T09:20:52.096 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-08T09:20:52.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T09:20:52.139 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-08T09:20:52.164 INFO:tasks.ceph:Creating extra log directories... 2024-05-08T09:20:52.164 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T09:20:52.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-08T09:20:52.240 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-08T09:20:52.240 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-08T09:20:52.240 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039', 'branch': 'squid', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7696039', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 6145, 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_96805dcf909541c4ca9a1e90258de8ae5b6fa1bc/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnX+L4lRtdCsUTRboj4pJM37ubDTVtneaHt67eSCD3xEbOKlr/UZEjtHR8HRQgHrKBVg9fx8XEuEOT3iXnWwyw=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF7IjatQTIah0Tca7C2JXut6A07HkAY98pEyCSFKAm8Yabw+ZRp1ZtfaNXVdyCKtkSM0gFsBighxGDMnG/05hq8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '96805dcf909541c4ca9a1e90258de8ae5b6fa1bc', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-07_21:40:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-08T09:20:52.241 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T09:20:52.274 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-08T09:20:52.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T09:20:52.330 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2024-05-08T09:20:52.355 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:52.356 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T09:20:52.412 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T09:20:52.413 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-08 09:20:36.349369865 +0000 2024-05-08T09:20:52.469 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-08 09:17:56.617451502 +0000 2024-05-08T09:20:52.470 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-08 09:17:56.617451502 +0000 2024-05-08T09:20:52.470 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-05-08 09:17:56.617451502 +0000 2024-05-08T09:20:52.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T09:20:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-08T09:20:52.534 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-08T09:20:52.535 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.9777e-05 s, 5.1 MB/s 2024-05-08T09:20:52.536 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T09:20:52.594 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-08 09:20:36.349369865 +0000 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-08 09:17:56.952446586 +0000 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-08 09:17:56.952446586 +0000 2024-05-08T09:20:52.651 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-05-08 09:17:56.952446586 +0000 2024-05-08T09:20:52.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T09:20:52.716 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-08T09:20:52.716 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-08T09:20:52.716 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00010163 s, 5.0 MB/s 2024-05-08T09:20:52.717 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T09:20:52.774 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-05-08T09:20:52.830 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-08 09:20:36.350369851 +0000 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-08 09:17:57.291441611 +0000 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-08 09:17:57.291441611 +0000 2024-05-08T09:20:52.831 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-05-08 09:17:57.291441611 +0000 2024-05-08T09:20:52.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T09:20:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-08T09:20:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-08T09:20:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000103614 s, 4.9 MB/s 2024-05-08T09:20:52.896 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T09:20:52.953 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-05-08T09:20:53.009 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-05-08 09:20:36.350369851 +0000 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-05-08 09:17:57.636436549 +0000 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-05-08 09:17:57.636436549 +0000 2024-05-08T09:20:53.010 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-05-08 09:17:57.636436549 +0000 2024-05-08T09:20:53.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T09:20:53.073 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-05-08T09:20:53.073 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-05-08T09:20:53.073 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 9.7713e-05 s, 5.2 MB/s 2024-05-08T09:20:53.074 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T09:20:53.131 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T09:20:53.131 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:53.131 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T09:20:53.149 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T09:20:53.149 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:53.206 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-05-08 09:20:47.616914334 +0000 2024-05-08T09:20:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-05-08 09:17:52.178344611 +0000 2024-05-08T09:20:53.207 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-05-08 09:17:52.178344611 +0000 2024-05-08T09:20:53.207 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-05-08 09:17:52.178344611 +0000 2024-05-08T09:20:53.207 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T09:20:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-05-08T09:20:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-05-08T09:20:53.272 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000214545 s, 2.4 MB/s 2024-05-08T09:20:53.273 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T09:20:53.331 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2024-05-08T09:20:53.387 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-05-08 09:20:47.617914333 +0000 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-05-08 09:17:52.510344497 +0000 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-05-08 09:17:52.510344497 +0000 2024-05-08T09:20:53.388 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-05-08 09:17:52.510344497 +0000 2024-05-08T09:20:53.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T09:20:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-05-08T09:20:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-05-08T09:20:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00021011 s, 2.4 MB/s 2024-05-08T09:20:53.454 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T09:20:53.511 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2024-05-08T09:20:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T09:20:53.567 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:53.567 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T09:20:53.567 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:53.567 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:53.568 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-05-08 09:20:47.617914333 +0000 2024-05-08T09:20:53.568 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-05-08 09:17:52.845344382 +0000 2024-05-08T09:20:53.568 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-05-08 09:17:52.845344382 +0000 2024-05-08T09:20:53.568 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-05-08 09:17:52.845344382 +0000 2024-05-08T09:20:53.568 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T09:20:53.631 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-05-08T09:20:53.631 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-05-08T09:20:53.631 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000185462 s, 2.8 MB/s 2024-05-08T09:20:53.632 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T09:20:53.689 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2024-05-08T09:20:53.744 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2024-05-08 09:20:47.617914333 +0000 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2024-05-08 09:17:53.186344266 +0000 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2024-05-08 09:17:53.186344266 +0000 2024-05-08T09:20:53.745 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: 2024-05-08 09:17:53.186344266 +0000 2024-05-08T09:20:53.745 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T09:20:53.809 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2024-05-08T09:20:53.809 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2024-05-08T09:20:53.809 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000213307 s, 2.4 MB/s 2024-05-08T09:20:53.810 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T09:20:53.866 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T09:20:53.867 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T09:20:53.867 INFO:tasks.ceph:Generating config... 2024-05-08T09:20:53.868 INFO:tasks.ceph:[client] debug ms = 1 2024-05-08T09:20:53.868 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-05-08T09:20:53.868 INFO:tasks.ceph:[client] debug rgw = 20 2024-05-08T09:20:53.868 INFO:tasks.ceph:[client] setgroup = ceph 2024-05-08T09:20:53.868 INFO:tasks.ceph:[client] setuser = ceph 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] debug objclass = 20 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] bdev async discard = True 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-08T09:20:53.868 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-08T09:20:53.869 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-08T09:20:53.869 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-08T09:20:53.869 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-08T09:20:53.869 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-08T09:20:53.869 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-08T09:20:53.869 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-08T09:20:53.869 INFO:tasks.ceph:Setting up mon.a... 2024-05-08T09:20:53.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-08T09:20:53.939 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2024-05-08T09:20:53.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-08T09:20:53.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T09:20:54.018 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45')] 2024-05-08T09:20:54.018 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-05-08T09:20:54.019 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:54.019 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T09:20:54.075 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --print /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:20:54.157 INFO:teuthology.orchestra.run.smithi045.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:20:54.157 INFO:teuthology.orchestra.run.smithi045.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:20:54.157 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 57dabfa9-0c4c-41b5-8694-d94716898a33 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = quincy 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 57dabfa9-0c4c-41b5-8694-d94716898a33 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2024-05-08T09:20:54.159100+0000 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-05-08T09:20:54.159100+0000 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 17 (quincy) 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-05-08T09:20:54.158 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-05-08T09:20:54.159 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-08T09:20:54.216 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 57dabfa9-0c4c-41b5-8694-d94716898a33... 2024-05-08T09:20:54.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T09:20:54.259 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-08T09:20:54.302 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-05-08T09:20:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2024-05-08T09:20:54.302 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T09:20:54.303 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2024-05-08T09:20:54.304 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = 172.21.15.45 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 57dabfa9-0c4c-41b5-8694-d94716898a33 2024-05-08T09:20:54.305 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2024-05-08T09:20:54.306 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug trim objects = true 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.307 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug objclass = 20 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2024-05-08T09:20:54.308 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-05-08T09:20:54.309 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.310 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T09:20:54.311 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout: rgw gc obj min wait = 15 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout: debug rgw = 20 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout: setgroup = ceph 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout: setuser = ceph 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2024-05-08T09:20:54.312 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2024-05-08T09:20:54.313 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2024-05-08T09:20:54.314 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2024-05-08T09:20:54.315 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = 172.21.15.45 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = 57dabfa9-0c4c-41b5-8694-d94716898a33 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd mclock profile = high_recovery_ops 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.316 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug trim objects = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2024-05-08T09:20:54.317 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug objclass = 20 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2024-05-08T09:20:54.318 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2024-05-08T09:20:54.319 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-08T09:20:54.320 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2024-05-08T09:20:54.321 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: rgw gc obj min wait = 15 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: debug rgw = 20 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: setgroup = ceph 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout: setuser = ceph 2024-05-08T09:20:54.322 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2024-05-08T09:20:54.323 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-08T09:20:54.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-08T09:20:54.419 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-08T09:20:54.420 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:54.420 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-08T09:20:54.435 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:54.436 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-08T09:20:54.491 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2024-05-08T09:20:54.491 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:54.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T09:20:54.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T09:20:54.568 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:20:54.568 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:20:54.624 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:20:54.624 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:54.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-08T09:20:54.624 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-08T09:20:54.659 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:20:54.659 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:20:54.715 INFO:tasks.ceph:Setting up mon nodes... 2024-05-08T09:20:54.715 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-08T09:20:54.715 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T09:20:54.819 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-08T09:20:54.822 INFO:tasks.ceph:Setting up mds nodes... 2024-05-08T09:20:54.822 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-08T09:20:54.822 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T09:20:54.863 INFO:teuthology.orchestra.run.smithi161.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-08T09:20:54.876 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-08T09:20:54.876 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-05-08T09:20:54.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-08T09:20:54.902 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-05-08T09:20:54.902 INFO:tasks.ceph:role: osd.0 2024-05-08T09:20:54.902 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2024-05-08T09:20:54.902 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T09:20:54.968 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T09:20:54.968 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T09:20:54.968 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T09:20:54.968 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T09:20:54.969 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T09:20:55.000 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2024-05-08T09:20:55.002 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2024-05-08T09:20:55.003 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-08T09:20:55.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-08T09:20:55.144 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-08T09:20:55.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:20:55.280+0000 7f09d46a0640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-08T09:20:58.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-08T09:20:58.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-08T09:20:58.198 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T09:20:58.198 INFO:tasks.ceph:role: osd.1 2024-05-08T09:20:58.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:20:58.198 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T09:20:58.275 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T09:20:58.771 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-05-08T09:20:58.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-05-08T09:20:58.774 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-05-08T09:20:58.918 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-08T09:20:58.957 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-08T09:20:59.026 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T09:20:59.026 INFO:tasks.ceph:role: osd.2 2024-05-08T09:20:59.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:20:59.026 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-08T09:20:59.099 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T09:20:59.100 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T09:20:59.101 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T09:20:59.542 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-05-08T09:20:59.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-05-08T09:20:59.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-05-08T09:20:59.636 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-08T09:20:59.665 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-08T09:20:59.731 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-05-08T09:20:59.731 INFO:tasks.ceph:role: osd.3 2024-05-08T09:20:59.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:20:59.731 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-08T09:20:59.803 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-05-08T09:20:59.804 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-08T09:20:59.804 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-08T09:21:00.295 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2024-05-08T09:21:00.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2024-05-08T09:21:00.297 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-05-08T09:21:00.452 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-08T09:21:00.481 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:21:00.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.576+0000 7f2d17012640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-08T09:21:00.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.583+0000 7f2d17012640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-08T09:21:00.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.583+0000 7f2d17012640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T09:21:00.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.583+0000 7f2d17012640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T09:21:00.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.583+0000 7f2d17012640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-08T09:21:00.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:00.591+0000 7f2d17012640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-08T09:21:03.448 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-08T09:21:03.479 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.568+0000 7f48d8e1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.568+0000 7f48d8e1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.568+0000 7f48d8e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.568+0000 7f48d8e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.568+0000 7f48d8e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-08T09:21:03.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:03.569+0000 7f48d8e1f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-08T09:21:06.412 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-08T09:21:06.442 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:21:06.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.533+0000 7f9948c0a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-08T09:21:06.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.534+0000 7f9948c0a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-08T09:21:06.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.534+0000 7f9948c0a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T09:21:06.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.534+0000 7f9948c0a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T09:21:06.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.534+0000 7f9948c0a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-08T09:21:06.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:06.534+0000 7f9948c0a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-08T09:21:09.389 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-08T09:21:09.419 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-08T09:21:09.419 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:21:09.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-08T09:21:09.450 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:09.451 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-08T09:21:09.487 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:09.487 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-08T09:21:09.555 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:09.555 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-08T09:21:09.622 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:09.622 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-08T09:21:09.690 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:09.690 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-08T09:21:09.746 INFO:tasks.ceph:Adding keys to all mons... 2024-05-08T09:21:09.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-08T09:21:09.775 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2024-05-08T09:21:09.775 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD3QztmxzXCEBAAqjRd6w/MAHnfu3qEzae4IQ== 2024-05-08T09:21:09.775 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD2QztmjbLzMBAA5vnLY+BB59VP+ZMqjI4ygA== 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD8QztmqWB9IhAASKfUz4OZF1Q2/zV0FnMgLA== 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD/QztmZAABIhAAO+y+/jfB0Z7K8Y0riK/spg== 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQACRDtmlejrHxAAB/G48H49CaQWV0ISZ83EuQ== 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-05-08T09:21:09.776 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD2QztmzuiMMxAABbLt6gNvNEHh1JkPXVYJUw== 2024-05-08T09:21:09.777 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T09:21:09.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-08T09:21:09.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T09:21:09.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T09:21:10.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-08T09:21:10.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-08T09:21:10.141 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-08T09:21:10.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-08T09:21:10.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-08T09:21:10.263 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-08T09:21:10.289 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-08T09:21:10.345 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-08T09:21:10.345 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-08T09:21:10.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-08T09:21:10.387 INFO:tasks.ceph.mon.a:Started 2024-05-08T09:21:10.387 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-08T09:21:10.388 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-08T09:21:10.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-08T09:21:10.390 INFO:tasks.ceph.mgr.x:Started 2024-05-08T09:21:10.390 INFO:tasks.ceph:Setting crush tunables to default 2024-05-08T09:21:10.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.494+0000 7fe7e59ed640 1 Processor -- start 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.494+0000 7fe7e59ed640 1 -- start start 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.494+0000 7fe7e59ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7e006de40 0x7fe7e006e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.494+0000 7fe7e59ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7e006c670 con 0x7fe7e006f370 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.494+0000 7fe7e59ed640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe7e0072490 con 0x7fe7e006de40 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7deffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7e006de40 0x7fe7e006e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7deffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe7e006de40 0x7fe7e006e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59758/0 (socket says 172.21.15.45:59758) 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7de7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe7e006f370 0x7fe7e006e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35050/0 (socket says 172.21.15.45:35050) 2024-05-08T09:21:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7deffd640 1 -- 172.21.15.45:0/3592788268 learned_addr learned my addr 172.21.15.45:0/3592788268 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7deffd640 1 -- 172.21.15.45:0/3592788268 >> v1:172.21.15.45:6789/0 conn(0x7fe7e006f370 legacy=0x7fe7e006e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.495+0000 7fe7deffd640 1 -- 172.21.15.45:0/3592788268 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e009bb00 con 0x7fe7e006de40 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7deffd640 1 --2- 172.21.15.45:0/3592788268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e006e220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097f0 tx=0x7fe7d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526ebff780407f32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7ddffb640 1 -- 172.21.15.45:0/3592788268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d0035020 con 0x7fe7e006de40 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7ddffb640 1 -- 172.21.15.45:0/3592788268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d00317a0 con 0x7fe7e006de40 2024-05-08T09:21:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7ddffb640 1 -- 172.21.15.45:0/3592788268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d0031aa0 con 0x7fe7e006de40 2024-05-08T09:21:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 -- 172.21.15.45:0/3592788268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 msgr2=0x7fe7e006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 --2- 172.21.15.45:0/3592788268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e006e220 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00097f0 tx=0x7fe7d002b910 comp rx=0 tx=0).stop 2024-05-08T09:21:10.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 -- 172.21.15.45:0/3592788268 shutdown_connections 2024-05-08T09:21:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 --2- 172.21.15.45:0/3592788268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e006e220 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 -- 172.21.15.45:0/3592788268 >> 172.21.15.45:0/3592788268 conn(0x7fe7e009ccf0 msgr2=0x7fe7e009d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 -- 172.21.15.45:0/3592788268 shutdown_connections 2024-05-08T09:21:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.497+0000 7fe7e59ed640 1 -- 172.21.15.45:0/3592788268 wait complete. 2024-05-08T09:21:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.498+0000 7fe7e59ed640 1 Processor -- start 2024-05-08T09:21:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.498+0000 7fe7e59ed640 1 -- start start 2024-05-08T09:21:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7e59ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:10.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7e59ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e0133b50 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7deffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59770/0 (socket says 172.21.15.45:59770) 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7deffd640 1 -- 172.21.15.45:0/1617938934 learned_addr learned my addr 172.21.15.45:0/1617938934 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7deffd640 1 -- 172.21.15.45:0/1617938934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e009b060 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7deffd640 1 --2- 172.21.15.45:0/1617938934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0034040 tx=0x7fe7d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d003ad00 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7d00443f0 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e0125140 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe7d00446d0 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.499+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e0122bf0 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.500+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7d004b060 con 0x7fe7e006de40 2024-05-08T09:21:10.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.500+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe7d004d940 con 0x7fe7e006de40 2024-05-08T09:21:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.500+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e0062e90 con 0x7fe7e006de40 2024-05-08T09:21:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.503+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe7d0063dd0 con 0x7fe7e006de40 2024-05-08T09:21:10.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.569+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe7e0073fd0 con 0x7fe7e006de40 2024-05-08T09:21:10.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.570+0000 7fe7c7fff640 1 -- 172.21.15.45:0/1617938934 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fe7d0052070 con 0x7fe7e006de40 2024-05-08T09:21:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-05-08T09:21:10.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 msgr2=0x7fe7e01224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 --2- 172.21.15.45:0/1617938934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0034040 tx=0x7fe7d00046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 shutdown_connections 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 --2- 172.21.15.45:0/1617938934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e006de40 0x7fe7e01224d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 >> 172.21.15.45:0/1617938934 conn(0x7fe7e009ccf0 msgr2=0x7fe7e011b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 shutdown_connections 2024-05-08T09:21:10.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:10.571+0000 7fe7e59ed640 1 -- 172.21.15.45:0/1617938934 wait complete. 2024-05-08T09:21:10.581 INFO:tasks.ceph:check_enable_crimson: False 2024-05-08T09:21:10.581 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-08T09:21:10.581 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-05-08T09:21:10.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-08T09:21:10.607 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:10.607 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-08T09:21:10.632 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:10.633 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-08T09:21:10.700 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2024-05-08T09:21:10.700 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-08T09:21:10.765 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 0e23c86d-f1e4-406d-a723-e8c11567fdac 0 2024-05-08T09:21:10.779 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:10.778+0000 7f703020d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T09:21:10.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f6b88c640 1 Processor -- start 2024-05-08T09:21:10.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f6b88c640 1 -- start start 2024-05-08T09:21:10.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f6b88c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f64117f10 0x7f1f641182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:10.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f6b88c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f64118980 con 0x7f1f64111bf0 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f6b88c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f1f641127b0 con 0x7f1f64117f10 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f69628640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f64117f10 0x7f1f641182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f69628640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f64117f10 0x7f1f641182f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45182/0 (socket says 172.21.15.161:45182) 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f69628640 1 -- 172.21.15.161:0/2620331195 learned_addr learned my addr 172.21.15.161:0/2620331195 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.877+0000 7f1f68e27640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1f64111bf0 0x7f1f641120a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:54558/0 (socket says 172.21.15.161:54558) 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.878+0000 7f1f69628640 1 -- 172.21.15.161:0/2620331195 >> v1:172.21.15.45:6789/0 conn(0x7f1f64111bf0 legacy=0x7f1f641120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.878+0000 7f1f69628640 1 -- 172.21.15.161:0/2620331195 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f64112960 con 0x7f1f64117f10 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.878+0000 7f1f69628640 1 --2- 172.21.15.161:0/2620331195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64117f10 0x7f1f641182f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009e50 tx=0x7f1f6002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53322d8eba0daf7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f5bfff640 1 -- 172.21.15.161:0/2620331195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6002c8a0 con 0x7f1f64117f10 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f5bfff640 1 -- 172.21.15.161:0/2620331195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6002ca40 con 0x7f1f64117f10 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f5bfff640 1 -- 172.21.15.161:0/2620331195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6002cd40 con 0x7f1f64117f10 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 -- 172.21.15.161:0/2620331195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64117f10 msgr2=0x7f1f641182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 --2- 172.21.15.161:0/2620331195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64117f10 0x7f1f641182f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f60009e50 tx=0x7f1f6002bf80 comp rx=0 tx=0).stop 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 -- 172.21.15.161:0/2620331195 shutdown_connections 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 --2- 172.21.15.161:0/2620331195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64117f10 0x7f1f641182f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 -- 172.21.15.161:0/2620331195 >> 172.21.15.161:0/2620331195 conn(0x7f1f6406e840 msgr2=0x7f1f6410fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:10.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 -- 172.21.15.161:0/2620331195 shutdown_connections 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.879+0000 7f1f6b88c640 1 -- 172.21.15.161:0/2620331195 wait complete. 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f6b88c640 1 Processor -- start 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f6b88c640 1 -- start start 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f6b88c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f6b88c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6411e090 con 0x7f1f64111bf0 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f69628640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f69628640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45194/0 (socket says 172.21.15.161:45194) 2024-05-08T09:21:10.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.880+0000 7f1f69628640 1 -- 172.21.15.161:0/739723926 learned_addr learned my addr 172.21.15.161:0/739723926 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:10.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f69628640 1 -- 172.21.15.161:0/739723926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f641a6ed0 con 0x7f1f64111bf0 2024-05-08T09:21:10.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f69628640 1 --2- 172.21.15.161:0/739723926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000f80 tx=0x7f1f60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:10.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f60043020 con 0x7f1f64111bf0 2024-05-08T09:21:10.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6003e660 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f641a7160 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.881+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1f6003e960 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.882+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f641ab110 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.882+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f60046020 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.882+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1f6003a040 con 0x7f1f64111bf0 2024-05-08T09:21:10.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.882+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6404fe40 con 0x7f1f64111bf0 2024-05-08T09:21:10.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.885+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1f6004d030 con 0x7f1f64111bf0 2024-05-08T09:21:10.945 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:10.944+0000 7f703020d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T09:21:10.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.957+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0e23c86d-f1e4-406d-a723-e8c11567fdac", "id": 0} v 0) -- 0x7f1f64117f10 con 0x7f1f64111bf0 2024-05-08T09:21:10.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.959+0000 7f1f59ffb640 1 -- 172.21.15.161:0/739723926 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0e23c86d-f1e4-406d-a723-e8c11567fdac", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1f60048400 con 0x7f1f64111bf0 2024-05-08T09:21:10.959 INFO:teuthology.orchestra.run.smithi161.stdout:0 2024-05-08T09:21:10.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 msgr2=0x7f1f641a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:10.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 --2- 172.21.15.161:0/739723926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1f60000f80 tx=0x7f1f60004a40 comp rx=0 tx=0).stop 2024-05-08T09:21:10.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 shutdown_connections 2024-05-08T09:21:10.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 --2- 172.21.15.161:0/739723926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f64111bf0 0x7f1f641a6990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:10.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 >> 172.21.15.161:0/739723926 conn(0x7f1f6406e840 msgr2=0x7f1f64113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:10.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 shutdown_connections 2024-05-08T09:21:10.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:10.960+0000 7f1f6b88c640 1 -- 172.21.15.161:0/739723926 wait complete. 2024-05-08T09:21:10.971 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 08fc9bb7-d840-43f5-b921-9c83c643eb02 1 2024-05-08T09:21:11.002 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:11.001+0000 7f703020d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T09:21:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.070+0000 7f6d9ba8c640 1 Processor -- start 2024-05-08T09:21:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.070+0000 7f6d9ba8c640 1 -- start start 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.070+0000 7f6d9ba8c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d94117f10 0x7f6d941182f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.070+0000 7f6d9ba8c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d94118980 con 0x7f6d94111bf0 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.070+0000 7f6d9ba8c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f6d941127b0 con 0x7f6d94117f10 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d99828640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6d94117f10 0x7f6d941182f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d99027640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6d94111bf0 0x7f6d941120a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:54572/0 (socket says 172.21.15.161:54572) 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d99027640 1 -- 172.21.15.161:0/3841349192 learned_addr learned my addr 172.21.15.161:0/3841349192 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d99828640 1 -- 172.21.15.161:0/3841349192 >> v1:172.21.15.45:6789/0 conn(0x7f6d94111bf0 legacy=0x7f6d941120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d99828640 1 -- 172.21.15.161:0/3841349192 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d94112960 con 0x7f6d94117f10 2024-05-08T09:21:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.071+0000 7f6d98826640 1 -- 172.21.15.161:0/3841349192 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863598604 0 0) 0x7f6d90001110 con 0x7f6d94111bf0 2024-05-08T09:21:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.072+0000 7f6d99828640 1 --2- 172.21.15.161:0/3841349192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94117f10 0x7f6d941182f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009720 tx=0x7f6d8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285fdb0938cb9850 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.072+0000 7f6d98826640 1 -- 172.21.15.161:0/3841349192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d880316d0 con 0x7f6d94117f10 2024-05-08T09:21:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.072+0000 7f6d98826640 1 -- 172.21.15.161:0/3841349192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d88037070 con 0x7f6d94117f10 2024-05-08T09:21:11.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.072+0000 7f6d98826640 1 -- 172.21.15.161:0/3841349192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d880319c0 con 0x7f6d94117f10 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/3841349192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94117f10 msgr2=0x7f6d941182f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 --2- 172.21.15.161:0/3841349192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94117f10 0x7f6d941182f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009720 tx=0x7f6d8802b840 comp rx=0 tx=0).stop 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/3841349192 shutdown_connections 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 --2- 172.21.15.161:0/3841349192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94117f10 0x7f6d941182f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/3841349192 >> 172.21.15.161:0/3841349192 conn(0x7f6d9406e840 msgr2=0x7f6d9410fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/3841349192 shutdown_connections 2024-05-08T09:21:11.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/3841349192 wait complete. 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 Processor -- start 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.073+0000 7f6d9ba8c640 1 -- start start 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d9ba8c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d9ba8c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6d9411e090 con 0x7f6d94111bf0 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d99828640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d99828640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45208/0 (socket says 172.21.15.161:45208) 2024-05-08T09:21:11.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d99828640 1 -- 172.21.15.161:0/208024155 learned_addr learned my addr 172.21.15.161:0/208024155 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d99828640 1 -- 172.21.15.161:0/208024155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d941a6ed0 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d99828640 1 --2- 172.21.15.161:0/208024155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009840 tx=0x7f6d880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d88032770 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d88032910 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.074+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d941a7160 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.075+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d88032c30 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.075+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d941ab110 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.075+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6d8804c060 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.075+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f6d8802f050 con 0x7f6d94111bf0 2024-05-08T09:21:11.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.075+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d9404fe40 con 0x7f6d94111bf0 2024-05-08T09:21:11.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.078+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6d88040070 con 0x7f6d94111bf0 2024-05-08T09:21:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.150+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08fc9bb7-d840-43f5-b921-9c83c643eb02", "id": 1} v 0) -- 0x7f6d94117f10 con 0x7f6d94111bf0 2024-05-08T09:21:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.151+0000 7f6d867fc640 1 -- 172.21.15.161:0/208024155 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08fc9bb7-d840-43f5-b921-9c83c643eb02", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f6d88032dd0 con 0x7f6d94111bf0 2024-05-08T09:21:11.152 INFO:teuthology.orchestra.run.smithi161.stdout:1 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 msgr2=0x7f6d941a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 --2- 172.21.15.161:0/208024155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009840 tx=0x7f6d880046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 shutdown_connections 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 --2- 172.21.15.161:0/208024155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d94111bf0 0x7f6d941a6990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 >> 172.21.15.161:0/208024155 conn(0x7f6d9406e840 msgr2=0x7f6d94113df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 shutdown_connections 2024-05-08T09:21:11.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.152+0000 7f6d9ba8c640 1 -- 172.21.15.161:0/208024155 wait complete. 2024-05-08T09:21:11.163 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 147190f8-36ff-4d5d-82c1-fb9b52d383c7 2 2024-05-08T09:21:11.274 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:11.273+0000 7f703020d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T09:21:11.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0efae6640 1 Processor -- start 2024-05-08T09:21:11.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0efae6640 1 -- start start 2024-05-08T09:21:11.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0efae6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e811ab90 0x7ff0e811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0efae6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e811d550 con 0x7ff0e8117f10 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0efae6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e811e750 con 0x7ff0e811ab90 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.303+0000 7ff0ed081640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e811ab90 0x7ff0e811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.304+0000 7ff0ed081640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e811ab90 0x7ff0e811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45210/0 (socket says 172.21.15.161:45210) 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.304+0000 7ff0ed882640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0e8117f10 0x7ff0e81182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:54586/0 (socket says 172.21.15.161:54586) 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.304+0000 7ff0ed081640 1 -- 172.21.15.161:0/1685522201 learned_addr learned my addr 172.21.15.161:0/1685522201 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.304+0000 7ff0ed081640 1 -- 172.21.15.161:0/1685522201 >> v1:172.21.15.45:6789/0 conn(0x7ff0e8117f10 legacy=0x7ff0e81182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.304+0000 7ff0ed081640 1 -- 172.21.15.161:0/1685522201 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e811e900 con 0x7ff0e811ab90 2024-05-08T09:21:11.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.305+0000 7ff0ed081640 1 --2- 172.21.15.161:0/1685522201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e811ab90 0x7ff0e811cf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097f0 tx=0x7ff0dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edbce04bdf637ff7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.305+0000 7ff0ec880640 1 -- 172.21.15.161:0/1685522201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc035020 con 0x7ff0e811ab90 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.305+0000 7ff0ec880640 1 -- 172.21.15.161:0/1685522201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0317a0 con 0x7ff0e811ab90 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.305+0000 7ff0ec880640 1 -- 172.21.15.161:0/1685522201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0dc031aa0 con 0x7ff0e811ab90 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 -- 172.21.15.161:0/1685522201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e811ab90 msgr2=0x7ff0e811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 --2- 172.21.15.161:0/1685522201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e811ab90 0x7ff0e811cf80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0097f0 tx=0x7ff0dc02b910 comp rx=0 tx=0).stop 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 -- 172.21.15.161:0/1685522201 shutdown_connections 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 --2- 172.21.15.161:0/1685522201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e811ab90 0x7ff0e811cf80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 -- 172.21.15.161:0/1685522201 >> 172.21.15.161:0/1685522201 conn(0x7ff0e806e840 msgr2=0x7ff0e810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 -- 172.21.15.161:0/1685522201 shutdown_connections 2024-05-08T09:21:11.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.306+0000 7ff0efae6640 1 -- 172.21.15.161:0/1685522201 wait complete. 2024-05-08T09:21:11.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.307+0000 7ff0efae6640 1 Processor -- start 2024-05-08T09:21:11.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.307+0000 7ff0efae6640 1 -- start start 2024-05-08T09:21:11.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.307+0000 7ff0efae6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.307+0000 7ff0efae6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e811dc40 con 0x7ff0e8117f10 2024-05-08T09:21:11.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0ed882640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0ed882640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45220/0 (socket says 172.21.15.161:45220) 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0ed882640 1 -- 172.21.15.161:0/948818436 learned_addr learned my addr 172.21.15.161:0/948818436 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0ed882640 1 -- 172.21.15.161:0/948818436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e81a6f30 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0ed882640 1 --2- 172.21.15.161:0/948818436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c450 tx=0x7ff0e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.308+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4007410 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e40075b0 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0e4004910 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e81a7220 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e81ab2d0 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff0e401a020 con 0x7ff0e8117f10 2024-05-08T09:21:11.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7ff0e4012810 con 0x7ff0e8117f10 2024-05-08T09:21:11.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.309+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e804fe40 con 0x7ff0e8117f10 2024-05-08T09:21:11.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.312+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff0e4021070 con 0x7ff0e8117f10 2024-05-08T09:21:11.323 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:11.322+0000 7f703020d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T09:21:11.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.384+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "147190f8-36ff-4d5d-82c1-fb9b52d383c7", "id": 2} v 0) -- 0x7ff0e81a7450 con 0x7ff0e8117f10 2024-05-08T09:21:11.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.385+0000 7ff0da7fc640 1 -- 172.21.15.161:0/948818436 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "147190f8-36ff-4d5d-82c1-fb9b52d383c7", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7ff0e40125d0 con 0x7ff0e8117f10 2024-05-08T09:21:11.386 INFO:teuthology.orchestra.run.smithi161.stdout:2 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 msgr2=0x7ff0e81a69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 --2- 172.21.15.161:0/948818436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400c450 tx=0x7ff0e400c910 comp rx=0 tx=0).stop 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 shutdown_connections 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 --2- 172.21.15.161:0/948818436 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e8117f10 0x7ff0e81a69f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 >> 172.21.15.161:0/948818436 conn(0x7ff0e806e840 msgr2=0x7ff0e811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 shutdown_connections 2024-05-08T09:21:11.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.386+0000 7ff0efae6640 1 -- 172.21.15.161:0/948818436 wait complete. 2024-05-08T09:21:11.397 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 249c3077-a292-4c01-893d-d51d0ea978b5 3 2024-05-08T09:21:11.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.494+0000 7ff89b1a0640 1 Processor -- start 2024-05-08T09:21:11.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.494+0000 7ff89b1a0640 1 -- start start 2024-05-08T09:21:11.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89b1a0640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff894110920 0x7ff89406bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89b1a0640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89406c4d0 con 0x7ff89406c020 2024-05-08T09:21:11.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89b1a0640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7ff89406c6a0 con 0x7ff894110920 2024-05-08T09:21:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89999d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff89406c020 0x7ff89411c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:54590/0 (socket says 172.21.15.161:54590) 2024-05-08T09:21:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89999d640 1 -- 172.21.15.161:0/1722334450 learned_addr learned my addr 172.21.15.161:0/1722334450 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.495+0000 7ff89a19e640 1 --2- 172.21.15.161:0/1722334450 >> v2:172.21.15.45:3300/0 conn(0x7ff894110920 0x7ff89406bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.496+0000 7ff89919c640 1 -- 172.21.15.161:0/1722334450 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992589416 0 0) 0x7ff89406c4d0 con 0x7ff89406c020 2024-05-08T09:21:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.496+0000 7ff89919c640 1 -- 172.21.15.161:0/1722334450 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff880003520 con 0x7ff89406c020 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.496+0000 7ff89a19e640 1 -- 172.21.15.161:0/1722334450 >> v1:172.21.15.45:6789/0 conn(0x7ff89406c020 legacy=0x7ff89411c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.496+0000 7ff89a19e640 1 -- 172.21.15.161:0/1722334450 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89406c850 con 0x7ff894110920 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.496+0000 7ff89a19e640 1 --2- 172.21.15.161:0/1722334450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff894110920 0x7ff89406bae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff890009720 tx=0x7ff89002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4709fc52a629a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89919c640 1 -- 172.21.15.161:0/1722334450 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8900316d0 con 0x7ff894110920 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89919c640 1 -- 172.21.15.161:0/1722334450 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff890037070 con 0x7ff894110920 2024-05-08T09:21:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89919c640 1 -- 172.21.15.161:0/1722334450 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff8900319c0 con 0x7ff894110920 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 -- 172.21.15.161:0/1722334450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff894110920 msgr2=0x7ff89406bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 --2- 172.21.15.161:0/1722334450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff894110920 0x7ff89406bae0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff890009720 tx=0x7ff89002b840 comp rx=0 tx=0).stop 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 -- 172.21.15.161:0/1722334450 shutdown_connections 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 --2- 172.21.15.161:0/1722334450 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff894110920 0x7ff89406bae0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 -- 172.21.15.161:0/1722334450 >> 172.21.15.161:0/1722334450 conn(0x7ff894070010 msgr2=0x7ff894072430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 -- 172.21.15.161:0/1722334450 shutdown_connections 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.497+0000 7ff89b1a0640 1 -- 172.21.15.161:0/1722334450 wait complete. 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.498+0000 7ff89b1a0640 1 Processor -- start 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.498+0000 7ff89b1a0640 1 -- start start 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.498+0000 7ff89b1a0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.498+0000 7ff89b1a0640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ff89411dec0 con 0x7ff89406c020 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.499+0000 7ff89a19e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.499+0000 7ff89a19e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:45242/0 (socket says 172.21.15.161:45242) 2024-05-08T09:21:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.499+0000 7ff89a19e640 1 -- 172.21.15.161:0/947858132 learned_addr learned my addr 172.21.15.161:0/947858132 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.499+0000 7ff89a19e640 1 -- 172.21.15.161:0/947858132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8941ac7e0 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.499+0000 7ff89a19e640 1 --2- 172.21.15.161:0/947858132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff890009720 tx=0x7ff8900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890032560 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8941aca10 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff890032700 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff890032a00 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8941a62a0 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff89004c060 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.500+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7ff89002f050 con 0x7ff89406c020 2024-05-08T09:21:11.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.501+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff89404fe40 con 0x7ff89406c020 2024-05-08T09:21:11.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.503+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7ff890040070 con 0x7ff89406c020 2024-05-08T09:21:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.575+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd new", "uuid": "249c3077-a292-4c01-893d-d51d0ea978b5", "id": 3} v 0) -- 0x7ff894110920 con 0x7ff89406c020 2024-05-08T09:21:11.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.576+0000 7ff886ffd640 1 -- 172.21.15.161:0/947858132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "249c3077-a292-4c01-893d-d51d0ea978b5", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7ff890006780 con 0x7ff89406c020 2024-05-08T09:21:11.577 INFO:teuthology.orchestra.run.smithi161.stdout:3 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 msgr2=0x7ff8941ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 --2- 172.21.15.161:0/947858132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff890009720 tx=0x7ff8900046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 shutdown_connections 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 --2- 172.21.15.161:0/947858132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff89406c020 0x7ff8941ac210 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 >> 172.21.15.161:0/947858132 conn(0x7ff894070010 msgr2=0x7ff8941196c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 shutdown_connections 2024-05-08T09:21:11.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:11.577+0000 7ff89b1a0640 1 -- 172.21.15.161:0/947858132 wait complete. 2024-05-08T09:21:11.588 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-08T09:21:11.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-08T09:21:11.591 INFO:tasks.ceph.osd.0:Started 2024-05-08T09:21:11.591 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-08T09:21:11.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-08T09:21:11.593 INFO:tasks.ceph.osd.1:Started 2024-05-08T09:21:11.593 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-08T09:21:11.593 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-08T09:21:11.595 INFO:tasks.ceph.osd.2:Started 2024-05-08T09:21:11.595 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-08T09:21:11.596 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-08T09:21:11.597 INFO:tasks.ceph.osd.3:Started 2024-05-08T09:21:11.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.713+0000 7f47c9ce6640 1 Processor -- start 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.713+0000 7f47c9ce6640 1 -- start start 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.713+0000 7f47c9ce6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47c412e460 0x7f47c4130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.713+0000 7f47c9ce6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47c4071020 con 0x7f47c4127ea0 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.713+0000 7f47c9ce6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f47c4071780 con 0x7f47c412e460 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.714+0000 7f47c2ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47c412e460 0x7f47c4130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.714+0000 7f47c37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f47c4127ea0 0x7f47c4128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35064/0 (socket says 172.21.15.45:35064) 2024-05-08T09:21:11.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.714+0000 7f47c37fe640 1 -- 172.21.15.45:0/2321410940 learned_addr learned my addr 172.21.15.45:0/2321410940 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.714+0000 7f47c2ffd640 1 -- 172.21.15.45:0/2321410940 >> v1:172.21.15.45:6789/0 conn(0x7f47c4127ea0 legacy=0x7f47c4128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.714+0000 7f47c2ffd640 1 -- 172.21.15.45:0/2321410940 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c406e6e0 con 0x7f47c412e460 2024-05-08T09:21:11.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c2ffd640 1 --2- 172.21.15.45:0/2321410940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c412e460 0x7f47c4130850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009720 tx=0x7f47b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ffade31fe5bc7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c27fc640 1 -- 172.21.15.45:0/2321410940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b8035020 con 0x7f47c412e460 2024-05-08T09:21:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c27fc640 1 -- 172.21.15.45:0/2321410940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b8031760 con 0x7f47c412e460 2024-05-08T09:21:11.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c27fc640 1 -- 172.21.15.45:0/2321410940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b8031a60 con 0x7f47c412e460 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 -- 172.21.15.45:0/2321410940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c412e460 msgr2=0x7f47c4130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 --2- 172.21.15.45:0/2321410940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c412e460 0x7f47c4130850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009720 tx=0x7f47b802b8d0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 -- 172.21.15.45:0/2321410940 shutdown_connections 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 --2- 172.21.15.45:0/2321410940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c412e460 0x7f47c4130850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 -- 172.21.15.45:0/2321410940 >> 172.21.15.45:0/2321410940 conn(0x7f47c4099380 msgr2=0x7f47c4099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 -- 172.21.15.45:0/2321410940 shutdown_connections 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.715+0000 7f47c9ce6640 1 -- 172.21.15.45:0/2321410940 wait complete. 2024-05-08T09:21:11.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.716+0000 7f47c9ce6640 1 Processor -- start 2024-05-08T09:21:11.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c9ce6640 1 -- start start 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c9ce6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c9ce6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f47c40725d0 con 0x7f47c4127ea0 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59806/0 (socket says 172.21.15.45:59806) 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c37fe640 1 -- 172.21.15.45:0/1572265153 learned_addr learned my addr 172.21.15.45:0/1572265153 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:11.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c37fe640 1 -- 172.21.15.45:0/1572265153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c4114640 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.717+0000 7f47c37fe640 1 --2- 172.21.15.45:0/1572265153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47b400c4a0 tx=0x7f47b400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4017070 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47b4005c10 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c4125110 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47b4007070 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c4124960 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f47b401a070 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.718+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f47b401cb50 con 0x7f47c4127ea0 2024-05-08T09:21:11.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.719+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c4062e90 con 0x7f47c4127ea0 2024-05-08T09:21:11.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.721+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f47b401c440 con 0x7f47c4127ea0 2024-05-08T09:21:11.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.783+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f47c406eae0 con 0x7f47c4127ea0 2024-05-08T09:21:11.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.783+0000 7f47abfff640 1 -- 172.21.15.45:0/1572265153 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f47b401c620 con 0x7f47c4127ea0 2024-05-08T09:21:11.783 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:11.784 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:21:11.578003+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:21:11.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 msgr2=0x7f47c4113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:11.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 --2- 172.21.15.45:0/1572265153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f47b400c4a0 tx=0x7f47b400c960 comp rx=0 tx=0).stop 2024-05-08T09:21:11.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 shutdown_connections 2024-05-08T09:21:11.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 --2- 172.21.15.45:0/1572265153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47c4127ea0 0x7f47c4113060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:11.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 >> 172.21.15.45:0/1572265153 conn(0x7f47c4099380 msgr2=0x7f47c409a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:11.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 shutdown_connections 2024-05-08T09:21:11.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:11.784+0000 7f47c9ce6640 1 -- 172.21.15.45:0/1572265153 wait complete. 2024-05-08T09:21:11.795 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-08T09:21:11.795 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-08T09:21:12.084 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.084+0000 7f703020d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T09:21:12.172 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.171+0000 7f703020d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T09:21:12.190 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-05-08T09:21:12.190+0000 7f4999925640 -1 Falling back to public interface 2024-05-08T09:21:12.197 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-05-08T09:21:12.196+0000 7f714660f640 -1 Falling back to public interface 2024-05-08T09:21:12.197 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-05-08T09:21:12.196+0000 7f8544041640 -1 Falling back to public interface 2024-05-08T09:21:12.197 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:12.196+0000 7f8c5020e640 -1 Falling back to public interface 2024-05-08T09:21:12.198 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-05-08T09:21:12.197+0000 7f7144f91640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-05-08T09:21:12.198 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:12.197+0000 7f8c4eae8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2024-05-08T09:21:12.198 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:12.197+0000 7f8c4eae8640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6803/0: (98) Address already in use 2024-05-08T09:21:12.198 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:12.198+0000 7f8c4eae8640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6813/0: (98) Address already in use 2024-05-08T09:21:12.199 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T09:21:12.218 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.217+0000 7f703020d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.296+0000 7f994dfbe640 1 Processor -- start 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f994dfbe640 1 -- start start 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f994dfbe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f994812b2b0 0x7f9948094710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f994dfbe640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f994812b700 con 0x7f994812aed0 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f994dfbe640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f99480906e0 con 0x7f994812b2b0 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f9946ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f994812b2b0 0x7f9948094710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:12.297 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f99477fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f994812aed0 0x7f9948094000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35070/0 (socket says 172.21.15.45:35070) 2024-05-08T09:21:12.298 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f99477fe640 1 -- 172.21.15.45:0/3764865571 learned_addr learned my addr 172.21.15.45:0/3764865571 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:12.298 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f9946ffd640 1 -- 172.21.15.45:0/3764865571 >> v1:172.21.15.45:6789/0 conn(0x7f994812aed0 legacy=0x7f9948094000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:12.298 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.297+0000 7f9946ffd640 1 -- 172.21.15.45:0/3764865571 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9948095390 con 0x7f994812b2b0 2024-05-08T09:21:12.299 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.298+0000 7f9946ffd640 1 --2- 172.21.15.45:0/3764865571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812b2b0 0x7f9948094710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f993c009720 tx=0x7f993c02c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb86344483c0f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:12.299 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.298+0000 7f99467fc640 1 -- 172.21.15.45:0/3764865571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c030730 con 0x7f994812b2b0 2024-05-08T09:21:12.299 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.298+0000 7f99467fc640 1 -- 172.21.15.45:0/3764865571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c0308d0 con 0x7f994812b2b0 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.298+0000 7f99467fc640 1 -- 172.21.15.45:0/3764865571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c030bd0 con 0x7f994812b2b0 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 -- 172.21.15.45:0/3764865571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812b2b0 msgr2=0x7f9948094710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 --2- 172.21.15.45:0/3764865571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812b2b0 0x7f9948094710 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f993c009720 tx=0x7f993c02c9e0 comp rx=0 tx=0).stop 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 -- 172.21.15.45:0/3764865571 shutdown_connections 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 --2- 172.21.15.45:0/3764865571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812b2b0 0x7f9948094710 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 -- 172.21.15.45:0/3764865571 >> 172.21.15.45:0/3764865571 conn(0x7f994809a170 msgr2=0x7f994809a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 -- 172.21.15.45:0/3764865571 shutdown_connections 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.299+0000 7f994dfbe640 1 -- 172.21.15.45:0/3764865571 wait complete. 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f994dfbe640 1 Processor -- start 2024-05-08T09:21:12.300 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f994dfbe640 1 -- start start 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f994dfbe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f994dfbe640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9948094c50 con 0x7f994812aed0 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f99477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f99477fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59836/0 (socket says 172.21.15.45:59836) 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.300+0000 7f99477fe640 1 -- 172.21.15.45:0/1517750376 learned_addr learned my addr 172.21.15.45:0/1517750376 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f99477fe640 1 -- 172.21.15.45:0/1517750376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994806df70 con 0x7f994812aed0 2024-05-08T09:21:12.302 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f99477fe640 1 --2- 172.21.15.45:0/1517750376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f993800c4a0 tx=0x7f993800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9938017070 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9938005c10 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994806e6e0 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9938007070 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99481c4220 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f993801a070 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.301+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f993801cb50 con 0x7f994812aed0 2024-05-08T09:21:12.303 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.302+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994808fdb0 con 0x7f994812aed0 2024-05-08T09:21:12.304 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.304+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f993801cdf0 con 0x7f994812aed0 2024-05-08T09:21:12.365 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.366+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9948062e90 con 0x7f994812aed0 2024-05-08T09:21:12.366 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.366+0000 7f992ffff640 1 -- 172.21.15.45:0/1517750376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f993801c440 con 0x7f994812aed0 2024-05-08T09:21:12.366 INFO:teuthology.misc.health.smithi045.stdout: 2024-05-08T09:21:12.366 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":6,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:21:11.578003+0000","last_up_change":"0.000000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 msgr2=0x7f99481c3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 --2- 172.21.15.45:0/1517750376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f993800c4a0 tx=0x7f993800c960 comp rx=0 tx=0).stop 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 shutdown_connections 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 --2- 172.21.15.45:0/1517750376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f994812aed0 0x7f99481c3ce0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 >> 172.21.15.45:0/1517750376 conn(0x7f994809a170 msgr2=0x7f9948096c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 shutdown_connections 2024-05-08T09:21:12.367 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:12.367+0000 7f994dfbe640 1 -- 172.21.15.45:0/1517750376 wait complete. 2024-05-08T09:21:12.376 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-05-08T09:21:12.385 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.384+0000 7f703020d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T09:21:12.434 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.434+0000 7f703020d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T09:21:12.488 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.488+0000 7f703020d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T09:21:12.600 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.600+0000 7f703020d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T09:21:12.984 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:12.983+0000 7f703020d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T09:21:13.246 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.245+0000 7f703020d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T09:21:13.299 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.299+0000 7f703020d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T09:21:13.416 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.416+0000 7f703020d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T09:21:13.710 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.709+0000 7f703020d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T09:21:13.757 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.757+0000 7f703020d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T09:21:13.916 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:13.916+0000 7f703020d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T09:21:14.053 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.053+0000 7f703020d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T09:21:14.104 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.104+0000 7f703020d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T09:21:14.176 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.176+0000 7f703020d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T09:21:14.221 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.221+0000 7f703020d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T09:21:14.706 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.706+0000 7f703020d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T09:21:14.824 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:14.824+0000 7f703020d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T09:21:15.620 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-05-08T09:21:15.620+0000 7f4999925640 -1 osd.0 0 log_to_monitors true 2024-05-08T09:21:15.748 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-05-08T09:21:15.748+0000 7f714660f640 -1 osd.1 0 log_to_monitors true 2024-05-08T09:21:15.749 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:15.749+0000 7f8c5020e640 -1 osd.3 0 log_to_monitors true 2024-05-08T09:21:15.753 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-05-08T09:21:15.753+0000 7f8544041640 -1 osd.2 0 log_to_monitors true 2024-05-08T09:21:15.833 INFO:tasks.ceph.mgr.x.smithi161.stderr:2024-05-08T09:21:15.833+0000 7f6fd0b14640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-08T09:21:17.660 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-05-08T09:21:17.660+0000 7f4995098640 -1 osd.0 0 waiting for initial osdmap 2024-05-08T09:21:17.669 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-05-08T09:21:17.670+0000 7f498d6ca640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T09:21:18.548 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:18.547+0000 7f8c4b2ac640 -1 osd.3 0 waiting for initial osdmap 2024-05-08T09:21:18.557 INFO:tasks.ceph.osd.3.smithi161.stderr:2024-05-08T09:21:18.557+0000 7f8c438de640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T09:21:18.567 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-05-08T09:21:18.567+0000 7f7141755640 -1 osd.1 0 waiting for initial osdmap 2024-05-08T09:21:18.578 INFO:tasks.ceph.osd.1.smithi161.stderr:2024-05-08T09:21:18.578+0000 7f7139d87640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T09:21:18.585 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-05-08T09:21:18.585+0000 7f853f7b4640 -1 osd.2 0 waiting for initial osdmap 2024-05-08T09:21:18.598 INFO:tasks.ceph.osd.2.smithi161.stderr:2024-05-08T09:21:18.599+0000 7f8537de6640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T09:21:18.779 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-08T09:21:18.886 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.885+0000 7ffbfa184640 1 Processor -- start 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.885+0000 7ffbfa184640 1 -- start start 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbfa184640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffbf412ed00 0x7ffbf4133810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbfa184640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf409a510 con 0x7ffbf412e210 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbfa184640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf409a940 con 0x7ffbf412ed00 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbf37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffbf412e210 0x7ffbf412e5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35072/0 (socket says 172.21.15.45:35072) 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbf37fe640 1 -- 172.21.15.45:0/722094364 learned_addr learned my addr 172.21.15.45:0/722094364 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbf2ffd640 1 --2- 172.21.15.45:0/722094364 >> v2:172.21.15.45:3300/0 conn(0x7ffbf412ed00 0x7ffbf4133810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbf2ffd640 1 -- 172.21.15.45:0/722094364 >> v1:172.21.15.45:6789/0 conn(0x7ffbf412e210 legacy=0x7ffbf412e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.886+0000 7ffbf2ffd640 1 -- 172.21.15.45:0/722094364 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf406d890 con 0x7ffbf412ed00 2024-05-08T09:21:18.887 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.887+0000 7ffbf2ffd640 1 --2- 172.21.15.45:0/722094364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412ed00 0x7ffbf4133810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8009750 tx=0x7ffbe802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1814555b5f595d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:18.888 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.888+0000 7ffbf27fc640 1 -- 172.21.15.45:0/722094364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe80316d0 con 0x7ffbf412ed00 2024-05-08T09:21:18.888 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.888+0000 7ffbf27fc640 1 -- 172.21.15.45:0/722094364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe8037070 con 0x7ffbf412ed00 2024-05-08T09:21:18.888 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.888+0000 7ffbf27fc640 1 -- 172.21.15.45:0/722094364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe80319c0 con 0x7ffbf412ed00 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.888+0000 7ffbfa184640 1 -- 172.21.15.45:0/722094364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412ed00 msgr2=0x7ffbf4133810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.888+0000 7ffbfa184640 1 --2- 172.21.15.45:0/722094364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412ed00 0x7ffbf4133810 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8009750 tx=0x7ffbe802b840 comp rx=0 tx=0).stop 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 -- 172.21.15.45:0/722094364 shutdown_connections 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 --2- 172.21.15.45:0/722094364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412ed00 0x7ffbf4133810 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 -- 172.21.15.45:0/722094364 >> 172.21.15.45:0/722094364 conn(0x7ffbf409d8e0 msgr2=0x7ffbf406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 -- 172.21.15.45:0/722094364 shutdown_connections 2024-05-08T09:21:18.889 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 -- 172.21.15.45:0/722094364 wait complete. 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.889+0000 7ffbfa184640 1 Processor -- start 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbfa184640 1 -- start start 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbfa184640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbfa184640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4133ed0 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbf37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbf37fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59854/0 (socket says 172.21.15.45:59854) 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.890+0000 7ffbf37fe640 1 -- 172.21.15.45:0/1690952240 learned_addr learned my addr 172.21.15.45:0/1690952240 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbf37fe640 1 -- 172.21.15.45:0/1690952240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf41333d0 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbf37fe640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c4a0 tx=0x7ffbe400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe4017070 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbe4005c10 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf411dad0 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffbe4007070 con 0x7ffbf412e210 2024-05-08T09:21:18.891 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.891+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf411df60 con 0x7ffbf412e210 2024-05-08T09:21:18.892 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.892+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7ffbe401a070 con 0x7ffbf412e210 2024-05-08T09:21:18.892 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.892+0000 7ffbdbfff640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 0x7ffbe003a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:18.892 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.892+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7ffbe4049df0 con 0x7ffbf412e210 2024-05-08T09:21:18.893 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.892+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf409cd20 con 0x7ffbf412e210 2024-05-08T09:21:18.893 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.892+0000 7ffbf2ffd640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 0x7ffbe003a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:18.893 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.893+0000 7ffbf2ffd640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 0x7ffbe003a440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8036000 tx=0x7ffbe8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:18.897 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:18.898+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7ffbf409cd20 con 0x7ffbf412e210 2024-05-08T09:21:19.086 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.087+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbf406d1e0 con 0x7ffbf412e210 2024-05-08T09:21:19.087 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.087+0000 7ffbdbfff640 1 -- 172.21.15.45:0/1690952240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+6104 (secure 0 0 0) 0x7ffbf406d1e0 con 0x7ffbf412e210 2024-05-08T09:21:19.087 INFO:teuthology.misc.health.smithi045.stdout: 2024-05-08T09:21:19.087 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":9,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:21:18.662327+0000","last_up_change":"2024-05-08T09:21:18.662327+0000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6801","nonce":2579517728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6803","nonce":2579517728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6807","nonce":2579517728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6805","nonce":2579517728}]},"public_addr":"172.21.15.45:6801/2579517728","cluster_addr":"172.21.15.45:6803/2579517728","heartbeat_back_addr":"172.21.15.45:6807/2579517728","heartbeat_front_addr":"172.21.15.45:6805/2579517728","state":["exists","up"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6801","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6803","nonce":4188235102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6809","nonce":4188235102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6820","nonce":4188235102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6815","nonce":4188235102}]},"public_addr":"172.21.15.161:6803/4188235102","cluster_addr":"172.21.15.161:6809/4188235102","heartbeat_back_addr":"172.21.15.161:6820/4188235102","heartbeat_front_addr":"172.21.15.161:6815/4188235102","state":["exists","up"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6802","nonce":1967789976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6808","nonce":1967789976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6819","nonce":1967789976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6813","nonce":1967789976}]},"public_addr":"172.21.15.161:6802/1967789976","cluster_addr":"172.21.15.161:6808/1967789976","heartbeat_back_addr":"172.21.15.161:6819/1967789976","heartbeat_front_addr":"172.21.15.161:6813/1967789976","state":["exists","up"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6807","nonce":1879099265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6814","nonce":1879099265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6823","nonce":1879099265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6821","nonce":1879099265}]},"public_addr":"172.21.15.161:6807/1879099265","cluster_addr":"172.21.15.161:6814/1879099265","heartbeat_back_addr":"172.21.15.161:6823/1879099265","heartbeat_front_addr":"172.21.15.161:6821/1879099265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:21:19.089 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 msgr2=0x7ffbe003a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.089 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 0x7ffbe003a440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ffbe8036000 tx=0x7ffbe8008030 comp rx=0 tx=0).stop 2024-05-08T09:21:19.089 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 msgr2=0x7ffbf411ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.089 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffbe400c4a0 tx=0x7ffbe400c960 comp rx=0 tx=0).stop 2024-05-08T09:21:19.089 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 shutdown_connections 2024-05-08T09:21:19.090 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7ffbe0037f80 0x7ffbe003a440 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.090 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 --2- 172.21.15.45:0/1690952240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbf412e210 0x7ffbf411ad20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.090 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.089+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 >> 172.21.15.45:0/1690952240 conn(0x7ffbf409d8e0 msgr2=0x7ffbf409bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.090 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.090+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 shutdown_connections 2024-05-08T09:21:19.090 INFO:teuthology.misc.health.smithi045.stderr:2024-05-08T09:21:19.090+0000 7ffbfa184640 1 -- 172.21.15.45:0/1690952240 wait complete. 2024-05-08T09:21:19.099 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-05-08T09:21:19.099 INFO:tasks.ceph:Creating RBD pool 2024-05-08T09:21:19.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.202+0000 7f76e21fb640 1 Processor -- start 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.202+0000 7f76e21fb640 1 -- start start 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76e21fb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76dc06d4f0 0x7f76dc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76e21fb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76dc0720b0 con 0x7f76dc06de10 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76e21fb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f76dc06f6b0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76db7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76dc06d4f0 0x7f76dc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76daffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f76dc06de10 0x7f76dc09a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35080/0 (socket says 172.21.15.45:35080) 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76daffd640 1 -- 172.21.15.45:0/1942841331 learned_addr learned my addr 172.21.15.45:0/1942841331 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:19.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76db7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f76dc06d4f0 0x7f76dc06d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59856/0 (socket says 172.21.15.45:59856) 2024-05-08T09:21:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76db7fe640 1 -- 172.21.15.45:0/1942841331 >> v1:172.21.15.45:6789/0 conn(0x7f76dc06de10 legacy=0x7f76dc09a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76db7fe640 1 -- 172.21.15.45:0/1942841331 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc06e710 con 0x7f76dc06d4f0 2024-05-08T09:21:19.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.203+0000 7f76da7fc640 1 -- 172.21.15.45:0/1942841331 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390015311 0 0) 0x7f76dc0720b0 con 0x7f76dc06de10 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.204+0000 7f76db7fe640 1 --2- 172.21.15.45:0/1942841331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc06d8d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009720 tx=0x7f76cc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ceeb32fa2b6eca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.204+0000 7f76da7fc640 1 -- 172.21.15.45:0/1942841331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76cc0316d0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.204+0000 7f76da7fc640 1 -- 172.21.15.45:0/1942841331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc037070 con 0x7f76dc06d4f0 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.204+0000 7f76da7fc640 1 -- 172.21.15.45:0/1942841331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76cc0319c0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 -- 172.21.15.45:0/1942841331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 msgr2=0x7f76dc06d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 --2- 172.21.15.45:0/1942841331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc06d8d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009720 tx=0x7f76cc02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 -- 172.21.15.45:0/1942841331 shutdown_connections 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 --2- 172.21.15.45:0/1942841331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc06d8d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 -- 172.21.15.45:0/1942841331 >> 172.21.15.45:0/1942841331 conn(0x7f76dc09d750 msgr2=0x7f76dc09db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 -- 172.21.15.45:0/1942841331 shutdown_connections 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.205+0000 7f76e21fb640 1 -- 172.21.15.45:0/1942841331 wait complete. 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76e21fb640 1 Processor -- start 2024-05-08T09:21:19.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76e21fb640 1 -- start start 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76e21fb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76e21fb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f76dc06ed30 con 0x7f76dc06d4f0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76db7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59870/0 (socket says 172.21.15.45:59870) 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.206+0000 7f76db7fe640 1 -- 172.21.15.45:0/179603291 learned_addr learned my addr 172.21.15.45:0/179603291 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76db7fe640 1 -- 172.21.15.45:0/179603291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76dc12a480 con 0x7f76dc06d4f0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76db7fe640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02b880 tx=0x7f76cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76cc004160 con 0x7f76dc06d4f0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76cc004300 con 0x7f76dc06d4f0 2024-05-08T09:21:19.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76dc12a9e0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f76cc032640 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.207+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76dc12afc0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.208+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f76cc0327e0 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.208+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76dc062e90 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.208+0000 7f76d3fff640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 0x7f76bc03a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.208+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 2743+0+0 (secure 0 0 0) 0x7f76cc02f050 con 0x7f76dc06d4f0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.208+0000 7f76daffd640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 0x7f76bc03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.209+0000 7f76daffd640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 0x7f76bc03a490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.213+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f76cc041070 con 0x7f76dc06d4f0 2024-05-08T09:21:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.395+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f76dc129d70 con 0x7f76dc06d4f0 2024-05-08T09:21:19.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.663+0000 7f76d3fff640 1 -- 172.21.15.45:0/179603291 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v10) ==== 109+0+0 (secure 0 0 0) 0x7f76cc03a380 con 0x7f76dc06d4f0 2024-05-08T09:21:19.663 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 msgr2=0x7f76bc03a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 0x7f76bc03a490 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76c4000c00 tx=0x7f76c4007910 comp rx=0 tx=0).stop 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 msgr2=0x7f76dc1c34d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f76cc02b880 tx=0x7f76cc0046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 shutdown_connections 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f76bc037fd0 0x7f76bc03a490 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 --2- 172.21.15.45:0/179603291 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76dc06d4f0 0x7f76dc1c34d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 >> 172.21.15.45:0/179603291 conn(0x7f76dc09d750 msgr2=0x7f76dc09a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 shutdown_connections 2024-05-08T09:21:19.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.665+0000 7f76e21fb640 1 -- 172.21.15.45:0/179603291 wait complete. 2024-05-08T09:21:19.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.782+0000 7f5783921640 1 Processor -- start 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5783921640 1 -- start start 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5783921640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c12e2e0 0x7f577c1306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5783921640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577c06e6e0 con 0x7f577c127ee0 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5783921640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f577c127a90 con 0x7f577c12e2e0 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5780ebc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c12e2e0 0x7f577c1306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5780ebc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577c12e2e0 0x7f577c1306d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44278/0 (socket says 172.21.15.45:44278) 2024-05-08T09:21:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f57816bd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f577c127ee0 0x7f577c1282c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35982/0 (socket says 172.21.15.45:35982) 2024-05-08T09:21:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.783+0000 7f5780ebc640 1 -- 172.21.15.45:0/3208931945 learned_addr learned my addr 172.21.15.45:0/3208931945 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.784+0000 7f5780ebc640 1 -- 172.21.15.45:0/3208931945 >> v1:172.21.15.45:6789/0 conn(0x7f577c127ee0 legacy=0x7f577c1282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.784+0000 7f5780ebc640 1 -- 172.21.15.45:0/3208931945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c0716a0 con 0x7f577c12e2e0 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.784+0000 7f5780ebc640 1 --2- 172.21.15.45:0/3208931945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c12e2e0 0x7f577c1306d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f576c0097f0 tx=0x7f576c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce56c8700de4991 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.784+0000 7f5773fff640 1 -- 172.21.15.45:0/3208931945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c035020 con 0x7f577c12e2e0 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.784+0000 7f5773fff640 1 -- 172.21.15.45:0/3208931945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c0317a0 con 0x7f577c12e2e0 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5773fff640 1 -- 172.21.15.45:0/3208931945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c031aa0 con 0x7f577c12e2e0 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 -- 172.21.15.45:0/3208931945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c12e2e0 msgr2=0x7f577c1306d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 --2- 172.21.15.45:0/3208931945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c12e2e0 0x7f577c1306d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f576c0097f0 tx=0x7f576c02b910 comp rx=0 tx=0).stop 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 -- 172.21.15.45:0/3208931945 shutdown_connections 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 --2- 172.21.15.45:0/3208931945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c12e2e0 0x7f577c1306d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 -- 172.21.15.45:0/3208931945 >> 172.21.15.45:0/3208931945 conn(0x7f577c0991a0 msgr2=0x7f577c0995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 -- 172.21.15.45:0/3208931945 shutdown_connections 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.785+0000 7f5783921640 1 -- 172.21.15.45:0/3208931945 wait complete. 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f5783921640 1 Processor -- start 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f5783921640 1 -- start start 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f5783921640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f5783921640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f577c130d90 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f57816bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f57816bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44284/0 (socket says 172.21.15.45:44284) 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.786+0000 7f57816bd640 1 -- 172.21.15.45:0/1867408437 learned_addr learned my addr 172.21.15.45:0/1867408437 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f57816bd640 1 -- 172.21.15.45:0/1867408437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577c114ea0 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f57816bd640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f577800c380 tx=0x7f577800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5778007410 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57780075b0 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57780047e0 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f577c12b560 con 0x7f577c127ee0 2024-05-08T09:21:19.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.787+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f577c12ad60 con 0x7f577c127ee0 2024-05-08T09:21:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.788+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f577801a020 con 0x7f577c127ee0 2024-05-08T09:21:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.788+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f577c12bc80 con 0x7f577c127ee0 2024-05-08T09:21:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.788+0000 7f5771ffb640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 0x7f576003a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.788+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 3460+0+0 (secure 0 0 0) 0x7f577804a600 con 0x7f577c127ee0 2024-05-08T09:21:19.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.789+0000 7f5780ebc640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 0x7f576003a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:19.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.789+0000 7f5780ebc640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 0x7f576003a440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f576c036000 tx=0x7f576c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:19.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.793+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f577c114ea0 con 0x7f577c127ee0 2024-05-08T09:21:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:19.977+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f577c062e90 con 0x7f577c127ee0 2024-05-08T09:21:20.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.663+0000 7f5771ffb640 1 -- 172.21.15.45:0/1867408437 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v11) ==== 173+0+0 (secure 0 0 0) 0x7f577801bc30 con 0x7f577c127ee0 2024-05-08T09:21:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 msgr2=0x7f576003a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 0x7f576003a440 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f576c036000 tx=0x7f576c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 msgr2=0x7f577c112ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f577800c380 tx=0x7f577800c840 comp rx=0 tx=0).stop 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 shutdown_connections 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5760037f80 0x7f576003a440 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 --2- 172.21.15.45:0/1867408437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577c127ee0 0x7f577c112ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 >> 172.21.15.45:0/1867408437 conn(0x7f577c0991a0 msgr2=0x7f577c09a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 shutdown_connections 2024-05-08T09:21:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.667+0000 7f5783921640 1 -- 172.21.15.45:0/1867408437 wait complete. 2024-05-08T09:21:20.681 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-08T09:21:20.682 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T09:21:20.682 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-08T09:21:20.682 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-08T09:21:20.682 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-08T09:21:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e32d21640 1 Processor -- start 2024-05-08T09:21:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e32d21640 1 -- start start 2024-05-08T09:21:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e32d21640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e2c06d7f0 0x7f5e2c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:20.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e32d21640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e2c06e710 con 0x7f5e2c06e110 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e32d21640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5e2c06f2a0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e30abd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e2c06d7f0 0x7f5e2c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e2bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e2c06e110 0x7f5e2c12e2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35992/0 (socket says 172.21.15.45:35992) 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.792+0000 7f5e2bfff640 1 -- 172.21.15.45:0/576562651 learned_addr learned my addr 172.21.15.45:0/576562651 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.793+0000 7f5e30abd640 1 -- 172.21.15.45:0/576562651 >> v1:172.21.15.45:6789/0 conn(0x7f5e2c06e110 legacy=0x7f5e2c12e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:20.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.793+0000 7f5e30abd640 1 -- 172.21.15.45:0/576562651 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c06f4e0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e30abd640 1 --2- 172.21.15.45:0/576562651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c06dbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009720 tx=0x7f5e2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1af979d7784a05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e2b7fe640 1 -- 172.21.15.45:0/576562651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e200316d0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e2b7fe640 1 -- 172.21.15.45:0/576562651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20037070 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e2b7fe640 1 -- 172.21.15.45:0/576562651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e200319c0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 -- 172.21.15.45:0/576562651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 msgr2=0x7f5e2c06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 --2- 172.21.15.45:0/576562651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c06dbd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5e20009720 tx=0x7f5e2002b840 comp rx=0 tx=0).stop 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 -- 172.21.15.45:0/576562651 shutdown_connections 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 --2- 172.21.15.45:0/576562651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c06dbd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 -- 172.21.15.45:0/576562651 >> 172.21.15.45:0/576562651 conn(0x7f5e2c0a0b40 msgr2=0x7f5e2c0a0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 -- 172.21.15.45:0/576562651 shutdown_connections 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.794+0000 7f5e32d21640 1 -- 172.21.15.45:0/576562651 wait complete. 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.795+0000 7f5e32d21640 1 Processor -- start 2024-05-08T09:21:20.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.795+0000 7f5e32d21640 1 -- start start 2024-05-08T09:21:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e32d21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e32d21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5e2c12eb80 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e30abd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e30abd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44304/0 (socket says 172.21.15.45:44304) 2024-05-08T09:21:20.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e30abd640 1 -- 172.21.15.45:0/254314203 learned_addr learned my addr 172.21.15.45:0/254314203 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e30abd640 1 -- 172.21.15.45:0/254314203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e2c08f9e0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e30abd640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000c00 tx=0x7f5e200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20032770 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e20032910 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.796+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e2c08fe60 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.797+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5e20032c30 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.797+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e2c090af0 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.798+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e2c12e980 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.798+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f5e2004c060 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.798+0000 7f5e297fa640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 0x7f5e1003a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:20.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.798+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f5e2002f050 con 0x7f5e2c06d7f0 2024-05-08T09:21:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.798+0000 7f5e2bfff640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 0x7f5e1003a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:20.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.799+0000 7f5e2bfff640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 0x7f5e1003a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:20.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:20.806+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5e20040070 con 0x7f5e2c06d7f0 2024-05-08T09:21:21.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.042+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5e2c062e90 con 0x7f5e2c06d7f0 2024-05-08T09:21:21.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.044+0000 7f5e297fa640 1 -- 172.21.15.45:0/254314203 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+87111 (secure 0 0 0) 0x7f5e20030dd0 con 0x7f5e2c06d7f0 2024-05-08T09:21:21.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:21.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.046+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 msgr2=0x7f5e1003a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.046+0000 7f5e32d21640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 0x7f5e1003a490 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5e18007fd0 tx=0x7f5e18007ac0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.046+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 msgr2=0x7f5e2c1c3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.046+0000 7f5e32d21640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5e20000c00 tx=0x7f5e200046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 shutdown_connections 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e10037fd0 0x7f5e1003a490 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 --2- 172.21.15.45:0/254314203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e2c06d7f0 0x7f5e2c1c3340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 >> 172.21.15.45:0/254314203 conn(0x7f5e2c0a0b40 msgr2=0x7f5e2c12c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 shutdown_connections 2024-05-08T09:21:21.047 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.047+0000 7f5e32d21640 1 -- 172.21.15.45:0/254314203 wait complete. 2024-05-08T09:21:21.057 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":4,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6824","nonce":2277433962},{"type":"v1","addr":"172.21.15.161:6825","nonce":2277433962}]},"active_addr":"172.21.15.161:6825/2277433962","active_change":"2024-05-08T09:21:14.827639+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":505473276}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3452282852}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":700992059}]}]} 2024-05-08T09:21:21.059 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-08T09:21:21.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-08T09:21:21.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd4a160640 1 Processor -- start 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd4a160640 1 -- start start 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd4a160640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd4412f580 0x7fbd44131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd4a160640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44113dd0 con 0x7fbd4412c5b0 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd4a160640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fbd44072290 con 0x7fbd4412f580 2024-05-08T09:21:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd437fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd4412c5b0 0x7fbd4412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36008/0 (socket says 172.21.15.45:36008) 2024-05-08T09:21:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd437fe640 1 -- 172.21.15.45:0/1714356868 learned_addr learned my addr 172.21.15.45:0/1714356868 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd3affd640 1 --2- 172.21.15.45:0/1714356868 >> v2:172.21.15.45:3300/0 conn(0x7fbd4412f580 0x7fbd44131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd3affd640 1 -- 172.21.15.45:0/1714356868 >> v1:172.21.15.45:6789/0 conn(0x7fbd4412c5b0 legacy=0x7fbd4412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.163+0000 7fbd3affd640 1 -- 172.21.15.45:0/1714356868 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4412c390 con 0x7fbd4412f580 2024-05-08T09:21:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.165+0000 7fbd3affd640 1 --2- 172.21.15.45:0/1714356868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412f580 0x7fbd44131970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009720 tx=0x7fbd2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f4e7e8ff7a0e3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.257+0000 7fbd42ffd640 1 -- 172.21.15.45:0/1714356868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0316d0 con 0x7fbd4412f580 2024-05-08T09:21:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.257+0000 7fbd42ffd640 1 -- 172.21.15.45:0/1714356868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c037070 con 0x7fbd4412f580 2024-05-08T09:21:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.257+0000 7fbd42ffd640 1 -- 172.21.15.45:0/1714356868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c0319c0 con 0x7fbd4412f580 2024-05-08T09:21:21.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.257+0000 7fbd4a160640 1 -- 172.21.15.45:0/1714356868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412f580 msgr2=0x7fbd44131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.257+0000 7fbd4a160640 1 --2- 172.21.15.45:0/1714356868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412f580 0x7fbd44131970 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009720 tx=0x7fbd2c02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 -- 172.21.15.45:0/1714356868 shutdown_connections 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 --2- 172.21.15.45:0/1714356868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412f580 0x7fbd44131970 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 -- 172.21.15.45:0/1714356868 >> 172.21.15.45:0/1714356868 conn(0x7fbd44099380 msgr2=0x7fbd44099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 -- 172.21.15.45:0/1714356868 shutdown_connections 2024-05-08T09:21:21.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 -- 172.21.15.45:0/1714356868 wait complete. 2024-05-08T09:21:21.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.258+0000 7fbd4a160640 1 Processor -- start 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd4a160640 1 -- start start 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd4a160640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd4a160640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbd44113990 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44314/0 (socket says 172.21.15.45:44314) 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd437fe640 1 -- 172.21.15.45:0/624379812 learned_addr learned my addr 172.21.15.45:0/624379812 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.259+0000 7fbd437fe640 1 -- 172.21.15.45:0/624379812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd441145d0 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd437fe640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c4a0 tx=0x7fbd3400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34017070 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd34005c10 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd44128650 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd34007070 con 0x7fbd4412c5b0 2024-05-08T09:21:21.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.260+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd44128b20 con 0x7fbd4412c5b0 2024-05-08T09:21:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.261+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd4406ef60 con 0x7fbd4412c5b0 2024-05-08T09:21:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.261+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7fbd3401a070 con 0x7fbd4412c5b0 2024-05-08T09:21:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.261+0000 7fbd40ff9640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 0x7fbd2403a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.261+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7fbd3404a060 con 0x7fbd4412c5b0 2024-05-08T09:21:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.261+0000 7fbd3affd640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 0x7fbd2403a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.262+0000 7fbd3affd640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 0x7fbd2403a490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c036000 tx=0x7fbd2c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.266+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbd4406ef60 con 0x7fbd4412c5b0 2024-05-08T09:21:21.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.449+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd44113360 con 0x7fbd4412c5b0 2024-05-08T09:21:21.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.449+0000 7fbd40ff9640 1 -- 172.21.15.45:0/624379812 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+9781 (secure 0 0 0) 0x7fbd34012400 con 0x7fbd4412c5b0 2024-05-08T09:21:21.449 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:21.449 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":11,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:21:20.664020+0000","last_up_change":"2024-05-08T09:21:18.662327+0000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T09:21:18.874472+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T09:21:19.426995+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6801","nonce":2579517728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6803","nonce":2579517728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6807","nonce":2579517728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6805","nonce":2579517728}]},"public_addr":"172.21.15.45:6801/2579517728","cluster_addr":"172.21.15.45:6803/2579517728","heartbeat_back_addr":"172.21.15.45:6807/2579517728","heartbeat_front_addr":"172.21.15.45:6805/2579517728","state":["exists","up"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6801","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6803","nonce":4188235102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6809","nonce":4188235102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6820","nonce":4188235102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6815","nonce":4188235102}]},"public_addr":"172.21.15.161:6803/4188235102","cluster_addr":"172.21.15.161:6809/4188235102","heartbeat_back_addr":"172.21.15.161:6820/4188235102","heartbeat_front_addr":"172.21.15.161:6815/4188235102","state":["exists","up"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6802","nonce":1967789976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6808","nonce":1967789976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6819","nonce":1967789976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6813","nonce":1967789976}]},"public_addr":"172.21.15.161:6802/1967789976","cluster_addr":"172.21.15.161:6808/1967789976","heartbeat_back_addr":"172.21.15.161:6819/1967789976","heartbeat_front_addr":"172.21.15.161:6813/1967789976","state":["exists","up"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6807","nonce":1879099265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6814","nonce":1879099265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6823","nonce":1879099265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6821","nonce":1879099265}]},"public_addr":"172.21.15.161:6807/1879099265","cluster_addr":"172.21.15.161:6814/1879099265","heartbeat_back_addr":"172.21.15.161:6823/1879099265","heartbeat_front_addr":"172.21.15.161:6821/1879099265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.625802+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.742080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.733406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.710305+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:21:21.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 msgr2=0x7fbd2403a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 0x7fbd2403a490 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c036000 tx=0x7fbd2c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:21.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 msgr2=0x7fbd44128110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbd3400c4a0 tx=0x7fbd3400c960 comp rx=0 tx=0).stop 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 shutdown_connections 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd24037fd0 0x7fbd2403a490 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 --2- 172.21.15.45:0/624379812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd4412c5b0 0x7fbd44128110 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 >> 172.21.15.45:0/624379812 conn(0x7fbd44099380 msgr2=0x7fbd4412ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.451+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 shutdown_connections 2024-05-08T09:21:21.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.452+0000 7fbd4a160640 1 -- 172.21.15.45:0/624379812 wait complete. 2024-05-08T09:21:21.462 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-08T09:21:21.462 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T09:21:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.566+0000 7f23f00d2640 1 Processor -- start 2024-05-08T09:21:21.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.566+0000 7f23f00d2640 1 -- start start 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23f00d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e81316f0 0x7f23e8133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23f00d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23e8070f50 con 0x7f23e812b590 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23f00d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f23e80706e0 con 0x7f23e81316f0 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ed66d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e81316f0 0x7f23e8133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ed66d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e81316f0 0x7f23e8133ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44322/0 (socket says 172.21.15.45:44322) 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ede6e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23e812b590 0x7f23e812b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36012/0 (socket says 172.21.15.45:36012) 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ed66d640 1 -- 172.21.15.45:0/1110358267 learned_addr learned my addr 172.21.15.45:0/1110358267 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ed66d640 1 -- 172.21.15.45:0/1110358267 >> v1:172.21.15.45:6789/0 conn(0x7f23e812b590 legacy=0x7f23e812b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.567+0000 7f23ed66d640 1 -- 172.21.15.45:0/1110358267 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e809dd00 con 0x7f23e81316f0 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.568+0000 7f23ed66d640 1 --2- 172.21.15.45:0/1110358267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e81316f0 0x7f23e8133ae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097f0 tx=0x7f23d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e44900535bd2d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.568+0000 7f23ece6c640 1 -- 172.21.15.45:0/1110358267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d8035020 con 0x7f23e81316f0 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.568+0000 7f23ece6c640 1 -- 172.21.15.45:0/1110358267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d80317a0 con 0x7f23e81316f0 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.568+0000 7f23ece6c640 1 -- 172.21.15.45:0/1110358267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23d8031aa0 con 0x7f23e81316f0 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 -- 172.21.15.45:0/1110358267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e81316f0 msgr2=0x7f23e8133ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 --2- 172.21.15.45:0/1110358267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e81316f0 0x7f23e8133ae0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f23d80097f0 tx=0x7f23d802b910 comp rx=0 tx=0).stop 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 -- 172.21.15.45:0/1110358267 shutdown_connections 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 --2- 172.21.15.45:0/1110358267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e81316f0 0x7f23e8133ae0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 -- 172.21.15.45:0/1110358267 >> 172.21.15.45:0/1110358267 conn(0x7f23e809ed60 msgr2=0x7f23e809f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 -- 172.21.15.45:0/1110358267 shutdown_connections 2024-05-08T09:21:21.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.569+0000 7f23f00d2640 1 -- 172.21.15.45:0/1110358267 wait complete. 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23f00d2640 1 Processor -- start 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23f00d2640 1 -- start start 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23f00d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23f00d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f23e8134020 con 0x7f23e812b590 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23ede6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23ede6e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44334/0 (socket says 172.21.15.45:44334) 2024-05-08T09:21:21.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23ede6e640 1 -- 172.21.15.45:0/3911937323 learned_addr learned my addr 172.21.15.45:0/3911937323 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.570+0000 7f23ede6e640 1 -- 172.21.15.45:0/3911937323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e812c260 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23ede6e640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23e400c360 tx=0x7f23e400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e4007410 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23e40075b0 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23e4004910 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e8070380 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.571+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e812c6f0 con 0x7f23e812b590 2024-05-08T09:21:21.572 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.572+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) ==== 45507+0+0 (secure 0 0 0) 0x7f23e401a020 con 0x7f23e812b590 2024-05-08T09:21:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.572+0000 7f23de7fc640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 0x7f23cc03a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.572+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e8062e90 con 0x7f23e812b590 2024-05-08T09:21:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.572+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 3482+0+0 (secure 0 0 0) 0x7f23e404a580 con 0x7f23e812b590 2024-05-08T09:21:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.572+0000 7f23ed66d640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 0x7f23cc03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.573+0000 7f23ed66d640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 0x7f23cc03a490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23d8036000 tx=0x7f23d8008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.577+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f23e401bbd0 con 0x7f23e812b590 2024-05-08T09:21:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.668+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23e4013920 con 0x7f23e812b590 2024-05-08T09:21:21.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.765+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23e8073fd0 con 0x7f23e812b590 2024-05-08T09:21:21.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.766+0000 7f23de7fc640 1 -- 172.21.15.45:0/3911937323 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+9755 (secure 0 0 0) 0x7f23e4011a90 con 0x7f23e812b590 2024-05-08T09:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:21.766 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":12,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:21:21.664984+0000","last_up_change":"2024-05-08T09:21:18.662327+0000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T09:21:18.874472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T09:21:19.426995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6801","nonce":2579517728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6803","nonce":2579517728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6807","nonce":2579517728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6805","nonce":2579517728}]},"public_addr":"172.21.15.45:6801/2579517728","cluster_addr":"172.21.15.45:6803/2579517728","heartbeat_back_addr":"172.21.15.45:6807/2579517728","heartbeat_front_addr":"172.21.15.45:6805/2579517728","state":["exists","up"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6801","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6803","nonce":4188235102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6809","nonce":4188235102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6820","nonce":4188235102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6815","nonce":4188235102}]},"public_addr":"172.21.15.161:6803/4188235102","cluster_addr":"172.21.15.161:6809/4188235102","heartbeat_back_addr":"172.21.15.161:6820/4188235102","heartbeat_front_addr":"172.21.15.161:6815/4188235102","state":["exists","up"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6802","nonce":1967789976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6808","nonce":1967789976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6819","nonce":1967789976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6813","nonce":1967789976}]},"public_addr":"172.21.15.161:6802/1967789976","cluster_addr":"172.21.15.161:6808/1967789976","heartbeat_back_addr":"172.21.15.161:6819/1967789976","heartbeat_front_addr":"172.21.15.161:6813/1967789976","state":["exists","up"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6807","nonce":1879099265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6814","nonce":1879099265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6823","nonce":1879099265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6821","nonce":1879099265}]},"public_addr":"172.21.15.161:6807/1879099265","cluster_addr":"172.21.15.161:6814/1879099265","heartbeat_back_addr":"172.21.15.161:6823/1879099265","heartbeat_front_addr":"172.21.15.161:6821/1879099265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.625802+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.742080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.733406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.710305+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 msgr2=0x7f23cc03a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 0x7f23cc03a490 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f23d8036000 tx=0x7f23d8008030 comp rx=0 tx=0).stop 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 msgr2=0x7f23e806e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f23e400c360 tx=0x7f23e400c820 comp rx=0 tx=0).stop 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 shutdown_connections 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f23cc037fd0 0x7f23cc03a490 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 --2- 172.21.15.45:0/3911937323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e812b590 0x7f23e806e210 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 >> 172.21.15.45:0/3911937323 conn(0x7f23e809ed60 msgr2=0x7f23e8130330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 shutdown_connections 2024-05-08T09:21:21.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.768+0000 7f23f00d2640 1 -- 172.21.15.45:0/3911937323 wait complete. 2024-05-08T09:21:21.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-08T09:21:21.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-08T09:21:21.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-08T09:21:21.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-08T09:21:21.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f14fb550640 1 Processor -- start 2024-05-08T09:21:21.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f485fff4640 1 Processor -- start 2024-05-08T09:21:21.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f49415c7640 1 Processor -- start 2024-05-08T09:21:21.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f7d9e9b6640 1 Processor -- start 2024-05-08T09:21:21.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f485fff4640 1 -- start start 2024-05-08T09:21:21.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f49415c7640 1 -- start start 2024-05-08T09:21:21.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f14fb550640 1 -- start start 2024-05-08T09:21:21.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f7d9e9b6640 1 -- start start 2024-05-08T09:21:21.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f49415c7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f493c1280f0 0x7f493c1284d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f14fb550640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14f406d6f0 0x7f14f406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.890+0000 7f485fff4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f485812e340 0x7f4858130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14fb550640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f4071b00 con 0x7f14f406e010 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14fb550640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f14f406f790 con 0x7f14f406d6f0 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f49415c7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493c127cc0 con 0x7f493c12b110 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485fff4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4858098840 con 0x7f485812b2e0 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485fff4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f485806f9a0 con 0x7f485812e340 2024-05-08T09:21:21.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485d58f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f485812e340 0x7f4858130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f493affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f493c1280f0 0x7f493c1284d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f493affd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f493c1280f0 0x7f493c1284d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44340/0 (socket says 172.21.15.45:44340) 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f493affd640 1 -- 172.21.15.45:0/1784532801 learned_addr learned my addr 172.21.15.45:0/1784532801 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f493c0720f0 con 0x7f493c1280f0 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14f8aeb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f14f406e010 0x7f14f4070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36016/0 (socket says 172.21.15.45:36016) 2024-05-08T09:21:21.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14f8aeb640 1 -- 172.21.15.45:0/910559910 learned_addr learned my addr 172.21.15.45:0/910559910 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14f92ec640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f14f406d6f0 0x7f14f406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d9e9b6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d9806f1a0 0x7f7d98133a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d9e9b6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d9806fde0 con 0x7f7d9806e6b0 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d9e9b6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f7d9806dbf0 con 0x7f7d9806f1a0 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485d58f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f485812e340 0x7f4858130730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44362/0 (socket says 172.21.15.45:44362) 2024-05-08T09:21:21.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485d58f640 1 -- 172.21.15.45:0/2543509528 learned_addr learned my addr 172.21.15.45:0/2543509528 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d97fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d9806e6b0 0x7f7d9806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36034/0 (socket says 172.21.15.45:36034) 2024-05-08T09:21:21.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d977fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d9806f1a0 0x7f7d98133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d97fff640 1 -- 172.21.15.45:0/2323799410 learned_addr learned my addr 172.21.15.45:0/2323799410 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:21.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485d58f640 1 -- 172.21.15.45:0/2543509528 >> v1:172.21.15.45:6789/0 conn(0x7f485812b2e0 legacy=0x7f485812b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f485d58f640 1 -- 172.21.15.45:0/2543509528 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485812bdd0 con 0x7f485812e340 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d977fe640 1 -- 172.21.15.45:0/2323799410 >> v1:172.21.15.45:6789/0 conn(0x7f7d9806e6b0 legacy=0x7f7d9806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f7d977fe640 1 -- 172.21.15.45:0/2323799410 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d9806cfa0 con 0x7f7d9806f1a0 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f493affd640 1 -- 172.21.15.45:0/1784532801 >> v1:172.21.15.45:6789/0 conn(0x7f493c12b110 legacy=0x7f493c12b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f493affd640 1 -- 172.21.15.45:0/1784532801 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c099b40 con 0x7f493c1280f0 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14f92ec640 1 -- 172.21.15.45:0/910559910 >> v1:172.21.15.45:6789/0 conn(0x7f14f406e010 legacy=0x7f14f4070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.891+0000 7f14f92ec640 1 -- 172.21.15.45:0/910559910 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f406ff00 con 0x7f14f406d6f0 2024-05-08T09:21:21.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f4939ffb640 1 -- 172.21.15.45:0/1784532801 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163794672 0 0) 0x7f493c127cc0 con 0x7f493c12b110 2024-05-08T09:21:21.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f485d58f640 1 --2- 172.21.15.45:0/2543509528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812e340 0x7f4858130730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f484800bac0 tx=0x7f484802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55e4d09b6ae53e27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f14f92ec640 1 --2- 172.21.15.45:0/910559910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406d6f0 0x7f14f406dad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009720 tx=0x7f14f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a80cce2d2279f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f7d977fe640 1 --2- 172.21.15.45:0/2323799410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806f1a0 0x7f7d98133a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009720 tx=0x7f7d8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c973e7828b22480 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f493affd640 1 --2- 172.21.15.45:0/1784532801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c1284d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5929985012d73b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f485cd8e640 1 -- 172.21.15.45:0/2543509528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f484803b070 con 0x7f485812e340 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.892+0000 7f14ebfff640 1 -- 172.21.15.45:0/910559910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f00316d0 con 0x7f14f406d6f0 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14ebfff640 1 -- 172.21.15.45:0/910559910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f0037070 con 0x7f14f406d6f0 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14ebfff640 1 -- 172.21.15.45:0/910559910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f00319c0 con 0x7f14f406d6f0 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f485cd8e640 1 -- 172.21.15.45:0/2543509528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f484802edc0 con 0x7f485812e340 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f485cd8e640 1 -- 172.21.15.45:0/2543509528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4848036590 con 0x7f485812e340 2024-05-08T09:21:21.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f7d96ffd640 1 -- 172.21.15.45:0/2323799410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c0316d0 con 0x7f7d9806f1a0 2024-05-08T09:21:21.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f4939ffb640 1 -- 172.21.15.45:0/1784532801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c034070 con 0x7f493c1280f0 2024-05-08T09:21:21.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f7d96ffd640 1 -- 172.21.15.45:0/2323799410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d8c037070 con 0x7f7d9806f1a0 2024-05-08T09:21:21.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f7d96ffd640 1 -- 172.21.15.45:0/2323799410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d8c0319c0 con 0x7f7d9806f1a0 2024-05-08T09:21:21.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f4939ffb640 1 -- 172.21.15.45:0/1784532801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c030790 con 0x7f493c1280f0 2024-05-08T09:21:21.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f4939ffb640 1 -- 172.21.15.45:0/1784532801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c030a90 con 0x7f493c1280f0 2024-05-08T09:21:21.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14fb550640 1 -- 172.21.15.45:0/910559910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406d6f0 msgr2=0x7f14f406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14fb550640 1 --2- 172.21.15.45:0/910559910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406d6f0 0x7f14f406dad0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009720 tx=0x7f14f002b840 comp rx=0 tx=0).stop 2024-05-08T09:21:21.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f485fff4640 1 -- 172.21.15.45:0/2543509528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812e340 msgr2=0x7f4858130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f485fff4640 1 --2- 172.21.15.45:0/2543509528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812e340 0x7f4858130730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f484800bac0 tx=0x7f484802e0e0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14fb550640 1 -- 172.21.15.45:0/910559910 shutdown_connections 2024-05-08T09:21:21.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14fb550640 1 --2- 172.21.15.45:0/910559910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406d6f0 0x7f14f406dad0 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009720 tx=0x7f14f002b840 comp rx=0 tx=0).stop 2024-05-08T09:21:21.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f14fb550640 1 -- 172.21.15.45:0/910559910 >> 172.21.15.45:0/910559910 conn(0x7f14f40996c0 msgr2=0x7f14f4099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.893+0000 7f485fff4640 1 -- 172.21.15.45:0/2543509528 shutdown_connections 2024-05-08T09:21:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f485fff4640 1 --2- 172.21.15.45:0/2543509528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812e340 0x7f4858130730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f485fff4640 1 -- 172.21.15.45:0/2543509528 >> 172.21.15.45:0/2543509528 conn(0x7f48580996c0 msgr2=0x7f4858099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f14fb550640 1 -- 172.21.15.45:0/910559910 shutdown_connections 2024-05-08T09:21:21.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f14fb550640 1 -- 172.21.15.45:0/910559910 wait complete. 2024-05-08T09:21:21.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/2323799410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806f1a0 msgr2=0x7f7d98133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/2323799410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806f1a0 0x7f7d98133a00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009720 tx=0x7f7d8c02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:21.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f485fff4640 1 -- 172.21.15.45:0/2543509528 shutdown_connections 2024-05-08T09:21:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/2323799410 shutdown_connections 2024-05-08T09:21:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/2323799410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806f1a0 0x7f7d98133a00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/2323799410 >> 172.21.15.45:0/2323799410 conn(0x7f7d9809da30 msgr2=0x7f7d9809de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f485fff4640 1 -- 172.21.15.45:0/2543509528 wait complete. 2024-05-08T09:21:21.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/2323799410 shutdown_connections 2024-05-08T09:21:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 msgr2=0x7f493c1284d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 --2- 172.21.15.45:0/1784532801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c1284d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c02b9a0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/2323799410 wait complete. 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 shutdown_connections 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 --2- 172.21.15.45:0/1784532801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c1284d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 >> 172.21.15.45:0/1784532801 conn(0x7f493c09a8b0 msgr2=0x7f493c0981b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 shutdown_connections 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.894+0000 7f49415c7640 1 -- 172.21.15.45:0/1784532801 wait complete. 2024-05-08T09:21:21.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f14fb550640 1 Processor -- start 2024-05-08T09:21:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f485fff4640 1 Processor -- start 2024-05-08T09:21:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f14fb550640 1 -- start start 2024-05-08T09:21:21.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f485fff4640 1 -- start start 2024-05-08T09:21:21.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f7d9e9b6640 1 Processor -- start 2024-05-08T09:21:21.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f7d9e9b6640 1 -- start start 2024-05-08T09:21:21.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f485fff4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.895+0000 7f485fff4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4858070190 con 0x7f485812b2e0 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f485dd90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f485dd90640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44370/0 (socket says 172.21.15.45:44370) 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f485dd90640 1 -- 172.21.15.45:0/2311759832 learned_addr learned my addr 172.21.15.45:0/2311759832 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f49415c7640 1 Processor -- start 2024-05-08T09:21:21.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d9e9b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f49415c7640 1 -- start start 2024-05-08T09:21:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d9e9b6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7d98134150 con 0x7f7d9806e6b0 2024-05-08T09:21:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f14fb550640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f14fb550640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f14f4098650 con 0x7f14f406e010 2024-05-08T09:21:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f14f92ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d97fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44376/0 (socket says 172.21.15.45:44376) 2024-05-08T09:21:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d97fff640 1 -- 172.21.15.45:0/807553043 learned_addr learned my addr 172.21.15.45:0/807553043 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f485dd90640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485808a450 con 0x7f485812b2e0 2024-05-08T09:21:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f14f92ec640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44378/0 (socket says 172.21.15.45:44378) 2024-05-08T09:21:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f14f92ec640 1 -- 172.21.15.45:0/2770752378 learned_addr learned my addr 172.21.15.45:0/2770752378 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f7d97fff640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d981245a0 con 0x7f7d9806e6b0 2024-05-08T09:21:21.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f485dd90640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485400c380 tx=0x7f485400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.896+0000 7f49415c7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f49415c7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f493c0703d0 con 0x7f493c1280f0 2024-05-08T09:21:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d97fff640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000cb20 tx=0x7f7d9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f14f92ec640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f4096440 con 0x7f14f406e010 2024-05-08T09:21:21.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854005200 con 0x7f485812b2e0 2024-05-08T09:21:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48540053c0 con 0x7f485812b2e0 2024-05-08T09:21:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f493affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4858127560 con 0x7f485812b2e0 2024-05-08T09:21:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f493affd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44382/0 (socket says 172.21.15.45:44382) 2024-05-08T09:21:21.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f493affd640 1 -- 172.21.15.45:0/3068775 learned_addr learned my addr 172.21.15.45:0/3068775 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4854007190 con 0x7f485812b2e0 2024-05-08T09:21:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f14f92ec640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14f002bdd0 tx=0x7f14f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d90017070 con 0x7f7d9806e6b0 2024-05-08T09:21:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485808a760 con 0x7f485812b2e0 2024-05-08T09:21:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d9000abf0 con 0x7f7d9806e6b0 2024-05-08T09:21:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d90012400 con 0x7f7d9806e6b0 2024-05-08T09:21:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d98124120 con 0x7f7d9806e6b0 2024-05-08T09:21:21.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f493affd640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493c126b70 con 0x7f493c1280f0 2024-05-08T09:21:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.897+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d98125230 con 0x7f7d9806e6b0 2024-05-08T09:21:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0032640 con 0x7f14f406e010 2024-05-08T09:21:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f00327e0 con 0x7f14f406e010 2024-05-08T09:21:21.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14f0032ac0 con 0x7f14f406e010 2024-05-08T09:21:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f493affd640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4858062e90 con 0x7f485812b2e0 2024-05-08T09:21:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7d98125510 con 0x7f7d9806e6b0 2024-05-08T09:21:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f4095740 con 0x7f14f406e010 2024-05-08T09:21:21.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f4123d80 con 0x7f14f406e010 2024-05-08T09:21:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.898+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7d9001a070 con 0x7f7d9806e6b0 2024-05-08T09:21:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4854007400 con 0x7f485812b2e0 2024-05-08T09:21:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c034040 con 0x7f493c1280f0 2024-05-08T09:21:21.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493c124b80 con 0x7f493c1280f0 2024-05-08T09:21:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d94ff9640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 0x7f7d8403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f7d9004ad80 con 0x7f7d9806e6b0 2024-05-08T09:21:21.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f484e7fc640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 0x7f483c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493c125ed0 con 0x7f493c1280f0 2024-05-08T09:21:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f485404a4f0 con 0x7f485812b2e0 2024-05-08T09:21:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f492c030790 con 0x7f493c1280f0 2024-05-08T09:21:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f492c039d30 con 0x7f493c1280f0 2024-05-08T09:21:21.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f484e7fc640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 0x7f483c03fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4854009e50 con 0x7f483c03d7e0 2024-05-08T09:21:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d94ff9640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 0x7f7d8403fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7d84040340 con 0x7f7d8403d830 2024-05-08T09:21:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f485d58f640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 0x7f483c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d977fe640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 0x7f7d8403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d9cf53640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 0x7f7d8403fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f485e591640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 0x7f483c03fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14f4062e90 con 0x7f14f406e010 2024-05-08T09:21:21.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.899+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f7d90011d40 con 0x7f7d9806e6b0 2024-05-08T09:21:21.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f7d9cf53640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 0x7f7d8403fc70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f491c000f80 con 0x7f493c1280f0 2024-05-08T09:21:21.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f7d977fe640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 0x7f7d8403a570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009720 tx=0x7f7d8c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f485e591640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 0x7f483c03fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f485d58f640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 0x7f483c03a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f484800bac0 tx=0x7f4848032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f14f004c060 con 0x7f14f406e010 2024-05-08T09:21:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f4854051050 con 0x7f485812b2e0 2024-05-08T09:21:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.900+0000 7f14e9ffb640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 0x7f14d803a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14f8aeb640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 0x7f14d803a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f14f002f050 con 0x7f14f406e010 2024-05-08T09:21:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4854009e50 con 0x7f483c03d7e0 2024-05-08T09:21:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7d84040340 con 0x7f7d8403d830 2024-05-08T09:21:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14e9ffb640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 0x7f14d803fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14f004ce80 con 0x7f14d803d830 2024-05-08T09:21:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f14f004ca40 con 0x7f14f406e010 2024-05-08T09:21:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14f9aed640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 0x7f14d803fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f492c04a060 con 0x7f493c1280f0 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 0x7f492803a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f492c06de20 con 0x7f493c1280f0 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 0x7f492803fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f492c004490 con 0x7f492803d830 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f492c06e190 con 0x7f493c1280f0 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f493a7fc640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 0x7f492803a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f493b7fe640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 0x7f492803fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f14f8aeb640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 0x7f14d803a570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14e4007fd0 tx=0x7f14e4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.901+0000 7f493a7fc640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 0x7f492803a570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4930001640 tx=0x7f4930007950 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.902+0000 7f14f9aed640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 0x7f14d803fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.902+0000 7f493b7fe640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 0x7f492803fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.902+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f14f004ce80 con 0x7f14d803d830 2024-05-08T09:21:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.902+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f492c004490 con 0x7f492803d830 2024-05-08T09:21:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.916+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7d98125be0 con 0x7f7d8403d830 2024-05-08T09:21:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.916+0000 7f7d94ff9640 1 -- 172.21.15.45:0/807553043 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7d98125be0 con 0x7f7d8403d830 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 msgr2=0x7f7d8403fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 0x7f7d8403fc70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 msgr2=0x7f7d8403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 0x7f7d8403a570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c009720 tx=0x7f7d8c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 msgr2=0x7f7d981c3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7d9000cb20 tx=0x7f7d9000a060 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 shutdown_connections 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f7d8403d830 0x7f7d8403fc70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d840380b0 0x7f7d8403a570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 --2- 172.21.15.45:0/807553043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d9806e6b0 0x7f7d981c3470 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 >> 172.21.15.45:0/807553043 conn(0x7f7d9809da30 msgr2=0x7f7d980903f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 shutdown_connections 2024-05-08T09:21:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.917+0000 7f7d9e9b6640 1 -- 172.21.15.45:0/807553043 wait complete. 2024-05-08T09:21:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.918+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f491c002c70 con 0x7f492803d830 2024-05-08T09:21:21.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.918+0000 7f49237fe640 1 -- 172.21.15.45:0/3068775 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f491c002c70 con 0x7f492803d830 2024-05-08T09:21:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 msgr2=0x7f492803fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 0x7f492803fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 msgr2=0x7f492803a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 0x7f492803a570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4930001640 tx=0x7f4930007950 comp rx=0 tx=0).stop 2024-05-08T09:21:21.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 msgr2=0x7f493c123050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f492c009820 tx=0x7f492c0046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 shutdown_connections 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f492803d830 0x7f492803fc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f49280380b0 0x7f492803a570 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 --2- 172.21.15.45:0/3068775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f493c1280f0 0x7f493c123050 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 >> 172.21.15.45:0/3068775 conn(0x7f493c09a8b0 msgr2=0x7f493c097900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 shutdown_connections 2024-05-08T09:21:21.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.919+0000 7f49415c7640 1 -- 172.21.15.45:0/3068775 wait complete. 2024-05-08T09:21:21.938 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:21.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T09:21:21.939 INFO:teuthology.orchestra.run.smithi045.stdout:38654705668 2024-05-08T09:21:21.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T09:21:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.933+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4858127e00 con 0x7f483c03d7e0 2024-05-08T09:21:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.933+0000 7f484e7fc640 1 -- 172.21.15.45:0/2311759832 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4858127e00 con 0x7f483c03d7e0 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 msgr2=0x7f483c03fc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 0x7f483c03fc20 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 msgr2=0x7f483c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 0x7f483c03a520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f484800bac0 tx=0x7f4848032000 comp rx=0 tx=0).stop 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 msgr2=0x7f4858125e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f485400c380 tx=0x7f485400c840 comp rx=0 tx=0).stop 2024-05-08T09:21:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 shutdown_connections 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f483c03d7e0 0x7f483c03fc20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f483c038060 0x7f483c03a520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 --2- 172.21.15.45:0/2311759832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f485812b2e0 0x7f4858125e00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 >> 172.21.15.45:0/2311759832 conn(0x7f48580996c0 msgr2=0x7f485809b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 shutdown_connections 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f485fff4640 1 -- 172.21.15.45:0/2311759832 wait complete. 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.934+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14f4123ae0 con 0x7f14d803d830 2024-05-08T09:21:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14e9ffb640 1 -- 172.21.15.45:0/2770752378 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14f4123ae0 con 0x7f14d803d830 2024-05-08T09:21:21.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 msgr2=0x7f14d803fc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 0x7f14d803fc70 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 msgr2=0x7f14d803a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 0x7f14d803a570 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f14e4007fd0 tx=0x7f14e4007ac0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 msgr2=0x7f14f4131740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f14f002bdd0 tx=0x7f14f00046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 shutdown_connections 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f14d803d830 0x7f14d803fc70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f14d80380b0 0x7f14d803a570 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 --2- 172.21.15.45:0/2770752378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f14f406e010 0x7f14f4131740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 >> 172.21.15.45:0/2770752378 conn(0x7f14f40996c0 msgr2=0x7f14f408e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 shutdown_connections 2024-05-08T09:21:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:21.935+0000 7f14fb550640 1 -- 172.21.15.45:0/2770752378 wait complete. 2024-05-08T09:21:21.945 INFO:teuthology.orchestra.run.smithi045.stdout:38654705668 2024-05-08T09:21:21.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T09:21:21.949 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:21.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T09:21:22.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.052+0000 7f4418b3b640 1 Processor -- start 2024-05-08T09:21:22.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.052+0000 7f4418b3b640 1 -- start start 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4418b3b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f441406dfe0 0x7f44141337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4418b3b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44140720b0 con 0x7f441406d4f0 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4418b3b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f441406f6b0 con 0x7f441406dfe0 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4411d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f441406dfe0 0x7f44141337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f441259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f441406d4f0 0x7f441406d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36038/0 (socket says 172.21.15.45:36038) 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f441259c640 1 -- 172.21.15.45:0/1978317486 learned_addr learned my addr 172.21.15.45:0/1978317486 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4411d9b640 1 -- 172.21.15.45:0/1978317486 >> v1:172.21.15.45:6789/0 conn(0x7f441406d4f0 legacy=0x7f441406d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f441159a640 1 -- 172.21.15.45:0/1978317486 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638653566 0 0) 0x7f44140720b0 con 0x7f441406d4f0 2024-05-08T09:21:22.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.053+0000 7f4411d9b640 1 -- 172.21.15.45:0/1978317486 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441406e710 con 0x7f441406dfe0 2024-05-08T09:21:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.054+0000 7f4411d9b640 1 --2- 172.21.15.45:0/1978317486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406dfe0 0x7f44141337c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4408009720 tx=0x7f440802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8921edcd80813e1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.054+0000 7f441159a640 1 -- 172.21.15.45:0/1978317486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44080316d0 con 0x7f441406dfe0 2024-05-08T09:21:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.054+0000 7f441159a640 1 -- 172.21.15.45:0/1978317486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4408037070 con 0x7f441406dfe0 2024-05-08T09:21:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.054+0000 7f441159a640 1 -- 172.21.15.45:0/1978317486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44080319c0 con 0x7f441406dfe0 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 -- 172.21.15.45:0/1978317486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406dfe0 msgr2=0x7f44141337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 --2- 172.21.15.45:0/1978317486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406dfe0 0x7f44141337c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4408009720 tx=0x7f440802b840 comp rx=0 tx=0).stop 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 -- 172.21.15.45:0/1978317486 shutdown_connections 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 --2- 172.21.15.45:0/1978317486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406dfe0 0x7f44141337c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 -- 172.21.15.45:0/1978317486 >> 172.21.15.45:0/1978317486 conn(0x7f441409d750 msgr2=0x7f441409db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 -- 172.21.15.45:0/1978317486 shutdown_connections 2024-05-08T09:21:22.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.055+0000 7f4418b3b640 1 -- 172.21.15.45:0/1978317486 wait complete. 2024-05-08T09:21:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.057+0000 7f4418b3b640 1 Processor -- start 2024-05-08T09:21:22.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.057+0000 7f4418b3b640 1 -- start start 2024-05-08T09:21:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f4418b3b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f4418b3b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f441409fe30 con 0x7f441406d4f0 2024-05-08T09:21:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f441259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f441259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44400/0 (socket says 172.21.15.45:44400) 2024-05-08T09:21:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f441259c640 1 -- 172.21.15.45:0/217839877 learned_addr learned my addr 172.21.15.45:0/217839877 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f441259c640 1 -- 172.21.15.45:0/217839877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441412b5a0 con 0x7f441406d4f0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f441259c640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f440400c420 tx=0x7f440400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404018070 con 0x7f441406d4f0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.058+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44040074d0 con 0x7f441406d4f0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.059+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441412a6e0 con 0x7f441406d4f0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.059+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4404004950 con 0x7f441406d4f0 2024-05-08T09:21:22.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.059+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4414128440 con 0x7f441406d4f0 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.060+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4414128e10 con 0x7f441406d4f0 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.060+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f440401b070 con 0x7f441406d4f0 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.060+0000 7f4402ffd640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 0x7f43f403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.060+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f440404a2c0 con 0x7f441406d4f0 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.060+0000 7f4411d9b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 0x7f43f403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.061+0000 7f4411d9b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 0x7f43f403a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4408036000 tx=0x7f4408008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.069+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4404011bf0 con 0x7f441406d4f0 2024-05-08T09:21:22.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.096+0000 7fc257580640 1 Processor -- start 2024-05-08T09:21:22.096 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.096+0000 7f28285bd640 1 Processor -- start 2024-05-08T09:21:22.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f28285bd640 1 -- start start 2024-05-08T09:21:22.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc257580640 1 -- start start 2024-05-08T09:21:22.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f28285bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f282012db20 0x7f282012ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc257580640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc25006dfe0 0x7fc2501337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f28285bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282006f120 con 0x7f282006d6f0 2024-05-08T09:21:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f28285bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f282006e800 con 0x7f282012db20 2024-05-08T09:21:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc257580640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2500720b0 con 0x7fc25006d4f0 2024-05-08T09:21:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc257580640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fc25006f6b0 con 0x7fc25006dfe0 2024-05-08T09:21:22.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc254b1b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc25006dfe0 0x7fc2501337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7fc254b1b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc25006dfe0 0x7fc2501337c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44414/0 (socket says 172.21.15.45:44414) 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7fc254b1b640 1 -- 172.21.15.45:0/2208665358 learned_addr learned my addr 172.21.15.45:0/2208665358 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f2825b58640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f282012db20 0x7f282012ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f2825b58640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f282012db20 0x7f282012ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44410/0 (socket says 172.21.15.45:44410) 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.097+0000 7f2825b58640 1 -- 172.21.15.45:0/2670955884 learned_addr learned my addr 172.21.15.45:0/2670955884 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7fc254b1b640 1 -- 172.21.15.45:0/2208665358 >> v1:172.21.15.45:6789/0 conn(0x7fc25006d4f0 legacy=0x7fc25006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7fc254b1b640 1 -- 172.21.15.45:0/2208665358 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25006e710 con 0x7fc25006dfe0 2024-05-08T09:21:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7f2825b58640 1 -- 172.21.15.45:0/2670955884 >> v1:172.21.15.45:6789/0 conn(0x7f282006d6f0 legacy=0x7f282006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7f2825b58640 1 -- 172.21.15.45:0/2670955884 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2820071b20 con 0x7f282012db20 2024-05-08T09:21:22.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.098+0000 7f2825357640 1 -- 172.21.15.45:0/2670955884 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502748319 0 0) 0x7f282006f120 con 0x7f282006d6f0 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7f2825b58640 1 --2- 172.21.15.45:0/2670955884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282012db20 0x7f282012ff10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f281000bab0 tx=0x7f281002dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2152c02f7a444010 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7f2825357640 1 -- 172.21.15.45:0/2670955884 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810034070 con 0x7f282012db20 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7f2825357640 1 -- 172.21.15.45:0/2670955884 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281002eb80 con 0x7f282012db20 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7f2825357640 1 -- 172.21.15.45:0/2670955884 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2810038400 con 0x7f282012db20 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7fc254b1b640 1 --2- 172.21.15.45:0/2208665358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006dfe0 0x7fc2501337c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2400097f0 tx=0x7fc24002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978672b7199334de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7fc247fff640 1 -- 172.21.15.45:0/2208665358 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc240035020 con 0x7fc25006dfe0 2024-05-08T09:21:22.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7fc247fff640 1 -- 172.21.15.45:0/2208665358 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2400317a0 con 0x7fc25006dfe0 2024-05-08T09:21:22.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.099+0000 7fc247fff640 1 -- 172.21.15.45:0/2208665358 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc240031aa0 con 0x7fc25006dfe0 2024-05-08T09:21:22.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 -- 172.21.15.45:0/2670955884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282012db20 msgr2=0x7f282012ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 --2- 172.21.15.45:0/2670955884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282012db20 0x7f282012ff10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f281000bab0 tx=0x7f281002dea0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f04a8231640 1 Processor -- start 2024-05-08T09:21:22.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 -- 172.21.15.45:0/2670955884 shutdown_connections 2024-05-08T09:21:22.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 --2- 172.21.15.45:0/2670955884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282012db20 0x7f282012ff10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 -- 172.21.15.45:0/2670955884 >> 172.21.15.45:0/2670955884 conn(0x7f28200996c0 msgr2=0x7f2820099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 -- 172.21.15.45:0/2670955884 shutdown_connections 2024-05-08T09:21:22.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f28285bd640 1 -- 172.21.15.45:0/2670955884 wait complete. 2024-05-08T09:21:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7f04a8231640 1 -- start start 2024-05-08T09:21:22.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 -- 172.21.15.45:0/2208665358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006dfe0 msgr2=0x7fc2501337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 --2- 172.21.15.45:0/2208665358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006dfe0 0x7fc2501337c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc2400097f0 tx=0x7fc24002b910 comp rx=0 tx=0).stop 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 -- 172.21.15.45:0/2208665358 shutdown_connections 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 --2- 172.21.15.45:0/2208665358 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006dfe0 0x7fc2501337c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 -- 172.21.15.45:0/2208665358 >> 172.21.15.45:0/2208665358 conn(0x7fc25009d750 msgr2=0x7fc25009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.100+0000 7fc257580640 1 -- 172.21.15.45:0/2208665358 shutdown_connections 2024-05-08T09:21:22.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7fc257580640 1 -- 172.21.15.45:0/2208665358 wait complete. 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a8231640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a006d4f0 0x7f04a006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a8231640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04a00720b0 con 0x7f04a006de10 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a8231640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f04a006f6b0 con 0x7f04a006d4f0 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a5fcd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a006d4f0 0x7f04a006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a5fcd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a006d4f0 0x7f04a006d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44420/0 (socket says 172.21.15.45:44420) 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a5fcd640 1 -- 172.21.15.45:0/2135936361 learned_addr learned my addr 172.21.15.45:0/2135936361 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f28285bd640 1 Processor -- start 2024-05-08T09:21:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f28285bd640 1 -- start start 2024-05-08T09:21:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a5fcd640 1 -- 172.21.15.45:0/2135936361 >> v1:172.21.15.45:6789/0 conn(0x7f04a006de10 legacy=0x7f04a009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f04a5fcd640 1 -- 172.21.15.45:0/2135936361 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a006e710 con 0x7f04a006d4f0 2024-05-08T09:21:22.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.101+0000 7f28285bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f28285bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2820071660 con 0x7f282006d6f0 2024-05-08T09:21:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7fc257580640 1 Processor -- start 2024-05-08T09:21:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f2826359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7fc257580640 1 -- start start 2024-05-08T09:21:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f2826359640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44428/0 (socket says 172.21.15.45:44428) 2024-05-08T09:21:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f2826359640 1 -- 172.21.15.45:0/2083395445 learned_addr learned my addr 172.21.15.45:0/2083395445 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f04a5fcd640 1 --2- 172.21.15.45:0/2135936361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a006d8d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f049c0097f0 tx=0x7f049c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3e24530a8d9b50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7fc257580640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7fc257580640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fc25009fe30 con 0x7fc25006d4f0 2024-05-08T09:21:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f04a4fcb640 1 -- 172.21.15.45:0/2135936361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c035020 con 0x7f04a006d4f0 2024-05-08T09:21:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.102+0000 7f2826359640 1 -- 172.21.15.45:0/2083395445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282012d460 con 0x7f282006d6f0 2024-05-08T09:21:22.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f04a4fcb640 1 -- 172.21.15.45:0/2135936361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c0317a0 con 0x7f04a006d4f0 2024-05-08T09:21:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc25531c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc25531c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44440/0 (socket says 172.21.15.45:44440) 2024-05-08T09:21:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc25531c640 1 -- 172.21.15.45:0/2546448407 learned_addr learned my addr 172.21.15.45:0/2546448407 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f04a4fcb640 1 -- 172.21.15.45:0/2135936361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c031aa0 con 0x7f04a006d4f0 2024-05-08T09:21:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f2826359640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c340 tx=0x7f281c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c017070 con 0x7f282006d6f0 2024-05-08T09:21:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc25531c640 1 -- 172.21.15.45:0/2546448407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25012a360 con 0x7fc25006d4f0 2024-05-08T09:21:22.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282008f2c0 con 0x7f282006d6f0 2024-05-08T09:21:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c005410 con 0x7f282006d6f0 2024-05-08T09:21:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc25531c640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c450 tx=0x7fc24c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282008ec30 con 0x7f282006d6f0 2024-05-08T09:21:22.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f281c003760 con 0x7f282006d6f0 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.103+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc24c017070 con 0x7fc25006d4f0 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 -- 172.21.15.45:0/2135936361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 msgr2=0x7f04a006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 --2- 172.21.15.45:0/2135936361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a006d8d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f049c0097f0 tx=0x7f049c02b910 comp rx=0 tx=0).stop 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 -- 172.21.15.45:0/2135936361 shutdown_connections 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 --2- 172.21.15.45:0/2135936361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a006d8d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 -- 172.21.15.45:0/2135936361 >> 172.21.15.45:0/2135936361 conn(0x7f04a009d750 msgr2=0x7f04a009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 -- 172.21.15.45:0/2135936361 shutdown_connections 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f04a8231640 1 -- 172.21.15.45:0/2135936361 wait complete. 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f281c01a070 con 0x7f282006d6f0 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25012a820 con 0x7fc25006d4f0 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc24c005220 con 0x7fc25006d4f0 2024-05-08T09:21:22.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc24c0035f0 con 0x7fc25006d4f0 2024-05-08T09:21:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2501281a0 con 0x7fc25006d4f0 2024-05-08T09:21:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.104+0000 7f2816ffd640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 0x7f280403a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.105+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f281c04a370 con 0x7f282006d6f0 2024-05-08T09:21:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.105+0000 7f2825b58640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 0x7f280403a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.105+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282008ee60 con 0x7f282006d6f0 2024-05-08T09:21:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.105+0000 7f2825b58640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 0x7f280403a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2810039000 tx=0x7f2810034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc250062e90 con 0x7fc25006d4f0 2024-05-08T09:21:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc24c01a070 con 0x7fc25006d4f0 2024-05-08T09:21:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7f04a8231640 1 Processor -- start 2024-05-08T09:21:22.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7f04a8231640 1 -- start start 2024-05-08T09:21:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7fc245ffb640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 0x7fc23403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fc24c04a2f0 con 0x7fc25006d4f0 2024-05-08T09:21:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7f04a8231640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7f04a8231640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f04a006ed30 con 0x7f04a006d4f0 2024-05-08T09:21:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.106+0000 7fc254b1b640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 0x7fc23403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7f04a5fcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7f04a5fcd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44452/0 (socket says 172.21.15.45:44452) 2024-05-08T09:21:22.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7f04a5fcd640 1 -- 172.21.15.45:0/4096136019 learned_addr learned my addr 172.21.15.45:0/4096136019 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7fc254b1b640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 0x7fc23403a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc240036000 tx=0x7fc240008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7f04a5fcd640 1 -- 172.21.15.45:0/4096136019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a008fb90 con 0x7f04a006d4f0 2024-05-08T09:21:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.107+0000 7f04a5fcd640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f049c02b950 tx=0x7f049c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.110+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f281c01b730 con 0x7f282006d6f0 2024-05-08T09:21:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.114+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c040070 con 0x7f04a006d4f0 2024-05-08T09:21:22.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.114+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fc24c019e10 con 0x7fc25006d4f0 2024-05-08T09:21:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.114+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c03a420 con 0x7f04a006d4f0 2024-05-08T09:21:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.114+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049c035040 con 0x7f04a006d4f0 2024-05-08T09:21:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.114+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a012ba10 con 0x7f04a006d4f0 2024-05-08T09:21:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.115+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a01c38a0 con 0x7f04a006d4f0 2024-05-08T09:21:22.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.116+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a008f6f0 con 0x7f04a006d4f0 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.116+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f049c04b060 con 0x7f04a006d4f0 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.116+0000 7f04967fc640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 0x7f048403a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.116+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f049c031730 con 0x7f04a006d4f0 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.117+0000 7f04a57cc640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 0x7f048403a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.117+0000 7f04a57cc640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 0x7f048403a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0490000f60 tx=0x7f0490007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:22.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.121+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f049c04b710 con 0x7f04a006d4f0 2024-05-08T09:21:22.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.258+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4414062e90 con 0x7f441406d4f0 2024-05-08T09:21:22.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.259+0000 7f4402ffd640 1 -- 172.21.15.45:0/217839877 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f440401c8d0 con 0x7f441406d4f0 2024-05-08T09:21:22.258 INFO:teuthology.orchestra.run.smithi045.stdout:38654705666 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.260+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 msgr2=0x7f43f403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.260+0000 7f4418b3b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 0x7f43f403a520 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4408036000 tx=0x7f4408008030 comp rx=0 tx=0).stop 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.260+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 msgr2=0x7f4414127d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.260+0000 7f4418b3b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f440400c420 tx=0x7f440400c8e0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 shutdown_connections 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f43f4038060 0x7f43f403a520 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 --2- 172.21.15.45:0/217839877 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f441406d4f0 0x7f4414127d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 >> 172.21.15.45:0/217839877 conn(0x7f441409d750 msgr2=0x7f44140708e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 shutdown_connections 2024-05-08T09:21:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.261+0000 7f4418b3b640 1 -- 172.21.15.45:0/217839877 wait complete. 2024-05-08T09:21:22.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.1 2024-05-08T09:21:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.298+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2820062e90 con 0x7f282006d6f0 2024-05-08T09:21:22.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.299+0000 7f2816ffd640 1 -- 172.21.15.45:0/2083395445 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f281c0192c0 con 0x7f282006d6f0 2024-05-08T09:21:22.299 INFO:teuthology.orchestra.run.smithi045.stdout:38654705666 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 msgr2=0x7f280403a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 0x7f280403a5c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2810039000 tx=0x7f2810034000 comp rx=0 tx=0).stop 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 msgr2=0x7f282008bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f281c00c340 tx=0x7f281c00c800 comp rx=0 tx=0).stop 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 shutdown_connections 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2804038100 0x7f280403a5c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 --2- 172.21.15.45:0/2083395445 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f282006d6f0 0x7f282008bfa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 >> 172.21.15.45:0/2083395445 conn(0x7f28200996c0 msgr2=0x7f2820127c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 shutdown_connections 2024-05-08T09:21:22.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.301+0000 7f28285bd640 1 -- 172.21.15.45:0/2083395445 wait complete. 2024-05-08T09:21:22.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.303+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc2501296f0 con 0x7fc25006d4f0 2024-05-08T09:21:22.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.303+0000 7fc245ffb640 1 -- 172.21.15.45:0/2546448407 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc24c01a760 con 0x7fc25006d4f0 2024-05-08T09:21:22.303 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 msgr2=0x7fc23403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 0x7fc23403a520 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc240036000 tx=0x7fc240008030 comp rx=0 tx=0).stop 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 msgr2=0x7fc250127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c450 tx=0x7fc24c00c910 comp rx=0 tx=0).stop 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 shutdown_connections 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc234038060 0x7fc23403a520 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 --2- 172.21.15.45:0/2546448407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc25006d4f0 0x7fc250127c60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 >> 172.21.15.45:0/2546448407 conn(0x7fc25009d750 msgr2=0x7fc250070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 shutdown_connections 2024-05-08T09:21:22.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.306+0000 7fc257580640 1 -- 172.21.15.45:0/2546448407 wait complete. 2024-05-08T09:21:22.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.308+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f04a0062e90 con 0x7f04a006d4f0 2024-05-08T09:21:22.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.308+0000 7f04967fc640 1 -- 172.21.15.45:0/4096136019 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f049c04b940 con 0x7f04a006d4f0 2024-05-08T09:21:22.308 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 msgr2=0x7f048403a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 0x7f048403a570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0490000f60 tx=0x7f0490007a30 comp rx=0 tx=0).stop 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 msgr2=0x7f04a01c3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f049c02b950 tx=0x7f049c0046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 shutdown_connections 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04840380b0 0x7f048403a570 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 --2- 172.21.15.45:0/4096136019 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a006d4f0 0x7f04a01c3180 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 >> 172.21.15.45:0/4096136019 conn(0x7f04a009d750 msgr2=0x7f04a009b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 shutdown_connections 2024-05-08T09:21:22.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:22.311+0000 7f04a8231640 1 -- 172.21.15.45:0/4096136019 wait complete. 2024-05-08T09:21:22.312 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.2 2024-05-08T09:21:22.318 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.0 2024-05-08T09:21:22.321 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705667 for osd.3 2024-05-08T09:21:23.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-08T09:21:23.313 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-08T09:21:23.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-08T09:21:23.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-08T09:21:23.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.393+0000 7f817fd52640 1 Processor -- start 2024-05-08T09:21:23.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.393+0000 7f817fd52640 1 -- start start 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817fd52640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f817806dfe0 0x7f81781337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817fd52640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81780720b0 con 0x7f817806d4f0 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817fd52640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f817806f6b0 con 0x7f817806dfe0 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817d2ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f817806dfe0 0x7f81781337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817daee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f817806d4f0 0x7f817806d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36068/0 (socket says 172.21.15.45:36068) 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817daee640 1 -- 172.21.15.45:0/3658388324 learned_addr learned my addr 172.21.15.45:0/3658388324 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817d2ed640 1 -- 172.21.15.45:0/3658388324 >> v1:172.21.15.45:6789/0 conn(0x7f817806d4f0 legacy=0x7f817806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.394+0000 7f817d2ed640 1 -- 172.21.15.45:0/3658388324 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817806e710 con 0x7f817806dfe0 2024-05-08T09:21:23.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.395+0000 7f817d2ed640 1 --2- 172.21.15.45:0/3658388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806dfe0 0x7f81781337c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8168009720 tx=0x7f816802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7dd47884193feb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.396+0000 7f817caec640 1 -- 172.21.15.45:0/3658388324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81680316d0 con 0x7f817806dfe0 2024-05-08T09:21:23.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.396+0000 7f817caec640 1 -- 172.21.15.45:0/3658388324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8168037070 con 0x7f817806dfe0 2024-05-08T09:21:23.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.396+0000 7f817caec640 1 -- 172.21.15.45:0/3658388324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f81680319c0 con 0x7f817806dfe0 2024-05-08T09:21:23.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 -- 172.21.15.45:0/3658388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806dfe0 msgr2=0x7f81781337c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 --2- 172.21.15.45:0/3658388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806dfe0 0x7f81781337c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8168009720 tx=0x7f816802b840 comp rx=0 tx=0).stop 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 -- 172.21.15.45:0/3658388324 shutdown_connections 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 --2- 172.21.15.45:0/3658388324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806dfe0 0x7f81781337c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 -- 172.21.15.45:0/3658388324 >> 172.21.15.45:0/3658388324 conn(0x7f817809d750 msgr2=0x7f817809db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 -- 172.21.15.45:0/3658388324 shutdown_connections 2024-05-08T09:21:23.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.397+0000 7f817fd52640 1 -- 172.21.15.45:0/3658388324 wait complete. 2024-05-08T09:21:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.398+0000 7f817fd52640 1 Processor -- start 2024-05-08T09:21:23.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.398+0000 7f817fd52640 1 -- start start 2024-05-08T09:21:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.399+0000 7f817fd52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.399+0000 7f817fd52640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f817809fe30 con 0x7f817806d4f0 2024-05-08T09:21:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.399+0000 7f817daee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.399+0000 7f817daee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44478/0 (socket says 172.21.15.45:44478) 2024-05-08T09:21:23.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.399+0000 7f817daee640 1 -- 172.21.15.45:0/2584075114 learned_addr learned my addr 172.21.15.45:0/2584075114 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f817daee640 1 -- 172.21.15.45:0/2584075114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f817812a360 con 0x7f817806d4f0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f817daee640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f817400c4a0 tx=0x7f817400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8174017070 con 0x7f817806d4f0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8174005c10 con 0x7f817806d4f0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f817812a820 con 0x7f817806d4f0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8174007070 con 0x7f817806d4f0 2024-05-08T09:21:23.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.400+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81781281a0 con 0x7f817806d4f0 2024-05-08T09:21:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.401+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8178062e90 con 0x7f817806d4f0 2024-05-08T09:21:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.402+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f817401a070 con 0x7f817806d4f0 2024-05-08T09:21:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.402+0000 7f816e7fc640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 0x7f815c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.402+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f817404a200 con 0x7f817806d4f0 2024-05-08T09:21:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.402+0000 7f817d2ed640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 0x7f815c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.403+0000 7f817d2ed640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 0x7f815c03a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8168036000 tx=0x7f8168008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.411+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f8174012400 con 0x7f817806d4f0 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ed62d2640 1 Processor -- start 2024-05-08T09:21:23.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ed62d2640 1 -- start start 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ed62d2640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ed006d4f0 0x7f1ed006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ed62d2640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed00720b0 con 0x7f1ed006de10 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ed62d2640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f1ed006f6b0 con 0x7f1ed006d4f0 2024-05-08T09:21:23.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ecffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ed006d4f0 0x7f1ed006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ecf7fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ed006de10 0x7f1ed009a4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36070/0 (socket says 172.21.15.45:36070) 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.432+0000 7f1ecf7fe640 1 -- 172.21.15.45:0/163257767 learned_addr learned my addr 172.21.15.45:0/163257767 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.433+0000 7f1ecffff640 1 -- 172.21.15.45:0/163257767 >> v1:172.21.15.45:6789/0 conn(0x7f1ed006de10 legacy=0x7f1ed009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.433+0000 7f1ecffff640 1 -- 172.21.15.45:0/163257767 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed006e710 con 0x7f1ed006d4f0 2024-05-08T09:21:23.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.434+0000 7f1ecffff640 1 --2- 172.21.15.45:0/163257767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed006d8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009720 tx=0x7f1ec002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfca81f01133391 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.434+0000 7f1eceffd640 1 -- 172.21.15.45:0/163257767 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec00316d0 con 0x7f1ed006d4f0 2024-05-08T09:21:23.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.434+0000 7f1eceffd640 1 -- 172.21.15.45:0/163257767 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec0037070 con 0x7f1ed006d4f0 2024-05-08T09:21:23.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.434+0000 7f1eceffd640 1 -- 172.21.15.45:0/163257767 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec00319c0 con 0x7f1ed006d4f0 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 -- 172.21.15.45:0/163257767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 msgr2=0x7f1ed006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/163257767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed006d8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009720 tx=0x7f1ec002b840 comp rx=0 tx=0).stop 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 -- 172.21.15.45:0/163257767 shutdown_connections 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/163257767 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed006d8d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 -- 172.21.15.45:0/163257767 >> 172.21.15.45:0/163257767 conn(0x7f1ed009d750 msgr2=0x7f1ed009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 -- 172.21.15.45:0/163257767 shutdown_connections 2024-05-08T09:21:23.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.435+0000 7f1ed62d2640 1 -- 172.21.15.45:0/163257767 wait complete. 2024-05-08T09:21:23.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.436+0000 7f1ed62d2640 1 Processor -- start 2024-05-08T09:21:23.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.436+0000 7f1ed62d2640 1 -- start start 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ed62d2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ed62d2640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1ed006ed30 con 0x7f1ed006d4f0 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ecffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44494/0 (socket says 172.21.15.45:44494) 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ecffff640 1 -- 172.21.15.45:0/2413054415 learned_addr learned my addr 172.21.15.45:0/2413054415 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.437+0000 7f1ecffff640 1 -- 172.21.15.45:0/2413054415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed012a2e0 con 0x7f1ed006d4f0 2024-05-08T09:21:23.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.438+0000 7f1ecffff640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009840 tx=0x7f1ec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.438+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0032770 con 0x7f1ed006d4f0 2024-05-08T09:21:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.438+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec0032910 con 0x7f1ed006d4f0 2024-05-08T09:21:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.438+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed012aa60 con 0x7f1ed006d4f0 2024-05-08T09:21:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.438+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0032c30 con 0x7f1ed006d4f0 2024-05-08T09:21:23.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.439+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ed008e910 con 0x7f1ed006d4f0 2024-05-08T09:21:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.439+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1ec004c060 con 0x7f1ed006d4f0 2024-05-08T09:21:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.440+0000 7f1eccff9640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 0x7f1ebc03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.440+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f1ec0072060 con 0x7f1ed006d4f0 2024-05-08T09:21:23.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.440+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ed0062e90 con 0x7f1ed006d4f0 2024-05-08T09:21:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.440+0000 7f1ecf7fe640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 0x7f1ebc03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.440+0000 7f1ecf7fe640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 0x7f1ebc03a4d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4007fd0 tx=0x7f1ec4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.449+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1ec0040070 con 0x7f1ed006d4f0 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29f53d7640 1 Processor -- start 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29f53d7640 1 -- start start 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29f53d7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f006d4f0 0x7f29f006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29f53d7640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29f00720b0 con 0x7f29f006de10 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29f53d7640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f29f006f6b0 con 0x7f29f006d4f0 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29eeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f006d4f0 0x7f29f006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29eeffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f29f006d4f0 0x7f29f006d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44502/0 (socket says 172.21.15.45:44502) 2024-05-08T09:21:23.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.472+0000 7f29eeffd640 1 -- 172.21.15.45:0/3931332122 learned_addr learned my addr 172.21.15.45:0/3931332122 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.473+0000 7f29edffb640 1 -- 172.21.15.45:0/3931332122 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486794865 0 0) 0x7f29f00720b0 con 0x7f29f006de10 2024-05-08T09:21:23.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.473+0000 7f29edffb640 1 -- 172.21.15.45:0/3931332122 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29d8003520 con 0x7f29f006de10 2024-05-08T09:21:23.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.473+0000 7f29eeffd640 1 -- 172.21.15.45:0/3931332122 >> v1:172.21.15.45:6789/0 conn(0x7f29f006de10 legacy=0x7f29f009a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.473+0000 7f29eeffd640 1 -- 172.21.15.45:0/3931332122 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f006e710 con 0x7f29f006d4f0 2024-05-08T09:21:23.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.474+0000 7f29eeffd640 1 --2- 172.21.15.45:0/3931332122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f006d8d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44844d6c81de33be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.474+0000 7f29edffb640 1 -- 172.21.15.45:0/3931332122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e0035020 con 0x7f29f006d4f0 2024-05-08T09:21:23.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.474+0000 7f29edffb640 1 -- 172.21.15.45:0/3931332122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e00317a0 con 0x7f29f006d4f0 2024-05-08T09:21:23.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.474+0000 7f29edffb640 1 -- 172.21.15.45:0/3931332122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e0031aa0 con 0x7f29f006d4f0 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 -- 172.21.15.45:0/3931332122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 msgr2=0x7f29f006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 --2- 172.21.15.45:0/3931332122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f006d8d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e002b910 comp rx=0 tx=0).stop 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 -- 172.21.15.45:0/3931332122 shutdown_connections 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 --2- 172.21.15.45:0/3931332122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f006d8d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 -- 172.21.15.45:0/3931332122 >> 172.21.15.45:0/3931332122 conn(0x7f29f009d750 msgr2=0x7f29f009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 -- 172.21.15.45:0/3931332122 shutdown_connections 2024-05-08T09:21:23.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.475+0000 7f29f53d7640 1 -- 172.21.15.45:0/3931332122 wait complete. 2024-05-08T09:21:23.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.477+0000 7f29f53d7640 1 Processor -- start 2024-05-08T09:21:23.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.477+0000 7f29f53d7640 1 -- start start 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29f53d7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29f53d7640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f29f006ed30 con 0x7f29f006d4f0 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29eeffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44518/0 (socket says 172.21.15.45:44518) 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29eeffd640 1 -- 172.21.15.45:0/1309553827 learned_addr learned my addr 172.21.15.45:0/1309553827 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.478+0000 7f29eeffd640 1 -- 172.21.15.45:0/1309553827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f008e910 con 0x7f29f006d4f0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29eeffd640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e0040070 con 0x7f29f006d4f0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e0031e10 con 0x7f29f006d4f0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f008ed50 con 0x7f29f006d4f0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29e0035040 con 0x7f29f006d4f0 2024-05-08T09:21:23.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f01c0200 con 0x7f29f006d4f0 2024-05-08T09:21:23.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f121da5c640 1 Processor -- start 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.479+0000 7f121da5c640 1 -- start start 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f121da5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f121806e670 0x7f12181339a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f121da5c640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f121806f570 con 0x7f121806db80 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f121da5c640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f121806fa00 con 0x7f121806e670 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f1216ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f121806db80 0x7f121806df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36076/0 (socket says 172.21.15.45:36076) 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f1216ffd640 1 -- 172.21.15.45:0/2358389074 learned_addr learned my addr 172.21.15.45:0/2358389074 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f12167fc640 1 --2- 172.21.15.45:0/2358389074 >> v2:172.21.15.45:3300/0 conn(0x7f121806e670 0x7f12181339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f12167fc640 1 -- 172.21.15.45:0/2358389074 >> v1:172.21.15.45:6789/0 conn(0x7f121806db80 legacy=0x7f121806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.480+0000 7f12167fc640 1 -- 172.21.15.45:0/2358389074 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121806f320 con 0x7f121806e670 2024-05-08T09:21:23.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f29e004b060 con 0x7f29f006d4f0 2024-05-08T09:21:23.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f29d77fe640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 0x7f29dc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f29e006cc90 con 0x7f29f006d4f0 2024-05-08T09:21:23.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29f008e4f0 con 0x7f29f006d4f0 2024-05-08T09:21:23.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f12167fc640 1 --2- 172.21.15.45:0/2358389074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806e670 0x7f12181339a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f120c009720 tx=0x7f120c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846374552949315 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.481+0000 7f29ee7fc640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 0x7f29dc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.482+0000 7f29ee7fc640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 0x7f29dc03a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007fd0 tx=0x7f29e4007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.490+0000 7f1215ffb640 1 -- 172.21.15.45:0/2358389074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c0316d0 con 0x7f121806e670 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.490+0000 7f1215ffb640 1 -- 172.21.15.45:0/2358389074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120c037070 con 0x7f121806e670 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.490+0000 7f1215ffb640 1 -- 172.21.15.45:0/2358389074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f120c0319c0 con 0x7f121806e670 2024-05-08T09:21:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f29e004be10 con 0x7f29f006d4f0 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 -- 172.21.15.45:0/2358389074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806e670 msgr2=0x7f12181339a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 --2- 172.21.15.45:0/2358389074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806e670 0x7f12181339a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f120c009720 tx=0x7f120c02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 -- 172.21.15.45:0/2358389074 shutdown_connections 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 --2- 172.21.15.45:0/2358389074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806e670 0x7f12181339a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 -- 172.21.15.45:0/2358389074 >> 172.21.15.45:0/2358389074 conn(0x7f121809eda0 msgr2=0x7f121809f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 -- 172.21.15.45:0/2358389074 shutdown_connections 2024-05-08T09:21:23.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.491+0000 7f121da5c640 1 -- 172.21.15.45:0/2358389074 wait complete. 2024-05-08T09:21:23.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.492+0000 7f121da5c640 1 Processor -- start 2024-05-08T09:21:23.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f121da5c640 1 -- start start 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f121da5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f121da5c640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1218134060 con 0x7f121806db80 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f1216ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f1216ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44538/0 (socket says 172.21.15.45:44538) 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f1216ffd640 1 -- 172.21.15.45:0/4227650699 learned_addr learned my addr 172.21.15.45:0/4227650699 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.493+0000 7f1216ffd640 1 -- 172.21.15.45:0/4227650699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1218129b40 con 0x7f121806db80 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f1216ffd640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f120800c4a0 tx=0x7f120800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1208017070 con 0x7f121806db80 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1208005c10 con 0x7f121806db80 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1208007070 con 0x7f121806db80 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f121812b6c0 con 0x7f121806db80 2024-05-08T09:21:23.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.494+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f121809afa0 con 0x7f121806db80 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.495+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f120801a070 con 0x7f121806db80 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.495+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1218062e90 con 0x7f121806db80 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.496+0000 7f11fffff640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 0x7f120403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.496+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f120804a260 con 0x7f121806db80 2024-05-08T09:21:23.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.496+0000 7f12167fc640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 0x7f120403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.497+0000 7f12167fc640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 0x7f120403a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f120c036000 tx=0x7f120c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.501+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1218129b40 con 0x7f121806db80 2024-05-08T09:21:23.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.605+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f81781296f0 con 0x7f817806d4f0 2024-05-08T09:21:23.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.606+0000 7f816e7fc640 1 -- 172.21.15.45:0/2584075114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f817401ac10 con 0x7f817806d4f0 2024-05-08T09:21:23.606 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 msgr2=0x7f815c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 0x7f815c03a520 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8168036000 tx=0x7f8168008030 comp rx=0 tx=0).stop 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 msgr2=0x7f8178127c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f817400c4a0 tx=0x7f817400c960 comp rx=0 tx=0).stop 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 shutdown_connections 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f815c038060 0x7f815c03a520 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.608 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 --2- 172.21.15.45:0/2584075114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f817806d4f0 0x7f8178127c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 >> 172.21.15.45:0/2584075114 conn(0x7f817809d750 msgr2=0x7f8178070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 shutdown_connections 2024-05-08T09:21:23.609 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.608+0000 7f817fd52640 1 -- 172.21.15.45:0/2584075114 wait complete. 2024-05-08T09:21:23.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.1 2024-05-08T09:21:23.620 DEBUG:teuthology.parallel:result is None 2024-05-08T09:21:23.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.643+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1ed008eb40 con 0x7f1ed006d4f0 2024-05-08T09:21:23.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.643+0000 7f1eccff9640 1 -- 172.21.15.45:0/2413054415 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ec003ad50 con 0x7f1ed006d4f0 2024-05-08T09:21:23.643 INFO:teuthology.orchestra.run.smithi045.stdout:38654705667 2024-05-08T09:21:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 msgr2=0x7f1ebc03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 0x7f1ebc03a4d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4007fd0 tx=0x7f1ec4007ac0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 msgr2=0x7f1ed01bf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009840 tx=0x7f1ec00046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 shutdown_connections 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ebc038010 0x7f1ebc03a4d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 --2- 172.21.15.45:0/2413054415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ed006d4f0 0x7f1ed01bf900 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.645+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 >> 172.21.15.45:0/2413054415 conn(0x7f1ed009d750 msgr2=0x7f1ed009b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.646+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 shutdown_connections 2024-05-08T09:21:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.646+0000 7f1ed62d2640 1 -- 172.21.15.45:0/2413054415 wait complete. 2024-05-08T09:21:23.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.2 2024-05-08T09:21:23.656 DEBUG:teuthology.parallel:result is None 2024-05-08T09:21:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.701+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f29f0062e90 con 0x7f29f006d4f0 2024-05-08T09:21:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.701+0000 7f29d77fe640 1 -- 172.21.15.45:0/1309553827 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f29e0030dd0 con 0x7f29f006d4f0 2024-05-08T09:21:23.701 INFO:teuthology.orchestra.run.smithi045.stdout:38654705668 2024-05-08T09:21:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 msgr2=0x7f29dc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 0x7f29dc03a520 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f29e4007fd0 tx=0x7f29e4007920 comp rx=0 tx=0).stop 2024-05-08T09:21:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 msgr2=0x7f29f01bfae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097f0 tx=0x7f29e00046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 shutdown_connections 2024-05-08T09:21:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f29dc038060 0x7f29dc03a520 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 --2- 172.21.15.45:0/1309553827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29f006d4f0 0x7f29f01bfae0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 >> 172.21.15.45:0/1309553827 conn(0x7f29f009d750 msgr2=0x7f29f009b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 shutdown_connections 2024-05-08T09:21:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.703+0000 7f29f53d7640 1 -- 172.21.15.45:0/1309553827 wait complete. 2024-05-08T09:21:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.711+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f121809b290 con 0x7f121806db80 2024-05-08T09:21:23.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.712+0000 7f11fffff640 1 -- 172.21.15.45:0/4227650699 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f120801b3b0 con 0x7f121806db80 2024-05-08T09:21:23.711 INFO:teuthology.orchestra.run.smithi045.stdout:38654705668 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 msgr2=0x7f120403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 0x7f120403a520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f120c036000 tx=0x7f120c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 msgr2=0x7f121809aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f120800c4a0 tx=0x7f120800c960 comp rx=0 tx=0).stop 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 shutdown_connections 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1204038060 0x7f120403a520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 --2- 172.21.15.45:0/4227650699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f121806db80 0x7f121809aa60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 >> 172.21.15.45:0/4227650699 conn(0x7f121809eda0 msgr2=0x7f121812e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 shutdown_connections 2024-05-08T09:21:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.714+0000 7f121da5c640 1 -- 172.21.15.45:0/4227650699 wait complete. 2024-05-08T09:21:23.715 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.3 2024-05-08T09:21:23.715 DEBUG:teuthology.parallel:result is None 2024-05-08T09:21:23.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705668 got 38654705668 for osd.0 2024-05-08T09:21:23.724 DEBUG:teuthology.parallel:result is None 2024-05-08T09:21:23.724 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T09:21:23.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.867+0000 7f85f78b3640 1 Processor -- start 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.867+0000 7f85f78b3640 1 -- start start 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f78b3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85f006d9d0 0x7f85f006ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f78b3640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f0072290 con 0x7f85f012e390 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f78b3640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f85f006eec0 con 0x7f85f006d9d0 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f564f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85f006d9d0 0x7f85f006ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f4e4e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85f012e390 0x7f85f012e810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36078/0 (socket says 172.21.15.45:36078) 2024-05-08T09:21:23.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f564f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85f006d9d0 0x7f85f006ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44550/0 (socket says 172.21.15.45:44550) 2024-05-08T09:21:23.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f4e4e640 1 -- 172.21.15.45:0/1378492968 learned_addr learned my addr 172.21.15.45:0/1378492968 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:23.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f564f640 1 -- 172.21.15.45:0/1378492968 >> v1:172.21.15.45:6789/0 conn(0x7f85f012e390 legacy=0x7f85f012e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.868+0000 7f85f564f640 1 -- 172.21.15.45:0/1378492968 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f006d4f0 con 0x7f85f006d9d0 2024-05-08T09:21:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.869+0000 7f85f564f640 1 --2- 172.21.15.45:0/1378492968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f006ddb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009720 tx=0x7f85ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eab7f389fad5297 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.869+0000 7f85e7fff640 1 -- 172.21.15.45:0/1378492968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85ec035020 con 0x7f85f006d9d0 2024-05-08T09:21:23.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.869+0000 7f85e7fff640 1 -- 172.21.15.45:0/1378492968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ec031760 con 0x7f85f006d9d0 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.869+0000 7f85e7fff640 1 -- 172.21.15.45:0/1378492968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85ec031a60 con 0x7f85f006d9d0 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 -- 172.21.15.45:0/1378492968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 msgr2=0x7f85f006ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1378492968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f006ddb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009720 tx=0x7f85ec02b8d0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 -- 172.21.15.45:0/1378492968 shutdown_connections 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1378492968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f006ddb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 -- 172.21.15.45:0/1378492968 >> 172.21.15.45:0/1378492968 conn(0x7f85f009d750 msgr2=0x7f85f009db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 -- 172.21.15.45:0/1378492968 shutdown_connections 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.870+0000 7f85f78b3640 1 -- 172.21.15.45:0/1378492968 wait complete. 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f78b3640 1 Processor -- start 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f78b3640 1 -- start start 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f78b3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f78b3640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f85f006f4e0 con 0x7f85f006d9d0 2024-05-08T09:21:23.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f564f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f564f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44552/0 (socket says 172.21.15.45:44552) 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f564f640 1 -- 172.21.15.45:0/1541929734 learned_addr learned my addr 172.21.15.45:0/1541929734 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.871+0000 7f85f564f640 1 -- 172.21.15.45:0/1541929734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f009a270 con 0x7f85f006d9d0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85f564f640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009840 tx=0x7f85ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85ec041070 con 0x7f85f006d9d0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ec03a8e0 con 0x7f85f006d9d0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f008f860 con 0x7f85f006d9d0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85ec035040 con 0x7f85f006d9d0 2024-05-08T09:21:23.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.872+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f012bbe0 con 0x7f85f006d9d0 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.873+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f85ec04c060 con 0x7f85f006d9d0 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.873+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f0062e90 con 0x7f85f006d9d0 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.873+0000 7f85e5ffb640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 0x7f85d403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.873+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f85ec06c980 con 0x7f85f006d9d0 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.874+0000 7f85f4e4e640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 0x7f85d403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:23.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.874+0000 7f85f4e4e640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 0x7f85d403a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e0007fd0 tx=0x7f85e0007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:23.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:23.878+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f85ec04ce10 con 0x7f85f006d9d0 2024-05-08T09:21:24.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.060+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f85f0090b20 con 0x7f85d4038060 2024-05-08T09:21:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.061+0000 7f85e5ffb640 1 -- 172.21.15.45:0/1541929734 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31852 (secure 0 0 0) 0x7f85e00058b0 con 0x7f85d4038060 2024-05-08T09:21:24.061 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:24.061 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 msgr2=0x7f85d403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 0x7f85d403a520 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f85e0007fd0 tx=0x7f85e0007ac0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 msgr2=0x7f85f008e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009840 tx=0x7f85ec0046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 shutdown_connections 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f85d4038060 0x7f85d403a520 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 --2- 172.21.15.45:0/1541929734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85f006d9d0 0x7f85f008e3e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 >> 172.21.15.45:0/1541929734 conn(0x7f85f009d750 msgr2=0x7f85f006fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 shutdown_connections 2024-05-08T09:21:24.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.063+0000 7f85f78b3640 1 -- 172.21.15.45:0/1541929734 wait complete. 2024-05-08T09:21:24.074 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T09:21:22.832798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118320,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369040,"statfs":{"total":386547056640,"available":386425896960,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":119138071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669585+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:21:21.669585+0000","last_peered":"2024-05-08T09:21:21.669585+0000","last_clean":"2024-05-08T09:21:21.669585+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:21:21.669585+0000","last_undegraded":"2024-05-08T09:21:21.669585+0000","last_fullsized":"2024-05-08T09:21:21.669585+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.673641+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:21:20.673641+0000","last_peered":"2024-05-08T09:21:20.673641+0000","last_clean":"2024-05-08T09:21:20.673641+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:21:20.673641+0000","last_undegraded":"2024-05-08T09:21:20.673641+0000","last_fullsized":"2024-05-08T09:21:20.673641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669527+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:21:21.669527+0000","last_peered":"2024-05-08T09:21:21.669527+0000","last_clean":"2024-05-08T09:21:21.669527+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:21:21.669527+0000","last_undegraded":"2024-05-08T09:21:21.669527+0000","last_fullsized":"2024-05-08T09:21:21.669527+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.672648+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:21:20.672648+0000","last_peered":"2024-05-08T09:21:20.672648+0000","last_clean":"2024-05-08T09:21:20.672648+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:21:20.672648+0000","last_undegraded":"2024-05-08T09:21:20.672648+0000","last_fullsized":"2024-05-08T09:21:20.672648+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669507+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:21:21.669507+0000","last_peered":"2024-05-08T09:21:21.669507+0000","last_clean":"2024-05-08T09:21:21.669507+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:21:21.669507+0000","last_undegraded":"2024-05-08T09:21:21.669507+0000","last_fullsized":"2024-05-08T09:21:21.669507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.672687+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:21:20.672687+0000","last_peered":"2024-05-08T09:21:20.672687+0000","last_clean":"2024-05-08T09:21:20.672687+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:21:20.672687+0000","last_undegraded":"2024-05-08T09:21:20.672687+0000","last_fullsized":"2024-05-08T09:21:20.672687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669454+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:21:21.669454+0000","last_peered":"2024-05-08T09:21:21.669454+0000","last_clean":"2024-05-08T09:21:21.669454+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:21:21.669454+0000","last_undegraded":"2024-05-08T09:21:21.669454+0000","last_fullsized":"2024-05-08T09:21:21.669454+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669564+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:21:21.669564+0000","last_peered":"2024-05-08T09:21:21.669564+0000","last_clean":"2024-05-08T09:21:21.669564+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:21:21.669564+0000","last_undegraded":"2024-05-08T09:21:21.669564+0000","last_fullsized":"2024-05-08T09:21:21.669564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.277438+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:21:21.277438+0000","last_peered":"2024-05-08T09:21:21.277438+0000","last_clean":"2024-05-08T09:21:21.277438+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:21:21.277438+0000","last_undegraded":"2024-05-08T09:21:21.277438+0000","last_fullsized":"2024-05-08T09:21:21.277438+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:21:24.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:21:24.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.177+0000 7f4cddd4b640 1 Processor -- start 2024-05-08T09:21:24.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cddd4b640 1 -- start start 2024-05-08T09:21:24.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cddd4b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cd812e460 0x7f4cd8130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cddd4b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd8071020 con 0x7f4cd8127ea0 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cddd4b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd8071780 con 0x7f4cd812e460 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cd77fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4cd8127ea0 0x7f4cd8128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36082/0 (socket says 172.21.15.45:36082) 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cd77fe640 1 -- 172.21.15.45:0/241398961 learned_addr learned my addr 172.21.15.45:0/241398961 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cd6ffd640 1 --2- 172.21.15.45:0/241398961 >> v2:172.21.15.45:3300/0 conn(0x7f4cd812e460 0x7f4cd8130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cd67fc640 1 -- 172.21.15.45:0/241398961 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949435631 0 0) 0x7f4cd8071020 con 0x7f4cd8127ea0 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.178+0000 7f4cd67fc640 1 -- 172.21.15.45:0/241398961 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc4003520 con 0x7f4cd8127ea0 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.179+0000 7f4cd6ffd640 1 -- 172.21.15.45:0/241398961 >> v1:172.21.15.45:6789/0 conn(0x7f4cd8127ea0 legacy=0x7f4cd8128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.179+0000 7f4cd6ffd640 1 -- 172.21.15.45:0/241398961 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd806e6e0 con 0x7f4cd812e460 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.179+0000 7f4cd6ffd640 1 --2- 172.21.15.45:0/241398961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd812e460 0x7f4cd8130850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009720 tx=0x7f4cc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbf65f2aa80486a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.179+0000 7f4cd67fc640 1 -- 172.21.15.45:0/241398961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0035020 con 0x7f4cd812e460 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cd67fc640 1 -- 172.21.15.45:0/241398961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc0031760 con 0x7f4cd812e460 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cd67fc640 1 -- 172.21.15.45:0/241398961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc0031a40 con 0x7f4cd812e460 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 -- 172.21.15.45:0/241398961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd812e460 msgr2=0x7f4cd8130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/241398961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd812e460 0x7f4cd8130850 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0009720 tx=0x7f4cc002b8d0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 -- 172.21.15.45:0/241398961 shutdown_connections 2024-05-08T09:21:24.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/241398961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd812e460 0x7f4cd8130850 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 -- 172.21.15.45:0/241398961 >> 172.21.15.45:0/241398961 conn(0x7f4cd8099380 msgr2=0x7f4cd8099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 -- 172.21.15.45:0/241398961 shutdown_connections 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.180+0000 7f4cddd4b640 1 -- 172.21.15.45:0/241398961 wait complete. 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.181+0000 7f4cddd4b640 1 Processor -- start 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.181+0000 7f4cddd4b640 1 -- start start 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.181+0000 7f4cddd4b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.181+0000 7f4cddd4b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd80725d0 con 0x7f4cd8127ea0 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cd77fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44576/0 (socket says 172.21.15.45:44576) 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cd77fe640 1 -- 172.21.15.45:0/1892109347 learned_addr learned my addr 172.21.15.45:0/1892109347 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cd77fe640 1 -- 172.21.15.45:0/1892109347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd8115610 con 0x7f4cd8127ea0 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cd77fe640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c3b0 tx=0x7f4cc800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8017070 con 0x7f4cd8127ea0 2024-05-08T09:21:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8005c10 con 0x7f4cd8127ea0 2024-05-08T09:21:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd81249a0 con 0x7f4cd8127ea0 2024-05-08T09:21:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc80070d0 con 0x7f4cd8127ea0 2024-05-08T09:21:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.182+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd81158b0 con 0x7f4cd8127ea0 2024-05-08T09:21:24.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.183+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cc801a070 con 0x7f4cd8127ea0 2024-05-08T09:21:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.183+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8062e90 con 0x7f4cd8127ea0 2024-05-08T09:21:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.183+0000 7f4ccffff640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 0x7f4cb803a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.183+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f4cc804a4a0 con 0x7f4cd8127ea0 2024-05-08T09:21:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.184+0000 7f4cd6ffd640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 0x7f4cb803a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.184+0000 7f4cd6ffd640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 0x7f4cb803a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0036000 tx=0x7f4cc0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.188+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4cd8115610 con 0x7f4cd8127ea0 2024-05-08T09:21:24.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.365+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4cd8073fd0 con 0x7f4cb8038010 2024-05-08T09:21:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.367+0000 7f4ccffff640 1 -- 172.21.15.45:0/1892109347 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31852 (secure 0 0 0) 0x7f4cd8073fd0 con 0x7f4cb8038010 2024-05-08T09:21:24.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 msgr2=0x7f4cb803a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 0x7f4cb803a4d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0036000 tx=0x7f4cc0008030 comp rx=0 tx=0).stop 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 msgr2=0x7f4cd81bec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c3b0 tx=0x7f4cc800c870 comp rx=0 tx=0).stop 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 shutdown_connections 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8038010 0x7f4cb803a4d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 --2- 172.21.15.45:0/1892109347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cd8127ea0 0x7f4cd81bec70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 >> 172.21.15.45:0/1892109347 conn(0x7f4cd8099380 msgr2=0x7f4cd809a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 shutdown_connections 2024-05-08T09:21:24.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.369+0000 7f4cddd4b640 1 -- 172.21.15.45:0/1892109347 wait complete. 2024-05-08T09:21:24.380 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2024-05-08T09:21:22.832798+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":118320,"kb_used_data":1552,"kb_used_omap":6,"kb_used_meta":116345,"kb_avail":377369040,"statfs":{"total":386547056640,"available":386425896960,"internally_reserved":0,"allocated":1589248,"data_stored":1291770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":119138071},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669585+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:21:21.669585+0000","last_peered":"2024-05-08T09:21:21.669585+0000","last_clean":"2024-05-08T09:21:21.669585+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:21:21.669585+0000","last_undegraded":"2024-05-08T09:21:21.669585+0000","last_fullsized":"2024-05-08T09:21:21.669585+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.673641+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:21:20.673641+0000","last_peered":"2024-05-08T09:21:20.673641+0000","last_clean":"2024-05-08T09:21:20.673641+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:21:20.673641+0000","last_undegraded":"2024-05-08T09:21:20.673641+0000","last_fullsized":"2024-05-08T09:21:20.673641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669527+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:21:21.669527+0000","last_peered":"2024-05-08T09:21:21.669527+0000","last_clean":"2024-05-08T09:21:21.669527+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:21:21.669527+0000","last_undegraded":"2024-05-08T09:21:21.669527+0000","last_fullsized":"2024-05-08T09:21:21.669527+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.672648+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:21:20.672648+0000","last_peered":"2024-05-08T09:21:20.672648+0000","last_clean":"2024-05-08T09:21:20.672648+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:21:20.672648+0000","last_undegraded":"2024-05-08T09:21:20.672648+0000","last_fullsized":"2024-05-08T09:21:20.672648+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669507+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:21:21.669507+0000","last_peered":"2024-05-08T09:21:21.669507+0000","last_clean":"2024-05-08T09:21:21.669507+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:21:21.669507+0000","last_undegraded":"2024-05-08T09:21:21.669507+0000","last_fullsized":"2024-05-08T09:21:21.669507+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:20.672687+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:21:20.672687+0000","last_peered":"2024-05-08T09:21:20.672687+0000","last_clean":"2024-05-08T09:21:20.672687+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:21:20.672687+0000","last_undegraded":"2024-05-08T09:21:20.672687+0000","last_fullsized":"2024-05-08T09:21:20.672687+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669454+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:21:21.669454+0000","last_peered":"2024-05-08T09:21:21.669454+0000","last_clean":"2024-05-08T09:21:21.669454+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:21:21.669454+0000","last_undegraded":"2024-05-08T09:21:21.669454+0000","last_fullsized":"2024-05-08T09:21:21.669454+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":12,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.669564+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:21:21.669564+0000","last_peered":"2024-05-08T09:21:21.669564+0000","last_clean":"2024-05-08T09:21:21.669564+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:21:21.669564+0000","last_undegraded":"2024-05-08T09:21:21.669564+0000","last_fullsized":"2024-05-08T09:21:21.669564+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":159,"reported_epoch":11,"state":"active+clean","last_fresh":"2024-05-08T09:21:21.277438+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:21:21.277438+0000","last_peered":"2024-05-08T09:21:21.277438+0000","last_clean":"2024-05-08T09:21:21.277438+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:21:21.277438+0000","last_undegraded":"2024-05-08T09:21:21.277438+0000","last_fullsized":"2024-05-08T09:21:21.277438+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:08.375009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27124,"kb_used_data":104,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344716,"statfs":{"total":96636764160,"available":96608989184,"internally_reserved":0,"allocated":106496,"data_stored":31051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705667,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":692224,"data_stored":617029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35436,"kb_used_data":96,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336404,"statfs":{"total":96636764160,"available":96600477696,"internally_reserved":0,"allocated":98304,"data_stored":26661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:21:24.380 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T09:21:24.381 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T09:21:24.381 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-08T09:21:24.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-08T09:21:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.482+0000 7f4d03360640 1 Processor -- start 2024-05-08T09:21:24.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d03360640 1 -- start start 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d03360640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cfc06e650 0x7f4cfc1337b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d03360640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cfc06f5a0 con 0x7f4cfc06db60 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d03360640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f4cfc06fc30 con 0x7f4cfc06e650 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d008fb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4cfc06e650 0x7f4cfc1337b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d010fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4cfc06db60 0x7f4cfc06df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36084/0 (socket says 172.21.15.45:36084) 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d010fc640 1 -- 172.21.15.45:0/2798445313 learned_addr learned my addr 172.21.15.45:0/2798445313 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d008fb640 1 -- 172.21.15.45:0/2798445313 >> v1:172.21.15.45:6789/0 conn(0x7f4cfc06db60 legacy=0x7f4cfc06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.483+0000 7f4d008fb640 1 -- 172.21.15.45:0/2798445313 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc070000 con 0x7f4cfc06e650 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.484+0000 7f4d008fb640 1 --2- 172.21.15.45:0/2798445313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06e650 0x7f4cfc1337b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009720 tx=0x7f4cec02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8dbb4413ce4752 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.484+0000 7f4cf3fff640 1 -- 172.21.15.45:0/2798445313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cec0316d0 con 0x7f4cfc06e650 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.484+0000 7f4cf3fff640 1 -- 172.21.15.45:0/2798445313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec037070 con 0x7f4cfc06e650 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.484+0000 7f4cf3fff640 1 -- 172.21.15.45:0/2798445313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cec0319c0 con 0x7f4cfc06e650 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 -- 172.21.15.45:0/2798445313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06e650 msgr2=0x7f4cfc1337b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 --2- 172.21.15.45:0/2798445313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06e650 0x7f4cfc1337b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4cec009720 tx=0x7f4cec02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:24.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 -- 172.21.15.45:0/2798445313 shutdown_connections 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 --2- 172.21.15.45:0/2798445313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06e650 0x7f4cfc1337b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 -- 172.21.15.45:0/2798445313 >> 172.21.15.45:0/2798445313 conn(0x7f4cfc0a0f60 msgr2=0x7f4cfc0a1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 -- 172.21.15.45:0/2798445313 shutdown_connections 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.485+0000 7f4d03360640 1 -- 172.21.15.45:0/2798445313 wait complete. 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d03360640 1 Processor -- start 2024-05-08T09:21:24.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d03360640 1 -- start start 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d03360640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d03360640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f4cfc133e70 con 0x7f4cfc06db60 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d010fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d010fc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44586/0 (socket says 172.21.15.45:44586) 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d010fc640 1 -- 172.21.15.45:0/231347649 learned_addr learned my addr 172.21.15.45:0/231347649 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.486+0000 7f4d010fc640 1 -- 172.21.15.45:0/231347649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cfc130c00 con 0x7f4cfc06db60 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4d010fc640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c4a0 tx=0x7f4cf800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cf8017070 con 0x7f4cfc06db60 2024-05-08T09:21:24.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf8005c10 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cfc132bd0 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cf8007070 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.487+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cfc131ef0 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.488+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4cf801a070 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.488+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cfc132820 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.488+0000 7f4cf1ffb640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 0x7f4ce003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.488+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7f4cf804a1a0 con 0x7f4cfc06db60 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.488+0000 7f4d008fb640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 0x7f4ce003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.489+0000 7f4d008fb640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 0x7f4ce003a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.493+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f4cfc131ef0 con 0x7f4cfc06db60 2024-05-08T09:21:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.713+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4cfc062e90 con 0x7f4cfc06db60 2024-05-08T09:21:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.713+0000 7f4cf1ffb640 1 -- 172.21.15.45:0/231347649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f4cf801b3b0 con 0x7f4cfc06db60 2024-05-08T09:21:24.713 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:21:24.713 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 msgr2=0x7f4ce003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 0x7f4ce003a520 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4cec036000 tx=0x7f4cec008030 comp rx=0 tx=0).stop 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 msgr2=0x7f4cfc12f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4cf800c4a0 tx=0x7f4cf800c960 comp rx=0 tx=0).stop 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 shutdown_connections 2024-05-08T09:21:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ce0038060 0x7f4ce003a520 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 --2- 172.21.15.45:0/231347649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4cfc06db60 0x7f4cfc12f7a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 >> 172.21.15.45:0/231347649 conn(0x7f4cfc0a0f60 msgr2=0x7f4cfc09d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 shutdown_connections 2024-05-08T09:21:24.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:21:24.715+0000 7f4d03360640 1 -- 172.21.15.45:0/231347649 wait complete. 2024-05-08T09:21:24.726 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-08T09:21:24.726 INFO:teuthology.run_tasks:Running task rgw... 2024-05-08T09:21:24.740 DEBUG:tasks.rgw:config is {'client.0': None} 2024-05-08T09:21:24.740 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-05-08T09:21:24.741 INFO:tasks.rgw:Creating data pools 2024-05-08T09:21:24.741 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-05-08T09:21:24.741 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-05-08T09:21:24.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.854+0000 7fdf6c803640 1 Processor -- start 2024-05-08T09:21:24.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.854+0000 7fdf6c803640 1 -- start start 2024-05-08T09:21:24.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6c803640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf6811a8a0 0x7fdf6811cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6c803640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf6811d1d0 con 0x7fdf681169d0 2024-05-08T09:21:24.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6c803640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fdf6811e3b0 con 0x7fdf6811a8a0 2024-05-08T09:21:24.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf6811a8a0 0x7fdf6811cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6659c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf6811a8a0 0x7fdf6811cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50122/0 (socket says 172.21.15.161:50122) 2024-05-08T09:21:24.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6659c640 1 -- 172.21.15.161:0/1097974354 learned_addr learned my addr 172.21.15.161:0/1097974354 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:24.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf66d9d640 1 --1- 172.21.15.161:0/1097974354 >> v1:172.21.15.45:6789/0 conn(0x7fdf681169d0 0x7fdf68116db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:48662/0 (socket says 172.21.15.161:48662) 2024-05-08T09:21:24.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6659c640 1 -- 172.21.15.161:0/1097974354 >> v1:172.21.15.45:6789/0 conn(0x7fdf681169d0 legacy=0x7fdf68116db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.855+0000 7fdf6659c640 1 -- 172.21.15.161:0/1097974354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6811e560 con 0x7fdf6811a8a0 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.856+0000 7fdf6659c640 1 --2- 172.21.15.161:0/1097974354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf6811a8a0 0x7fdf6811cc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0097f0 tx=0x7fdf5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9432e256608a1410 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.856+0000 7fdf65d9b640 1 -- 172.21.15.161:0/1097974354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c035020 con 0x7fdf6811a8a0 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.856+0000 7fdf65d9b640 1 -- 172.21.15.161:0/1097974354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf5c0317a0 con 0x7fdf6811a8a0 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.856+0000 7fdf65d9b640 1 -- 172.21.15.161:0/1097974354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf5c031aa0 con 0x7fdf6811a8a0 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 -- 172.21.15.161:0/1097974354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf6811a8a0 msgr2=0x7fdf6811cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 --2- 172.21.15.161:0/1097974354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf6811a8a0 0x7fdf6811cc90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c0097f0 tx=0x7fdf5c02b910 comp rx=0 tx=0).stop 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 -- 172.21.15.161:0/1097974354 shutdown_connections 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 --2- 172.21.15.161:0/1097974354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf6811a8a0 0x7fdf6811cc90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 -- 172.21.15.161:0/1097974354 >> 172.21.15.161:0/1097974354 conn(0x7fdf6806e710 msgr2=0x7fdf6810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:24.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 -- 172.21.15.161:0/1097974354 shutdown_connections 2024-05-08T09:21:24.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.857+0000 7fdf6c803640 1 -- 172.21.15.161:0/1097974354 wait complete. 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.858+0000 7fdf6c803640 1 Processor -- start 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.858+0000 7fdf6c803640 1 -- start start 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.858+0000 7fdf6c803640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.858+0000 7fdf6c803640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6811d8c0 con 0x7fdf681169d0 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf66d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf66d9d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50134/0 (socket says 172.21.15.161:50134) 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf66d9d640 1 -- 172.21.15.161:0/4160919144 learned_addr learned my addr 172.21.15.161:0/4160919144 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf66d9d640 1 -- 172.21.15.161:0/4160919144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf681ac8b0 con 0x7fdf681169d0 2024-05-08T09:21:24.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf66d9d640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c450 tx=0x7fdf5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf58007410 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf580075b0 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf681acb40 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf58004910 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.859+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf681a65d0 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.860+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdf5801a020 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.860+0000 7fdf4f7fe640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 0x7fdf5403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.860+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 3482+0+0 (secure 0 0 0) 0x7fdf5804a800 con 0x7fdf681169d0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.861+0000 7fdf6659c640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 0x7fdf5403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:24.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.861+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6804fe40 con 0x7fdf681169d0 2024-05-08T09:21:24.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.861+0000 7fdf6659c640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 0x7fdf5403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c036000 tx=0x7fdf5c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:24.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:24.866+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdf5801b9f0 con 0x7fdf681169d0 2024-05-08T09:21:25.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.050+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7fdf681acd70 con 0x7fdf681169d0 2024-05-08T09:21:25.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.916+0000 7fdf4f7fe640 1 -- 172.21.15.161:0/4160919144 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v13) ==== 171+0+0 (secure 0 0 0) 0x7fdf5801bc50 con 0x7fdf681169d0 2024-05-08T09:21:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 msgr2=0x7fdf5403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 0x7fdf5403a520 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c036000 tx=0x7fdf5c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:25.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 msgr2=0x7fdf681ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800c450 tx=0x7fdf5800c910 comp rx=0 tx=0).stop 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 shutdown_connections 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf54038060 0x7fdf5403a520 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 --2- 172.21.15.161:0/4160919144 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf681169d0 0x7fdf681ac2e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 >> 172.21.15.161:0/4160919144 conn(0x7fdf6806e710 msgr2=0x7fdf6811b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 shutdown_connections 2024-05-08T09:21:25.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:25.919+0000 7fdf6c803640 1 -- 172.21.15.161:0/4160919144 wait complete. 2024-05-08T09:21:25.932 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.038+0000 7fbeed998640 1 Processor -- start 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.038+0000 7fbeed998640 1 -- start start 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbeed998640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbee811ab90 0x7fbee811cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbeed998640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbee811d550 con 0x7fbee8117f10 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbeed998640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fbee811e750 con 0x7fbee811ab90 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbede7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbee811ab90 0x7fbee811cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbede7fc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbee811ab90 0x7fbee811cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50136/0 (socket says 172.21.15.161:50136) 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbee6ffd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbee8117f10 0x7fbee81182f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:48676/0 (socket says 172.21.15.161:48676) 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbede7fc640 1 -- 172.21.15.161:0/150375486 learned_addr learned my addr 172.21.15.161:0/150375486 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:26.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbede7fc640 1 -- 172.21.15.161:0/150375486 >> v1:172.21.15.45:6789/0 conn(0x7fbee8117f10 legacy=0x7fbee81182f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:26.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.039+0000 7fbede7fc640 1 -- 172.21.15.161:0/150375486 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee811e900 con 0x7fbee811ab90 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.040+0000 7fbede7fc640 1 --2- 172.21.15.161:0/150375486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee811ab90 0x7fbee811cf80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbed00097f0 tx=0x7fbed002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e852f11b995e84e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.040+0000 7fbee67fc640 1 -- 172.21.15.161:0/150375486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0035020 con 0x7fbee811ab90 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.040+0000 7fbee67fc640 1 -- 172.21.15.161:0/150375486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed00317a0 con 0x7fbee811ab90 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.040+0000 7fbee67fc640 1 -- 172.21.15.161:0/150375486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0031aa0 con 0x7fbee811ab90 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 -- 172.21.15.161:0/150375486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee811ab90 msgr2=0x7fbee811cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 --2- 172.21.15.161:0/150375486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee811ab90 0x7fbee811cf80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbed00097f0 tx=0x7fbed002b910 comp rx=0 tx=0).stop 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 -- 172.21.15.161:0/150375486 shutdown_connections 2024-05-08T09:21:26.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 --2- 172.21.15.161:0/150375486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee811ab90 0x7fbee811cf80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 -- 172.21.15.161:0/150375486 >> 172.21.15.161:0/150375486 conn(0x7fbee806e840 msgr2=0x7fbee810fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 -- 172.21.15.161:0/150375486 shutdown_connections 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.041+0000 7fbeed998640 1 -- 172.21.15.161:0/150375486 wait complete. 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbeed998640 1 Processor -- start 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbeed998640 1 -- start start 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbeed998640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbeed998640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbee811dc40 con 0x7fbee8117f10 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbee6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbee6ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50142/0 (socket says 172.21.15.161:50142) 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.042+0000 7fbee6ffd640 1 -- 172.21.15.161:0/1656221216 learned_addr learned my addr 172.21.15.161:0/1656221216 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbee6ffd640 1 -- 172.21.15.161:0/1656221216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee81a6f70 con 0x7fbee8117f10 2024-05-08T09:21:26.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbee6ffd640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c450 tx=0x7fbed800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8007410 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed80075b0 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee81a7260 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed8004910 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.043+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee81ab390 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.044+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee804fe40 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.044+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbed801a020 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.044+0000 7fbee4ff9640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 0x7fbec803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.044+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3797+0+0 (secure 0 0 0) 0x7fbed804a880 con 0x7fbee8117f10 2024-05-08T09:21:26.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.044+0000 7fbede7fc640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 0x7fbec803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:26.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.045+0000 7fbede7fc640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 0x7fbec803a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbed0036000 tx=0x7fbed0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:26.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.050+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbed801b9f0 con 0x7fbee8117f10 2024-05-08T09:21:26.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:26.223+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7fbee81a7490 con 0x7fbee8117f10 2024-05-08T09:21:27.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.922+0000 7fbee4ff9640 1 -- 172.21.15.161:0/1656221216 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v15) ==== 227+0+0 (secure 0 0 0) 0x7fbed801bc50 con 0x7fbee8117f10 2024-05-08T09:21:27.922 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.data' created 2024-05-08T09:21:27.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 msgr2=0x7fbec803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:27.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 0x7fbec803a520 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbed0036000 tx=0x7fbed0008030 comp rx=0 tx=0).stop 2024-05-08T09:21:27.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 msgr2=0x7fbee81a6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:27.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fbed800c450 tx=0x7fbed800c910 comp rx=0 tx=0).stop 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 shutdown_connections 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbec8038060 0x7fbec803a520 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 --2- 172.21.15.161:0/1656221216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbee8117f10 0x7fbee81a6a30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.927+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 >> 172.21.15.161:0/1656221216 conn(0x7fbee806e840 msgr2=0x7fbee811af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.928+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 shutdown_connections 2024-05-08T09:21:27.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:27.928+0000 7fbeed998640 1 -- 172.21.15.161:0/1656221216 wait complete. 2024-05-08T09:21:27.950 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f655a8ac640 1 Processor -- start 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f655a8ac640 1 -- start start 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f655a8ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f655410e000 0x7f655410e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f655a8ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f655410eb30 con 0x7f6554117990 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f655a8ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f655411c4b0 con 0x7f655410e000 2024-05-08T09:21:28.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f6553fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f655410e000 0x7f655410e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f6553fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f655410e000 0x7f655410e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50144/0 (socket says 172.21.15.161:50144) 2024-05-08T09:21:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f6553fff640 1 -- 172.21.15.161:0/1947861671 learned_addr learned my addr 172.21.15.161:0/1947861671 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.054+0000 7f65537fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6554117990 0x7f6554119d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:48686/0 (socket says 172.21.15.161:48686) 2024-05-08T09:21:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.055+0000 7f6553fff640 1 -- 172.21.15.161:0/1947861671 >> v1:172.21.15.45:6789/0 conn(0x7f6554117990 legacy=0x7f6554119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.055+0000 7f6553fff640 1 -- 172.21.15.161:0/1947861671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655411c630 con 0x7f655410e000 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f6553fff640 1 --2- 172.21.15.161:0/1947861671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410e3e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65440097f0 tx=0x7f654402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae6f98c18787c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f6552ffd640 1 -- 172.21.15.161:0/1947861671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6544035020 con 0x7f655410e000 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f6552ffd640 1 -- 172.21.15.161:0/1947861671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65440317a0 con 0x7f655410e000 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f6552ffd640 1 -- 172.21.15.161:0/1947861671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6544031aa0 con 0x7f655410e000 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 -- 172.21.15.161:0/1947861671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 msgr2=0x7f655410e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 --2- 172.21.15.161:0/1947861671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410e3e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65440097f0 tx=0x7f654402b910 comp rx=0 tx=0).stop 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 -- 172.21.15.161:0/1947861671 shutdown_connections 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 --2- 172.21.15.161:0/1947861671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410e3e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 -- 172.21.15.161:0/1947861671 >> 172.21.15.161:0/1947861671 conn(0x7f655406f430 msgr2=0x7f6554071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 -- 172.21.15.161:0/1947861671 shutdown_connections 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.056+0000 7f655a8ac640 1 -- 172.21.15.161:0/1947861671 wait complete. 2024-05-08T09:21:28.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.057+0000 7f655a8ac640 1 Processor -- start 2024-05-08T09:21:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.057+0000 7f655a8ac640 1 -- start start 2024-05-08T09:21:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.057+0000 7f655a8ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:28.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.057+0000 7f655a8ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f655411b9c0 con 0x7f655410e000 2024-05-08T09:21:28.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6553fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6553fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50148/0 (socket says 172.21.15.161:50148) 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6553fff640 1 -- 172.21.15.161:0/2519494343 learned_addr learned my addr 172.21.15.161:0/2519494343 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6553fff640 1 -- 172.21.15.161:0/2519494343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655410fd40 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6553fff640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65440097f0 tx=0x7f65440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f654403ad00 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65440443f0 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655410ff70 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65440446d0 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.058+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6554110400 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.059+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f654404b060 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.059+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655404fe40 con 0x7f655410e000 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.060+0000 7f6550ff9640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 0x7f654003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:28.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.060+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4272+0+0 (secure 0 0 0) 0x7f654406d500 con 0x7f655410e000 2024-05-08T09:21:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.060+0000 7f65537fe640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 0x7f654003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:28.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.060+0000 7f65537fe640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 0x7f654003a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f65480015f0 tx=0x7f6548007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:28.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.066+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f654403f070 con 0x7f655410e000 2024-05-08T09:21:28.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.240+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f6554117990 con 0x7f655410e000 2024-05-08T09:21:28.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.925+0000 7f6550ff9640 1 -- 172.21.15.161:0/2519494343 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v16) ==== 185+0+0 (secure 0 0 0) 0x7f654406c060 con 0x7f655410e000 2024-05-08T09:21:28.926 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 msgr2=0x7f654003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 0x7f654003a520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f65480015f0 tx=0x7f6548007a40 comp rx=0 tx=0).stop 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 msgr2=0x7f655410f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65440097f0 tx=0x7f65440046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 shutdown_connections 2024-05-08T09:21:28.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6540038060 0x7f654003a520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 --2- 172.21.15.161:0/2519494343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f655410e000 0x7f655410f800 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.927+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 >> 172.21.15.161:0/2519494343 conn(0x7f655406f430 msgr2=0x7f655406f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.928+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 shutdown_connections 2024-05-08T09:21:28.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:28.928+0000 7f655a8ac640 1 -- 172.21.15.161:0/2519494343 wait complete. 2024-05-08T09:21:28.954 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb8874640 1 Processor -- start 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb8874640 1 -- start start 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb8874640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1eb41189a0 0x7f1eb411ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb8874640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1eb411b2d0 con 0x7f1eb410e000 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb8874640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f1eb411c4b0 con 0x7f1eb41189a0 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1ea9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1eb41189a0 0x7f1eb411ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1eb410e000 0x7f1eb410e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:48688/0 (socket says 172.21.15.161:48688) 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1ea9d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1eb41189a0 0x7f1eb411ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50158/0 (socket says 172.21.15.161:50158) 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.067+0000 7f1eb259c640 1 -- 172.21.15.161:0/3214173700 learned_addr learned my addr 172.21.15.161:0/3214173700 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.068+0000 7f1ea9d9b640 1 -- 172.21.15.161:0/3214173700 >> v1:172.21.15.45:6789/0 conn(0x7f1eb410e000 legacy=0x7f1eb410e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:29.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.068+0000 7f1ea9d9b640 1 -- 172.21.15.161:0/3214173700 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb411c630 con 0x7f1eb41189a0 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.068+0000 7f1ea9d9b640 1 --2- 172.21.15.161:0/3214173700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb41189a0 0x7f1eb411ad90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009720 tx=0x7f1e9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1a3f9bf825f5d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.068+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/3214173700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c0316d0 con 0x7f1eb41189a0 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/3214173700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9c037070 con 0x7f1eb41189a0 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb1d9b640 1 -- 172.21.15.161:0/3214173700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1e9c0319c0 con 0x7f1eb41189a0 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 -- 172.21.15.161:0/3214173700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb41189a0 msgr2=0x7f1eb411ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3214173700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb41189a0 0x7f1eb411ad90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c009720 tx=0x7f1e9c02b840 comp rx=0 tx=0).stop 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 -- 172.21.15.161:0/3214173700 shutdown_connections 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3214173700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb41189a0 0x7f1eb411ad90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 -- 172.21.15.161:0/3214173700 >> 172.21.15.161:0/3214173700 conn(0x7f1eb406f430 msgr2=0x7f1eb4071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 -- 172.21.15.161:0/3214173700 shutdown_connections 2024-05-08T09:21:29.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.069+0000 7f1eb8874640 1 -- 172.21.15.161:0/3214173700 wait complete. 2024-05-08T09:21:29.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.070+0000 7f1eb8874640 1 Processor -- start 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.070+0000 7f1eb8874640 1 -- start start 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.070+0000 7f1eb8874640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.070+0000 7f1eb8874640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb411b9c0 con 0x7f1eb410e000 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50168/0 (socket says 172.21.15.161:50168) 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb259c640 1 -- 172.21.15.161:0/3433095086 learned_addr learned my addr 172.21.15.161:0/3433095086 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb259c640 1 -- 172.21.15.161:0/3433095086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb410fd40 con 0x7f1eb410e000 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb259c640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c340 tx=0x7f1ea4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea4005c10 con 0x7f1eb410e000 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ea4005db0 con 0x7f1eb410e000 2024-05-08T09:21:29.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb410ff70 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ea4004930 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.071+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb4110440 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.072+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eb404fe40 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.072+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1ea401a020 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.072+0000 7f1eab7fe640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 0x7f1e9403a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.072+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4283+0+0 (secure 0 0 0) 0x7f1ea404aab0 con 0x7f1eb410e000 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.073+0000 7f1ea9d9b640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 0x7f1e9403a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:29.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.073+0000 7f1ea9d9b640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 0x7f1e9403a4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c036000 tx=0x7f1e9c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:29.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.078+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f1ea40127f0 con 0x7f1eb410e000 2024-05-08T09:21:29.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.253+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7f1eb41189a0 con 0x7f1eb410e000 2024-05-08T09:21:29.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.927+0000 7f1eab7fe640 1 -- 172.21.15.161:0/3433095086 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v17) ==== 169+0+0 (secure 0 0 0) 0x7f1ea4012a50 con 0x7f1eb410e000 2024-05-08T09:21:29.927 INFO:teuthology.orchestra.run.smithi161.stderr:pool 'default.rgw.buckets.index' created 2024-05-08T09:21:29.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 msgr2=0x7f1e9403a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 0x7f1e9403a4d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c036000 tx=0x7f1e9c008030 comp rx=0 tx=0).stop 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 msgr2=0x7f1eb410f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c340 tx=0x7f1ea4001e70 comp rx=0 tx=0).stop 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 shutdown_connections 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1e94038010 0x7f1e9403a4d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 --2- 172.21.15.161:0/3433095086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1eb410e000 0x7f1eb410f800 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c340 tx=0x7f1ea4001e70 comp rx=0 tx=0).stop 2024-05-08T09:21:29.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 >> 172.21.15.161:0/3433095086 conn(0x7f1eb406f430 msgr2=0x7f1eb4071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:29.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 shutdown_connections 2024-05-08T09:21:29.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:29.930+0000 7f1eb8874640 1 -- 172.21.15.161:0/3433095086 wait complete. 2024-05-08T09:21:29.948 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb86723640 1 Processor -- start 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb86723640 1 -- start start 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb86723640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb8010e000 0x7fdb8010e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb86723640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8010eb30 con 0x7fdb80117990 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb86723640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fdb8011c4b0 con 0x7fdb8010e000 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb7ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb8010e000 0x7fdb8010e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:30.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb7ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb8010e000 0x7fdb8010e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50174/0 (socket says 172.21.15.161:50174) 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb7ffff640 1 -- 172.21.15.161:0/991216537 learned_addr learned my addr 172.21.15.161:0/991216537 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.050+0000 7fdb7f7fe640 1 --1- 172.21.15.161:0/991216537 >> v1:172.21.15.45:6789/0 conn(0x7fdb80117990 0x7fdb80119d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:48690/0 (socket says 172.21.15.161:48690) 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.051+0000 7fdb7ffff640 1 -- 172.21.15.161:0/991216537 >> v1:172.21.15.45:6789/0 conn(0x7fdb80117990 legacy=0x7fdb80119d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.051+0000 7fdb7ffff640 1 -- 172.21.15.161:0/991216537 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8011c630 con 0x7fdb8010e000 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb7ffff640 1 --2- 172.21.15.161:0/991216537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010e3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097f0 tx=0x7fdb7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2809651e617682af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb7effd640 1 -- 172.21.15.161:0/991216537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb70035020 con 0x7fdb8010e000 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb7effd640 1 -- 172.21.15.161:0/991216537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700317a0 con 0x7fdb8010e000 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb7effd640 1 -- 172.21.15.161:0/991216537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb70031aa0 con 0x7fdb8010e000 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 -- 172.21.15.161:0/991216537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 msgr2=0x7fdb8010e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 --2- 172.21.15.161:0/991216537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010e3e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fdb700097f0 tx=0x7fdb7002b910 comp rx=0 tx=0).stop 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 -- 172.21.15.161:0/991216537 shutdown_connections 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 --2- 172.21.15.161:0/991216537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010e3e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 -- 172.21.15.161:0/991216537 >> 172.21.15.161:0/991216537 conn(0x7fdb8006f430 msgr2=0x7fdb80071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:30.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 -- 172.21.15.161:0/991216537 shutdown_connections 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.052+0000 7fdb86723640 1 -- 172.21.15.161:0/991216537 wait complete. 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.053+0000 7fdb86723640 1 Processor -- start 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.053+0000 7fdb86723640 1 -- start start 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.053+0000 7fdb86723640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.053+0000 7fdb86723640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8011b9c0 con 0x7fdb8010e000 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7ffff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:50186/0 (socket says 172.21.15.161:50186) 2024-05-08T09:21:30.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7ffff640 1 -- 172.21.15.161:0/486309625 learned_addr learned my addr 172.21.15.161:0/486309625 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7ffff640 1 -- 172.21.15.161:0/486309625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8010fd40 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7ffff640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb700090b0 tx=0x7fdb700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb70049070 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb70031a80 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdb70044550 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8010ff70 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.054+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb80110460 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.055+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdb7004c070 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.055+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb8004fe40 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.056+0000 7fdb7cff9640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 0x7fdb6003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.056+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4647+0+0 (secure 0 0 0) 0x7fdb7006d860 con 0x7fdb8010e000 2024-05-08T09:21:30.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.056+0000 7fdb7f7fe640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 0x7fdb6003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:30.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.056+0000 7fdb7f7fe640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 0x7fdb6003a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb68000f60 tx=0x7fdb68007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:30.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.061+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fdb7003f070 con 0x7fdb8010e000 2024-05-08T09:21:30.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.233+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7fdb80117990 con 0x7fdb8010e000 2024-05-08T09:21:30.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.932+0000 7fdb7cff9640 1 -- 172.21.15.161:0/486309625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v18) ==== 187+0+0 (secure 0 0 0) 0x7fdb700393b0 con 0x7fdb8010e000 2024-05-08T09:21:30.933 INFO:teuthology.orchestra.run.smithi161.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-05-08T09:21:30.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 msgr2=0x7fdb6003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:30.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 0x7fdb6003a4d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb68000f60 tx=0x7fdb68007a80 comp rx=0 tx=0).stop 2024-05-08T09:21:30.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 msgr2=0x7fdb8010f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:30.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb700090b0 tx=0x7fdb700046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:30.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 shutdown_connections 2024-05-08T09:21:30.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdb60038010 0x7fdb6003a4d0 secure :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb68000f60 tx=0x7fdb68007a80 comp rx=0 tx=0).stop 2024-05-08T09:21:30.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 --2- 172.21.15.161:0/486309625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb8010e000 0x7fdb8010f800 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb700090b0 tx=0x7fdb700046c0 comp rx=0 tx=0).stop 2024-05-08T09:21:30.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.935+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 >> 172.21.15.161:0/486309625 conn(0x7fdb8006f430 msgr2=0x7fdb8006f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:30.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.941+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 shutdown_connections 2024-05-08T09:21:30.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:30.947+0000 7fdb86723640 1 -- 172.21.15.161:0/486309625 wait complete. 2024-05-08T09:21:30.966 DEBUG:tasks.rgw:Pools created 2024-05-08T09:21:30.966 INFO:tasks.rgw:Starting rgw... 2024-05-08T09:21:30.966 INFO:tasks.rgw:rgw client.0 config is {} 2024-05-08T09:21:30.967 INFO:tasks.rgw:Using beast as radosgw frontend 2024-05-08T09:21:30.967 DEBUG:teuthology.orchestra.run.smithi161:> sudo echo -n http://smithi161.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-05-08T09:21:30.993 INFO:teuthology.orchestra.run.smithi161.stdout:http://smithi161.front.sepia.ceph.com:80 2024-05-08T09:21:30.993 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-05-08T09:21:31.060 INFO:tasks.rgw.client.0:Restarting daemon 2024-05-08T09:21:31.060 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-05-08T09:21:31.103 INFO:tasks.rgw.client.0:Started 2024-05-08T09:21:31.104 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:31.104 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:31.129 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T09:21:31.129 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2024-05-08T09:21:31.129 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T09:21:31.131 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T09:21:31.131 INFO:teuthology.orchestra.run.smithi161.stderr:curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 80: Connection refused 2024-05-08T09:21:32.132 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:32.158 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T09:21:32.158 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T09:21:32.159 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2024-05-08T09:21:32.159 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T09:21:32.159 INFO:teuthology.orchestra.run.smithi161.stderr:curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 80: Connection refused 2024-05-08T09:21:34.160 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:34.184 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T09:21:34.184 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2024-05-08T09:21:34.185 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T09:21:34.185 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T09:21:34.186 INFO:teuthology.orchestra.run.smithi161.stderr:curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 80: Connection refused 2024-05-08T09:21:38.187 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:38.211 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T09:21:38.211 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2024-05-08T09:21:38.212 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-05-08T09:21:38.213 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-05-08T09:21:38.213 INFO:teuthology.orchestra.run.smithi161.stderr:curl: (7) Failed to connect to smithi161.front.sepia.ceph.com port 80: Connection refused 2024-05-08T09:21:40.044 INFO:tasks.rgw.client.0.smithi161.stdout:2024-05-08T09:21:40.044+0000 7fbd0566b880 -1 LDAP not started since no server URIs were provided in the configuration. 2024-05-08T09:21:46.214 DEBUG:teuthology.orchestra.run.smithi161:> curl http://smithi161.front.sepia.ceph.com:80/ 2024-05-08T09:21:46.238 INFO:teuthology.orchestra.run.smithi161.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-05-08T09:21:46.238 INFO:teuthology.orchestra.run.smithi161.stderr: Dload Upload Total Spent Left Speed 2024-05-08T09:21:46.242 INFO:teuthology.orchestra.run.smithi161.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-05-08T09:21:46.242 INFO:teuthology.orchestra.run.smithi161.stdout:anonymous 2024-05-08T09:21:46.242 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-05-08T09:21:46.647 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-05-08T09:21:46.647 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T09:21:46.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T09:21:46.647 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T09:21:46.698 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:46.698 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:46.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.698+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.698+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.698+0000 7f1b39e98800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d6c02505d0 0x55d6c02509f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.698+0000 7f1b39e98800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d6c0251070 con 0x55d6c024f290 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.698+0000 7f1b39e98800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55d6c00e1050 con 0x55d6c02505d0 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.699+0000 7f1b3799e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d6c02505d0 0x55d6c02509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.699+0000 7f1b3719d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55d6c024f290 0x55d6c024f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42632/0 (socket says 172.21.15.161:42632) 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.699+0000 7f1b3719d640 1 -- 172.21.15.161:0/3613720456 learned_addr learned my addr 172.21.15.161:0/3613720456 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.699+0000 7f1b3799e640 1 -- 172.21.15.161:0/3613720456 >> v1:172.21.15.45:6789/0 conn(0x55d6c024f290 legacy=0x55d6c024f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.699+0000 7f1b3799e640 1 -- 172.21.15.161:0/3613720456 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c024fe50 con 0x55d6c02505d0 2024-05-08T09:21:46.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.701+0000 7f1b3799e640 1 --2- 172.21.15.161:0/3613720456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c02505d0 0x55d6c02509f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005fd0 tx=0x7f1b2801ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197b8965950503a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b3699c640 1 -- 172.21.15.161:0/3613720456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28052560 con 0x55d6c02505d0 2024-05-08T09:21:46.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b3699c640 1 -- 172.21.15.161:0/3613720456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b28052700 con 0x55d6c02505d0 2024-05-08T09:21:46.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b3699c640 1 -- 172.21.15.161:0/3613720456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28052a60 con 0x55d6c02505d0 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 -- 172.21.15.161:0/3613720456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c02505d0 msgr2=0x55d6c02509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3613720456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c02505d0 0x55d6c02509f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005fd0 tx=0x7f1b2801ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 -- 172.21.15.161:0/3613720456 shutdown_connections 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3613720456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c02505d0 0x55d6c02509f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 -- 172.21.15.161:0/3613720456 >> 172.21.15.161:0/3613720456 conn(0x55d6c0249d20 msgr2=0x55d6c024c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 -- 172.21.15.161:0/3613720456 shutdown_connections 2024-05-08T09:21:46.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.702+0000 7f1b39e98800 1 -- 172.21.15.161:0/3613720456 wait complete. 2024-05-08T09:21:46.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.718+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.718+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.718+0000 7f1b39e98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.718+0000 7f1b39e98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6c019b1c0 con 0x55d6c024f290 2024-05-08T09:21:46.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.719+0000 7f1b3799e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.719+0000 7f1b3799e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51298/0 (socket says 172.21.15.161:51298) 2024-05-08T09:21:46.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.719+0000 7f1b3799e640 1 -- 172.21.15.161:0/2554271042 learned_addr learned my addr 172.21.15.161:0/2554271042 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.719+0000 7f1b3799e640 1 -- 172.21.15.161:0/2554271042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c0340d20 con 0x55d6c024f290 2024-05-08T09:21:46.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.719+0000 7f1b3799e640 1 --2- 172.21.15.161:0/2554271042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b28054040 tx=0x7f1b2804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df18280bd9a29d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.720+0000 7f1a25e0b640 1 -- 172.21.15.161:0/2554271042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28052aa0 con 0x55d6c024f290 2024-05-08T09:21:46.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.720+0000 7f1a25e0b640 1 -- 172.21.15.161:0/2554271042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b28052c40 con 0x55d6c024f290 2024-05-08T09:21:46.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.720+0000 7f1a25e0b640 1 -- 172.21.15.161:0/2554271042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b2805c430 con 0x55d6c024f290 2024-05-08T09:21:46.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.720+0000 7f1b39e98800 1 -- 172.21.15.161:0/2554271042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 msgr2=0x55d6c0340750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.720+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2554271042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b28054040 tx=0x7f1b2804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- 172.21.15.161:0/2554271042 shutdown_connections 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2554271042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0340750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- 172.21.15.161:0/2554271042 >> 172.21.15.161:0/2554271042 conn(0x55d6c0249d20 msgr2=0x55d6c033c070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- 172.21.15.161:0/2554271042 shutdown_connections 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- 172.21.15.161:0/2554271042 wait complete. 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b39e98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6c02587a0 con 0x55d6c024f290 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b3799e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b3799e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51302/0 (socket says 172.21.15.161:51302) 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.721+0000 7f1b3799e640 1 -- 172.21.15.161:0/2427131807 learned_addr learned my addr 172.21.15.161:0/2427131807 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1b3799e640 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c0347670 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1b3799e640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801b9b0 tx=0x7f1b28003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1a1ffff640 1 -- 172.21.15.161:0/2427131807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28052aa0 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1a1ffff640 1 -- 172.21.15.161:0/2427131807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2805cc30 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6c0347900 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1a1ffff640 1 -- 172.21.15.161:0/2427131807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28066410 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.722+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c034a5b0 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.723+0000 7f1a1ffff640 1 -- 172.21.15.161:0/2427131807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b280665b0 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.723+0000 7f1a1ffff640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 0x7f1a2003d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.723+0000 7f1a1ffff640 1 -- 172.21.15.161:0/2427131807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1b2806c070 con 0x55d6c024f290 2024-05-08T09:21:46.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b3719d640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 0x7f1a2003d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 0x55d6c034e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c034e8b0 con 0x55d6c02505d0 2024-05-08T09:21:46.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b3819f640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 0x55d6c034e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b3719d640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 0x7f1a2003d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000f60 tx=0x7f1b2c0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b3819f640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 0x55d6c034e370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b3819f640 1 -- 172.21.15.161:0/2427131807 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b300083e0 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.724+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c034b900 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.725+0000 7f1b3819f640 1 -- 172.21.15.161:0/2427131807 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b300083e0 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.725+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 0x55d6c0352fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.725+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03536a0 con 0x55d6c0350be0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.725+0000 7f1b3799e640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 0x55d6c0352fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.725+0000 7f1b3799e640 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 0x55d6c0352fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.726+0000 7f1b3799e640 1 -- 172.21.15.161:0/2427131807 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c0350be0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.726+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c034fb90 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.726+0000 7f1b3819f640 1 -- 172.21.15.161:0/2427131807 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b300083e0 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.726+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0350030 con 0x55d6c02505d0 2024-05-08T09:21:46.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.726+0000 7f1b3819f640 1 -- 172.21.15.161:0/2427131807 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b300083e0 con 0x55d6c02505d0 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b39e98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b39e98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6c0141cf0 con 0x55d6c0362840 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51312/0 (socket says 172.21.15.161:51312) 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.727+0000 7f1b3819f640 1 -- 172.21.15.161:0/3659244226 learned_addr learned my addr 172.21.15.161:0/3659244226 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1b3819f640 1 -- 172.21.15.161:0/3659244226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c03631a0 con 0x55d6c0362840 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1b3819f640 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55d6c0348000 tx=0x7f1b3000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1a1d7fa640 1 -- 172.21.15.161:0/3659244226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30007d00 con 0x55d6c0362840 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1a1d7fa640 1 -- 172.21.15.161:0/3659244226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3001e020 con 0x55d6c0362840 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1a1d7fa640 1 -- 172.21.15.161:0/3659244226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30019420 con 0x55d6c0362840 2024-05-08T09:21:46.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6c0363c10 con 0x55d6c0362840 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.728+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c0364110 con 0x55d6c0362840 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.729+0000 7f1a1d7fa640 1 -- 172.21.15.161:0/3659244226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b30016040 con 0x55d6c0362840 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.729+0000 7f1a1d7fa640 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 0x7f1a10038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.729+0000 7f1a1d7fa640 1 -- 172.21.15.161:0/3659244226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1b3001f030 con 0x55d6c0362840 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.729+0000 7f1b3799e640 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 0x7f1a10038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.730+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.730+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.730+0000 7f1b3799e640 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 0x7f1a10038e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55d6c034ed10 tx=0x7f1b28077bf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.730+0000 7f1b39e98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.730+0000 7f1b39e98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6c0341040 con 0x55d6c036fa60 2024-05-08T09:21:46.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.731+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.731+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51320/0 (socket says 172.21.15.161:51320) 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.731+0000 7f1b3819f640 1 -- 172.21.15.161:0/2764584193 learned_addr learned my addr 172.21.15.161:0/2764584193 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b3819f640 1 -- 172.21.15.161:0/2764584193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c0370450 con 0x55d6c036fa60 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b3819f640 1 --2- 172.21.15.161:0/2764584193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b30022470 tx=0x7f1b30017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc206becf89c47ab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1a16ffd640 1 -- 172.21.15.161:0/2764584193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3001d040 con 0x55d6c036fa60 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1a16ffd640 1 -- 172.21.15.161:0/2764584193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3003f030 con 0x55d6c036fa60 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1a16ffd640 1 -- 172.21.15.161:0/2764584193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30015d00 con 0x55d6c036fa60 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- 172.21.15.161:0/2764584193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 msgr2=0x55d6c036fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2764584193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1b30022470 tx=0x7f1b30017fa0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- 172.21.15.161:0/2764584193 shutdown_connections 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2764584193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c036fe80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- 172.21.15.161:0/2764584193 >> 172.21.15.161:0/2764584193 conn(0x55d6c036bdc0 msgr2=0x55d6c0369e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- 172.21.15.161:0/2764584193 shutdown_connections 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- 172.21.15.161:0/2764584193 wait complete. 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 Processor -- start 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- start start 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.733+0000 7f1b39e98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d6c0370b60 con 0x55d6c036fa60 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1b3819f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51326/0 (socket says 172.21.15.161:51326) 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 learned_addr learned my addr 172.21.15.161:0/1712351423 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c0377540 con 0x55d6c036fa60 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1b3819f640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b30017b60 tx=0x7f1b3004cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.734+0000 7f1a157fa640 1 -- 172.21.15.161:0/1712351423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3001d040 con 0x55d6c036fa60 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.735+0000 7f1a157fa640 1 -- 172.21.15.161:0/1712351423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b30023410 con 0x55d6c036fa60 2024-05-08T09:21:46.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.735+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6c03777d0 con 0x55d6c036fa60 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.735+0000 7f1a157fa640 1 -- 172.21.15.161:0/1712351423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30019b20 con 0x55d6c036fa60 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.735+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c037a480 con 0x55d6c036fa60 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.735+0000 7f1a157fa640 1 -- 172.21.15.161:0/1712351423 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1b300153e0 con 0x55d6c036fa60 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1a157fa640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a000369a0 0x7f1a00038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1a157fa640 1 -- 172.21.15.161:0/1712351423 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1b3002e050 con 0x55d6c036fa60 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b3799e640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a000369a0 0x7f1a00038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c0382aa0 0x55d6c0384f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03856b0 con 0x55d6c0382aa0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b3719d640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c0382aa0 0x55d6c0384f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b3799e640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a000369a0 0x7f1a00038e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b28052500 tx=0x7f1b28089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.736+0000 7f1b3719d640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c0382aa0 0x55d6c0384f60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c009050 con 0x55d6c0382aa0 2024-05-08T09:21:46.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 realm 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0381ef0 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c009050 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0386190 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c009050 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0386a60 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b2c009050 con 0x55d6c0382aa0 2024-05-08T09:21:46.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:46.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.737+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.738+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0387310 0x55d6c0389700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.738+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.738+0000 7f1b3819f640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0387310 0x55d6c0389700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.739+0000 7f1b3819f640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0387310 0x55d6c0389700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b39e98800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:46.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b39e98800 20 searching for the correct realm 2024-05-08T09:21:46.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d6c038bef0 0x55d6c038e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038ea80 con 0x55d6c038bef0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b3799e640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d6c038bef0 0x55d6c038e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.740+0000 7f1b3799e640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d6c038bef0 0x55d6c038e3b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3799e640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1b2806f020 0x7f1b2805b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038ea80 con 0x7f1b2806f020 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3719d640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1b2806f020 0x7f1b2805b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3719d640 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1b2806f020 0x7f1b2805b390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c009050 con 0x7f1b2806f020 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.741+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038ea80 con 0x55d6c0387310 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c009050 con 0x55d6c0382aa0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.743+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x7f1b2806f020 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.744+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.745+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x7f1b2806f020 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.746+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.747+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.748+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x7f1b2806f020 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.749+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x7f1b2806f020 2024-05-08T09:21:46.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c038bef0 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.750+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0387310 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x55d6c0382aa0 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0389e40 con 0x7f1b2806f020 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:46.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.751+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038a7f0 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b000 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:46.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 zone default found 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 4 Realm: () 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 zonegroup default 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.752+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0390d90 con 0x55d6c038bef0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0391130 con 0x55d6c038bef0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 started sync module instance, tier type = 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.753+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03901d0 con 0x7f1b2806f020 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.754+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.754+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94380836324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03901d0 con 0x7f1b2806f020 2024-05-08T09:21:46.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.754+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0391af0 con 0x55d6c0382aa0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.755+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94380836324800] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.756+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.756+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94380836323104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0391af0 con 0x55d6c0382aa0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.756+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03924f0 con 0x55d6c038bef0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.757+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94380836323104] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.758+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.758+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94380836329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0391a60 con 0x55d6c038bef0 2024-05-08T09:21:46.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.758+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03933b0 con 0x7f1b2806f020 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.760+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94380836329024] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.761+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.761+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94380836335360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03937d0 con 0x7f1b2806f020 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.761+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0394190 con 0x55d6c0382aa0 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.762+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94380836335360] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.762+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.762+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94380836336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0394190 con 0x55d6c0382aa0 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.762+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0394b50 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.764+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94380836336896] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.764+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.764+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94380836339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0394b50 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.764+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0395510 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.765+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94380836339392] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.765+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.765+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94380836341408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0395510 con 0x55d6c0387310 2024-05-08T09:21:46.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.765+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0395f60 con 0x55d6c0387310 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94380836341408] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94380836346448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0395f20 con 0x55d6c0387310 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=0 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=1 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=2 2024-05-08T09:21:46.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=3 2024-05-08T09:21:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=4 2024-05-08T09:21:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=5 2024-05-08T09:21:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.767+0000 7f1b39e98800 20 add_watcher() i=6 2024-05-08T09:21:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.769+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94380836346448] v27'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.769+0000 7f1b39e98800 20 add_watcher() i=7 2024-05-08T09:21:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.769+0000 7f1b39e98800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.769+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0399380 con 0x55d6c0382aa0 2024-05-08T09:21:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.770+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.770+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94380836343904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03968d0 con 0x55d6c0382aa0 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94380836343904] v27'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f19edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 5 note: GC not initialized 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f19ecfe1640 20 reqs_thread_entry: start 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 20 Filter name: none 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f19667fc640 20 reqs_thread_entry: start 2024-05-08T09:21:46.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.771+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03cc0a0 con 0x55d6c038bef0 2024-05-08T09:21:46.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.772+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.772+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03cc0a0 con 0x55d6c038bef0 2024-05-08T09:21:46.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.772+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.772+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03cc0a0 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.772+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x7f1b2806f020 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c038bef0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.773+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c038bef0 2024-05-08T09:21:46.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x7f1b2806f020 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c038bef0 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.774+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0387310 2024-05-08T09:21:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.776+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.776+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.777+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.777+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c038bef0 2024-05-08T09:21:46.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.777+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.777+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.778+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.778+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.779+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.779+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c038bef0 2024-05-08T09:21:46.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x7f1b2806f020 2024-05-08T09:21:46.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0382aa0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.780+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0382aa0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c038bef0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x7f1b2806f020 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.781+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0382aa0 2024-05-08T09:21:46.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.782+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c038bef0 2024-05-08T09:21:46.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x7f1b2806f020 2024-05-08T09:21:46.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0387310 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.783+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c0382aa0 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.784+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.784+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x55d6c038bef0 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.784+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.784+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038b430 con 0x7f1b2806f020 2024-05-08T09:21:46.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.784+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.785+0000 7f19edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:46.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.785+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94380836343904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.786+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94380836343904] v27'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.786+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94380836324800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x7f1b2806f020 2024-05-08T09:21:46.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.787+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94380836324800] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.787+0000 7f1b39e98800 20 remove_watcher() i=0 2024-05-08T09:21:46.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.787+0000 7f1b39e98800 2 removed watcher, disabling cache 2024-05-08T09:21:46.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.787+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94380836323104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c0382aa0 2024-05-08T09:21:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.788+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94380836323104] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.788+0000 7f1b39e98800 20 remove_watcher() i=1 2024-05-08T09:21:46.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.788+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94380836329024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c038abe0 con 0x55d6c038bef0 2024-05-08T09:21:46.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.790+0000 7f1b3799e640 1 -- 172.21.15.161:0/1712351423 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94380836329024] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28077360 con 0x55d6c038bef0 2024-05-08T09:21:46.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.790+0000 7f1b39e98800 20 remove_watcher() i=2 2024-05-08T09:21:46.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.790+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94380836335360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03905c0 con 0x7f1b2806f020 2024-05-08T09:21:46.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.791+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94380836335360] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x7f1b2806f020 2024-05-08T09:21:46.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.791+0000 7f1b39e98800 20 remove_watcher() i=3 2024-05-08T09:21:46.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.791+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94380836336896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0391640 con 0x55d6c0382aa0 2024-05-08T09:21:46.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.792+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94380836336896] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b2c029040 con 0x55d6c0382aa0 2024-05-08T09:21:46.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.792+0000 7f1b39e98800 20 remove_watcher() i=4 2024-05-08T09:21:46.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.792+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94380836339392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0392f00 con 0x55d6c0387310 2024-05-08T09:21:46.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.793+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94380836339392] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.793+0000 7f1b39e98800 20 remove_watcher() i=5 2024-05-08T09:21:46.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.793+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94380836341408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c03905c0 con 0x55d6c0387310 2024-05-08T09:21:46.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.794+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94380836341408] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.794+0000 7f1b39e98800 20 remove_watcher() i=6 2024-05-08T09:21:46.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.794+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94380836346448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d6c0393500 con 0x55d6c0387310 2024-05-08T09:21:46.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.795+0000 7f1b3819f640 1 -- 172.21.15.161:0/1712351423 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94380836346448] v27'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3002a070 con 0x55d6c0387310 2024-05-08T09:21:46.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.795+0000 7f1b39e98800 20 remove_watcher() i=7 2024-05-08T09:21:46.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0387310 msgr2=0x55d6c0389700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0387310 0x55d6c0389700 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c0382aa0 msgr2=0x55d6c0384f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c0382aa0 0x55d6c0384f60 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1b2806f020 msgr2=0x7f1b2805b390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1b2806f020 0x7f1b2805b390 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d6c038bef0 msgr2=0x55d6c038e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d6c038bef0 0x55d6c038e3b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a000369a0 msgr2=0x7f1a00038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a000369a0 0x7f1a00038e60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1b28052500 tx=0x7f1b28089000 comp rx=0 tx=0).stop 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 msgr2=0x55d6c0377000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b3719d640 1 -- 172.21.15.161:0/1712351423 reap_dead start 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1b30017b60 tx=0x7f1b3004cb30 comp rx=0 tx=0).stop 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 shutdown_connections 2024-05-08T09:21:46.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/1712351423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c036fa60 0x55d6c0377000 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 >> 172.21.15.161:0/1712351423 conn(0x55d6c036bdc0 msgr2=0x55d6c0369420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 shutdown_connections 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/1712351423 wait complete. 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 msgr2=0x7f1a10038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 0x7f1a10038e10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55d6c034ed10 tx=0x7f1b28077bf0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 msgr2=0x55d6c0362c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55d6c0348000 tx=0x7f1b3000aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 shutdown_connections 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a10036950 0x7f1a10038e10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 --2- 172.21.15.161:0/3659244226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c0362840 0x55d6c0362c60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 >> 172.21.15.161:0/3659244226 conn(0x55d6c03568e0 msgr2=0x55d6c0356ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 shutdown_connections 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.796+0000 7f1b39e98800 1 -- 172.21.15.161:0/3659244226 wait complete. 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 msgr2=0x55d6c0352fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 0x55d6c0352fd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 msgr2=0x55d6c034e370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 0x55d6c034e370 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 msgr2=0x7f1a2003d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 0x7f1a2003d270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c000f60 tx=0x7f1b2c0012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 msgr2=0x55d6c0347130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b2801b9b0 tx=0x7f1b28003330 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 shutdown_connections 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d6c0350be0 0x55d6c0352fd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d6c02505d0 0x55d6c034e370 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a2003adb0 0x7f1a2003d270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 --2- 172.21.15.161:0/2427131807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d6c024f290 0x55d6c0347130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 >> 172.21.15.161:0/2427131807 conn(0x55d6c0249d20 msgr2=0x55d6c024e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 shutdown_connections 2024-05-08T09:21:46.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.797+0000 7f1b39e98800 1 -- 172.21.15.161:0/2427131807 wait complete. 2024-05-08T09:21:46.807 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2024-05-08T09:21:46.807 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T09:21:46.807 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-05-08T09:21:46.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-05-08T09:21:46.808 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-05-08T09:21:46.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:46.852 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.852+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.852+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.852+0000 7fcfcae3f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560ac4b3d010 0x560ac4bccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.852+0000 7fcfcae3f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560ac4bd0f50 con 0x560ac4bcd200 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.852+0000 7fcfcae3f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x560ac4a5b050 con 0x560ac4b3d010 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc893e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560ac4b3d010 0x560ac4bccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc3fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x560ac4bcd200 0x560ac4bcf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42644/0 (socket says 172.21.15.161:42644) 2024-05-08T09:21:46.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc3fff640 1 -- 172.21.15.161:0/1089744532 learned_addr learned my addr 172.21.15.161:0/1089744532 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:46.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc37fe640 1 -- 172.21.15.161:0/1089744532 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430107989 0 0) 0x560ac4bd0f50 con 0x560ac4bcd200 2024-05-08T09:21:46.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc37fe640 1 -- 172.21.15.161:0/1089744532 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfb8001e10 con 0x560ac4bcd200 2024-05-08T09:21:46.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc893e640 1 -- 172.21.15.161:0/1089744532 >> v1:172.21.15.45:6789/0 conn(0x560ac4bcd200 legacy=0x560ac4bcf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.854 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.853+0000 7fcfc893e640 1 -- 172.21.15.161:0/1089744532 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4bd2180 con 0x560ac4b3d010 2024-05-08T09:21:46.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.855+0000 7fcfc893e640 1 --2- 172.21.15.161:0/1089744532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bccc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00a470 tx=0x7fcfbc01cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d22b8d590a6aed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.855+0000 7fcfc37fe640 1 -- 172.21.15.161:0/1089744532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc057070 con 0x560ac4b3d010 2024-05-08T09:21:46.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.855+0000 7fcfc37fe640 1 -- 172.21.15.161:0/1089744532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc052570 con 0x560ac4b3d010 2024-05-08T09:21:46.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.855+0000 7fcfc37fe640 1 -- 172.21.15.161:0/1089744532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc052850 con 0x560ac4b3d010 2024-05-08T09:21:46.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1089744532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 msgr2=0x560ac4bccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/1089744532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bccc90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00a470 tx=0x7fcfbc01cdb0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1089744532 shutdown_connections 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/1089744532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bccc90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1089744532 >> 172.21.15.161:0/1089744532 conn(0x560ac4bc45b0 msgr2=0x560ac4bc69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1089744532 shutdown_connections 2024-05-08T09:21:46.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.856+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1089744532 wait complete. 2024-05-08T09:21:46.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.870+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.870+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.870+0000 7fcfcae3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.870+0000 7fcfcae3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ac4b151d0 con 0x560ac4b3d010 2024-05-08T09:21:46.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.872+0000 7fcfc893e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.872+0000 7fcfc893e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51342/0 (socket says 172.21.15.161:51342) 2024-05-08T09:21:46.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.872+0000 7fcfc893e640 1 -- 172.21.15.161:0/4033094267 learned_addr learned my addr 172.21.15.161:0/4033094267 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.875+0000 7fcfc893e640 1 -- 172.21.15.161:0/4033094267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4bc8b80 con 0x560ac4b3d010 2024-05-08T09:21:46.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfc893e640 1 --2- 172.21.15.161:0/4033094267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc055040 tx=0x7fcfbc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d1c119c29d6ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fceb6e05640 1 -- 172.21.15.161:0/4033094267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc057070 con 0x560ac4b3d010 2024-05-08T09:21:46.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fceb6e05640 1 -- 172.21.15.161:0/4033094267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc063070 con 0x560ac4b3d010 2024-05-08T09:21:46.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fceb6e05640 1 -- 172.21.15.161:0/4033094267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc052a80 con 0x560ac4b3d010 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4033094267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 msgr2=0x560ac4bca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4033094267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc055040 tx=0x7fcfbc04c000 comp rx=0 tx=0).stop 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4033094267 shutdown_connections 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4033094267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4bca5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4033094267 >> 172.21.15.161:0/4033094267 conn(0x560ac4bc45b0 msgr2=0x560ac4cb6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4033094267 shutdown_connections 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.876+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4033094267 wait complete. 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfcae3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfcae3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ac4bd13c0 con 0x560ac4b3d010 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfc893e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfc893e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51356/0 (socket says 172.21.15.161:51356) 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfc893e640 1 -- 172.21.15.161:0/4277804583 learned_addr learned my addr 172.21.15.161:0/4277804583 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.877+0000 7fcfc893e640 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4cc55e0 con 0x560ac4b3d010 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fcfc893e640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005870 tx=0x7fcfbc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fceb5602640 1 -- 172.21.15.161:0/4277804583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc05e7c0 con 0x560ac4b3d010 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fceb5602640 1 -- 172.21.15.161:0/4277804583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfbc06d070 con 0x560ac4b3d010 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac4cc5870 con 0x560ac4b3d010 2024-05-08T09:21:46.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fceb5602640 1 -- 172.21.15.161:0/4277804583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfbc05ea90 con 0x560ac4b3d010 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.878+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac4cc8520 con 0x560ac4b3d010 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fceb5602640 1 -- 172.21.15.161:0/4277804583 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfbc05ec30 con 0x560ac4b3d010 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fceb5602640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 0x7fceb0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fceb5602640 1 -- 172.21.15.161:0/4277804583 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcfbc08eca0 con 0x560ac4b3d010 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 0x7fceb0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 0x560ac4ccc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4ccc820 con 0x560ac4bcd200 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fcfc913f640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 0x560ac4ccc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.879+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 0x7fceb0038dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4001db0 tx=0x7fcfb4001350 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfc913f640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 0x560ac4ccc2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfc913f640 1 -- 172.21.15.161:0/4277804583 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfc400a4a0 con 0x560ac4bcd200 2024-05-08T09:21:46.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4cc98b0 con 0x560ac4bcd200 2024-05-08T09:21:46.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfc913f640 1 -- 172.21.15.161:0/4277804583 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfc400a4a0 con 0x560ac4bcd200 2024-05-08T09:21:46.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 0x560ac4cd0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4cd1650 con 0x560ac4cceb70 2024-05-08T09:21:46.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.880+0000 7fcfc893e640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 0x560ac4cd0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.881+0000 7fcfc893e640 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 0x560ac4cd0f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.881+0000 7fcfc893e640 1 -- 172.21.15.161:0/4277804583 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4cceb70 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.881+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4ccdb20 con 0x560ac4bcd200 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.881+0000 7fcfc913f640 1 -- 172.21.15.161:0/4277804583 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfc400a4a0 con 0x560ac4bcd200 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.881+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4cce000 con 0x560ac4bcd200 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfc913f640 1 -- 172.21.15.161:0/4277804583 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcfc400a4a0 con 0x560ac4bcd200 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfcae3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfcae3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ac4abbcf0 con 0x560ac4ce0800 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.882+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51364/0 (socket says 172.21.15.161:51364) 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfc913f640 1 -- 172.21.15.161:0/435259452 learned_addr learned my addr 172.21.15.161:0/435259452 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfc913f640 1 -- 172.21.15.161:0/435259452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4ce1160 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfc913f640 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x560ac4cccc20 tx=0x7fcfc4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fceae7fc640 1 -- 172.21.15.161:0/435259452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc4014450 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fceae7fc640 1 -- 172.21.15.161:0/435259452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc4014610 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac4ce1bd0 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fceae7fc640 1 -- 172.21.15.161:0/435259452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc4014930 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.883+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac4ce20d0 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.884+0000 7fceae7fc640 1 -- 172.21.15.161:0/435259452 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfc4011040 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.884+0000 7fceae7fc640 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 0x7fcea0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.884+0000 7fceae7fc640 1 -- 172.21.15.161:0/435259452 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcfc401e070 con 0x560ac4ce0800 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.884+0000 7fcfc893e640 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 0x7fcea0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfc893e640 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 0x7fcea0038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x560ac4ccccc0 tx=0x7fcfbc052f70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfcae3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfcae3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ac4bc8e40 con 0x560ac4ceda50 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51376/0 (socket says 172.21.15.161:51376) 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfc913f640 1 -- 172.21.15.161:0/1907865471 learned_addr learned my addr 172.21.15.161:0/1907865471 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.885+0000 7fcfc913f640 1 -- 172.21.15.161:0/1907865471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4cee440 con 0x560ac4ceda50 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfc913f640 1 --2- 172.21.15.161:0/1907865471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcfc404c8d0 tx=0x7fcfc4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b250f476f882537f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fce9ffff640 1 -- 172.21.15.161:0/1907865471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc400dd90 con 0x560ac4ceda50 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fce9ffff640 1 -- 172.21.15.161:0/1907865471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc40167e0 con 0x560ac4ceda50 2024-05-08T09:21:46.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fce9ffff640 1 -- 172.21.15.161:0/1907865471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc4014ad0 con 0x560ac4ceda50 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1907865471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 msgr2=0x560ac4cede70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/1907865471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcfc404c8d0 tx=0x7fcfc4011ef0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1907865471 shutdown_connections 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/1907865471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cede70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1907865471 >> 172.21.15.161:0/1907865471 conn(0x560ac4ce9e00 msgr2=0x560ac4ce7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1907865471 shutdown_connections 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.886+0000 7fcfcae3f800 1 -- 172.21.15.161:0/1907865471 wait complete. 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfcae3f800 1 Processor -- start 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfcae3f800 1 -- start start 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfcae3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cf4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfcae3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560ac4ceeba0 con 0x560ac4ceda50 2024-05-08T09:21:46.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cf4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfc913f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cf4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51388/0 (socket says 172.21.15.161:51388) 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 learned_addr learned my addr 172.21.15.161:0/829147494 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.887+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ac4cf5530 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fcfc913f640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cf4ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40119b0 tx=0x7fcfc404c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fce9e7fc640 1 -- 172.21.15.161:0/829147494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc404e2e0 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fce9e7fc640 1 -- 172.21.15.161:0/829147494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc404b200 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ac4cf57c0 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fce9e7fc640 1 -- 172.21.15.161:0/829147494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfc404b4e0 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.888+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ac4cf8470 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fce9e7fc640 1 -- 172.21.15.161:0/829147494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfc403bb20 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fce9e7fc640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fce940368b0 0x7fce94038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fce9e7fc640 1 -- 172.21.15.161:0/829147494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcfc400e040 con 0x560ac4ceda50 2024-05-08T09:21:46.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fcfc893e640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fce940368b0 0x7fce94038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fcfc893e640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fce940368b0 0x7fce94038d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0813f0 tx=0x7fcfbc08a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4d00b10 0x560ac4d02fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.889+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d03720 con 0x560ac4d00b10 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4d00b10 0x560ac4d02fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4d00b10 0x560ac4d02fd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfb4009050 con 0x560ac4d00b10 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 20 realm 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4cfff60 con 0x560ac4d00b10 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfb4009050 con 0x560ac4d00b10 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.890+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d04210 con 0x560ac4d00b10 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfb4009050 con 0x560ac4d00b10 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d04ae0 con 0x560ac4d00b10 2024-05-08T09:21:46.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfb4009050 con 0x560ac4d00b10 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4d05500 0x560ac4d078f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d07ff0 con 0x560ac4d05500 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfc913f640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4d05500 0x560ac4d078f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.891+0000 7fcfc913f640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4d05500 0x560ac4d078f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfcae3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfcae3f800 20 searching for the correct realm 2024-05-08T09:21:46.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560ac4d09fa0 0x560ac4d0c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfc893e640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560ac4d09fa0 0x560ac4d0c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.892+0000 7fcfc893e640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560ac4d09fa0 0x560ac4d0c460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc893e640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfbc074ba0 0x7fcfbc07aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfbc074ba0 0x7fcfbc07aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc3fff640 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfbc074ba0 0x7fcfbc07aa40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4009050 con 0x7fcfbc074ba0 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.893+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4009050 con 0x560ac4d00b10 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.894+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.895+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.895+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.895+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.895+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.896+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.897+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.898+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.899+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.900+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d09fa0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.901+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d05500 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x560ac4d00b10 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cb30 con 0x7fcfbc074ba0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:46.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.902+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d089b0 con 0x560ac4d00b10 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d085c0 con 0x560ac4d00b10 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d09320 con 0x560ac4d00b10 2024-05-08T09:21:46.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 zone default found 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 4 Realm: () 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 zonegroup default 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.903+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0cfb0 con 0x560ac4d05500 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0f230 con 0x560ac4d09fa0 2024-05-08T09:21:46.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0f5d0 con 0x560ac4d09fa0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 started sync module instance, tier type = 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.904+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e6c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.905+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.905+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94604251687952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e6c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.905+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d10010 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.906+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94604251687952] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.906+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.906+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94604251691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e6c0 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.906+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d10a60 con 0x560ac4d09fa0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.907+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94604251691744] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.908+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.908+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94604251685392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e630 con 0x560ac4d09fa0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.908+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d117f0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.909+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.909+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94604251685392] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.909+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94604251697920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d120c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.909+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d10e90 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.910+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.910+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94604251697920] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.910+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94604251702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d10e90 con 0x560ac4d00b10 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.910+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d11c10 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.911+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94604251702864] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.911+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.911+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94604251703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d13540 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.911+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d13dd0 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.912+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94604251703920] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.912+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.912+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94604251705488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d13960 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.912+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d14830 con 0x560ac4d05500 2024-05-08T09:21:46.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94604251705488] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94604251710256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d13960 con 0x560ac4d05500 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=0 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=1 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=2 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=3 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=4 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=5 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.913+0000 7fcfcae3f800 20 add_watcher() i=6 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.914+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94604251710256] v27'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.914+0000 7fcfcae3f800 20 add_watcher() i=7 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.914+0000 7fcfcae3f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:46.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.914+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d17c50 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.915+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.915+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94604251707008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d15170 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.916+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94604251707008] v27'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.916+0000 7fce7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.916+0000 7fcfcae3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.916+0000 7fcfcae3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.916+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d17980 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.917+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.917+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20d10 con 0x560ac4d05500 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.918+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.918+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20d10 con 0x560ac4d09fa0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.919+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.919+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d217b0 con 0x560ac4d00b10 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.920+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.920+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x7fcfbc074ba0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.921+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.921+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x560ac4d09fa0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.922+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.922+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d00b10 2024-05-08T09:21:46.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.923+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.923+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d05500 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.924+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'13 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.925+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.925+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.926+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.926+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.927+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.927+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.927+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d05500 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.929+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.929+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d224e0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.930+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'10 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.930+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d224e0 con 0x560ac4d05500 2024-05-08T09:21:46.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.931+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'19 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.931+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d224e0 con 0x560ac4d00b10 2024-05-08T09:21:46.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.932+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.932+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.934+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.934+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.935+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.935+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.936+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.936+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d00b10 2024-05-08T09:21:46.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.937+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.937+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d00b10 2024-05-08T09:21:46.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.938+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.938+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.939+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'15 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.939+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.940+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.940+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.941+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.941+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.942+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.942+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.943+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.943+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d09fa0 2024-05-08T09:21:46.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.944+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.944+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d220c0 con 0x560ac4d05500 2024-05-08T09:21:46.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.945+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.945+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x560ac4d09fa0 2024-05-08T09:21:46.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.946+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.946+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x560ac4d05500 2024-05-08T09:21:46.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.947+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'14 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.947+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x560ac4d09fa0 2024-05-08T09:21:46.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.948+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.949+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x560ac4d05500 2024-05-08T09:21:46.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.950+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'20 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.950+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d20330 con 0x7fcfbc074ba0 2024-05-08T09:21:46.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.951+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.951+0000 7fce7dfe3640 20 reqs_thread_entry: start 2024-05-08T09:21:46.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.951+0000 7fcfcae3f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.951+0000 7fcfcae3f800 20 Filter name: none 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcdef7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfcae3f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfcae3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d4d4c0 con 0x7fcfbc074ba0 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfcae3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, user does not exist2024-05-08T09:21:46.952+0000 7fcfcae3f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:21:46.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.952+0000 7fcfcae3f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:21:46.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.953+0000 7fce7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:46.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.953+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94604251707008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d1f150 con 0x560ac4d00b10 2024-05-08T09:21:46.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.954+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94604251707008] v27'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.955+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94604251687952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d1f150 con 0x7fcfbc074ba0 2024-05-08T09:21:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.955+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94604251687952] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.955+0000 7fcfcae3f800 20 remove_watcher() i=0 2024-05-08T09:21:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.956+0000 7fcfcae3f800 2 removed watcher, disabling cache 2024-05-08T09:21:46.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.956+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94604251691744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0ebf0 con 0x560ac4d00b10 2024-05-08T09:21:46.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.957+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94604251691744] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.957+0000 7fcfcae3f800 20 remove_watcher() i=1 2024-05-08T09:21:46.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.957+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94604251685392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0fae0 con 0x560ac4d09fa0 2024-05-08T09:21:46.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.958+0000 7fcfc893e640 1 -- 172.21.15.161:0/829147494 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94604251685392] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfbc073d50 con 0x560ac4d09fa0 2024-05-08T09:21:46.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.958+0000 7fcfcae3f800 20 remove_watcher() i=2 2024-05-08T09:21:46.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.958+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94604251697920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e210 con 0x7fcfbc074ba0 2024-05-08T09:21:46.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.959+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94604251697920] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x7fcfbc074ba0 2024-05-08T09:21:46.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.959+0000 7fcfcae3f800 20 remove_watcher() i=3 2024-05-08T09:21:46.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.959+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94604251702864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e210 con 0x560ac4d00b10 2024-05-08T09:21:46.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.961+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94604251702864] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfb4029040 con 0x560ac4d00b10 2024-05-08T09:21:46.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.961+0000 7fcfcae3f800 20 remove_watcher() i=4 2024-05-08T09:21:46.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.961+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94604251703920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d12650 con 0x560ac4d05500 2024-05-08T09:21:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.962+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94604251703920] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.962+0000 7fcfcae3f800 20 remove_watcher() i=5 2024-05-08T09:21:46.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.962+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94604251705488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d0e210 con 0x560ac4d05500 2024-05-08T09:21:46.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.963+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94604251705488] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.963+0000 7fcfcae3f800 20 remove_watcher() i=6 2024-05-08T09:21:46.963 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.963+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94604251710256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560ac4d12b00 con 0x560ac4d05500 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfc913f640 1 -- 172.21.15.161:0/829147494 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94604251710256] v27'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfc402a070 con 0x560ac4d05500 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 20 remove_watcher() i=7 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4d05500 msgr2=0x560ac4d078f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4d05500 0x560ac4d078f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4d00b10 msgr2=0x560ac4d02fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4d00b10 0x560ac4d02fd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfbc074ba0 msgr2=0x7fcfbc07aa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfbc074ba0 0x7fcfbc07aa40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560ac4d09fa0 msgr2=0x560ac4d0c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560ac4d09fa0 0x560ac4d0c460 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fce940368b0 msgr2=0x7fce94038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fce940368b0 0x7fce94038d70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0813f0 tx=0x7fcfbc08a000 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 msgr2=0x560ac4cf4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/829147494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ceda50 0x560ac4cf4ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcfc40119b0 tx=0x7fcfc404c860 comp rx=0 tx=0).stop 2024-05-08T09:21:46.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 reap_dead start 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfc3fff640 1 -- 172.21.15.161:0/829147494 reap_dead start 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 shutdown_connections 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 >> 172.21.15.161:0/829147494 conn(0x560ac4ce9e00 msgr2=0x560ac4cef2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 shutdown_connections 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/829147494 wait complete. 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 msgr2=0x7fcea0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 0x7fcea0038dc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x560ac4ccccc0 tx=0x7fcfbc052f70 comp rx=0 tx=0).stop 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.964+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 msgr2=0x560ac4ce0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x560ac4cccc20 tx=0x7fcfc4018830 comp rx=0 tx=0).stop 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 shutdown_connections 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcea0036900 0x7fcea0038dc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/435259452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4ce0800 0x560ac4ce0c20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 >> 172.21.15.161:0/435259452 conn(0x560ac4cd48a0 msgr2=0x560ac4cd4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 shutdown_connections 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/435259452 wait complete. 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 msgr2=0x560ac4cd0f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 0x560ac4cd0f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 msgr2=0x560ac4ccc2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 0x560ac4ccc2e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 msgr2=0x7fceb0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 0x7fceb0038dc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4001db0 tx=0x7fcfb4001350 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 msgr2=0x560ac4cc50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc005870 tx=0x7fcfbc002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 shutdown_connections 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560ac4cceb70 0x560ac4cd0f60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560ac4bcd200 0x560ac4ccc2e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fceb0036900 0x7fceb0038dc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 --2- 172.21.15.161:0/4277804583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560ac4b3d010 0x560ac4cc50a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:46.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 >> 172.21.15.161:0/4277804583 conn(0x560ac4bc45b0 msgr2=0x560ac4bc93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:46.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 shutdown_connections 2024-05-08T09:21:46.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:46.965+0000 7fcfcae3f800 1 -- 172.21.15.161:0/4277804583 wait complete. 2024-05-08T09:21:46.974 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T09:21:46.975 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-05-08T09:21:46.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-05-08T09:21:46.975 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-05-08T09:21:47.019 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.019 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.019+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.019+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.019+0000 7fceb762f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e52015d460 0x55e52015f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.019+0000 7fceb762f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e52015fe20 con 0x55e520158fd0 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.019+0000 7fceb762f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e51ffeb050 con 0x55e52015d460 2024-05-08T09:21:47.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.020+0000 7fceb21bf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e52015d460 0x55e52015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.020+0000 7fceb29c0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e520158fd0 0x55e5201593f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42652/0 (socket says 172.21.15.161:42652) 2024-05-08T09:21:47.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.020+0000 7fceb29c0640 1 -- 172.21.15.161:0/2288337476 learned_addr learned my addr 172.21.15.161:0/2288337476 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.020+0000 7fceb21bf640 1 -- 172.21.15.161:0/2288337476 >> v1:172.21.15.45:6789/0 conn(0x55e520158fd0 legacy=0x55e5201593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.020+0000 7fceb21bf640 1 -- 172.21.15.161:0/2288337476 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520161050 con 0x55e52015d460 2024-05-08T09:21:47.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.022+0000 7fceb21bf640 1 --2- 172.21.15.161:0/2288337476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52015d460 0x55e52015f850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcea800a470 tx=0x7fcea801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e568f3d1052410d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.022+0000 7fceb19be640 1 -- 172.21.15.161:0/2288337476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea8057070 con 0x55e52015d460 2024-05-08T09:21:47.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.022+0000 7fceb19be640 1 -- 172.21.15.161:0/2288337476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea8052570 con 0x55e52015d460 2024-05-08T09:21:47.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.022+0000 7fceb19be640 1 -- 172.21.15.161:0/2288337476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea8052870 con 0x55e52015d460 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 -- 172.21.15.161:0/2288337476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52015d460 msgr2=0x55e52015f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 --2- 172.21.15.161:0/2288337476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52015d460 0x55e52015f850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcea800a470 tx=0x7fcea801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 -- 172.21.15.161:0/2288337476 shutdown_connections 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 --2- 172.21.15.161:0/2288337476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52015d460 0x55e52015f850 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 -- 172.21.15.161:0/2288337476 >> 172.21.15.161:0/2288337476 conn(0x55e5201545b0 msgr2=0x55e5201569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 -- 172.21.15.161:0/2288337476 shutdown_connections 2024-05-08T09:21:47.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.023+0000 7fceb762f800 1 -- 172.21.15.161:0/2288337476 wait complete. 2024-05-08T09:21:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb762f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb762f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e5200a51d0 con 0x55e520158fd0 2024-05-08T09:21:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb29c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb29c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51410/0 (socket says 172.21.15.161:51410) 2024-05-08T09:21:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb29c0640 1 -- 172.21.15.161:0/3386867656 learned_addr learned my addr 172.21.15.161:0/3386867656 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.037+0000 7fceb29c0640 1 -- 172.21.15.161:0/3386867656 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520249ae0 con 0x55e520158fd0 2024-05-08T09:21:47.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.038+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3386867656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcea4001e10 tx=0x7fcea400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc59a72fd27ab244 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.039+0000 7fcda0e09640 1 -- 172.21.15.161:0/3386867656 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4012020 con 0x55e520158fd0 2024-05-08T09:21:47.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.039+0000 7fcda0e09640 1 -- 172.21.15.161:0/3386867656 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea400e5a0 con 0x55e520158fd0 2024-05-08T09:21:47.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.039+0000 7fcda0e09640 1 -- 172.21.15.161:0/3386867656 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea400e8e0 con 0x55e520158fd0 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- 172.21.15.161:0/3386867656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 msgr2=0x55e520249510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 --2- 172.21.15.161:0/3386867656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcea4001e10 tx=0x7fcea400b780 comp rx=0 tx=0).stop 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- 172.21.15.161:0/3386867656 shutdown_connections 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 --2- 172.21.15.161:0/3386867656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520249510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- 172.21.15.161:0/3386867656 >> 172.21.15.161:0/3386867656 conn(0x55e5201545b0 msgr2=0x55e520244e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- 172.21.15.161:0/3386867656 shutdown_connections 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- 172.21.15.161:0/3386867656 wait complete. 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb762f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e5201602f0 con 0x55e520158fd0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb29c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb29c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51420/0 (socket says 172.21.15.161:51420) 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.040+0000 7fceb29c0640 1 -- 172.21.15.161:0/283808045 learned_addr learned my addr 172.21.15.161:0/283808045 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fceb29c0640 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520251680 con 0x55e520158fd0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fceb29c0640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcea4004170 tx=0x7fcea4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fcd9f606640 1 -- 172.21.15.161:0/283808045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea4012030 con 0x55e520158fd0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fcd9f606640 1 -- 172.21.15.161:0/283808045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcea401a680 con 0x55e520158fd0 2024-05-08T09:21:47.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e520251910 con 0x55e520158fd0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fcd9f606640 1 -- 172.21.15.161:0/283808045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcea401a870 con 0x55e520158fd0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.041+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5202545c0 con 0x55e520158fd0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fcd9f606640 1 -- 172.21.15.161:0/283808045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcea4015020 con 0x55e520158fd0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fcd9f606640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 0x7fcd98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fcd9f606640 1 -- 172.21.15.161:0/283808045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcea4020030 con 0x55e520158fd0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fceb21bf640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 0x7fcd98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 0x55e520258380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520258910 con 0x55e52015d460 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.042+0000 7fceb31c1640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 0x55e520258380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb21bf640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 0x7fcd98038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcea8054000 tx=0x7fcea804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb31c1640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 0x55e520258380 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb31c1640 1 -- 172.21.15.161:0/283808045 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fceac00a4a0 con 0x55e52015d460 2024-05-08T09:21:47.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520255950 con 0x55e52015d460 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb31c1640 1 -- 172.21.15.161:0/283808045 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fceac00a4a0 con 0x55e52015d460 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 0x55e52025d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.043+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52025d6d0 con 0x55e52025ac40 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.044+0000 7fceb29c0640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 0x55e52025d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.044+0000 7fceb29c0640 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 0x55e52025d030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.044+0000 7fceb29c0640 1 -- 172.21.15.161:0/283808045 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52025ac40 2024-05-08T09:21:47.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.044+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520259bf0 con 0x55e52015d460 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.045+0000 7fceb31c1640 1 -- 172.21.15.161:0/283808045 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fceac00a4a0 con 0x55e52015d460 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.045+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52025a0d0 con 0x55e52015d460 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.045+0000 7fceb31c1640 1 -- 172.21.15.161:0/283808045 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fceac00a4a0 con 0x55e52015d460 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.045+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.045+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb762f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb762f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e52004bcf0 con 0x55e520270c10 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51434/0 (socket says 172.21.15.161:51434) 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb31c1640 1 -- 172.21.15.161:0/3758387493 learned_addr learned my addr 172.21.15.161:0/3758387493 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb31c1640 1 -- 172.21.15.161:0/3758387493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520271570 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb31c1640 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55e520258cf0 tx=0x7fceac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fcd9ce01640 1 -- 172.21.15.161:0/3758387493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac014450 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fcd9ce01640 1 -- 172.21.15.161:0/3758387493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac014610 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e520271fe0 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fcd9ce01640 1 -- 172.21.15.161:0/3758387493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac014930 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.046+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5202724e0 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.047+0000 7fcd9ce01640 1 -- 172.21.15.161:0/3758387493 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fceac011040 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.047+0000 7fcd9ce01640 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 0x7fcd8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.047+0000 7fcd9ce01640 1 -- 172.21.15.161:0/3758387493 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fceac01e070 con 0x55e520270c10 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.047+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 0x7fcd8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 0x7fcd8c038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e520258d60 tx=0x7fcea4024ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb762f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb762f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e520249e60 con 0x55e52026c6c0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51448/0 (socket says 172.21.15.161:51448) 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb31c1640 1 -- 172.21.15.161:0/2234860096 learned_addr learned my addr 172.21.15.161:0/2234860096 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb31c1640 1 -- 172.21.15.161:0/2234860096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e52026d0b0 con 0x55e52026c6c0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.048+0000 7fceb31c1640 1 --2- 172.21.15.161:0/2234860096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fceac04c8d0 tx=0x7fceac04cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8055de8709b3b735 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fcd967fc640 1 -- 172.21.15.161:0/2234860096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac04e0d0 con 0x55e52026c6c0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fcd967fc640 1 -- 172.21.15.161:0/2234860096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac04e270 con 0x55e52026c6c0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fcd967fc640 1 -- 172.21.15.161:0/2234860096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac04b300 con 0x55e52026c6c0 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- 172.21.15.161:0/2234860096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 msgr2=0x55e52026cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 --2- 172.21.15.161:0/2234860096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fceac04c8d0 tx=0x7fceac04cb50 comp rx=0 tx=0).stop 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- 172.21.15.161:0/2234860096 shutdown_connections 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 --2- 172.21.15.161:0/2234860096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e52026cae0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- 172.21.15.161:0/2234860096 >> 172.21.15.161:0/2234860096 conn(0x55e52027a250 msgr2=0x55e5202782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- 172.21.15.161:0/2234860096 shutdown_connections 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- 172.21.15.161:0/2234860096 wait complete. 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 Processor -- start 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.049+0000 7fceb762f800 1 -- start start 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb762f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb762f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e52026d870 con 0x55e52026c6c0 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb31c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51454/0 (socket says 172.21.15.161:51454) 2024-05-08T09:21:47.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 learned_addr learned my addr 172.21.15.161:0/3360431926 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e520289d90 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb31c1640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fceac011fd0 tx=0x7fceac04c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fcd94ff9640 1 -- 172.21.15.161:0/3360431926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac04e0d0 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fcd94ff9640 1 -- 172.21.15.161:0/3360431926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceac0135c0 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fcd94ff9640 1 -- 172.21.15.161:0/3360431926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceac011e10 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e52028a020 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.050+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e52028ccd0 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.051+0000 7fcd94ff9640 1 -- 172.21.15.161:0/3360431926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fceac0138e0 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.051+0000 7fcd94ff9640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd7c036900 0x7fcd7c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.051+0000 7fcd94ff9640 1 -- 172.21.15.161:0/3360431926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fceac046040 con 0x55e52026c6c0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.051+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd7c036900 0x7fcd7c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd7c036900 0x7fcd7c038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c010 tx=0x7fcea4044000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e5202955f0 0x55e520297ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520298200 con 0x55e5202955f0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb21bf640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e5202955f0 0x55e520297ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.052+0000 7fceb21bf640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e5202955f0 0x55e520297ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 realm 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202985d0 con 0x55e5202955f0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520298ea0 con 0x55e5202955f0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e520299240 con 0x55e5202955f0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e520299fa0 0x55e52029c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.053+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52029c950 con 0x55e520299fa0 2024-05-08T09:21:47.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb31c1640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e520299fa0 0x55e52029c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb31c1640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e520299fa0 0x55e52029c390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb762f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb762f800 20 searching for the correct realm 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e52029e920 0x55e5202a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.054+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e52029e920 0x55e5202a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.055+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e52029e920 0x55e5202a0de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.055+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.055+0000 7fceb29c0640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcea4037070 0x7fcea4042750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.055+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.055+0000 7fceb21bf640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcea4037070 0x7fcea4042750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.056+0000 7fceb21bf640 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcea4037070 0x7fcea4042750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.056+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.056+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.056+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.056+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.057+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.058+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.059+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.060+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.061+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.061+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.061+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.061+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.062+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.063+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e52029e920 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e520299fa0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x55e5202955f0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a14b0 con 0x7fcea4037070 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.064+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:47.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52029d310 con 0x55e5202955f0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52029dbb0 con 0x55e5202955f0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e52029cf50 con 0x55e5202955f0 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 zone default found 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 4 Realm: () 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 zonegroup default 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.065+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a1970 con 0x55e520299fa0 2024-05-08T09:21:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a3c40 con 0x55e52029e920 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a3fe0 con 0x55e52029e920 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 started sync module instance, tier type = 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.066+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a30d0 con 0x7fcea4037070 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.068+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.068+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442575509024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a30d0 con 0x7fcea4037070 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.068+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a49a0 con 0x55e5202955f0 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.069+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442575509024] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.069+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.069+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442575513296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a30d0 con 0x55e5202955f0 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.069+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a5410 con 0x55e52029e920 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.070+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.070+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442575515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a5cb0 con 0x55e52029e920 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.070+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a6730 con 0x7fcea4037070 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.071+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442575513296] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.071+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.071+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442575520320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a6b50 con 0x7fcea4037070 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.071+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a7550 con 0x55e5202955f0 2024-05-08T09:21:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.072+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442575515392] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.073+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.073+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442575517696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a7510 con 0x55e5202955f0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.073+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a7f60 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.073+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442575520320] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.074+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.074+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442575526576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a8350 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.074+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a8d50 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.074+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442575517696] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.075+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.075+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442575523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a8d10 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.075+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a9760 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.075+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442575526576] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442575523936] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442575506464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a8d10 con 0x55e520299fa0 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=0 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=1 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=2 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=3 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=4 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=5 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.076+0000 7fceb762f800 20 add_watcher() i=6 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442575506464] v27'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb762f800 20 add_watcher() i=7 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb762f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202ac750 con 0x55e5202955f0 2024-05-08T09:21:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.077+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442575530544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a9bd0 con 0x55e5202955f0 2024-05-08T09:21:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.080+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442575530544] v27'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.080+0000 7fcd697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.080+0000 7fceb762f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.080+0000 7fceb762f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.080+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b4f80 con 0x55e5202955f0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.081+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.081+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b5630 con 0x55e520299fa0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.083+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.083+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b5630 con 0x55e52029e920 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.085+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.085+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b5e80 con 0x55e5202955f0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.088+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'32 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.088+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6270 con 0x7fcea4037070 2024-05-08T09:21:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.092+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.092+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6670 con 0x55e52029e920 2024-05-08T09:21:47.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.095+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.095+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6a10 con 0x55e5202955f0 2024-05-08T09:21:47.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.095+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.095+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6be0 con 0x55e520299fa0 2024-05-08T09:21:47.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.096+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'15 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.096+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6be0 con 0x7fcea4037070 2024-05-08T09:21:47.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.097+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.097+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6be0 con 0x55e52029e920 2024-05-08T09:21:47.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.098+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.098+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6be0 con 0x7fcea4037070 2024-05-08T09:21:47.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.101+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.102+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b6be0 con 0x55e520299fa0 2024-05-08T09:21:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.103+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.103+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7270 con 0x7fcea4037070 2024-05-08T09:21:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.104+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'11 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.104+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e520299fa0 2024-05-08T09:21:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.107+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'21 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.107+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e5202955f0 2024-05-08T09:21:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.109+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.109+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.112+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.112+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x7fcea4037070 2024-05-08T09:21:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.115+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.115+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.118+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.118+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e5202955f0 2024-05-08T09:21:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.119+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.119+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e5202955f0 2024-05-08T09:21:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.121+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.121+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.124+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'18 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.124+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x7fcea4037070 2024-05-08T09:21:47.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.125+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.125+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.128+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.128+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.129+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.129+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.130+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.130+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.131+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.131+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e520299fa0 2024-05-08T09:21:47.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.133+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.133+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.134+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.134+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e520299fa0 2024-05-08T09:21:47.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.137+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'16 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.137+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e52029e920 2024-05-08T09:21:47.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.138+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.139+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x55e520299fa0 2024-05-08T09:21:47.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.140+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'22 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.140+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b7250 con 0x7fcea4037070 2024-05-08T09:21:47.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.141+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.141 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.141+0000 7fcce3fff640 20 reqs_thread_entry: start 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.141+0000 7fceb762f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.141+0000 7fceb762f800 20 Filter name: none 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fcce1ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e5202e22b0 con 0x55e520299fa0 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.142+0000 7fceb762f800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T09:21:47.143 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T09:21:47.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.143+0000 7fcd697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.143+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442575530544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202b2ce0 con 0x55e5202955f0 2024-05-08T09:21:47.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.144+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94442575530544] v27'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.144+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442575509024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a8a00 con 0x7fcea4037070 2024-05-08T09:21:47.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.145+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94442575509024] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.145+0000 7fceb762f800 20 remove_watcher() i=0 2024-05-08T09:21:47.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.145+0000 7fceb762f800 2 removed watcher, disabling cache 2024-05-08T09:21:47.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.145+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442575513296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a3600 con 0x55e5202955f0 2024-05-08T09:21:47.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.146+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94442575513296] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.146+0000 7fceb762f800 20 remove_watcher() i=1 2024-05-08T09:21:47.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.146+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442575515392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a46d0 con 0x55e52029e920 2024-05-08T09:21:47.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.147+0000 7fceb29c0640 1 -- 172.21.15.161:0/3360431926 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94442575515392] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea402dcf0 con 0x55e52029e920 2024-05-08T09:21:47.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.147+0000 7fceb762f800 20 remove_watcher() i=2 2024-05-08T09:21:47.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.147+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442575520320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a46d0 con 0x7fcea4037070 2024-05-08T09:21:47.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.148+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94442575520320] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x7fcea4037070 2024-05-08T09:21:47.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.148+0000 7fceb762f800 20 remove_watcher() i=3 2024-05-08T09:21:47.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.148+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442575517696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a46d0 con 0x55e5202955f0 2024-05-08T09:21:47.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.151+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94442575517696] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcea805a040 con 0x55e5202955f0 2024-05-08T09:21:47.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.151+0000 7fceb762f800 20 remove_watcher() i=4 2024-05-08T09:21:47.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.151+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442575526576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a46d0 con 0x55e520299fa0 2024-05-08T09:21:47.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.152+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94442575526576] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.152+0000 7fceb762f800 20 remove_watcher() i=5 2024-05-08T09:21:47.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.152+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442575523936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a7ab0 con 0x55e520299fa0 2024-05-08T09:21:47.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.153+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94442575523936] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.153+0000 7fceb762f800 20 remove_watcher() i=6 2024-05-08T09:21:47.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.153+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442575506464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e5202a46d0 con 0x55e520299fa0 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.154+0000 7fceb31c1640 1 -- 172.21.15.161:0/3360431926 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94442575506464] v27'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fceac056040 con 0x55e520299fa0 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.154+0000 7fceb762f800 20 remove_watcher() i=7 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e520299fa0 msgr2=0x55e52029c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e520299fa0 0x55e52029c390 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e5202955f0 msgr2=0x55e520297ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e5202955f0 0x55e520297ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcea4037070 msgr2=0x7fcea4042750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcea4037070 0x7fcea4042750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e52029e920 msgr2=0x55e5202a0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e52029e920 0x55e5202a0de0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd7c036900 msgr2=0x7fcd7c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd7c036900 0x7fcd7c038dc0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcea400c010 tx=0x7fcea4044000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 msgr2=0x55e520289850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb21bf640 1 -- 172.21.15.161:0/3360431926 reap_dead start 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fceac011fd0 tx=0x7fceac04c830 comp rx=0 tx=0).stop 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 shutdown_connections 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3360431926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e52026c6c0 0x55e520289850 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 >> 172.21.15.161:0/3360431926 conn(0x55e52027a250 msgr2=0x55e5202778b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 shutdown_connections 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3360431926 wait complete. 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 msgr2=0x7fcd8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 0x7fcd8c038dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55e520258d60 tx=0x7fcea4024ef0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 msgr2=0x55e520271030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x55e520258cf0 tx=0x7fceac018830 comp rx=0 tx=0).stop 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 shutdown_connections 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd8c036900 0x7fcd8c038dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 --2- 172.21.15.161:0/3758387493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520270c10 0x55e520271030 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 >> 172.21.15.161:0/3758387493 conn(0x55e5202608a0 msgr2=0x55e520260ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 shutdown_connections 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.155+0000 7fceb762f800 1 -- 172.21.15.161:0/3758387493 wait complete. 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 msgr2=0x55e52025d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 0x55e52025d030 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 msgr2=0x55e520258380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 0x55e520258380 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 msgr2=0x7fcd98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 0x7fcd98038e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcea8054000 tx=0x7fcea804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 msgr2=0x55e520251140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcea4004170 tx=0x7fcea4000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 shutdown_connections 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e52025ac40 0x55e52025d030 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e52015d460 0x55e520258380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcd98036950 0x7fcd98038e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 --2- 172.21.15.161:0/283808045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e520158fd0 0x55e520251140 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 >> 172.21.15.161:0/283808045 conn(0x55e5201545b0 msgr2=0x55e520243630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 shutdown_connections 2024-05-08T09:21:47.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.156+0000 7fceb762f800 1 -- 172.21.15.161:0/283808045 wait complete. 2024-05-08T09:21:47.165 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T09:21:47.165 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:47.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:47.166 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T09:21:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.210+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.210+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.210+0000 7f1bc5c98800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5609e6a9bfd0 0x5609e6a9c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.210+0000 7f1bc5c98800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5609e6a9ca70 con 0x5609e6a9d230 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.210+0000 7f1bc5c98800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5609e692e050 con 0x5609e6a9bfd0 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bbaf9d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5609e6a9d230 0x5609e6a9d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42660/0 (socket says 172.21.15.161:42660) 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/2998321623 learned_addr learned my addr 172.21.15.161:0/2998321623 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc379e640 1 --2- 172.21.15.161:0/2998321623 >> v2:172.21.15.45:3300/0 conn(0x5609e6a9bfd0 0x5609e6a9c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512100125 0 0) 0x5609e6a9ca70 con 0x5609e6a9d230 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb0004020 con 0x5609e6a9d230 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 765482222 0 0) 0x7f1bb0004020 con 0x5609e6a9d230 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 >> v2:172.21.15.45:3300/0 conn(0x5609e6a9bfd0 msgr2=0x5609e6a9c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 --2- 172.21.15.161:0/2998321623 >> v2:172.21.15.45:3300/0 conn(0x5609e6a9bfd0 0x5609e6a9c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6a9ddf0 con 0x5609e6a9d230 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1106978320 0 0) 0x7f1bac0015a0 con 0x5609e6a9d230 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 >> v1:172.21.15.45:6789/0 conn(0x5609e6a9d230 legacy=0x5609e6a9d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 --2- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 0x7f1bb00048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e692e050 con 0x7f1bb00044b0 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.211+0000 7f1bc379e640 1 --2- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 0x7f1bb00048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.212+0000 7f1bc379e640 1 -- 172.21.15.161:0/2998321623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb0004020 con 0x7f1bb00044b0 2024-05-08T09:21:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.213+0000 7f1bc379e640 1 --2- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 0x7f1bb00048b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40097c0 tx=0x7f1bb401d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99029b609078fda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4057070 con 0x7f1bb00044b0 2024-05-08T09:21:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb4052570 con 0x7f1bb00044b0 2024-05-08T09:21:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc2f9d640 1 -- 172.21.15.161:0/2998321623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4009410 con 0x7f1bb00044b0 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 -- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 msgr2=0x7f1bb00048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 0x7f1bb00048b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1bb40097c0 tx=0x7f1bb401d2b0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 -- 172.21.15.161:0/2998321623 shutdown_connections 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/2998321623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb00044b0 0x7f1bb00048b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/2998321623 >> v2:172.21.15.45:3300/0 conn(0x5609e6a9bfd0 0x5609e6a9c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 -- 172.21.15.161:0/2998321623 >> 172.21.15.161:0/2998321623 conn(0x5609e6a975b0 msgr2=0x5609e6a999d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 -- 172.21.15.161:0/2998321623 shutdown_connections 2024-05-08T09:21:47.216 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.214+0000 7f1bc5c98800 1 -- 172.21.15.161:0/2998321623 wait complete. 2024-05-08T09:21:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc5c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc5c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e69e81d0 con 0x5609e6a9bfd0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc379e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc379e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51482/0 (socket says 172.21.15.161:51482) 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.228+0000 7f1bc379e640 1 -- 172.21.15.161:0/4179878007 learned_addr learned my addr 172.21.15.161:0/4179878007 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.229+0000 7f1bc379e640 1 -- 172.21.15.161:0/4179878007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6b90c90 con 0x5609e6a9bfd0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.229+0000 7f1bc379e640 1 --2- 172.21.15.161:0/4179878007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bb401d2f0 tx=0x7f1bb4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d9d8239e92c1544 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.229+0000 7f1ab160a640 1 -- 172.21.15.161:0/4179878007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4057040 con 0x5609e6a9bfd0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.229+0000 7f1ab160a640 1 -- 172.21.15.161:0/4179878007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb4052850 con 0x5609e6a9bfd0 2024-05-08T09:21:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.229+0000 7f1ab160a640 1 -- 172.21.15.161:0/4179878007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4052b70 con 0x5609e6a9bfd0 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- 172.21.15.161:0/4179878007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 msgr2=0x5609e6b906c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/4179878007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bb401d2f0 tx=0x7f1bb4002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- 172.21.15.161:0/4179878007 shutdown_connections 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/4179878007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b906c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- 172.21.15.161:0/4179878007 >> 172.21.15.161:0/4179878007 conn(0x5609e6a975b0 msgr2=0x5609e6b87bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- 172.21.15.161:0/4179878007 shutdown_connections 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- 172.21.15.161:0/4179878007 wait complete. 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc5c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e6a0f570 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc379e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc379e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51496/0 (socket says 172.21.15.161:51496) 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.230+0000 7f1bc379e640 1 -- 172.21.15.161:0/365771823 learned_addr learned my addr 172.21.15.161:0/365771823 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1bc379e640 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6b98640 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1bc379e640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4055040 tx=0x7f1bb0006330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1aafe07640 1 -- 172.21.15.161:0/365771823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4073070 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1aafe07640 1 -- 172.21.15.161:0/365771823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb405c480 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e6b988d0 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1aafe07640 1 -- 172.21.15.161:0/365771823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb4057040 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.231+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e6b9b530 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1aafe07640 1 -- 172.21.15.161:0/365771823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bb4076070 con 0x5609e6a9bfd0 2024-05-08T09:21:47.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1aafe07640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 0x7f1aa8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1aafe07640 1 -- 172.21.15.161:0/365771823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bb406b070 con 0x5609e6a9bfd0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 0x7f1aa8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 0x5609e6b9f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6b9f880 con 0x5609e6a9d230 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.232+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 0x5609e6b9f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 0x7f1aa8038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00b2d0 tx=0x7f1bac0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 0x5609e6b9f2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/365771823 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bbc00a4a0 con 0x5609e6a9d230 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6b9c8a0 con 0x5609e6a9d230 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/365771823 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bbc00a4a0 con 0x5609e6a9d230 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 0x5609e6ba3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.233+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6ba42e0 con 0x7f1bb00044b0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.234+0000 7f1bc379e640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 0x5609e6ba3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.234+0000 7f1bc379e640 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 0x5609e6ba3c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.234+0000 7f1bc379e640 1 -- 172.21.15.161:0/365771823 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bb4075030 con 0x7f1bb00044b0 2024-05-08T09:21:47.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.234+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6ba0bb0 con 0x5609e6a9d230 2024-05-08T09:21:47.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/365771823 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bbc00a4a0 con 0x5609e6a9d230 2024-05-08T09:21:47.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6ba1050 con 0x5609e6a9d230 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/365771823 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bbc00a4a0 con 0x5609e6a9d230 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc5c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc5c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e698ecf0 con 0x5609e6bb3470 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.235+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51500/0 (socket says 172.21.15.161:51500) 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/3461156191 learned_addr learned my addr 172.21.15.161:0/3461156191 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/3461156191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6bb3dd0 con 0x5609e6bb3470 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5609e6b9fc80 tx=0x7f1bbc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1aad602640 1 -- 172.21.15.161:0/3461156191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc014450 con 0x5609e6bb3470 2024-05-08T09:21:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1aad602640 1 -- 172.21.15.161:0/3461156191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0145f0 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e6bb4840 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1aad602640 1 -- 172.21.15.161:0/3461156191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc0148f0 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.236+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e6bb4d40 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.237+0000 7f1aad602640 1 -- 172.21.15.161:0/3461156191 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bbc011040 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.237+0000 7f1aad602640 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 0x7f1a9c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.237+0000 7f1aad602640 1 -- 172.21.15.161:0/3461156191 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bbc01e070 con 0x5609e6bb3470 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.237+0000 7f1bc379e640 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 0x7f1a9c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.237+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc379e640 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 0x7f1a9c038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5609e6b9fd70 tx=0x7f1bb4070f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc5c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc5c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e6b90fb0 con 0x5609e6bc0850 2024-05-08T09:21:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51508/0 (socket says 172.21.15.161:51508) 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/3341979388 learned_addr learned my addr 172.21.15.161:0/3341979388 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/3341979388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6bc1240 con 0x5609e6bc0850 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/3341979388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011f80 tx=0x7f1bbc0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b02ac4ead297a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1aa6ffd640 1 -- 172.21.15.161:0/3341979388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc04e200 con 0x5609e6bc0850 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1aa6ffd640 1 -- 172.21.15.161:0/3341979388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc04b200 con 0x5609e6bc0850 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.238+0000 7f1aa6ffd640 1 -- 172.21.15.161:0/3341979388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc04b4e0 con 0x5609e6bc0850 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3341979388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 msgr2=0x5609e6bc0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3341979388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011f80 tx=0x7f1bbc0118e0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3341979388 shutdown_connections 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3341979388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc0c70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3341979388 >> 172.21.15.161:0/3341979388 conn(0x5609e6bbcad0 msgr2=0x5609e6bbab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3341979388 shutdown_connections 2024-05-08T09:21:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3341979388 wait complete. 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 Processor -- start 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- start start 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.239+0000 7f1bc5c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5609e6bc1970 con 0x5609e6bc0850 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc3f9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51522/0 (socket says 172.21.15.161:51522) 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 learned_addr learned my addr 172.21.15.161:0/1991235795 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609e6bc8260 con 0x5609e6bc0850 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011fd0 tx=0x7f1bbc04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1aa57fa640 1 -- 172.21.15.161:0/1991235795 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc022bb0 con 0x5609e6bc0850 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1aa57fa640 1 -- 172.21.15.161:0/1991235795 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc022d50 con 0x5609e6bc0850 2024-05-08T09:21:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5609e6bc84f0 con 0x5609e6bc0850 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1aa57fa640 1 -- 172.21.15.161:0/1991235795 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bbc0134e0 con 0x5609e6bc0850 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.240+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609e6bcb1a0 con 0x5609e6bc0850 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.241+0000 7f1aa57fa640 1 -- 172.21.15.161:0/1991235795 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1bbc03b2a0 con 0x5609e6bc0850 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.241+0000 7f1aa57fa640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a8c036900 0x7f1a8c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.241+0000 7f1aa57fa640 1 -- 172.21.15.161:0/1991235795 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1bbc00e040 con 0x5609e6bc0850 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.241+0000 7f1bc379e640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a8c036900 0x7f1a8c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bc379e640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a8c036900 0x7f1a8c038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5609e6ba46c0 tx=0x7f1bb4089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6bd3830 0x5609e6bd5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bd6440 con 0x5609e6bd3830 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6bd3830 0x5609e6bd5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6bd3830 0x5609e6bd5cf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.242+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bac00f770 con 0x5609e6bd3830 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 realm 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bd2c80 con 0x5609e6bd3830 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bac00f770 con 0x5609e6bd3830 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bd6f30 con 0x5609e6bd3830 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bac00f770 con 0x5609e6bd3830 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bd7800 con 0x5609e6bd3830 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bac00f770 con 0x5609e6bd3830 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5609e6bd8220 0x5609e6bda610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdad50 con 0x5609e6bd8220 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.243+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5609e6bd8220 0x5609e6bda610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc3f9f640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5609e6bd8220 0x5609e6bda610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc5c98800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc5c98800 20 searching for the correct realm 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5609e6bdcd20 0x5609e6bdf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bdcd20 2024-05-08T09:21:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc379e640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5609e6bdcd20 0x5609e6bdf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.244+0000 7f1bc379e640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5609e6bdcd20 0x5609e6bdf1e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.245+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.245+0000 7f1bc379e640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1bb408d040 0x7f1bb4064730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.245+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x7f1bb408d040 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.245+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1bb408d040 0x7f1bb4064730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.245+0000 7f1bbaf9d640 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1bb408d040 0x7f1bb4064730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac00f770 con 0x7f1bb408d040 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd8220 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd3830 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac00f770 con 0x5609e6bd3830 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd3830 2024-05-08T09:21:47.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.246+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x7f1bb408d040 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x7f1bb408d040 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bdcd20 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.247+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd3830 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bd3830 2024-05-08T09:21:47.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x7f1bb408d040 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bac02b040 con 0x7f1bb408d040 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.248+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdf8b0 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd8220 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.249+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd3830 2024-05-08T09:21:47.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd3830 2024-05-08T09:21:47.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.250+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd8220 2024-05-08T09:21:47.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x7f1bb408d040 2024-05-08T09:21:47.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x7f1bb408d040 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.251+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd3830 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd8220 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd8220 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.252+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x7f1bb408d040 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x7f1bb408d040 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bdcd20 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd8220 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x5609e6bd3830 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.253+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f1bb40a7040 con 0x7f1bb408d040 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bac02b040 con 0x7f1bb408d040 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdb710 con 0x5609e6bd3830 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bac02b040 con 0x5609e6bd3830 2024-05-08T09:21:47.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdb350 con 0x5609e6bd3830 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.254+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdc0b0 con 0x5609e6bd3830 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 zone default found 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 4 Realm: () 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:47.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 zonegroup default 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bdfdc0 con 0x5609e6bd8220 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be2090 con 0x5609e6bdcd20 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be2430 con 0x5609e6bdcd20 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.255+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.256+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.256+0000 7f1bc5c98800 20 started sync module instance, tier type = 2024-05-08T09:21:47.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.256+0000 7f1bc5c98800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.256+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be1520 con 0x7f1bb408d040 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.257+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.257+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94600525912608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be1520 con 0x7f1bb408d040 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.257+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be2e40 con 0x5609e6bd3830 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.258+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94600525912608] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.258+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.258+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94600525917040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be1520 con 0x5609e6bd3830 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.258+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be3890 con 0x5609e6bdcd20 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.260+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.260+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94600525919136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be4160 con 0x5609e6bdcd20 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.260+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be4c00 con 0x7f1bb408d040 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.260+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94600525917040] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.263+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94600525919136] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.263+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.263+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94600525921456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be1070 con 0x7f1bb408d040 2024-05-08T09:21:47.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.263+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be54a0 con 0x5609e6bd3830 2024-05-08T09:21:47.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.266+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.266+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94600525926304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be58f0 con 0x5609e6bd3830 2024-05-08T09:21:47.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.266+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be6410 con 0x5609e6bd8220 2024-05-08T09:21:47.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.268+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.268+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94600525921456] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.268+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94600525930208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be6cb0 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.268+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be46f0 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.271+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94600525926304] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.271+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94600525930208] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.271+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.271+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94600525927360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be6cb0 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.271+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7720 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94600525927360] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94600525935216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7b40 con 0x5609e6bd8220 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=0 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=1 2024-05-08T09:21:47.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=2 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=3 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=4 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=5 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.272+0000 7f1bc5c98800 20 add_watcher() i=6 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.273+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94600525935216] v27'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.273+0000 7f1bc5c98800 20 add_watcher() i=7 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.273+0000 7f1bc5c98800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.273+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7b40 con 0x5609e6bd3830 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.273+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.274+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94600525936272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7ab0 con 0x5609e6bd3830 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.275+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94600525936272] v27'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.275+0000 7f1a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.275+0000 7f1bc5c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.275+0000 7f1bc5c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.275+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf33a0 con 0x5609e6bd3830 2024-05-08T09:21:47.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.277+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.277+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf39f0 con 0x5609e6bd8220 2024-05-08T09:21:47.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.278+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.278+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf39f0 con 0x5609e6bdcd20 2024-05-08T09:21:47.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.280+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.280+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf3ef0 con 0x5609e6bd3830 2024-05-08T09:21:47.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.281+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.281+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf1260 con 0x7f1bb408d040 2024-05-08T09:21:47.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.282+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.282+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf1260 con 0x5609e6bdcd20 2024-05-08T09:21:47.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.283+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.283+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf1260 con 0x5609e6bd3830 2024-05-08T09:21:47.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.287+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.287+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf13a0 con 0x5609e6bd8220 2024-05-08T09:21:47.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.287+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'17 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.287+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x7f1bb408d040 2024-05-08T09:21:47.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.288+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.288+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x5609e6bdcd20 2024-05-08T09:21:47.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.289+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.289+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x7f1bb408d040 2024-05-08T09:21:47.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.290+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.290+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x5609e6bd8220 2024-05-08T09:21:47.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.291+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.291+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x7f1bb408d040 2024-05-08T09:21:47.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.292+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.292+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a50 con 0x5609e6bd8220 2024-05-08T09:21:47.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.294+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'23 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.294+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd3830 2024-05-08T09:21:47.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.295+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.295+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.296+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.296+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x7f1bb408d040 2024-05-08T09:21:47.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.297+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.297+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.298+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.298+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd3830 2024-05-08T09:21:47.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.299+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.299+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd3830 2024-05-08T09:21:47.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.300+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.300+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.301+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'21 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.301+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x7f1bb408d040 2024-05-08T09:21:47.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.302+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.302+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.303+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.303+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.304+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.304+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.306+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.306+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.307+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.307+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd8220 2024-05-08T09:21:47.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.308+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.308+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.309+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.309+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd8220 2024-05-08T09:21:47.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.310+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'18 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.310+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bdcd20 2024-05-08T09:21:47.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.311+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.311+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x5609e6bd8220 2024-05-08T09:21:47.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.313+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'24 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.313+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf4a00 con 0x7f1bb408d040 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1a78fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bc5c98800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bc5c98800 20 Filter name: none 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f19f27fc640 20 reqs_thread_entry: start 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bc5c98800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:47.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bc5c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.314+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5609e6c1fbf0 con 0x5609e6bd8220 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1bc5c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1bc5c98800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1bc5c98800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1a79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.315+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94600525936272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6bf0580 con 0x5609e6bd3830 2024-05-08T09:21:47.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.317+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94600525936272] v27'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.317+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94600525912608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7690 con 0x7f1bb408d040 2024-05-08T09:21:47.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.318+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94600525912608] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.318+0000 7f1bc5c98800 20 remove_watcher() i=0 2024-05-08T09:21:47.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.318+0000 7f1bc5c98800 2 removed watcher, disabling cache 2024-05-08T09:21:47.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.318+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94600525917040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7690 con 0x5609e6bd3830 2024-05-08T09:21:47.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.319+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94600525917040] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.319+0000 7f1bc5c98800 20 remove_watcher() i=1 2024-05-08T09:21:47.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.319+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94600525919136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be2b70 con 0x5609e6bdcd20 2024-05-08T09:21:47.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.320+0000 7f1bc379e640 1 -- 172.21.15.161:0/1991235795 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94600525919136] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb4098070 con 0x5609e6bdcd20 2024-05-08T09:21:47.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.320+0000 7f1bc5c98800 20 remove_watcher() i=2 2024-05-08T09:21:47.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.320+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94600525921456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7690 con 0x7f1bb408d040 2024-05-08T09:21:47.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.321+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94600525921456] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x7f1bb408d040 2024-05-08T09:21:47.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.321+0000 7f1bc5c98800 20 remove_watcher() i=3 2024-05-08T09:21:47.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.321+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94600525926304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be3cb0 con 0x5609e6bd3830 2024-05-08T09:21:47.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.322+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94600525926304] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bac03d040 con 0x5609e6bd3830 2024-05-08T09:21:47.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.322+0000 7f1bc5c98800 20 remove_watcher() i=4 2024-05-08T09:21:47.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.322+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94600525930208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be7690 con 0x5609e6bd8220 2024-05-08T09:21:47.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.324+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94600525930208] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.324+0000 7f1bc5c98800 20 remove_watcher() i=5 2024-05-08T09:21:47.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.324+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94600525927360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be4fa0 con 0x5609e6bd8220 2024-05-08T09:21:47.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.325+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94600525927360] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.325+0000 7f1bc5c98800 20 remove_watcher() i=6 2024-05-08T09:21:47.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.325+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94600525935216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5609e6be3cb0 con 0x5609e6bd8220 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc3f9f640 1 -- 172.21.15.161:0/1991235795 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94600525935216] v27'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bbc02a070 con 0x5609e6bd8220 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 20 remove_watcher() i=7 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5609e6bd8220 msgr2=0x5609e6bda610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5609e6bd8220 0x5609e6bda610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6bd3830 msgr2=0x5609e6bd5cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6bd3830 0x5609e6bd5cf0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1bb408d040 msgr2=0x7f1bb4064730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1bb408d040 0x7f1bb4064730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5609e6bdcd20 msgr2=0x5609e6bdf1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5609e6bdcd20 0x5609e6bdf1e0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a8c036900 msgr2=0x7f1a8c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a8c036900 0x7f1a8c038dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5609e6ba46c0 tx=0x7f1bb4089000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 msgr2=0x5609e6bc7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bbaf9d640 1 -- 172.21.15.161:0/1991235795 reap_dead start 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc011fd0 tx=0x7f1bbc04c820 comp rx=0 tx=0).stop 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 shutdown_connections 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.326+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/1991235795 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bc0850 0x5609e6bc7d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 >> 172.21.15.161:0/1991235795 conn(0x5609e6bbcad0 msgr2=0x5609e6bba130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 shutdown_connections 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/1991235795 wait complete. 2024-05-08T09:21:47.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 msgr2=0x7f1a9c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 0x7f1a9c038dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5609e6b9fd70 tx=0x7f1bb4070f00 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 msgr2=0x5609e6bb3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x5609e6b9fc80 tx=0x7f1bbc018830 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 shutdown_connections 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1a9c036900 0x7f1a9c038dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/3461156191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6bb3470 0x5609e6bb3890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 >> 172.21.15.161:0/3461156191 conn(0x5609e6ba7510 msgr2=0x5609e6ba7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 shutdown_connections 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/3461156191 wait complete. 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 msgr2=0x5609e6ba3c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 0x5609e6ba3c10 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 msgr2=0x5609e6b9f2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 0x5609e6b9f2f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 msgr2=0x7f1aa8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 0x7f1aa8038dc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1bac00b2d0 tx=0x7f1bac0013b0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 msgr2=0x5609e6b98100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.327+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4055040 tx=0x7f1bb0006330 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 shutdown_connections 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f1bb00044b0 0x5609e6ba3c10 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5609e6a9d230 0x5609e6b9f2f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1aa8036900 0x7f1aa8038dc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 --2- 172.21.15.161:0/365771823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5609e6a9bfd0 0x5609e6b98100 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 >> 172.21.15.161:0/365771823 conn(0x5609e6a975b0 msgr2=0x5609e6b863d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 shutdown_connections 2024-05-08T09:21:47.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.328+0000 7f1bc5c98800 1 -- 172.21.15.161:0/365771823 wait complete. 2024-05-08T09:21:47.336 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T09:21:47.337 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T09:21:47.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T09:21:47.337 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T09:21:47.422 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.422 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994e333800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556f67ec3670 0x556f67ec5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994e333800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556f67ec5fa0 con 0x556f67ebfb60 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994e333800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x556f67d50050 con 0x556f67ec3670 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f99418f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556f67ec3670 0x556f67ec5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994a0f2640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x556f67ebfb60 0x556f67ec1f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42670/0 (socket says 172.21.15.161:42670) 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f99418f1640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556f67ec3670 0x556f67ec5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51532/0 (socket says 172.21.15.161:51532) 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f994a0f2640 1 -- 172.21.15.161:0/3989803474 learned_addr learned my addr 172.21.15.161:0/3989803474 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f99418f1640 1 -- 172.21.15.161:0/3989803474 >> v1:172.21.15.45:6789/0 conn(0x556f67ebfb60 legacy=0x556f67ec1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.423+0000 7f99418f1640 1 -- 172.21.15.161:0/3989803474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67ec7180 con 0x556f67ec3670 2024-05-08T09:21:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.425+0000 7f99418f1640 1 --2- 172.21.15.161:0/3989803474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ec3670 0x556f67ec5a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2658adea76a43ed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.425+0000 7f99498f1640 1 -- 172.21.15.161:0/3989803474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934057070 con 0x556f67ec3670 2024-05-08T09:21:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.425+0000 7f99498f1640 1 -- 172.21.15.161:0/3989803474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9934052570 con 0x556f67ec3670 2024-05-08T09:21:47.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f99498f1640 1 -- 172.21.15.161:0/3989803474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934052870 con 0x556f67ec3670 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 -- 172.21.15.161:0/3989803474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ec3670 msgr2=0x556f67ec5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 --2- 172.21.15.161:0/3989803474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ec3670 0x556f67ec5a60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f993400a470 tx=0x7f993401ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 -- 172.21.15.161:0/3989803474 shutdown_connections 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 --2- 172.21.15.161:0/3989803474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ec3670 0x556f67ec5a60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 -- 172.21.15.161:0/3989803474 >> 172.21.15.161:0/3989803474 conn(0x556f67eb95b0 msgr2=0x556f67ebb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 -- 172.21.15.161:0/3989803474 shutdown_connections 2024-05-08T09:21:47.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.426+0000 7f994e333800 1 -- 172.21.15.161:0/3989803474 wait complete. 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994e333800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994e333800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f67e0a1d0 con 0x556f67ebfb60 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994a0f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994a0f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51540/0 (socket says 172.21.15.161:51540) 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.440+0000 7f994a0f2640 1 -- 172.21.15.161:0/429103559 learned_addr learned my addr 172.21.15.161:0/429103559 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.441+0000 7f994a0f2640 1 -- 172.21.15.161:0/429103559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67fb0c60 con 0x556f67ebfb60 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.441+0000 7f994a0f2640 1 --2- 172.21.15.161:0/429103559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f993c001d50 tx=0x7f993c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d71b57372c6a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.441+0000 7f9838608640 1 -- 172.21.15.161:0/429103559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c013030 con 0x556f67ebfb60 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.441+0000 7f9838608640 1 -- 172.21.15.161:0/429103559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c00e470 con 0x556f67ebfb60 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.441+0000 7f9838608640 1 -- 172.21.15.161:0/429103559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c00e810 con 0x556f67ebfb60 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- 172.21.15.161:0/429103559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 msgr2=0x556f67fb0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 --2- 172.21.15.161:0/429103559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f993c001d50 tx=0x7f993c00b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- 172.21.15.161:0/429103559 shutdown_connections 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 --2- 172.21.15.161:0/429103559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb0690 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- 172.21.15.161:0/429103559 >> 172.21.15.161:0/429103559 conn(0x556f67eb95b0 msgr2=0x556f67fabfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- 172.21.15.161:0/429103559 shutdown_connections 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- 172.21.15.161:0/429103559 wait complete. 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.442+0000 7f994e333800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f67ec6470 con 0x556f67ebfb60 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994a0f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994a0f2640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51550/0 (socket says 172.21.15.161:51550) 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994a0f2640 1 -- 172.21.15.161:0/3477099482 learned_addr learned my addr 172.21.15.161:0/3477099482 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994a0f2640 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67fb8740 con 0x556f67ebfb60 2024-05-08T09:21:47.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994a0f2640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556f67fb1420 tx=0x7f993c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f9836e05640 1 -- 172.21.15.161:0/3477099482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c027070 con 0x556f67ebfb60 2024-05-08T09:21:47.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f9836e05640 1 -- 172.21.15.161:0/3477099482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f993c019900 con 0x556f67ebfb60 2024-05-08T09:21:47.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67fb89d0 con 0x556f67ebfb60 2024-05-08T09:21:47.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f9836e05640 1 -- 172.21.15.161:0/3477099482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f993c019c40 con 0x556f67ebfb60 2024-05-08T09:21:47.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.443+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67fbb680 con 0x556f67ebfb60 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f9836e05640 1 -- 172.21.15.161:0/3477099482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f993c02a070 con 0x556f67ebfb60 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f9836e05640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 0x7f9830038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f9836e05640 1 -- 172.21.15.161:0/3477099482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f993c01f070 con 0x556f67ebfb60 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f99418f1640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 0x7f9830038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 0x556f67fbf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.444+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67fbf9d0 con 0x556f67ec3670 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f994a8f3640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 0x556f67fbf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f99418f1640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 0x7f9830038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9934054000 tx=0x7f993404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f994a8f3640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 0x556f67fbf440 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f994a8f3640 1 -- 172.21.15.161:0/3477099482 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f994400a4a0 con 0x556f67ec3670 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67fbca10 con 0x556f67ec3670 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.445+0000 7f994a8f3640 1 -- 172.21.15.161:0/3477099482 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f994400a4a0 con 0x556f67ec3670 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 0x556f67fc4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67fc4800 con 0x556f67fc1d20 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994a0f2640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 0x556f67fc4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994a0f2640 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 0x556f67fc4110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994a0f2640 1 -- 172.21.15.161:0/3477099482 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f993c029030 con 0x556f67fc1d20 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.446+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67fc0cd0 con 0x556f67ec3670 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994a8f3640 1 -- 172.21.15.161:0/3477099482 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f994400a4a0 con 0x556f67ec3670 2024-05-08T09:21:47.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67fc1170 con 0x556f67ec3670 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994a8f3640 1 -- 172.21.15.161:0/3477099482 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f994400a4a0 con 0x556f67ec3670 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994e333800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.447+0000 7f994e333800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f67db0cf0 con 0x556f67fd3940 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51556/0 (socket says 172.21.15.161:51556) 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994a8f3640 1 -- 172.21.15.161:0/3961548813 learned_addr learned my addr 172.21.15.161:0/3961548813 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994a8f3640 1 -- 172.21.15.161:0/3961548813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67fd42a0 con 0x556f67fd3940 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994a8f3640 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x556f67fb9600 tx=0x7f9944018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f982ffff640 1 -- 172.21.15.161:0/3961548813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944014450 con 0x556f67fd3940 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f982ffff640 1 -- 172.21.15.161:0/3961548813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99440145f0 con 0x556f67fd3940 2024-05-08T09:21:47.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67fd4d10 con 0x556f67fd3940 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f982ffff640 1 -- 172.21.15.161:0/3961548813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944014910 con 0x556f67fd3940 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.448+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67fd5210 con 0x556f67fd3940 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.449+0000 7f982ffff640 1 -- 172.21.15.161:0/3961548813 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9944011040 con 0x556f67fd3940 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.449+0000 7f982ffff640 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 0x7f9824038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.449+0000 7f982ffff640 1 -- 172.21.15.161:0/3961548813 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f994401e070 con 0x556f67fd3940 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.449+0000 7f994a0f2640 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 0x7f9824038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a0f2640 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 0x7f9824038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556f67fbfe70 tx=0x7f993c04aa70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994e333800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994e333800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f67fb0fe0 con 0x556f67fe0cd0 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51564/0 (socket says 172.21.15.161:51564) 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a8f3640 1 -- 172.21.15.161:0/2514601509 learned_addr learned my addr 172.21.15.161:0/2514601509 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a8f3640 1 -- 172.21.15.161:0/2514601509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67fe16c0 con 0x556f67fe0cd0 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.450+0000 7f994a8f3640 1 --2- 172.21.15.161:0/2514601509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f994404c990 tx=0x7f9944011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cab5fbf5b8b07b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f982dffb640 1 -- 172.21.15.161:0/2514601509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9944040e60 con 0x556f67fe0cd0 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f982dffb640 1 -- 172.21.15.161:0/2514601509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9944016940 con 0x556f67fe0cd0 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f982dffb640 1 -- 172.21.15.161:0/2514601509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994403bce0 con 0x556f67fe0cd0 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- 172.21.15.161:0/2514601509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 msgr2=0x556f67fe10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 --2- 172.21.15.161:0/2514601509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f994404c990 tx=0x7f9944011700 comp rx=0 tx=0).stop 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- 172.21.15.161:0/2514601509 shutdown_connections 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 --2- 172.21.15.161:0/2514601509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe10f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- 172.21.15.161:0/2514601509 >> 172.21.15.161:0/2514601509 conn(0x556f67fdcfa0 msgr2=0x556f67fdb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- 172.21.15.161:0/2514601509 shutdown_connections 2024-05-08T09:21:47.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- 172.21.15.161:0/2514601509 wait complete. 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 Processor -- start 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.451+0000 7f994e333800 1 -- start start 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994e333800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994e333800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556f67fe1e50 con 0x556f67fe0cd0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994a8f3640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51568/0 (socket says 172.21.15.161:51568) 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 learned_addr learned my addr 172.21.15.161:0/2289178736 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f67fe86c0 con 0x556f67fe0cd0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994a8f3640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe8180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f994402bfd0 tx=0x7f994404c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f981bfff640 1 -- 172.21.15.161:0/2289178736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994404e280 con 0x556f67fe0cd0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f981bfff640 1 -- 172.21.15.161:0/2289178736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f994404e420 con 0x556f67fe0cd0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556f67fe8950 con 0x556f67fe0cd0 2024-05-08T09:21:47.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f981bfff640 1 -- 172.21.15.161:0/2289178736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f994404b340 con 0x556f67fe0cd0 2024-05-08T09:21:47.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.452+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f67feb600 con 0x556f67fe0cd0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.453+0000 7f981bfff640 1 -- 172.21.15.161:0/2289178736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f994404b4e0 con 0x556f67fe0cd0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.453+0000 7f981bfff640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9814036900 0x7f9814038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.453+0000 7f981bfff640 1 -- 172.21.15.161:0/2289178736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9944033030 con 0x556f67fe0cd0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.453+0000 7f994a0f2640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9814036900 0x7f9814038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f994a0f2640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9814036900 0x7f9814038dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f993c04c010 tx=0x7f993c032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ff3ed0 0x556f67ff6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ff6ae0 con 0x556f67ff3ed0 2024-05-08T09:21:47.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f99418f1640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ff3ed0 0x556f67ff6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.454+0000 7f99418f1640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ff3ed0 0x556f67ff6390 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 realm 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ff6eb0 con 0x556f67ff3ed0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ff7780 con 0x556f67ff3ed0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ff7b20 con 0x556f67ff3ed0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67ff8880 0x556f67ffac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.455+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ffb280 con 0x556f67ff8880 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994a8f3640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67ff8880 0x556f67ffac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994a8f3640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67ff8880 0x556f67ffac70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994e333800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994e333800 20 searching for the correct realm 2024-05-08T09:21:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556f67ffd210 0x556f67fff6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.456+0000 7f994a0f2640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556f67ffd210 0x556f67fff6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.457+0000 7f994a0f2640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556f67ffd210 0x556f67fff6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.457+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.457+0000 7f994a0f2640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f993c02c060 0x7f993c0447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.457+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.457+0000 7f99418f1640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f993c02c060 0x7f993c0447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f99418f1640 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f993c02c060 0x7f993c0447a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.458+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v20'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.459+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.460+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.461+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.462+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.463+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.464+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ffd210 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.465+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x556f67ff3ed0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556f67fffda0 con 0x7f993c02c060 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ffc760 con 0x556f67ff3ed0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ffb710 con 0x556f67ff3ed0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.466+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f67ffc110 con 0x556f67ff3ed0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 zone default found 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 4 Realm: () 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 zonegroup default 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f680006d0 con 0x556f67ff8880 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f68002980 con 0x556f67ffd210 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.467+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f68002d20 con 0x556f67ffd210 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 20 started sync module instance, tier type = 2024-05-08T09:21:47.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.468+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68001e10 con 0x7f993c02c060 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.469+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.469+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93936974570288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68001e10 con 0x7f993c02c060 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.469+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68003730 con 0x556f67ff3ed0 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.470+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93936974570288] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.470+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.470+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93936974568256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68003730 con 0x556f67ff3ed0 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.470+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68004130 con 0x556f67ffd210 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.471+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93936974568256] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.471+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.471+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93936974574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680036a0 con 0x556f67ffd210 2024-05-08T09:21:47.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.471+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68004ff0 con 0x7f993c02c060 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.472+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.472+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93936974581024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68005770 con 0x7f993c02c060 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.472+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68006290 con 0x556f67ff3ed0 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.472+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93936974574208] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.473+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.473+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93936974585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68006250 con 0x556f67ff3ed0 2024-05-08T09:21:47.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.473+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68006cc0 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.473+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93936974581024] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.474+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93936974585184] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.474+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.474+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93936974578976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68006cc0 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.474+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68007560 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.476+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.476+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93936974578976] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.476+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93936974590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68007980 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.476+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680067f0 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93936974590128] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93936974591184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68007da0 con 0x556f67ff8880 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=0 2024-05-08T09:21:47.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=1 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=2 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=3 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=4 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=5 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.477+0000 7f994e333800 20 add_watcher() i=6 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93936974591184] v27'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f994e333800 20 add_watcher() i=7 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f994e333800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f6800af40 con 0x556f67ff3ed0 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.478+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93936974592240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680081c0 con 0x556f67ff3ed0 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.479+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93936974592240] v27'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.479+0000 7f9800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.479+0000 7f994e333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.479+0000 7f994e333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.479+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f6800a680 con 0x556f67ff3ed0 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.483+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.483+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68014000 con 0x556f67ff8880 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.483+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.483+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68014000 con 0x556f67ffd210 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.485+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.485+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68014a20 con 0x556f67ff3ed0 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.488+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.488+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680136a0 con 0x7f993c02c060 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.489+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.489+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68013670 con 0x556f67ffd210 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.490+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.490+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680153b0 con 0x556f67ff3ed0 2024-05-08T09:21:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.493+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.493+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680153b0 con 0x556f67ff8880 2024-05-08T09:21:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.495+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.495+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680153b0 con 0x7f993c02c060 2024-05-08T09:21:47.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.496+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.496+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680153b0 con 0x556f67ffd210 2024-05-08T09:21:47.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.497+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.497+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68015440 con 0x7f993c02c060 2024-05-08T09:21:47.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.497+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.498+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68015440 con 0x556f67ff8880 2024-05-08T09:21:47.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.499+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.499+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68015610 con 0x7f993c02c060 2024-05-08T09:21:47.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.499+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.499+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68015610 con 0x556f67ff8880 2024-05-08T09:21:47.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.501+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'25 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.501+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68015610 con 0x556f67ff3ed0 2024-05-08T09:21:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.505+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.505+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.506+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.506+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x7f993c02c060 2024-05-08T09:21:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.507+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.507+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.508+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.508+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ff3ed0 2024-05-08T09:21:47.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.512+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.512+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ff3ed0 2024-05-08T09:21:47.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.514+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.514+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.515+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'24 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.515+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x7f993c02c060 2024-05-08T09:21:47.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.516+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.516+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.519+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.519+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.520+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.520+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.521+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.521+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.523+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.523+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ff8880 2024-05-08T09:21:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.525+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.525+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.526+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.526+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ff8880 2024-05-08T09:21:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.528+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'20 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.528+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ffd210 2024-05-08T09:21:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.529+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.529+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x556f67ff8880 2024-05-08T09:21:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.530+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'26 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.530+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680159f0 con 0x7f993c02c060 2024-05-08T09:21:47.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.531+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.531+0000 7f977b7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 20 Filter name: none 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f97797fa640 20 reqs_thread_entry: start 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556f680406e0 con 0x556f67ff3ed0 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.532+0000 7f994e333800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:47.533 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, user does not exist 2024-05-08T09:21:47.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.533+0000 7f9800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.533+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93936974592240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68012560 con 0x556f67ff3ed0 2024-05-08T09:21:47.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.534+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93936974592240] v27'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.534+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93936974570288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680078f0 con 0x7f993c02c060 2024-05-08T09:21:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.536+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93936974570288] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.536+0000 7f994e333800 20 remove_watcher() i=0 2024-05-08T09:21:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.536+0000 7f994e333800 2 removed watcher, disabling cache 2024-05-08T09:21:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.536+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93936974568256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680078f0 con 0x556f67ff3ed0 2024-05-08T09:21:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.537+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93936974568256] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.537+0000 7f994e333800 20 remove_watcher() i=1 2024-05-08T09:21:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.537+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93936974574208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680078f0 con 0x556f67ffd210 2024-05-08T09:21:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.539+0000 7f994a0f2640 1 -- 172.21.15.161:0/2289178736 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93936974574208] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993c029030 con 0x556f67ffd210 2024-05-08T09:21:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.539+0000 7f994e333800 20 remove_watcher() i=2 2024-05-08T09:21:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.539+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93936974581024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68003280 con 0x7f993c02c060 2024-05-08T09:21:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.540+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93936974581024] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x7f993c02c060 2024-05-08T09:21:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.540+0000 7f994e333800 20 remove_watcher() i=3 2024-05-08T09:21:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.540+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93936974585184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f680078f0 con 0x556f67ff3ed0 2024-05-08T09:21:47.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.543+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93936974585184] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f993405a040 con 0x556f67ff3ed0 2024-05-08T09:21:47.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.543+0000 7f994e333800 20 remove_watcher() i=4 2024-05-08T09:21:47.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.543+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93936974578976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68004d20 con 0x556f67ff8880 2024-05-08T09:21:47.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.544+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93936974578976] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.544+0000 7f994e333800 20 remove_watcher() i=5 2024-05-08T09:21:47.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.544+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93936974590128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68003280 con 0x556f67ff8880 2024-05-08T09:21:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.547+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93936974590128] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.547+0000 7f994e333800 20 remove_watcher() i=6 2024-05-08T09:21:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.547+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93936974591184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556f68003280 con 0x556f67ff8880 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994a8f3640 1 -- 172.21.15.161:0/2289178736 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93936974591184] v27'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f994404cd70 con 0x556f67ff8880 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 20 remove_watcher() i=7 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67ff8880 msgr2=0x556f67ffac70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67ff8880 0x556f67ffac70 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ff3ed0 msgr2=0x556f67ff6390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ff3ed0 0x556f67ff6390 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f993c02c060 msgr2=0x7f993c0447a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f993c02c060 0x7f993c0447a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556f67ffd210 msgr2=0x556f67fff6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556f67ffd210 0x556f67fff6d0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9814036900 msgr2=0x7f9814038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9814036900 0x7f9814038dc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f993c04c010 tx=0x7f993c032000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 msgr2=0x556f67fe8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 --2- 172.21.15.161:0/2289178736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fe0cd0 0x556f67fe8180 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f994402bfd0 tx=0x7f994404c8f0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 reap_dead start 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f99418f1640 1 -- 172.21.15.161:0/2289178736 reap_dead start 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 shutdown_connections 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 >> 172.21.15.161:0/2289178736 conn(0x556f67fdcfa0 msgr2=0x556f67fda600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 shutdown_connections 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.548+0000 7f994e333800 1 -- 172.21.15.161:0/2289178736 wait complete. 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 msgr2=0x7f9824038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 0x7f9824038dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x556f67fbfe70 tx=0x7f993c04aa70 comp rx=0 tx=0).stop 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 msgr2=0x556f67fd3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x556f67fb9600 tx=0x7f9944018830 comp rx=0 tx=0).stop 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 shutdown_connections 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9824036900 0x7f9824038dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3961548813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67fd3940 0x556f67fd3d60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 >> 172.21.15.161:0/3961548813 conn(0x556f67fc79e0 msgr2=0x556f67fc7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 shutdown_connections 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3961548813 wait complete. 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 msgr2=0x556f67fc4110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 0x556f67fc4110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 msgr2=0x556f67fbf440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 0x556f67fbf440 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 msgr2=0x7f9830038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 0x7f9830038dc0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9934054000 tx=0x7f993404e000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 msgr2=0x556f67fb8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x556f67fb1420 tx=0x7f993c000bc0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 shutdown_connections 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556f67fc1d20 0x556f67fc4110 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556f67ec3670 0x556f67fbf440 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9830036900 0x7f9830038dc0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 --2- 172.21.15.161:0/3477099482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556f67ebfb60 0x556f67fb8200 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 >> 172.21.15.161:0/3477099482 conn(0x556f67eb95b0 msgr2=0x556f67faa7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 shutdown_connections 2024-05-08T09:21:47.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.549+0000 7f994e333800 1 -- 172.21.15.161:0/3477099482 wait complete. 2024-05-08T09:21:47.558 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-05-08T09:21:47.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T09:21:47.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T09:21:47.559 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T09:21:47.605 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.605 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe24375800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559ab5c37050 0x559ab5c37470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe24375800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559ab5c37af0 con 0x559ab5c382b0 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe24375800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x559ab5ac9050 con 0x559ab5c37050 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe21e74640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559ab5c37050 0x559ab5c37470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe19673640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x559ab5c382b0 0x559ab5c38730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42684/0 (socket says 172.21.15.161:42684) 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe19673640 1 -- 172.21.15.161:0/2840180452 learned_addr learned my addr 172.21.15.161:0/2840180452 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe21e74640 1 -- 172.21.15.161:0/2840180452 >> v1:172.21.15.45:6789/0 conn(0x559ab5c382b0 legacy=0x559ab5c38730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe21e74640 1 -- 172.21.15.161:0/2840180452 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5c38e70 con 0x559ab5c37050 2024-05-08T09:21:47.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.606+0000 7efe21673640 1 -- 172.21.15.161:0/2840180452 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640854931 0 0) 0x559ab5c37af0 con 0x559ab5c382b0 2024-05-08T09:21:47.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.608+0000 7efe21e74640 1 --2- 172.21.15.161:0/2840180452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5c37470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe1400a470 tx=0x7efe1401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e692689d952524 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.608+0000 7efe21673640 1 -- 172.21.15.161:0/2840180452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14057070 con 0x559ab5c37050 2024-05-08T09:21:47.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.608+0000 7efe21673640 1 -- 172.21.15.161:0/2840180452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1404adc0 con 0x559ab5c37050 2024-05-08T09:21:47.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.608+0000 7efe21673640 1 -- 172.21.15.161:0/2840180452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14052590 con 0x559ab5c37050 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 -- 172.21.15.161:0/2840180452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 msgr2=0x559ab5c37470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 --2- 172.21.15.161:0/2840180452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5c37470 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe1400a470 tx=0x7efe1401ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 -- 172.21.15.161:0/2840180452 shutdown_connections 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 --2- 172.21.15.161:0/2840180452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5c37470 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 -- 172.21.15.161:0/2840180452 >> 172.21.15.161:0/2840180452 conn(0x559ab5c32670 msgr2=0x559ab5c34a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 -- 172.21.15.161:0/2840180452 shutdown_connections 2024-05-08T09:21:47.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.609+0000 7efe24375800 1 -- 172.21.15.161:0/2840180452 wait complete. 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe24375800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe24375800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559ab5b831f0 con 0x559ab5c37050 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51588/0 (socket says 172.21.15.161:51588) 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe21e74640 1 -- 172.21.15.161:0/2130009944 learned_addr learned my addr 172.21.15.161:0/2130009944 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.623+0000 7efe21e74640 1 -- 172.21.15.161:0/2130009944 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5d2a240 con 0x559ab5c37050 2024-05-08T09:21:47.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efe21e74640 1 --2- 172.21.15.161:0/2130009944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe14055040 tx=0x7efe1404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784992366b17eae2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efd0fe07640 1 -- 172.21.15.161:0/2130009944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14057040 con 0x559ab5c37050 2024-05-08T09:21:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efd0fe07640 1 -- 172.21.15.161:0/2130009944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe14063070 con 0x559ab5c37050 2024-05-08T09:21:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efd0fe07640 1 -- 172.21.15.161:0/2130009944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1405d790 con 0x559ab5c37050 2024-05-08T09:21:47.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efe24375800 1 -- 172.21.15.161:0/2130009944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 msgr2=0x559ab5baaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.624+0000 7efe24375800 1 --2- 172.21.15.161:0/2130009944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe14055040 tx=0x7efe1404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- 172.21.15.161:0/2130009944 shutdown_connections 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 --2- 172.21.15.161:0/2130009944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5baaf50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- 172.21.15.161:0/2130009944 >> 172.21.15.161:0/2130009944 conn(0x559ab5c32670 msgr2=0x559ab5d23f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- 172.21.15.161:0/2130009944 shutdown_connections 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- 172.21.15.161:0/2130009944 wait complete. 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe24375800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559ab5c40780 con 0x559ab5c37050 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51598/0 (socket says 172.21.15.161:51598) 2024-05-08T09:21:47.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe21e74640 1 -- 172.21.15.161:0/1033181768 learned_addr learned my addr 172.21.15.161:0/1033181768 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.625+0000 7efe21e74640 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5d33820 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efe21e74640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe14060040 tx=0x7efe14002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efd0e604640 1 -- 172.21.15.161:0/1033181768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14057050 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ab5d33ab0 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ab5d36760 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efd0e604640 1 -- 172.21.15.161:0/1033181768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1405de00 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.626+0000 7efd0e604640 1 -- 172.21.15.161:0/1033181768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe14076060 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efd0e604640 1 -- 172.21.15.161:0/1033181768 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe14052570 con 0x559ab5c37050 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe24375800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe24375800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559ab5b29cf0 con 0x559ab5d40be0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efd0e604640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 0x7efd08038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efd0e604640 1 -- 172.21.15.161:0/1033181768 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efe1408e110 con 0x559ab5c37050 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe22675640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe21e74640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 0x7efd08038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe22675640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51606/0 (socket says 172.21.15.161:51606) 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe22675640 1 -- 172.21.15.161:0/4069967213 learned_addr learned my addr 172.21.15.161:0/4069967213 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe21e74640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 0x7efd08038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe14066e40 tx=0x7efe1407d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.627+0000 7efe22675640 1 -- 172.21.15.161:0/4069967213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5d41540 con 0x559ab5d40be0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe22675640 1 --2- 172.21.15.161:0/4069967213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00a430 tx=0x7efe1c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e88b23bc6e704b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efd07fff640 1 -- 172.21.15.161:0/4069967213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1c015070 con 0x559ab5d40be0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efd07fff640 1 -- 172.21.15.161:0/4069967213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1c001670 con 0x559ab5d40be0 2024-05-08T09:21:47.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efd07fff640 1 -- 172.21.15.161:0/4069967213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1c001990 con 0x559ab5d40be0 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 -- 172.21.15.161:0/4069967213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 msgr2=0x559ab5d41000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 --2- 172.21.15.161:0/4069967213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe1c00a430 tx=0x7efe1c00a8f0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 -- 172.21.15.161:0/4069967213 shutdown_connections 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 --2- 172.21.15.161:0/4069967213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d41000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 -- 172.21.15.161:0/4069967213 >> 172.21.15.161:0/4069967213 conn(0x559ab5c382b0 msgr2=0x559ab5d3d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 -- 172.21.15.161:0/4069967213 shutdown_connections 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.628+0000 7efe24375800 1 -- 172.21.15.161:0/4069967213 wait complete. 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe24375800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe24375800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559ab5d2e910 con 0x559ab5d40be0 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe22675640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe22675640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51616/0 (socket says 172.21.15.161:51616) 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe22675640 1 -- 172.21.15.161:0/600576316 learned_addr learned my addr 172.21.15.161:0/600576316 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.629+0000 7efe22675640 1 -- 172.21.15.161:0/600576316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5d48500 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efe22675640 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe1c013040 tx=0x7efe1c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efd067fc640 1 -- 172.21.15.161:0/600576316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1c020020 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efd067fc640 1 -- 172.21.15.161:0/600576316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe1c0108e0 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ab5d48790 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efd067fc640 1 -- 172.21.15.161:0/600576316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1c015040 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.630+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ab5d4b440 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efd067fc640 1 -- 172.21.15.161:0/600576316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe1c023020 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efd067fc640 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 0x7efcfc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efd067fc640 1 -- 172.21.15.161:0/600576316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efe1c04c040 con 0x559ab5d40be0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efe19673640 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 0x7efcfc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efe24375800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efe24375800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efe19673640 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 0x7efcfc038dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000c00 tx=0x7efe0c001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.631+0000 7efe24375800 1 Processor -- start 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe24375800 1 -- start start 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe24375800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe24375800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559ab5d41ed0 con 0x559ab5d62690 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe21e74640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51632/0 (socket says 172.21.15.161:51632) 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe21e74640 1 -- 172.21.15.161:0/997825781 learned_addr learned my addr 172.21.15.161:0/997825781 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe21e74640 1 -- 172.21.15.161:0/997825781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ab5d62ff0 con 0x559ab5d62690 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe21e74640 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe1405d840 tx=0x7efe1408c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efce6fe5640 1 -- 172.21.15.161:0/997825781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1408c2a0 con 0x559ab5d62690 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efce6fe5640 1 -- 172.21.15.161:0/997825781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe14052c90 con 0x559ab5d62690 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559ab5d63a60 con 0x559ab5d62690 2024-05-08T09:21:47.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.632+0000 7efce6fe5640 1 -- 172.21.15.161:0/997825781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efe1407aab0 con 0x559ab5d62690 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.633+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ab5d63f60 con 0x559ab5d62690 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.633+0000 7efce6fe5640 1 -- 172.21.15.161:0/997825781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efe1407ace0 con 0x559ab5d62690 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.633+0000 7efce6fe5640 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 0x7efc60038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.633+0000 7efce6fe5640 1 -- 172.21.15.161:0/997825781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efe14099c50 con 0x559ab5d62690 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.633+0000 7efe19673640 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 0x7efc60038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efce4fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 0x559ab5d72570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe19673640 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 0x7efc60038f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000f60 tx=0x7efe0c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559ab5d72c40 con 0x559ab5d700e0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe22675640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 0x559ab5d72570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe22675640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 0x559ab5d72570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.634+0000 7efe22675640 1 -- 172.21.15.161:0/1033181768 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efe1c00e070 con 0x559ab5d700e0 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 0x559ab5d76e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:2 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x559ab5d774d0 con 0x559ab5d74a10 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe21e74640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 0x559ab5d76e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe21e74640 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 0x559ab5d76e00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe21e74640 1 -- 172.21.15.161:0/1033181768 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(2 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efe1406f070 con 0x559ab5d74a10 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.635+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x559ab5d73f10 con 0x559ab5d74a10 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.637+0000 7efe21e74640 1 -- 172.21.15.161:0/1033181768 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [stat,call,call,writefull 0~993] v27'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7efe1406f070 con 0x559ab5d74a10 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 msgr2=0x7efcfc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 0x7efcfc038dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000c00 tx=0x7efe0c001330 comp rx=0 tx=0).stop 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 msgr2=0x559ab5d47fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efe1c013040 tx=0x7efe1c003370 comp rx=0 tx=0).stop 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 shutdown_connections 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efcfc036900 0x7efcfc038dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/600576316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d40be0 0x559ab5d47fc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 >> 172.21.15.161:0/600576316 conn(0x559ab5c382b0 msgr2=0x559ab5d3acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 shutdown_connections 2024-05-08T09:21:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/600576316 wait complete. 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 msgr2=0x7efc60038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 0x7efc60038f60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe0c000f60 tx=0x7efe0c006000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 msgr2=0x559ab5d62ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7efe1405d840 tx=0x7efe1408c450 comp rx=0 tx=0).stop 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 shutdown_connections 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efc60036aa0 0x7efc60038f60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/997825781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5d62690 0x559ab5d62ab0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 >> 172.21.15.161:0/997825781 conn(0x559ab5d57160 msgr2=0x559ab5d57b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 shutdown_connections 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/997825781 wait complete. 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 msgr2=0x559ab5d76e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 0x559ab5d76e00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 msgr2=0x559ab5d72570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 0x559ab5d72570 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 msgr2=0x7efd08038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 0x7efd08038dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7efe14066e40 tx=0x7efe1407d040 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 msgr2=0x559ab5d332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe14060040 tx=0x7efe14002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 shutdown_connections 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559ab5d74a10 0x559ab5d76e00 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559ab5d700e0 0x559ab5d72570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efd08036900 0x7efd08038dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.638+0000 7efe24375800 1 --2- 172.21.15.161:0/1033181768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ab5c37050 0x559ab5d332e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.639+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 >> 172.21.15.161:0/1033181768 conn(0x559ab5c32670 msgr2=0x559ab5d22740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.639+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 shutdown_connections 2024-05-08T09:21:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.639+0000 7efe24375800 1 -- 172.21.15.161:0/1033181768 wait complete. 2024-05-08T09:21:47.648 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T09:21:47.648 DEBUG:tasks.util.rgw: json result: {'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T09:21:47.650 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T09:21:47.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T09:21:47.650 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T09:21:47.693 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.693 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa291d29800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dc20e65c0 0x556dc20e69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa291d29800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556dc20e7010 con 0x556dc20e52d0 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa291d29800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x556dc1f77050 con 0x556dc20e65c0 2024-05-08T09:21:47.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa28d94e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dc20e65c0 0x556dc20e69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa28d14d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x556dc20e52d0 0x556dc20e5780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42700/0 (socket says 172.21.15.161:42700) 2024-05-08T09:21:47.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa28d94e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dc20e65c0 0x556dc20e69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51646/0 (socket says 172.21.15.161:51646) 2024-05-08T09:21:47.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.693+0000 7fa28d14d640 1 -- 172.21.15.161:0/1251864685 learned_addr learned my addr 172.21.15.161:0/1251864685 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.694+0000 7fa28d94e640 1 -- 172.21.15.161:0/1251864685 >> v1:172.21.15.45:6789/0 conn(0x556dc20e52d0 legacy=0x556dc20e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.694+0000 7fa28d94e640 1 -- 172.21.15.161:0/1251864685 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc20e5e90 con 0x556dc20e65c0 2024-05-08T09:21:47.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa28d94e640 1 --2- 172.21.15.161:0/1251864685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e65c0 0x556dc20e69e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa280005fd0 tx=0x7fa28001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e01a7a885481dd3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa28c94c640 1 -- 172.21.15.161:0/1251864685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa280052560 con 0x556dc20e65c0 2024-05-08T09:21:47.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa28c94c640 1 -- 172.21.15.161:0/1251864685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280052700 con 0x556dc20e65c0 2024-05-08T09:21:47.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa28c94c640 1 -- 172.21.15.161:0/1251864685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa280052a60 con 0x556dc20e65c0 2024-05-08T09:21:47.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 -- 172.21.15.161:0/1251864685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e65c0 msgr2=0x556dc20e69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 --2- 172.21.15.161:0/1251864685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e65c0 0x556dc20e69e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa280005fd0 tx=0x7fa28001ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 -- 172.21.15.161:0/1251864685 shutdown_connections 2024-05-08T09:21:47.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 --2- 172.21.15.161:0/1251864685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e65c0 0x556dc20e69e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 -- 172.21.15.161:0/1251864685 >> 172.21.15.161:0/1251864685 conn(0x556dc20dfd20 msgr2=0x556dc20e2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 -- 172.21.15.161:0/1251864685 shutdown_connections 2024-05-08T09:21:47.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.696+0000 7fa291d29800 1 -- 172.21.15.161:0/1251864685 wait complete. 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.710+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa291d29800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa291d29800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dc20311c0 con 0x556dc20e52d0 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa28d94e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa28d94e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51662/0 (socket says 172.21.15.161:51662) 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa28d94e640 1 -- 172.21.15.161:0/3531970690 learned_addr learned my addr 172.21.15.161:0/3531970690 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa28d94e640 1 -- 172.21.15.161:0/3531970690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc21d7d70 con 0x556dc20e52d0 2024-05-08T09:21:47.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3531970690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa280007000 tx=0x7fa28004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab44931b9927df8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa17be07640 1 -- 172.21.15.161:0/3531970690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2800529e0 con 0x556dc20e52d0 2024-05-08T09:21:47.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.711+0000 7fa17be07640 1 -- 172.21.15.161:0/3531970690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280052b80 con 0x556dc20e52d0 2024-05-08T09:21:47.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa17be07640 1 -- 172.21.15.161:0/3531970690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa28005c430 con 0x556dc20e52d0 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 -- 172.21.15.161:0/3531970690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 msgr2=0x556dc21d77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 --2- 172.21.15.161:0/3531970690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa280007000 tx=0x7fa28004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 -- 172.21.15.161:0/3531970690 shutdown_connections 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 --2- 172.21.15.161:0/3531970690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d77a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 -- 172.21.15.161:0/3531970690 >> 172.21.15.161:0/3531970690 conn(0x556dc20dfd20 msgr2=0x556dc21d5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 -- 172.21.15.161:0/3531970690 shutdown_connections 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 -- 172.21.15.161:0/3531970690 wait complete. 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.712+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa291d29800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa291d29800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dc20ee750 con 0x556dc20e52d0 2024-05-08T09:21:47.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa28d94e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa28d94e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51678/0 (socket says 172.21.15.161:51678) 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa28d94e640 1 -- 172.21.15.161:0/301817183 learned_addr learned my addr 172.21.15.161:0/301817183 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.713+0000 7fa28d94e640 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc21d3940 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa28d94e640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2800526d0 tx=0x7fa280003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa17a604640 1 -- 172.21.15.161:0/301817183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa280075070 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa17a604640 1 -- 172.21.15.161:0/301817183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa280070410 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa17a604640 1 -- 172.21.15.161:0/301817183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2800529e0 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc21d1b90 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.714+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc21d2110 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa17a604640 1 -- 172.21.15.161:0/301817183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa280078070 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa17a604640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 0x7fa174038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa17a604640 1 -- 172.21.15.161:0/301817183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa28006d070 con 0x556dc20e52d0 2024-05-08T09:21:47.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa28d14d640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 0x7fa174038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 0x556dc21e8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc21e8c50 con 0x556dc20e65c0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa28e14f640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 0x556dc21e8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa28d14d640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 0x7fa174038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa284000f60 tx=0x7fa2840012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.715+0000 7fa28e14f640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 0x556dc21e8710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa28e14f640 1 -- 172.21.15.161:0/301817183 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc20e65c0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc21d25a0 con 0x556dc20e65c0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa28e14f640 1 -- 172.21.15.161:0/301817183 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc20e65c0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 0x556dc21ed310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc21eda00 con 0x556dc21eaf20 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa28d94e640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 0x556dc21ed310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.716+0000 7fa28d94e640 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 0x556dc21ed310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.717+0000 7fa28d94e640 1 -- 172.21.15.161:0/301817183 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa280077030 con 0x556dc21eaf20 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.717+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc21e9ed0 con 0x556dc20e65c0 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.717+0000 7fa28e14f640 1 -- 172.21.15.161:0/301817183 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc20e65c0 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.717+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc21ea390 con 0x556dc20e65c0 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.717+0000 7fa28e14f640 1 -- 172.21.15.161:0/301817183 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc20e65c0 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa291d29800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa291d29800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dc1fd7cf0 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51682/0 (socket says 172.21.15.161:51682) 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa28e14f640 1 -- 172.21.15.161:0/582140677 learned_addr learned my addr 172.21.15.161:0/582140677 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.718+0000 7fa28e14f640 1 -- 172.21.15.161:0/582140677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc21fd510 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa28e14f640 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x556dc21d3140 tx=0x7fa28800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa1737fe640 1 -- 172.21.15.161:0/582140677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa288007d00 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa1737fe640 1 -- 172.21.15.161:0/582140677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28801e020 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc21fdf80 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa1737fe640 1 -- 172.21.15.161:0/582140677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa288019420 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc21fe480 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.719+0000 7fa1737fe640 1 -- 172.21.15.161:0/582140677 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa288016040 con 0x556dc21fcbb0 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa1737fe640 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 0x7fa168038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa1737fe640 1 -- 172.21.15.161:0/582140677 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa28801f030 con 0x556dc21fcbb0 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa28d94e640 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 0x7fa168038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa28d94e640 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 0x7fa168038dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556dc21e9090 tx=0x7fa28005fdc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa291d29800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa291d29800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dc21d8090 con 0x556dc2209e50 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51684/0 (socket says 172.21.15.161:51684) 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.720+0000 7fa28e14f640 1 -- 172.21.15.161:0/3212122773 learned_addr learned my addr 172.21.15.161:0/3212122773 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa28e14f640 1 -- 172.21.15.161:0/3212122773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc220a840 con 0x556dc2209e50 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa28e14f640 1 --2- 172.21.15.161:0/3212122773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa288005700 tx=0x7fa28804cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180060b3a1986a4e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa1717fa640 1 -- 172.21.15.161:0/3212122773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa28801d070 con 0x556dc2209e50 2024-05-08T09:21:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa1717fa640 1 -- 172.21.15.161:0/3212122773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880183b0 con 0x556dc2209e50 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa1717fa640 1 -- 172.21.15.161:0/3212122773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa288014340 con 0x556dc2209e50 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 -- 172.21.15.161:0/3212122773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 msgr2=0x556dc220a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 --2- 172.21.15.161:0/3212122773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa288005700 tx=0x7fa28804cba0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 -- 172.21.15.161:0/3212122773 shutdown_connections 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 --2- 172.21.15.161:0/3212122773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc220a270 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 -- 172.21.15.161:0/3212122773 >> 172.21.15.161:0/3212122773 conn(0x556dc22061b0 msgr2=0x556dc2204210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 -- 172.21.15.161:0/3212122773 shutdown_connections 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.721+0000 7fa291d29800 1 -- 172.21.15.161:0/3212122773 wait complete. 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa291d29800 1 Processor -- start 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa291d29800 1 -- start start 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa291d29800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa291d29800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dc220afb0 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa28e14f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51694/0 (socket says 172.21.15.161:51694) 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 learned_addr learned my addr 172.21.15.161:0/3341168041 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dc22119a0 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.722+0000 7fa28e14f640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa28804b7f0 tx=0x7fa28804c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa15f7fe640 1 -- 172.21.15.161:0/3341168041 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa28804b440 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa15f7fe640 1 -- 172.21.15.161:0/3341168041 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28803bb20 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dc2211c30 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa15f7fe640 1 -- 172.21.15.161:0/3341168041 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa28803be60 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dc22148e0 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.723+0000 7fa15f7fe640 1 -- 172.21.15.161:0/3341168041 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa288034020 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa15f7fe640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa1580368b0 0x7fa158038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa15f7fe640 1 -- 172.21.15.161:0/3341168041 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa288032020 con 0x556dc2209e50 2024-05-08T09:21:47.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa1580368b0 0x7fa158038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc221cf30 0x556dc221f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc221fb40 con 0x556dc221cf30 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa28d14d640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc221cf30 0x556dc221f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa1580368b0 0x7fa158038d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa28005b780 tx=0x7fa28008f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.724+0000 7fa28d14d640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc221cf30 0x556dc221f3f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa284009050 con 0x556dc221cf30 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 realm 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc221c380 con 0x556dc221cf30 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa284009050 con 0x556dc221cf30 2024-05-08T09:21:47.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2220620 con 0x556dc221cf30 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa284009050 con 0x556dc221cf30 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2220ef0 con 0x556dc221cf30 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa284009050 con 0x556dc221cf30 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc22217a0 0x556dc2223b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.725+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa28e14f640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc22217a0 0x556dc2223b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa28e14f640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc22217a0 0x556dc2223b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa291d29800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa291d29800 20 searching for the correct realm 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dc2226380 0x556dc2228840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc2228f10 con 0x556dc2226380 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.726+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dc2226380 0x556dc2228840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dc2226380 0x556dc2228840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d94e640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa28007a060 0x7fa28005b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc2228f10 con 0x7fa28007a060 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d14d640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa28007a060 0x7fa28005b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.727+0000 7fa28d14d640 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa28007a060 0x7fa28005b7f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284009050 con 0x7fa28007a060 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc2228f10 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284009050 con 0x556dc221cf30 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.728+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x7fa28007a060 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.729+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.730+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x7fa28007a060 2024-05-08T09:21:47.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.731+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.732+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.733+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x7fa28007a060 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.734+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x7fa28007a060 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc2226380 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.735+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc22217a0 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x556dc221cf30 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dc22242d0 con 0x7fa28007a060 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2224c80 con 0x556dc221cf30 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.736+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2225070 con 0x556dc221cf30 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2225490 con 0x556dc221cf30 2024-05-08T09:21:47.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 zone default found 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 4 Realm: () 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 zonegroup default 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.737+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22258c0 con 0x556dc22217a0 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc222b220 con 0x556dc2226380 2024-05-08T09:21:47.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc222b5c0 con 0x556dc2226380 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 started sync module instance, tier type = 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.738+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222a660 con 0x7fa28007a060 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.739+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.739+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929896847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222a660 con 0x7fa28007a060 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.739+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222bf80 con 0x556dc221cf30 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.741+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.741+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929896852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222c3e0 con 0x556dc221cf30 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.741+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222cee0 con 0x556dc2226380 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.744+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929896852176] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.744+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929896847952] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.744+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.744+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929896845744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222bef0 con 0x556dc2226380 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.744+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222d780 con 0x7fa28007a060 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.745+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929896845744] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.746+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.746+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929896858320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222dba0 con 0x7fa28007a060 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.746+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222e560 con 0x556dc221cf30 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.750+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.750+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929896861872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222e980 con 0x556dc221cf30 2024-05-08T09:21:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.750+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222f400 con 0x556dc22217a0 2024-05-08T09:21:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.750+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929896858320] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.750+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929896861872] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.751+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.751+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929896865520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222e4d0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.752+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222fca0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.752+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929896865520] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.753+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.753+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929896859376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc222e4d0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.753+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc2230320 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929896869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc2230790 con 0x556dc22217a0 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=0 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=1 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=2 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=3 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=4 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=5 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929896859376] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.754+0000 7fa291d29800 20 add_watcher() i=6 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929896869360] v27'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa291d29800 20 add_watcher() i=7 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa291d29800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2230790 con 0x556dc221cf30 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.755+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929896870624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc2230700 con 0x556dc221cf30 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.756+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929896870624] v27'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.756+0000 7fa13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.756+0000 7fa291d29800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.756+0000 7fa291d29800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.756+0000 7fa291d29800 5 note: GC not initialized 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa13e7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa291d29800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa291d29800 20 Filter name: none 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa0affff640 20 reqs_thread_entry: start 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22672d0 con 0x556dc221cf30 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22672d0 con 0x7fa28007a060 2024-05-08T09:21:47.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.757+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267290 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267290 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22677c0 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22677c0 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22677c0 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.758+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22677c0 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267770 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.759+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc22217a0 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc221cf30 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x7fa28007a060 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.760+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc22217a0 2024-05-08T09:21:47.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267730 con 0x556dc2226380 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267710 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267710 con 0x556dc221cf30 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.761+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc2267710 con 0x556dc2226380 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x7fa28007a060 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.762+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc2226380 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.763+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc2226380 2024-05-08T09:21:47.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc2226380 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc2226380 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.764+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.765+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.765+0000 7fa13f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.765+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929896870624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.766+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93929896870624] v27'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.766+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929896847952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x7fa28007a060 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.767+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93929896847952] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.767+0000 7fa291d29800 20 remove_watcher() i=0 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.767+0000 7fa291d29800 2 removed watcher, disabling cache 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.767+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929896852176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.769+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93929896852176] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.769+0000 7fa291d29800 20 remove_watcher() i=1 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.769+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929896845744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc2226380 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.770+0000 7fa28d94e640 1 -- 172.21.15.161:0/3341168041 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93929896845744] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa280088040 con 0x556dc2226380 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.770+0000 7fa291d29800 20 remove_watcher() i=2 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.770+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929896858320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x7fa28007a060 2024-05-08T09:21:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.771+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93929896858320] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x7fa28007a060 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.771+0000 7fa291d29800 20 remove_watcher() i=3 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.771+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929896861872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc221cf30 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.773+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93929896861872] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa284029040 con 0x556dc221cf30 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.773+0000 7fa291d29800 20 remove_watcher() i=4 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.773+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929896865520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.774+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93929896865520] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.774+0000 7fa291d29800 20 remove_watcher() i=5 2024-05-08T09:21:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.774+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929896859376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.777+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93929896859376] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.777+0000 7fa291d29800 20 remove_watcher() i=6 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.777+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929896869360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dc22676d0 con 0x556dc22217a0 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa28e14f640 1 -- 172.21.15.161:0/3341168041 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93929896869360] v27'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa2880083e0 con 0x556dc22217a0 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 20 remove_watcher() i=7 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc22217a0 msgr2=0x556dc2223b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc22217a0 0x556dc2223b90 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc221cf30 msgr2=0x556dc221f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc221cf30 0x556dc221f3f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa28007a060 msgr2=0x7fa28005b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa28007a060 0x7fa28005b7f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dc2226380 msgr2=0x556dc2228840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dc2226380 0x556dc2228840 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa1580368b0 msgr2=0x7fa158038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa1580368b0 0x7fa158038d70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa28005b780 tx=0x7fa28008f000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 msgr2=0x556dc2211460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa28804b7f0 tx=0x7fa28804c860 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa28d14d640 1 -- 172.21.15.161:0/3341168041 reap_dead start 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 shutdown_connections 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/3341168041 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc2209e50 0x556dc2211460 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 >> 172.21.15.161:0/3341168041 conn(0x556dc22061b0 msgr2=0x556dc2203810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 shutdown_connections 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/3341168041 wait complete. 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 msgr2=0x7fa168038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 0x7fa168038dc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556dc21e9090 tx=0x7fa28005fdc0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 msgr2=0x556dc21fcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x556dc21d3140 tx=0x7fa28800aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 shutdown_connections 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa168036900 0x7fa168038dc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 --2- 172.21.15.161:0/582140677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc21fcbb0 0x556dc21fcfd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 >> 172.21.15.161:0/582140677 conn(0x556dc21f0c50 msgr2=0x556dc21f1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 shutdown_connections 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.778+0000 7fa291d29800 1 -- 172.21.15.161:0/582140677 wait complete. 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 msgr2=0x556dc21ed310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 0x556dc21ed310 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 msgr2=0x556dc21e8710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 0x556dc21e8710 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 msgr2=0x7fa174038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 0x7fa174038e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa284000f60 tx=0x7fa2840012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 msgr2=0x556dc21d3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2800526d0 tx=0x7fa280003330 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 shutdown_connections 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dc21eaf20 0x556dc21ed310 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dc20e65c0 0x556dc21e8710 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa174036950 0x7fa174038e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 --2- 172.21.15.161:0/301817183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dc20e52d0 0x556dc21d3400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 >> 172.21.15.161:0/301817183 conn(0x556dc20dfd20 msgr2=0x556dc21d1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 shutdown_connections 2024-05-08T09:21:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.779+0000 7fa291d29800 1 -- 172.21.15.161:0/301817183 wait complete. 2024-05-08T09:21:47.788 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[],"summary":[]} 2024-05-08T09:21:47.788 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T09:21:47.789 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:47.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:47.789 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:47.872 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:47.872 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9401f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564de46bcb60 0x564de46bef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9401f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564de46c2fa0 con 0x564de46bf490 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9401f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564de454d050 con 0x564de46bcb60 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f91b1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564de46bcb60 0x564de46bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9131d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x564de46bf490 0x564de46c1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42716/0 (socket says 172.21.15.161:42716) 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f91b1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564de46bcb60 0x564de46bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51704/0 (socket says 172.21.15.161:51704) 2024-05-08T09:21:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f9131d640 1 -- 172.21.15.161:0/3657567477 learned_addr learned my addr 172.21.15.161:0/3657567477 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:47.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3657567477 >> v1:172.21.15.45:6789/0 conn(0x564de46bf490 legacy=0x564de46c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.873+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3657567477 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de46c4180 con 0x564de46bcb60 2024-05-08T09:21:47.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.875+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3657567477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bef50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005fd0 tx=0x7f5f8401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c61ecad50930f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.875+0000 7f5f90b1c640 1 -- 172.21.15.161:0/3657567477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84052560 con 0x564de46bcb60 2024-05-08T09:21:47.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.875+0000 7f5f90b1c640 1 -- 172.21.15.161:0/3657567477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84052700 con 0x564de46bcb60 2024-05-08T09:21:47.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.875+0000 7f5f90b1c640 1 -- 172.21.15.161:0/3657567477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84052a60 con 0x564de46bcb60 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 -- 172.21.15.161:0/3657567477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 msgr2=0x564de46bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3657567477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bef50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5f84005fd0 tx=0x7f5f8401ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 -- 172.21.15.161:0/3657567477 shutdown_connections 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3657567477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bef50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 -- 172.21.15.161:0/3657567477 >> 172.21.15.161:0/3657567477 conn(0x564de46b65b0 msgr2=0x564de46b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 -- 172.21.15.161:0/3657567477 shutdown_connections 2024-05-08T09:21:47.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.876+0000 7f5f9401f800 1 -- 172.21.15.161:0/3657567477 wait complete. 2024-05-08T09:21:47.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.890+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.890+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.890+0000 7f5f9401f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.890+0000 7f5f9401f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564de46071d0 con 0x564de46bcb60 2024-05-08T09:21:47.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5f91b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5f91b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51718/0 (socket says 172.21.15.161:51718) 2024-05-08T09:21:47.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3381384705 learned_addr learned my addr 172.21.15.161:0/3381384705 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3381384705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de46baa60 con 0x564de46bcb60 2024-05-08T09:21:47.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3381384705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f84007000 tx=0x7f5f8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9867d3012f00b4c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5e7fe07640 1 -- 172.21.15.161:0/3381384705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f840529e0 con 0x564de46bcb60 2024-05-08T09:21:47.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5e7fe07640 1 -- 172.21.15.161:0/3381384705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84052b80 con 0x564de46bcb60 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.891+0000 7f5e7fe07640 1 -- 172.21.15.161:0/3381384705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8405c430 con 0x564de46bcb60 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- 172.21.15.161:0/3381384705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 msgr2=0x564de46bc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3381384705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f84007000 tx=0x7f5f8404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- 172.21.15.161:0/3381384705 shutdown_connections 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3381384705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de46bc4a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- 172.21.15.161:0/3381384705 >> 172.21.15.161:0/3381384705 conn(0x564de46b65b0 msgr2=0x564de47a8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- 172.21.15.161:0/3381384705 shutdown_connections 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- 172.21.15.161:0/3381384705 wait complete. 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.892+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f9401f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f9401f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564de46c3410 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f91b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f91b1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51724/0 (socket says 172.21.15.161:51724) 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f91b1e640 1 -- 172.21.15.161:0/901123914 learned_addr learned my addr 172.21.15.161:0/901123914 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f91b1e640 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de47b78e0 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.893+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f840526d0 tx=0x7f5f84003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5e7e604640 1 -- 172.21.15.161:0/901123914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f84075070 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5e7e604640 1 -- 172.21.15.161:0/901123914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f84070410 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564de47b7b70 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5e7e604640 1 -- 172.21.15.161:0/901123914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f840529e0 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de47ba820 con 0x564de46bcb60 2024-05-08T09:21:47.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.894+0000 7f5e7e604640 1 -- 172.21.15.161:0/901123914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f84078070 con 0x564de46bcb60 2024-05-08T09:21:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5e7e604640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 0x7f5e78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5e7e604640 1 -- 172.21.15.161:0/901123914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f8406d070 con 0x564de46bcb60 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9131d640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 0x7f5e78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 0x564de47be5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47beb60 con 0x564de46bf490 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9231f640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 0x564de47be5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9131d640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 0x7f5e78038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000f60 tx=0x7f5f880012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9231f640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 0x564de47be5e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9231f640 1 -- 172.21.15.161:0/901123914 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f8c0083e0 con 0x564de46bf490 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.895+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47bbb90 con 0x564de46bf490 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.896+0000 7f5f9231f640 1 -- 172.21.15.161:0/901123914 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f8c0083e0 con 0x564de46bf490 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.896+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 0x564de47c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.896+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47c39a0 con 0x564de47c0ec0 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.896+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 0x564de47c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.896+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 0x564de47c32b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.897+0000 7f5f91b1e640 1 -- 172.21.15.161:0/901123914 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5f84077030 con 0x564de47c0ec0 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.897+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47bfe70 con 0x564de46bf490 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.897+0000 7f5f9231f640 1 -- 172.21.15.161:0/901123914 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f8c0083e0 con 0x564de46bf490 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.897+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47c0330 con 0x564de46bf490 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.897+0000 7f5f9231f640 1 -- 172.21.15.161:0/901123914 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5f8c0083e0 con 0x564de46bf490 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9401f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9401f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564de45adcf0 con 0x564de47d2b50 2024-05-08T09:21:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51740/0 (socket says 172.21.15.161:51740) 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9231f640 1 -- 172.21.15.161:0/89205579 learned_addr learned my addr 172.21.15.161:0/89205579 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9231f640 1 -- 172.21.15.161:0/89205579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de47d34b0 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.898+0000 7f5f9231f640 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564de47b87a0 tx=0x7f5f8c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.899+0000 7f5e777fe640 1 -- 172.21.15.161:0/89205579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c007d00 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.899+0000 7f5e777fe640 1 -- 172.21.15.161:0/89205579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c01e020 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.899+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564de47d3f20 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.899+0000 7f5e777fe640 1 -- 172.21.15.161:0/89205579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c019590 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.899+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de47d4420 con 0x564de47d2b50 2024-05-08T09:21:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5e777fe640 1 -- 172.21.15.161:0/89205579 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f8c016040 con 0x564de47d2b50 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5e777fe640 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 0x7f5e6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5e777fe640 1 -- 172.21.15.161:0/89205579 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f8c01f030 con 0x564de47d2b50 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 0x7f5e6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 0x7f5e6c038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x564de47bf030 tx=0x7f5f8408e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9401f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9401f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564de46bad80 con 0x564de47dff90 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51742/0 (socket says 172.21.15.161:51742) 2024-05-08T09:21:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.900+0000 7f5f9231f640 1 -- 172.21.15.161:0/1515771845 learned_addr learned my addr 172.21.15.161:0/1515771845 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9231f640 1 -- 172.21.15.161:0/1515771845 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de47e0980 con 0x564de47dff90 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9231f640 1 --2- 172.21.15.161:0/1515771845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c04c810 tx=0x7f5f8c014f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1267bc606765c11 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5e757fa640 1 -- 172.21.15.161:0/1515771845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c01d070 con 0x564de47dff90 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5e757fa640 1 -- 172.21.15.161:0/1515771845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c017d90 con 0x564de47dff90 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5e757fa640 1 -- 172.21.15.161:0/1515771845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c018520 con 0x564de47dff90 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 -- 172.21.15.161:0/1515771845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 msgr2=0x564de47e03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 --2- 172.21.15.161:0/1515771845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c04c810 tx=0x7f5f8c014f30 comp rx=0 tx=0).stop 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 -- 172.21.15.161:0/1515771845 shutdown_connections 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 --2- 172.21.15.161:0/1515771845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e03b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 -- 172.21.15.161:0/1515771845 >> 172.21.15.161:0/1515771845 conn(0x564de47dc210 msgr2=0x564de47da270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 -- 172.21.15.161:0/1515771845 shutdown_connections 2024-05-08T09:21:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.901+0000 7f5f9401f800 1 -- 172.21.15.161:0/1515771845 wait complete. 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9401f800 1 Processor -- start 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9401f800 1 -- start start 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9401f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9401f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564de47e10b0 con 0x564de47dff90 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9231f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51758/0 (socket says 172.21.15.161:51758) 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 learned_addr learned my addr 172.21.15.161:0/3874434863 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.902+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de47e7a10 con 0x564de47dff90 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5f9231f640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e74d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c017f60 tx=0x7f5f8c04c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5e637fe640 1 -- 172.21.15.161:0/3874434863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c030070 con 0x564de47dff90 2024-05-08T09:21:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5e637fe640 1 -- 172.21.15.161:0/3874434863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f8c0155f0 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564de47e7ca0 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5e637fe640 1 -- 172.21.15.161:0/3874434863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5f8c019730 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de47ea950 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.903+0000 7f5e637fe640 1 -- 172.21.15.161:0/3874434863 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5f8c033070 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5e637fe640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e5c036950 0x7f5e5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5e637fe640 1 -- 172.21.15.161:0/3874434863 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5f8c04fdf0 con 0x564de47dff90 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e5c036950 0x7f5e5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de47f2fa0 0x564de47f5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47f5bb0 con 0x564de47f2fa0 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f9131d640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de47f2fa0 0x564de47f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e5c036950 0x7f5e5c038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f8408e010 tx=0x7f5f84089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.904+0000 7f5f9131d640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de47f2fa0 0x564de47f5460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f88009050 con 0x564de47f2fa0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 realm 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47f23f0 con 0x564de47f2fa0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f88009050 con 0x564de47f2fa0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47f6690 con 0x564de47f2fa0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f88009050 con 0x564de47f2fa0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47f6f60 con 0x564de47f2fa0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5f88009050 con 0x564de47f2fa0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47f7810 0x564de47f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.905+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47fa340 con 0x564de47f7810 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9231f640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47f7810 0x564de47f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9231f640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47f7810 0x564de47f9c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9401f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9401f800 20 searching for the correct realm 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564de47fc3f0 0x564de47fe8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.906+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564de47fc3f0 0x564de47fe8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.907+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564de47fc3f0 0x564de47fe8b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.907+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.907+0000 7f5f91b1e640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5f8409b040 0x7f5f8408c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.907+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.907+0000 7f5f9131d640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5f8409b040 0x7f5f8408c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9131d640 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5f8409b040 0x7f5f8408c460 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:47.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88009050 con 0x7f5f8409b040 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88009050 con 0x564de47f2fa0 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.908+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.909+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.910+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.911+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.912+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.913+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.914+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47fc3f0 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f7810 2024-05-08T09:21:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.915+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x564de47f2fa0 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564de47fef80 con 0x7f5f8409b040 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47fadf0 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47fb270 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.916+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47fb750 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:47.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 zone default found 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 4 Realm: () 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 zonegroup default 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de47ff400 con 0x564de47f7810 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de4801630 con 0x564de47fc3f0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.917+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de48019d0 con 0x564de47fc3f0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.918+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.918+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.918+0000 7f5f9401f800 20 started sync module instance, tier type = 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.918+0000 7f5f9401f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.918+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4800a70 con 0x7f5f8409b040 2024-05-08T09:21:47.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.919+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.919+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94892546068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4800a70 con 0x7f5f8409b040 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.919+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4802390 con 0x564de47f2fa0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.921+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.921+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94892546072288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4802340 con 0x564de47f2fa0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.921+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4803340 con 0x564de47fc3f0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.922+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94892546068336] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.924+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.924+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94892546072288] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.924+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94892546074496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4802e50 con 0x564de47fc3f0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.924+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4803be0 con 0x7f5f8409b040 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.927+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94892546074496] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.927+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.927+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94892546078512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4803b50 con 0x7f5f8409b040 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.927+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4804970 con 0x564de47f2fa0 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.929+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.929+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94892546081920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de48048a0 con 0x564de47f2fa0 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.929+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de48058c0 con 0x564de47f7810 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.930+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.930+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94892546085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4805880 con 0x564de47f7810 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.931+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4806870 con 0x564de47f7810 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.931+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94892546085808] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.932+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94892546078512] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.932+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.932+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94892546080720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4806350 con 0x564de47f7810 2024-05-08T09:21:47.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.932+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4806d60 con 0x564de47f7810 2024-05-08T09:21:47.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.932+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94892546081920] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94892546084192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4806d20 con 0x564de47f7810 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=0 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=1 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=2 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=3 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=4 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=5 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94892546080720] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.933+0000 7f5f9401f800 20 add_watcher() i=6 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.934+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94892546084192] v27'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.934+0000 7f5f9401f800 20 add_watcher() i=7 2024-05-08T09:21:47.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.934+0000 7f5f9401f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.934+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de4806d20 con 0x564de47f2fa0 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.935+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.935+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94892546091120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4806c90 con 0x564de47f2fa0 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94892546091120] v27'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 5 note: GC not initialized 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5e427fc640 20 reqs_thread_entry: start 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:47.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 20 Filter name: none 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5db3fff640 20 reqs_thread_entry: start 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.936+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564de483cc10 con 0x564de47f2fa0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.937+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.937+0000 7f5f9401f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:could not fetch user info: no user info saved 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.938+0000 7f5e437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.938+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94892546091120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de483cbd0 con 0x564de47f2fa0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.939+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94892546091120] v27'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.939+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94892546068336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de483cbd0 con 0x7f5f8409b040 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.940+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94892546068336] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.940+0000 7f5f9401f800 20 remove_watcher() i=0 2024-05-08T09:21:47.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.940+0000 7f5f9401f800 2 removed watcher, disabling cache 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.940+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94892546072288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de483cbd0 con 0x564de47f2fa0 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.941+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94892546072288] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.941+0000 7f5f9401f800 20 remove_watcher() i=1 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.941+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94892546074496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de483cbd0 con 0x564de47fc3f0 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.942+0000 7f5f91b1e640 1 -- 172.21.15.161:0/3874434863 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94892546074496] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f84098070 con 0x564de47fc3f0 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.942+0000 7f5f9401f800 20 remove_watcher() i=2 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.942+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94892546078512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4800f70 con 0x7f5f8409b040 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.943+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94892546078512] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x7f5f8409b040 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.943+0000 7f5f9401f800 20 remove_watcher() i=3 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.943+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94892546081920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4803730 con 0x564de47f2fa0 2024-05-08T09:21:47.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.944+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94892546081920] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f88029040 con 0x564de47f2fa0 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.944+0000 7f5f9401f800 20 remove_watcher() i=4 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.944+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94892546085808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4800f70 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.945+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94892546085808] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.945+0000 7f5f9401f800 20 remove_watcher() i=5 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.945+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94892546080720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4804480 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.946+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94892546080720] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.946+0000 7f5f9401f800 20 remove_watcher() i=6 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.946+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94892546084192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564de4803730 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9231f640 1 -- 172.21.15.161:0/3874434863 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94892546084192] v27'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5f8c032030 con 0x564de47f7810 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 20 remove_watcher() i=7 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47f7810 msgr2=0x564de47f9c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47f7810 0x564de47f9c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de47f2fa0 msgr2=0x564de47f5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de47f2fa0 0x564de47f5460 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5f8409b040 msgr2=0x7f5f8408c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5f8409b040 0x7f5f8408c460 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564de47fc3f0 msgr2=0x564de47fe8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564de47fc3f0 0x564de47fe8b0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e5c036950 msgr2=0x7f5e5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e5c036950 0x7f5e5c038e10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5f8408e010 tx=0x7f5f84089000 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 msgr2=0x564de47e74d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/3874434863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47dff90 0x564de47e74d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c017f60 tx=0x7f5f8c04c770 comp rx=0 tx=0).stop 2024-05-08T09:21:47.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 reap_dead start 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9131d640 1 -- 172.21.15.161:0/3874434863 reap_dead start 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 shutdown_connections 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 >> 172.21.15.161:0/3874434863 conn(0x564de47dc210 msgr2=0x564de47d9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 shutdown_connections 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/3874434863 wait complete. 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 msgr2=0x7f5e6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 0x7f5e6c038dc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x564de47bf030 tx=0x7f5f8408e040 comp rx=0 tx=0).stop 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 msgr2=0x564de47d2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x564de47b87a0 tx=0x7f5f8c00aea0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 shutdown_connections 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e6c036900 0x7f5e6c038dc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 --2- 172.21.15.161:0/89205579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de47d2b50 0x564de47d2f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.947+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 >> 172.21.15.161:0/89205579 conn(0x564de47c6bf0 msgr2=0x564de47c6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 shutdown_connections 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/89205579 wait complete. 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 msgr2=0x564de47c32b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 0x564de47c32b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 msgr2=0x564de47be5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 0x564de47be5e0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 msgr2=0x7f5e78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 0x7f5e78038e10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f88000f60 tx=0x7f5f880012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 msgr2=0x564de47b73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5f840526d0 tx=0x7f5f84003330 comp rx=0 tx=0).stop 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 shutdown_connections 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564de47c0ec0 0x564de47c32b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564de46bf490 0x564de47be5e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5e78036950 0x7f5e78038e10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 --2- 172.21.15.161:0/901123914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564de46bcb60 0x564de47b73a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 >> 172.21.15.161:0/901123914 conn(0x564de46b65b0 msgr2=0x564de46bb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 shutdown_connections 2024-05-08T09:21:47.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:47.948+0000 7f5f9401f800 1 -- 172.21.15.161:0/901123914 wait complete. 2024-05-08T09:21:47.960 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T09:21:47.960 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T09:21:47.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-05-08T09:21:47.961 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-05-08T09:21:48.015 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.015 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f58d46800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b37f89ef70 0x55b37f89f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f58d46800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b37f89fa10 con 0x55b37f8a01d0 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f58d46800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55b37f731050 con 0x55b37f89ef70 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f5684c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b37f89ef70 0x55b37f89f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f4ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55b37f8a01d0 0x55b37f8a0650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42732/0 (socket says 172.21.15.161:42732) 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2542303140 learned_addr learned my addr 172.21.15.161:0/2542303140 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:48.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f5684c640 1 -- 172.21.15.161:0/2542303140 >> v1:172.21.15.45:6789/0 conn(0x55b37f8a01d0 legacy=0x55b37f8a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.016+0000 7f4f5684c640 1 -- 172.21.15.161:0/2542303140 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f8a0d90 con 0x55b37f89ef70 2024-05-08T09:21:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.018+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2542303140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f89f390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800a470 tx=0x7f4f4801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49ba807ebfab324a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f5604b640 1 -- 172.21.15.161:0/2542303140 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48057070 con 0x55b37f89ef70 2024-05-08T09:21:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f5604b640 1 -- 172.21.15.161:0/2542303140 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4804adc0 con 0x55b37f89ef70 2024-05-08T09:21:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f5604b640 1 -- 172.21.15.161:0/2542303140 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48052590 con 0x55b37f89ef70 2024-05-08T09:21:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 -- 172.21.15.161:0/2542303140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 msgr2=0x55b37f89f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2542303140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f89f390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800a470 tx=0x7f4f4801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 -- 172.21.15.161:0/2542303140 shutdown_connections 2024-05-08T09:21:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2542303140 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f89f390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 -- 172.21.15.161:0/2542303140 >> 172.21.15.161:0/2542303140 conn(0x55b37f89a550 msgr2=0x55b37f89c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 -- 172.21.15.161:0/2542303140 shutdown_connections 2024-05-08T09:21:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.019+0000 7f4f58d46800 1 -- 172.21.15.161:0/2542303140 wait complete. 2024-05-08T09:21:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f58d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f58d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b37f7eb170 con 0x55b37f89ef70 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f5684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f5684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51784/0 (socket says 172.21.15.161:51784) 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f5684c640 1 -- 172.21.15.161:0/1992665992 learned_addr learned my addr 172.21.15.161:0/1992665992 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.033+0000 7f4f5684c640 1 -- 172.21.15.161:0/1992665992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f990d60 con 0x55b37f89ef70 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.034+0000 7f4f5684c640 1 --2- 172.21.15.161:0/1992665992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f48055040 tx=0x7f4f4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c49903eb2160902 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.034+0000 7f4e44e09640 1 -- 172.21.15.161:0/1992665992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48057040 con 0x55b37f89ef70 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.034+0000 7f4e44e09640 1 -- 172.21.15.161:0/1992665992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f48063070 con 0x55b37f89ef70 2024-05-08T09:21:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.034+0000 7f4e44e09640 1 -- 172.21.15.161:0/1992665992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f4805d790 con 0x55b37f89ef70 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/1992665992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 msgr2=0x55b37f990790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 --2- 172.21.15.161:0/1992665992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f48055040 tx=0x7f4f4804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/1992665992 shutdown_connections 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 --2- 172.21.15.161:0/1992665992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f990790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/1992665992 >> 172.21.15.161:0/1992665992 conn(0x55b37f89a550 msgr2=0x55b37f98c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/1992665992 shutdown_connections 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/1992665992 wait complete. 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b37f8a86a0 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f5684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f5684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51790/0 (socket says 172.21.15.161:51790) 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f5684c640 1 -- 172.21.15.161:0/3008699455 learned_addr learned my addr 172.21.15.161:0/3008699455 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f5684c640 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f999d50 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f5684c640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800a470 tx=0x7f4f48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4e43606640 1 -- 172.21.15.161:0/3008699455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48057050 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4e43606640 1 -- 172.21.15.161:0/3008699455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f4805dc90 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4e43606640 1 -- 172.21.15.161:0/3008699455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f48052440 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b37f99e360 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.036+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b37f99e8e0 con 0x55b37f89ef70 2024-05-08T09:21:48.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4e43606640 1 -- 172.21.15.161:0/3008699455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f480525e0 con 0x55b37f89ef70 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4e43606640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 0x7f4e3c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4e43606640 1 -- 172.21.15.161:0/3008699455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f4808dc60 con 0x55b37f89ef70 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 0x7f4e3c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 0x55b37f9a2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9a2cd0 con 0x55b37f8a01d0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.037+0000 7f4f5704d640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 0x55b37f9a2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 0x7f4e3c038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000f60 tx=0x7f4f400012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f5704d640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 0x55b37f9a2700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f5704d640 1 -- 172.21.15.161:0/3008699455 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f5000a4a0 con 0x55b37f8a01d0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f99fcd0 con 0x55b37f8a01d0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f5704d640 1 -- 172.21.15.161:0/3008699455 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f5000a4a0 con 0x55b37f8a01d0 2024-05-08T09:21:48.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 0x55b37f9a73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9a7a70 con 0x55b37f9a4fe0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.038+0000 7f4f5684c640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 0x55b37f9a73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.039+0000 7f4f5684c640 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 0x55b37f9a73d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.039+0000 7f4f5684c640 1 -- 172.21.15.161:0/3008699455 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9a4fe0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.039+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9a3f90 con 0x55b37f8a01d0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.039+0000 7f4f5704d640 1 -- 172.21.15.161:0/3008699455 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f5000a4a0 con 0x55b37f8a01d0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9a4470 con 0x55b37f8a01d0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f5704d640 1 -- 172.21.15.161:0/3008699455 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4f5000a4a0 con 0x55b37f8a01d0 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f58d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f58d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b37f791cf0 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51802/0 (socket says 172.21.15.161:51802) 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.040+0000 7f4f5704d640 1 -- 172.21.15.161:0/3852711553 learned_addr learned my addr 172.21.15.161:0/3852711553 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4f5704d640 1 -- 172.21.15.161:0/3852711553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f9b7580 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4f5704d640 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55b37f999f20 tx=0x7f4f500188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4e40e01640 1 -- 172.21.15.161:0/3852711553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50014450 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4e40e01640 1 -- 172.21.15.161:0/3852711553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f500145f0 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b37f9b7ff0 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4e40e01640 1 -- 172.21.15.161:0/3852711553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f500148d0 con 0x55b37f9b6c20 2024-05-08T09:21:48.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.041+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b37f9b84f0 con 0x55b37f9b6c20 2024-05-08T09:21:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4e40e01640 1 -- 172.21.15.161:0/3852711553 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f50011040 con 0x55b37f9b6c20 2024-05-08T09:21:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4e40e01640 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 0x7f4e30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4e40e01640 1 -- 172.21.15.161:0/3852711553 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f5001e070 con 0x55b37f9b6c20 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4f5684c640 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 0x7f4e30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4f5684c640 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 0x7f4e30038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55b37f9a3100 tx=0x7f4f4808bf20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.042+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f58d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f58d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b37f991020 con 0x55b37f9c3f70 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51806/0 (socket says 172.21.15.161:51806) 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f5704d640 1 -- 172.21.15.161:0/85587069 learned_addr learned my addr 172.21.15.161:0/85587069 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f5704d640 1 -- 172.21.15.161:0/85587069 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f9c4960 con 0x55b37f9c3f70 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4f5704d640 1 --2- 172.21.15.161:0/85587069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f5004c850 tx=0x7f4f50011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8f09cf8760b450 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4e3a7fc640 1 -- 172.21.15.161:0/85587069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5003ee60 con 0x55b37f9c3f70 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4e3a7fc640 1 -- 172.21.15.161:0/85587069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50013cb0 con 0x55b37f9c3f70 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.043+0000 7f4e3a7fc640 1 -- 172.21.15.161:0/85587069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5004e0d0 con 0x55b37f9c3f70 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- 172.21.15.161:0/85587069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 msgr2=0x55b37f9c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 --2- 172.21.15.161:0/85587069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4f5004c850 tx=0x7f4f50011700 comp rx=0 tx=0).stop 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- 172.21.15.161:0/85587069 shutdown_connections 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 --2- 172.21.15.161:0/85587069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9c4390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- 172.21.15.161:0/85587069 >> 172.21.15.161:0/85587069 conn(0x55b37f9c0240 msgr2=0x55b37f9be2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- 172.21.15.161:0/85587069 shutdown_connections 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- 172.21.15.161:0/85587069 wait complete. 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 Processor -- start 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- start start 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.044+0000 7f4f58d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b37f9c5120 con 0x55b37f9c3f70 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f5704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51822/0 (socket says 172.21.15.161:51822) 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 learned_addr learned my addr 172.21.15.161:0/2725154671 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37f9cba00 con 0x55b37f9c3f70 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f5704d640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9cb4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f5004b770 tx=0x7f4f5004c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4e38ff9640 1 -- 172.21.15.161:0/2725154671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f5002ba60 con 0x55b37f9c3f70 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4e38ff9640 1 -- 172.21.15.161:0/2725154671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5002bc20 con 0x55b37f9c3f70 2024-05-08T09:21:48.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b37f9cbc90 con 0x55b37f9c3f70 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4e38ff9640 1 -- 172.21.15.161:0/2725154671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4f50022a50 con 0x55b37f9c3f70 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.045+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b37f9ce940 con 0x55b37f9c3f70 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.046+0000 7f4e38ff9640 1 -- 172.21.15.161:0/2725154671 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4f50022bf0 con 0x55b37f9c3f70 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.046+0000 7f4e38ff9640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e20036950 0x7f4e20038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.046+0000 7f4e38ff9640 1 -- 172.21.15.161:0/2725154671 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4f5000e040 con 0x55b37f9c3f70 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.046+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e20036950 0x7f4e20038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e20036950 0x7f4e20038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f4805cb40 tx=0x7f4f48087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f9d7000 0x55b37f9d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9d9c10 con 0x55b37f9d7000 2024-05-08T09:21:48.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f9d7000 0x55b37f9d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f9d7000 0x55b37f9d94c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.047+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f40009050 con 0x55b37f9d7000 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 realm 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9d6450 con 0x55b37f9d7000 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f40009050 con 0x55b37f9d7000 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9da700 con 0x55b37f9d7000 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f40009050 con 0x55b37f9d7000 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9dafd0 con 0x55b37f9d7000 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4f40009050 con 0x55b37f9d7000 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9db910 0x55b37f9ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9de490 con 0x55b37f9db910 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.048+0000 7f4f5704d640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9db910 0x55b37f9ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f5704d640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9db910 0x55b37f9ddd00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f58d46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f58d46800 20 searching for the correct realm 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b37f9e0440 0x55b37f9e2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b37f9e0440 0x55b37f9e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.049+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b37f9e0440 0x55b37f9e2900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.050+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.050+0000 7f4f5684c640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4f4809b040 0x7f4f4808d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.050+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.050+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4f4809b040 0x7f4f4808d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.050+0000 7f4f4ffff640 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4f4809b040 0x7f4f4808d410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40009050 con 0x7f4f4809b040 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40009050 con 0x55b37f9d7000 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.051+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.052+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.053+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.054+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.055+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.056+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.057+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9e0440 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9db910 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.058+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x55b37f9d7000 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e2fd0 con 0x7f4f4809b040 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9dee50 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9df6f0 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.059+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9dea90 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 zone default found 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 4 Realm: () 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 zonegroup default 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9df350 con 0x55b37f9db910 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.060+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e5830 con 0x55b37f9e0440 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e5bd0 con 0x55b37f9e0440 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 20 started sync module instance, tier type = 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.061+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e4cc0 con 0x7f4f4809b040 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.062+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.062+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94229428589024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e4cc0 con 0x7f4f4809b040 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.062+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e6590 con 0x55b37f9d7000 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.063+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.063+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94229428592864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e6560 con 0x55b37f9d7000 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.063+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e7580 con 0x55b37f9e0440 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.063+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94229428589024] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.064+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94229428592864] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.064+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.065+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94229428595120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e4810 con 0x55b37f9e0440 2024-05-08T09:21:48.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.065+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e7e20 con 0x7f4f4809b040 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.066+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.066+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94229428599664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e86c0 con 0x7f4f4809b040 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.066+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e9130 con 0x55b37f9d7000 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.066+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94229428595120] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.067+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.067+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94229428603904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e90f0 con 0x55b37f9d7000 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.067+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e9b40 con 0x55b37f9db910 2024-05-08T09:21:48.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.067+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94229428599664] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.068+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94229428603904] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.068+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.068+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94229428596816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e8210 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.068+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9ea3e0 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.069+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94229428596816] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.070+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.070+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94229428606608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9ea3e0 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.070+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9eada0 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94229428606608] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94229428611312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9eb200 con 0x55b37f9db910 2024-05-08T09:21:48.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=0 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=1 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=2 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=3 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=4 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=5 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.072+0000 7f4f58d46800 20 add_watcher() i=6 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94229428611312] v27'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f58d46800 20 add_watcher() i=7 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f58d46800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e9f60 con 0x55b37f9d7000 2024-05-08T09:21:48.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.073+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94229428612368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e9f60 con 0x55b37f9d7000 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.074+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94229428612368] v27'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.074+0000 7f4e0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.074+0000 7f4f58d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.074+0000 7f4f58d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.074+0000 7f4f58d46800 5 note: GC not initialized 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4d87fff640 20 reqs_thread_entry: start 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 Filter name: none 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4d85ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:48.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa21810 con 0x55b37f9d7000 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa1ffb0 con 0x55b37f9d7000 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.075+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa1ffb0 con 0x55b37f9db910 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T09:21:48.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.076+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa208d0 con 0x55b37f9d7000 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f58d46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f58d46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94229428831264 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa25150 con 0x55b37f9d7000 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify (1) cookie 94229428603904 notify 115964116992 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b37fa20c70 con 0x55b37f9d7000 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.077+0000 7f4e3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94229428603904 notifier 4286 bl.length()=567 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4e3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4e3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 notify.4 [notify cookie 94229428831264 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4e3a7fc640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e1c003ea0 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== watch-notify(notify_complete (2) cookie 94229428831264 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b37fa21260 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.078+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa20420 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.079+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.079+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.079+0000 7f4f58d46800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.079+0000 7f4f58d46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.079+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94229428831264 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa25110 con 0x7f4f4809b040 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== watch-notify(notify (1) cookie 94229428599664 notify 115964116992 ret 0) ==== 211+0+0 (crc 0 0 0) 0x55b37fa21260 con 0x7f4f4809b040 2024-05-08T09:21:48.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4e39ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94229428599664 notifier 4286 bl.length()=169 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4e39ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4e39ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4e39ffb640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4d8c003400 con 0x7f4f4809b040 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(69 notify.3 [notify cookie 94229428831264 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== watch-notify(notify_complete (2) cookie 94229428831264 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b37f89fa10 con 0x7f4f4809b040 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.080+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa203f0 con 0x55b37f9db910 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f58d46800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f58d46800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T09:21:48.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f58d46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94229428831216 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa25270 con 0x7f4f4809b040 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== watch-notify(notify (1) cookie 94229428599664 notify 115964116993 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b37f89fa10 con 0x7f4f4809b040 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4e3a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94229428599664 notifier 4286 bl.length()=177 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4e3a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4e3a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(72 notify.3 [notify cookie 94229428831216 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4e3a7fc640 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4e1c003ea0 con 0x7f4f4809b040 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.082+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.083+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== watch-notify(notify_complete (2) cookie 94229428831216 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4f4002f450 con 0x7f4f4809b040 2024-05-08T09:21:48.101 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.083+0000 7f4e0d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.083+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94229428612368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37fa227b0 con 0x55b37f9d7000 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.084+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94229428612368] v27'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.084+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94229428589024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9ead10 con 0x7f4f4809b040 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.085+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94229428589024] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.085+0000 7f4f58d46800 20 remove_watcher() i=0 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.085+0000 7f4f58d46800 2 removed watcher, disabling cache 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.085+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94229428592864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e51c0 con 0x55b37f9d7000 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.087+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94229428592864] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.087+0000 7f4f58d46800 20 remove_watcher() i=1 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.087+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94229428595120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e60e0 con 0x55b37f9e0440 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.088+0000 7f4f5684c640 1 -- 172.21.15.161:0/2725154671 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94229428595120] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f48078070 con 0x55b37f9e0440 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.088+0000 7f4f58d46800 20 remove_watcher() i=2 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.088+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94229428599664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e69b0 con 0x7f4f4809b040 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.089+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94229428599664] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x7f4f4809b040 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.089+0000 7f4f58d46800 20 remove_watcher() i=3 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.089+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94229428603904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e7b70 con 0x55b37f9d7000 2024-05-08T09:21:48.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.090+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94229428603904] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f40029040 con 0x55b37f9d7000 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.090+0000 7f4f58d46800 20 remove_watcher() i=4 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.090+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94229428596816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e7b70 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.091+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94229428596816] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.091+0000 7f4f58d46800 20 remove_watcher() i=5 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.091+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94229428606608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e7050 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.092+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94229428606608] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.093+0000 7f4f58d46800 20 remove_watcher() i=6 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.093+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94229428611312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b37f9e9690 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.093+0000 7f4f5704d640 1 -- 172.21.15.161:0/2725154671 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94229428611312] v27'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4f5002a070 con 0x55b37f9db910 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.093+0000 7f4f58d46800 20 remove_watcher() i=7 2024-05-08T09:21:48.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9db910 msgr2=0x55b37f9ddd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9db910 0x55b37f9ddd00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f9d7000 msgr2=0x55b37f9d94c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f9d7000 0x55b37f9d94c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4f4809b040 msgr2=0x7f4f4808d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4f4809b040 0x7f4f4808d410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b37f9e0440 msgr2=0x55b37f9e2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b37f9e0440 0x55b37f9e2900 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e20036950 msgr2=0x7f4e20038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e20036950 0x7f4e20038e10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4f4805cb40 tx=0x7f4f48087000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 msgr2=0x55b37f9cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/2725154671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9c3f70 0x55b37f9cb4c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4f5004b770 tx=0x7f4f5004c7e0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 reap_dead start 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f4ffff640 1 -- 172.21.15.161:0/2725154671 reap_dead start 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 shutdown_connections 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 >> 172.21.15.161:0/2725154671 conn(0x55b37f9c0240 msgr2=0x55b37f9bd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 shutdown_connections 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/2725154671 wait complete. 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 msgr2=0x7f4e30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 0x7f4e30038e10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55b37f9a3100 tx=0x7f4f4808bf20 comp rx=0 tx=0).stop 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 msgr2=0x55b37f9b7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x55b37f999f20 tx=0x7f4f500188f0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 shutdown_connections 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e30036950 0x7f4e30038e10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3852711553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f9b6c20 0x55b37f9b7040 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 >> 172.21.15.161:0/3852711553 conn(0x55b37f9aacc0 msgr2=0x55b37f9ab0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 shutdown_connections 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.094+0000 7f4f58d46800 1 -- 172.21.15.161:0/3852711553 wait complete. 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 msgr2=0x55b37f9a73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 0x55b37f9a73d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 msgr2=0x55b37f9a2700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 0x55b37f9a2700 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 msgr2=0x7f4e3c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 0x7f4e3c038e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4f40000f60 tx=0x7f4f400012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 msgr2=0x55b37f812e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800a470 tx=0x7f4f48002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 shutdown_connections 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b37f9a4fe0 0x55b37f9a73d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b37f8a01d0 0x55b37f9a2700 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4e3c036950 0x7f4e3c038e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 --2- 172.21.15.161:0/3008699455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b37f89ef70 0x55b37f812e20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 >> 172.21.15.161:0/3008699455 conn(0x55b37f89a550 msgr2=0x55b37f98a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 shutdown_connections 2024-05-08T09:21:48.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.095+0000 7f4f58d46800 1 -- 172.21.15.161:0/3008699455 wait complete. 2024-05-08T09:21:48.113 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.113 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T09:21:48.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-05-08T09:21:48.114 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-05-08T09:21:48.162 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.162 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8de3f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55695cf16ff0 0x55695cf17410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8de3f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55695cf17a90 con 0x55695cf18250 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8de3f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55695cda9050 con 0x55695cf16ff0 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b93e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55695cf16ff0 0x55695cf17410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b13d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55695cf18250 0x55695cf186d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42736/0 (socket says 172.21.15.161:42736) 2024-05-08T09:21:48.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b93e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55695cf16ff0 0x55695cf17410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51836/0 (socket says 172.21.15.161:51836) 2024-05-08T09:21:48.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b13d640 1 -- 172.21.15.161:0/4197538556 learned_addr learned my addr 172.21.15.161:0/4197538556 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:48.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b93e640 1 -- 172.21.15.161:0/4197538556 >> v1:172.21.15.45:6789/0 conn(0x55695cf18250 legacy=0x55695cf186d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.163+0000 7fba8b93e640 1 -- 172.21.15.161:0/4197538556 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695cf18e10 con 0x55695cf16ff0 2024-05-08T09:21:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.165+0000 7fba8b93e640 1 --2- 172.21.15.161:0/4197538556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695cf17410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00a470 tx=0x7fba7c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28b88648324a57a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.165+0000 7fba8a93c640 1 -- 172.21.15.161:0/4197538556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c057070 con 0x55695cf16ff0 2024-05-08T09:21:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.165+0000 7fba8a93c640 1 -- 172.21.15.161:0/4197538556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c04adc0 con 0x55695cf16ff0 2024-05-08T09:21:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.165+0000 7fba8a93c640 1 -- 172.21.15.161:0/4197538556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c052590 con 0x55695cf16ff0 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 -- 172.21.15.161:0/4197538556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 msgr2=0x55695cf17410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 --2- 172.21.15.161:0/4197538556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695cf17410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00a470 tx=0x7fba7c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 -- 172.21.15.161:0/4197538556 shutdown_connections 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 --2- 172.21.15.161:0/4197538556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695cf17410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 -- 172.21.15.161:0/4197538556 >> 172.21.15.161:0/4197538556 conn(0x55695cf125d0 msgr2=0x55695cf149f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 -- 172.21.15.161:0/4197538556 shutdown_connections 2024-05-08T09:21:48.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.166+0000 7fba8de3f800 1 -- 172.21.15.161:0/4197538556 wait complete. 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.180+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.180+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.180+0000 7fba8de3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.180+0000 7fba8de3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55695ce631f0 con 0x55695cf16ff0 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fba8b93e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fba8b93e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51842/0 (socket says 172.21.15.161:51842) 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fba8b93e640 1 -- 172.21.15.161:0/2024581814 learned_addr learned my addr 172.21.15.161:0/2024581814 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fba8b93e640 1 -- 172.21.15.161:0/2024581814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695d00c580 con 0x55695cf16ff0 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fba8b93e640 1 --2- 172.21.15.161:0/2024581814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fba7c055040 tx=0x7fba7c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb633a03d17860e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fb979e0b640 1 -- 172.21.15.161:0/2024581814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c057040 con 0x55695cf16ff0 2024-05-08T09:21:48.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fb979e0b640 1 -- 172.21.15.161:0/2024581814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c063070 con 0x55695cf16ff0 2024-05-08T09:21:48.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.181+0000 7fb979e0b640 1 -- 172.21.15.161:0/2024581814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c05d790 con 0x55695cf16ff0 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- 172.21.15.161:0/2024581814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 msgr2=0x55695ce8ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2024581814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fba7c055040 tx=0x7fba7c04c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- 172.21.15.161:0/2024581814 shutdown_connections 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2024581814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695ce8ae60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- 172.21.15.161:0/2024581814 >> 172.21.15.161:0/2024581814 conn(0x55695cf125d0 msgr2=0x55695d004070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- 172.21.15.161:0/2024581814 shutdown_connections 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- 172.21.15.161:0/2024581814 wait complete. 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.182+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8de3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8de3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55695cf20720 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8b93e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8b93e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51858/0 (socket says 172.21.15.161:51858) 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8b93e640 1 -- 172.21.15.161:0/2790011461 learned_addr learned my addr 172.21.15.161:0/2790011461 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8b93e640 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695d0085a0 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.183+0000 7fba8b93e640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00a470 tx=0x7fba7c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fb973fff640 1 -- 172.21.15.161:0/2790011461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c057050 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fb973fff640 1 -- 172.21.15.161:0/2790011461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c05dc90 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55695d008830 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fb973fff640 1 -- 172.21.15.161:0/2790011461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba7c052440 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695d008db0 con 0x55695cf16ff0 2024-05-08T09:21:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.184+0000 7fb973fff640 1 -- 172.21.15.161:0/2790011461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba7c0525e0 con 0x55695cf16ff0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fb973fff640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 0x7fb974038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fb973fff640 1 -- 172.21.15.161:0/2790011461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba7c08dba0 con 0x55695cf16ff0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8b13d640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 0x7fb974038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 0x55695d01a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d01ad70 con 0x55695cf18250 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8c13f640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 0x55695d01a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8b13d640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 0x7fb974038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba80000f60 tx=0x7fba800012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8c13f640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 0x55695d01a830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8c13f640 1 -- 172.21.15.161:0/2790011461 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba8400a4a0 con 0x55695cf18250 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.185+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d01b5c0 con 0x55695cf18250 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8c13f640 1 -- 172.21.15.161:0/2790011461 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba8400a4a0 con 0x55695cf18250 2024-05-08T09:21:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 0x55695d01f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d01fc10 con 0x55695d01cff0 2024-05-08T09:21:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8b93e640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 0x55695d01f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8b93e640 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 0x55695d01f480 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8b93e640 1 -- 172.21.15.161:0/2790011461 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fba7c078070 con 0x55695d01cff0 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d01be70 con 0x55695cf18250 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8c13f640 1 -- 172.21.15.161:0/2790011461 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba8400a4a0 con 0x55695cf18250 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.187+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d01c2d0 con 0x55695cf18250 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8c13f640 1 -- 172.21.15.161:0/2790011461 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fba8400a4a0 con 0x55695cf18250 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8de3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8de3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55695d00a3f0 con 0x55695d02ed80 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51864/0 (socket says 172.21.15.161:51864) 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.188+0000 7fba8c13f640 1 -- 172.21.15.161:0/3398737650 learned_addr learned my addr 172.21.15.161:0/3398737650 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fba8c13f640 1 -- 172.21.15.161:0/3398737650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695d02f6e0 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fba8c13f640 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55695d009810 tx=0x7fba84018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fb9717fa640 1 -- 172.21.15.161:0/3398737650 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba84014450 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fb9717fa640 1 -- 172.21.15.161:0/3398737650 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba840145f0 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fb9717fa640 1 -- 172.21.15.161:0/3398737650 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba840148d0 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55695d030150 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.189+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695d030650 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fb9717fa640 1 -- 172.21.15.161:0/3398737650 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba84011040 con 0x55695d02ed80 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fb9717fa640 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 0x7fb964038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fb9717fa640 1 -- 172.21.15.161:0/3398737650 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba8401e070 con 0x55695d02ed80 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fba8b93e640 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 0x7fb964038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fba8b93e640 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 0x7fb964038dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55695d009360 tx=0x7fba7c08bf20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.190+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8de3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8de3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55695ce09cf0 con 0x55695d03c0f0 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51876/0 (socket says 172.21.15.161:51876) 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8c13f640 1 -- 172.21.15.161:0/133613822 learned_addr learned my addr 172.21.15.161:0/133613822 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.191+0000 7fba8c13f640 1 -- 172.21.15.161:0/133613822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695d03cae0 con 0x55695d03c0f0 2024-05-08T09:21:48.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.192+0000 7fba8c13f640 1 --2- 172.21.15.161:0/133613822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba8404c9e0 tx=0x7fba8402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66253bca145d5769 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.193+0000 7fb96affd640 1 -- 172.21.15.161:0/133613822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba84013c50 con 0x55695d03c0f0 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.193+0000 7fb96affd640 1 -- 172.21.15.161:0/133613822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84013df0 con 0x55695d03c0f0 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.193+0000 7fb96affd640 1 -- 172.21.15.161:0/133613822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba84022bf0 con 0x55695d03c0f0 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- 172.21.15.161:0/133613822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 msgr2=0x55695d03c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 --2- 172.21.15.161:0/133613822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fba8404c9e0 tx=0x7fba8402bf60 comp rx=0 tx=0).stop 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- 172.21.15.161:0/133613822 shutdown_connections 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 --2- 172.21.15.161:0/133613822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d03c510 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- 172.21.15.161:0/133613822 >> 172.21.15.161:0/133613822 conn(0x55695d0383c0 msgr2=0x55695d036420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- 172.21.15.161:0/133613822 shutdown_connections 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- 172.21.15.161:0/133613822 wait complete. 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 Processor -- start 2024-05-08T09:21:48.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- start start 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.194+0000 7fba8de3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55695d03d120 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8c13f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51892/0 (socket says 172.21.15.161:51892) 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 learned_addr learned my addr 172.21.15.161:0/1635280560 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695d0439a0 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8c13f640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba84011590 tx=0x7fba8404c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fb9697fa640 1 -- 172.21.15.161:0/1635280560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8403a070 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fb9697fa640 1 -- 172.21.15.161:0/1635280560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba84022c90 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fb9697fa640 1 -- 172.21.15.161:0/1635280560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba8404b1f0 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55695d043c30 con 0x55695d03c0f0 2024-05-08T09:21:48.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.195+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695d0468e0 con 0x55695d03c0f0 2024-05-08T09:21:48.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.196+0000 7fb9697fa640 1 -- 172.21.15.161:0/1635280560 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fba8404b390 con 0x55695d03c0f0 2024-05-08T09:21:48.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.196+0000 7fb9697fa640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb954036900 0x7fb954038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.196+0000 7fb9697fa640 1 -- 172.21.15.161:0/1635280560 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fba84046040 con 0x55695d03c0f0 2024-05-08T09:21:48.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.196+0000 7fba8b93e640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb954036900 0x7fb954038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8b93e640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb954036900 0x7fb954038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba7c05bf90 tx=0x7fba7c087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695d04efb0 0x55695d051470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d051bc0 con 0x55695d04efb0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8b13d640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695d04efb0 0x55695d051470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.197+0000 7fba8b13d640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695d04efb0 0x55695d051470 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80009050 con 0x55695d04efb0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 realm 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d04e400 con 0x55695d04efb0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80009050 con 0x55695d04efb0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d0526b0 con 0x55695d04efb0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80009050 con 0x55695d04efb0 2024-05-08T09:21:48.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d052f80 con 0x55695d04efb0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fba80009050 con 0x55695d04efb0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d0538c0 0x55695d055cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.198+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d056440 con 0x55695d0538c0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8c13f640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d0538c0 0x55695d055cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8c13f640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d0538c0 0x55695d055cb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8de3f800 20 searching for the correct realm 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55695d058410 0x55695d05a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.199+0000 7fba8b93e640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55695d058410 0x55695d05a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.200+0000 7fba8b93e640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55695d058410 0x55695d05a8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.200+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.200+0000 7fba8b93e640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fba7c09b040 0x7fba7c0073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.200+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.200+0000 7fba8b13d640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fba7c09b040 0x7fba7c0073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8b13d640 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fba7c09b040 0x7fba7c0073e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80009050 con 0x7fba7c09b040 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80009050 con 0x55695d04efb0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.201+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.202+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.204+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.206+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.207+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d058410 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.208+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d0538c0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x55695d04efb0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55695d05afa0 con 0x7fba7c09b040 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d056e00 con 0x55695d04efb0 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.209+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d056a40 con 0x55695d04efb0 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d0577a0 con 0x55695d04efb0 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 zone default found 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 4 Realm: () 2024-05-08T09:21:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 zonegroup default 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d05b460 con 0x55695d0538c0 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.210+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d05d730 con 0x55695d058410 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d05dad0 con 0x55695d058410 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 20 started sync module instance, tier type = 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.211+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05cb70 con 0x7fba7c09b040 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.212+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.212+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93911020589168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05cb70 con 0x7fba7c09b040 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.212+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05e490 con 0x55695d04efb0 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.213+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93911020589168] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.213+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.213+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93911020593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05cb70 con 0x55695d04efb0 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.213+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05ef30 con 0x55695d058410 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.214+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93911020593600] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.214+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.215+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93911020586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05cae0 con 0x55695d058410 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.215+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05fdf0 con 0x7fba7c09b040 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.215+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93911020586688] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93911020599616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d060210 con 0x7fba7c09b040 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d060bd0 con 0x55695d04efb0 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93911020603168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d060ff0 con 0x55695d04efb0 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.216+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d061aa0 con 0x55695d0538c0 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.217+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93911020599616] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.217+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.218+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93911020600672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d061e90 con 0x55695d0538c0 2024-05-08T09:21:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.218+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d062890 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.218+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93911020603168] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.218+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93911020600672] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.219+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.219+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93911020604224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d0623a0 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.219+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d062d60 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93911020604224] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93911020611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d062cd0 con 0x55695d0538c0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=0 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=1 2024-05-08T09:21:48.244 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=2 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=3 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=4 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=5 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.220+0000 7fba8de3f800 20 add_watcher() i=6 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93911020611760] v27'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8de3f800 20 add_watcher() i=7 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8de3f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d061610 con 0x55695d04efb0 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.221+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93911020613968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d061610 con 0x55695d04efb0 2024-05-08T09:21:48.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.222+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93911020613968] v27'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.222+0000 7fb941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.222+0000 7fba8de3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.222+0000 7fba8de3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.222+0000 7fba8de3f800 5 note: GC not initialized 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fb940fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8de3f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8de3f800 20 Filter name: none 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fb8ba7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8de3f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d099770 con 0x55695d0538c0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.223+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d097f10 con 0x55695d04efb0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=7 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-05-08T09:21:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55695d098300 con 0x55695d04efb0 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.224+0000 7fba8de3f800 20 get_user_info_from_index found 0 xattrs 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-05-08T09:21:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.225+0000 7fb941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.225+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93911020613968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d048940 con 0x55695d04efb0 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.226+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93911020613968] v27'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.226+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93911020589168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d063150 con 0x7fba7c09b040 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.229+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93911020589168] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.229+0000 7fba8de3f800 20 remove_watcher() i=0 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.229+0000 7fba8de3f800 2 removed watcher, disabling cache 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.229+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93911020593600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05d070 con 0x55695d04efb0 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.230+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93911020593600] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.230+0000 7fba8de3f800 20 remove_watcher() i=1 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.230+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93911020586688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05d070 con 0x55695d058410 2024-05-08T09:21:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.232+0000 7fba8b93e640 1 -- 172.21.15.161:0/1635280560 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93911020586688] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba7c078070 con 0x55695d058410 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.232+0000 7fba8de3f800 20 remove_watcher() i=2 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.232+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93911020599616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05c6c0 con 0x7fba7c09b040 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93911020599616] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x7fba7c09b040 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8de3f800 20 remove_watcher() i=3 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93911020603168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05f940 con 0x55695d04efb0 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93911020603168] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba80029040 con 0x55695d04efb0 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8de3f800 20 remove_watcher() i=4 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.234+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93911020600672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05c6c0 con 0x55695d0538c0 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.235+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93911020600672] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.235+0000 7fba8de3f800 20 remove_watcher() i=5 2024-05-08T09:21:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.235+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93911020604224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d060720 con 0x55695d0538c0 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.238+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93911020604224] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.238+0000 7fba8de3f800 20 remove_watcher() i=6 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.238+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93911020611760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55695d05c6c0 con 0x55695d0538c0 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8c13f640 1 -- 172.21.15.161:0/1635280560 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93911020611760] v27'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fba8402a070 con 0x55695d0538c0 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 20 remove_watcher() i=7 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d0538c0 msgr2=0x55695d055cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d0538c0 0x55695d055cb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695d04efb0 msgr2=0x55695d051470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695d04efb0 0x55695d051470 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fba7c09b040 msgr2=0x7fba7c0073e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fba7c09b040 0x7fba7c0073e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55695d058410 msgr2=0x55695d05a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55695d058410 0x55695d05a8d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb954036900 msgr2=0x7fb954038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb954036900 0x7fb954038dc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba7c05bf90 tx=0x7fba7c087000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 msgr2=0x55695d043460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fba84011590 tx=0x7fba8404c970 comp rx=0 tx=0).stop 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8b13d640 1 -- 172.21.15.161:0/1635280560 reap_dead start 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 shutdown_connections 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 --2- 172.21.15.161:0/1635280560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d03c0f0 0x55695d043460 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 >> 172.21.15.161:0/1635280560 conn(0x55695d0383c0 msgr2=0x55695d035a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 shutdown_connections 2024-05-08T09:21:48.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.239+0000 7fba8de3f800 1 -- 172.21.15.161:0/1635280560 wait complete. 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 msgr2=0x7fb964038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 0x7fb964038dc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55695d009360 tx=0x7fba7c08bf20 comp rx=0 tx=0).stop 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 msgr2=0x55695d02f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x55695d009810 tx=0x7fba84018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 shutdown_connections 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb964036900 0x7fb964038dc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/3398737650 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695d02ed80 0x55695d02f1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 >> 172.21.15.161:0/3398737650 conn(0x55695d022e20 msgr2=0x55695d023220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 shutdown_connections 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/3398737650 wait complete. 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 msgr2=0x55695d01f480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 0x55695d01f480 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 msgr2=0x55695d01a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 0x55695d01a830 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 msgr2=0x7fb974038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 0x7fb974038e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fba80000f60 tx=0x7fba800012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 msgr2=0x55695d009eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00a470 tx=0x7fba7c002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 shutdown_connections 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55695d01cff0 0x55695d01f480 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55695cf18250 0x55695d01a830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb974036950 0x7fb974038e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 --2- 172.21.15.161:0/2790011461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55695cf16ff0 0x55695d009eb0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 >> 172.21.15.161:0/2790011461 conn(0x55695cf125d0 msgr2=0x55695d002870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 shutdown_connections 2024-05-08T09:21:48.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.240+0000 7fba8de3f800 1 -- 172.21.15.161:0/2790011461 wait complete. 2024-05-08T09:21:48.255 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-05-08T09:21:48.256 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.256 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.301 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.301+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.301+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.301+0000 7f196c928800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56521a3b3bd0 0x56521a3b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.301+0000 7f196c928800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56521a3ba010 con 0x56521a3b6500 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.301+0000 7f196c928800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x56521a244050 con 0x56521a3b3bd0 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1968660640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56521a3b3bd0 0x56521a3b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1968660640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56521a3b3bd0 0x56521a3b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51898/0 (socket says 172.21.15.161:51898) 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1967e5f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x56521a3b6500 0x56521a3b88f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42738/0 (socket says 172.21.15.161:42738) 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1968660640 1 -- 172.21.15.161:0/3146421039 learned_addr learned my addr 172.21.15.161:0/3146421039 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1968660640 1 -- 172.21.15.161:0/3146421039 >> v1:172.21.15.45:6789/0 conn(0x56521a3b6500 legacy=0x56521a3b88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.302+0000 7f1968660640 1 -- 172.21.15.161:0/3146421039 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a3bb1f0 con 0x56521a3b3bd0 2024-05-08T09:21:48.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f1968660640 1 --2- 172.21.15.161:0/3146421039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b5fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f195800a520 tx=0x7f195801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e872b593e431e67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196765e640 1 -- 172.21.15.161:0/3146421039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1958057070 con 0x56521a3b3bd0 2024-05-08T09:21:48.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196765e640 1 -- 172.21.15.161:0/3146421039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1958052570 con 0x56521a3b3bd0 2024-05-08T09:21:48.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196765e640 1 -- 172.21.15.161:0/3146421039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f195804ae60 con 0x56521a3b3bd0 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196c928800 1 -- 172.21.15.161:0/3146421039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 msgr2=0x56521a3b5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196c928800 1 --2- 172.21.15.161:0/3146421039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b5fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f195800a520 tx=0x7f195801d010 comp rx=0 tx=0).stop 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196c928800 1 -- 172.21.15.161:0/3146421039 shutdown_connections 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196c928800 1 --2- 172.21.15.161:0/3146421039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b5fc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.304+0000 7f196c928800 1 -- 172.21.15.161:0/3146421039 >> 172.21.15.161:0/3146421039 conn(0x56521a3ad5a0 msgr2=0x56521a3af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.305+0000 7f196c928800 1 -- 172.21.15.161:0/3146421039 shutdown_connections 2024-05-08T09:21:48.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.305+0000 7f196c928800 1 -- 172.21.15.161:0/3146421039 wait complete. 2024-05-08T09:21:48.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.319+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.319+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.319+0000 7f196c928800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.319+0000 7f196c928800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56521a2fe1d0 con 0x56521a3b3bd0 2024-05-08T09:21:48.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f1968660640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f1968660640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51912/0 (socket says 172.21.15.161:51912) 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f1968660640 1 -- 172.21.15.161:0/1290093021 learned_addr learned my addr 172.21.15.161:0/1290093021 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f1968660640 1 -- 172.21.15.161:0/1290093021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a3b1ad0 con 0x56521a3b3bd0 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f1968660640 1 --2- 172.21.15.161:0/1290093021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1958055040 tx=0x7f195804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4628ff0f428a479 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f185660c640 1 -- 172.21.15.161:0/1290093021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1958057040 con 0x56521a3b3bd0 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f185660c640 1 -- 172.21.15.161:0/1290093021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1958052720 con 0x56521a3b3bd0 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.320+0000 7f185660c640 1 -- 172.21.15.161:0/1290093021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1958052a20 con 0x56521a3b3bd0 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- 172.21.15.161:0/1290093021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 msgr2=0x56521a3b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 --2- 172.21.15.161:0/1290093021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1958055040 tx=0x7f195804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- 172.21.15.161:0/1290093021 shutdown_connections 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 --2- 172.21.15.161:0/1290093021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a3b3510 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- 172.21.15.161:0/1290093021 >> 172.21.15.161:0/1290093021 conn(0x56521a3ad5a0 msgr2=0x56521a49ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- 172.21.15.161:0/1290093021 shutdown_connections 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- 172.21.15.161:0/1290093021 wait complete. 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f196c928800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56521a3ba480 con 0x56521a3b3bd0 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f1968660640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f1968660640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51922/0 (socket says 172.21.15.161:51922) 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f1968660640 1 -- 172.21.15.161:0/559713341 learned_addr learned my addr 172.21.15.161:0/559713341 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.321+0000 7f1968660640 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a4ae850 con 0x56521a3b3bd0 2024-05-08T09:21:48.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f1968660640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1958052540 tx=0x7f1958003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f1854e09640 1 -- 172.21.15.161:0/559713341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1958073070 con 0x56521a3b3bd0 2024-05-08T09:21:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f1854e09640 1 -- 172.21.15.161:0/559713341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f195805d440 con 0x56521a3b3bd0 2024-05-08T09:21:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521a4aeae0 con 0x56521a3b3bd0 2024-05-08T09:21:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f1854e09640 1 -- 172.21.15.161:0/559713341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1958057070 con 0x56521a3b3bd0 2024-05-08T09:21:48.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521a4b1790 con 0x56521a3b3bd0 2024-05-08T09:21:48.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.322+0000 7f1854e09640 1 -- 172.21.15.161:0/559713341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1958076070 con 0x56521a3b3bd0 2024-05-08T09:21:48.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1854e09640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 0x7f1850038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1854e09640 1 -- 172.21.15.161:0/559713341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f195808dc40 con 0x56521a3b3bd0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1967e5f640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 0x7f1850038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 0x56521a4b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4b5a90 con 0x56521a3b6500 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1968e61640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 0x56521a4b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1967e5f640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 0x7f1850038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f195c001e40 tx=0x7f195c0013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.323+0000 7f1968e61640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 0x56521a4b5550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f1968e61640 1 -- 172.21.15.161:0/559713341 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f196000a4a0 con 0x56521a3b6500 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4b2b00 con 0x56521a3b6500 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f1968e61640 1 -- 172.21.15.161:0/559713341 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f196000a4a0 con 0x56521a3b6500 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 0x56521a4ba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4ba8d0 con 0x56521a4b7df0 2024-05-08T09:21:48.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f1968660640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 0x56521a4ba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.325+0000 7f1968660640 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 0x56521a4ba1e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.326+0000 7f1968660640 1 -- 172.21.15.161:0/559713341 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1958075030 con 0x56521a4b7df0 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.326+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4b6da0 con 0x56521a3b6500 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.326+0000 7f1968e61640 1 -- 172.21.15.161:0/559713341 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f196000a4a0 con 0x56521a3b6500 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.326+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4b7280 con 0x56521a3b6500 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.326+0000 7f1968e61640 1 -- 172.21.15.161:0/559713341 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f196000a4a0 con 0x56521a3b6500 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56521a2a4cf0 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51934/0 (socket says 172.21.15.161:51934) 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f1968e61640 1 -- 172.21.15.161:0/1829554834 learned_addr learned my addr 172.21.15.161:0/1829554834 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f1968e61640 1 -- 172.21.15.161:0/1829554834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a4ca3a0 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f1968e61640 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56521a4b5e70 tx=0x7f1960018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f184dffb640 1 -- 172.21.15.161:0/1829554834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1960014450 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f184dffb640 1 -- 172.21.15.161:0/1829554834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1960014610 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521a4cae10 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f184dffb640 1 -- 172.21.15.161:0/1829554834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1960014930 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521a4cb310 con 0x56521a4c9a40 2024-05-08T09:21:48.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.327+0000 7f184dffb640 1 -- 172.21.15.161:0/1829554834 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1960011040 con 0x56521a4c9a40 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f184dffb640 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 0x7f1840038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f184dffb640 1 -- 172.21.15.161:0/1829554834 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f196001e070 con 0x56521a4c9a40 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f1968660640 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 0x7f1840038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f1968660640 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 0x7f1840038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x56521a4b5f60 tx=0x7f195805ee80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f196c928800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f196c928800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56521a3b1d90 con 0x56521a4d6d00 2024-05-08T09:21:48.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51946/0 (socket says 172.21.15.161:51946) 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.328+0000 7f1968e61640 1 -- 172.21.15.161:0/875435517 learned_addr learned my addr 172.21.15.161:0/875435517 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 -- 172.21.15.161:0/875435517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a4d76f0 con 0x56521a4d6d00 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 --2- 172.21.15.161:0/875435517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f196004c980 tx=0x7f196002bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd83b7ba2f1b6197 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f18477fe640 1 -- 172.21.15.161:0/875435517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196003bbd0 con 0x56521a4d6d00 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f18477fe640 1 -- 172.21.15.161:0/875435517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196003bd70 con 0x56521a4d6d00 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f18477fe640 1 -- 172.21.15.161:0/875435517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1960011bb0 con 0x56521a4d6d00 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- 172.21.15.161:0/875435517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 msgr2=0x56521a4d7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 --2- 172.21.15.161:0/875435517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f196004c980 tx=0x7f196002bdf0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- 172.21.15.161:0/875435517 shutdown_connections 2024-05-08T09:21:48.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 --2- 172.21.15.161:0/875435517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4d7120 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- 172.21.15.161:0/875435517 >> 172.21.15.161:0/875435517 conn(0x56521a4d3020 msgr2=0x56521a4d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- 172.21.15.161:0/875435517 shutdown_connections 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- 172.21.15.161:0/875435517 wait complete. 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 Processor -- start 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- start start 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f196c928800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56521a4d7e10 con 0x56521a4d6d00 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51958/0 (socket says 172.21.15.161:51958) 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 learned_addr learned my addr 172.21.15.161:0/655596645 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56521a4de850 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.330+0000 7f1968e61640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f196003e040 tx=0x7f196004c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f1845ffb640 1 -- 172.21.15.161:0/655596645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f196003bbd0 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f1845ffb640 1 -- 172.21.15.161:0/655596645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f196004e280 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56521a4deae0 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f1845ffb640 1 -- 172.21.15.161:0/655596645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1960011980 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56521a4e1790 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.331+0000 7f1845ffb640 1 -- 172.21.15.161:0/655596645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f196004cac0 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1845ffb640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1838036900 0x7f1838038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1845ffb640 1 -- 172.21.15.161:0/655596645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1960033030 con 0x56521a4d6d00 2024-05-08T09:21:48.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1968660640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1838036900 0x7f1838038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a4e9ec0 0x56521a4ec380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4ecad0 con 0x56521a4e9ec0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1967e5f640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a4e9ec0 0x56521a4ec380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1968660640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1838036900 0x7f1838038dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f195808c290 tx=0x7f1958090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.332+0000 7f1967e5f640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a4e9ec0 0x56521a4ec380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f195c00f670 con 0x56521a4e9ec0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 realm 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4e9310 con 0x56521a4e9ec0 2024-05-08T09:21:48.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f195c00f670 con 0x56521a4e9ec0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4ed5b0 con 0x56521a4e9ec0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f195c00f670 con 0x56521a4e9ec0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4ede80 con 0x56521a4e9ec0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f195c00f670 con 0x56521a4e9ec0 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4ee730 0x56521a4f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.333+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f1260 con 0x56521a4ee730 2024-05-08T09:21:48.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.335+0000 7f1968e61640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4ee730 0x56521a4f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.336+0000 7f1968e61640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4ee730 0x56521a4f0b20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f196c928800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f196c928800 20 searching for the correct realm 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56521a4f3300 0x56521a4f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968660640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56521a4f3300 0x56521a4f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968660640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56521a4f3300 0x56521a4f57c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968660640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1958078060 0x7f195808d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.337+0000 7f1967e5f640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1958078060 0x7f195808d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.338+0000 7f1967e5f640 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1958078060 0x7f195808d3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.338+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c00f670 con 0x7f1958078060 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.338+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.338+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.338+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c00f670 con 0x56521a4e9ec0 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.339+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x7f1958078060 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.340+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f195c02b040 con 0x7f1958078060 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.341+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.342+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.343+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.343+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.343+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.343+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x7f1958078060 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.344+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x7f1958078060 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.345+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4f3300 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4ee730 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x56521a4e9ec0 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f5e90 con 0x7f1958078060 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f195c02b040 con 0x7f1958078060 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.346+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f1d00 con 0x56521a4e9ec0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f195c02b040 con 0x56521a4e9ec0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f18e0 con 0x56521a4e9ec0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f25e0 con 0x56521a4e9ec0 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 zone default found 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 4 Realm: () 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 zonegroup default 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.347+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f6310 con 0x56521a4ee730 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f8540 con 0x56521a4f3300 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f88e0 con 0x56521a4f3300 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 started sync module instance, tier type = 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.348+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f7980 con 0x7f1958078060 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.349+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.349+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94910628724128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f7980 con 0x7f1958078060 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.349+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f92a0 con 0x56521a4e9ec0 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.351+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.351+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94910628728304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f96c0 con 0x56521a4e9ec0 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.351+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fa1b0 con 0x56521a4f3300 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.352+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94910628728304] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.352+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94910628724128] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.355+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.355+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94910628721872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f96c0 con 0x56521a4f3300 2024-05-08T09:21:48.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.355+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4faa50 con 0x7f1958078060 2024-05-08T09:21:48.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.356+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.356+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94910628734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fb2f0 con 0x7f1958078060 2024-05-08T09:21:48.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.356+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fbd60 con 0x56521a4e9ec0 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.357+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94910628721872] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.357+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.357+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94910628739120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fbd20 con 0x56521a4e9ec0 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.357+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fc770 con 0x56521a4ee730 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.358+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94910628734880] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.358+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94910628739120] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.359+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.359+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94910628729360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fc2c0 con 0x56521a4ee730 2024-05-08T09:21:48.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.359+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fcc80 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.360+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.360+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94910628743120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fd0a0 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.360+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fdb80 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.361+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94910628729360] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.361+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94910628743120] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.361+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94910628746896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fcbf0 con 0x56521a4ee730 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=0 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=1 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=2 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=3 2024-05-08T09:21:48.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=4 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=5 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=6 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94910628746896] v27'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 20 add_watcher() i=7 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.362+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a500c80 con 0x56521a4e9ec0 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.363+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.363+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94910628736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fe100 con 0x56521a4e9ec0 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94910628736576] v27'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f181e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f196c928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f196c928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f196c928800 5 note: GC not initialized 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f181d7e2640 20 reqs_thread_entry: start 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f196c928800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f196c928800 20 Filter name: none 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.364+0000 7f178effd640 20 reqs_thread_entry: start 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.365+0000 7f196c928800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.365+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56521a533aa0 con 0x56521a4e9ec0 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.365+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.365+0000 7f196c928800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.377 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.366+0000 7f181e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.366+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94910628736576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a532a10 con 0x56521a4e9ec0 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.367+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94910628736576] v27'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.367+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94910628724128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fae40 con 0x7f1958078060 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.368+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94910628724128] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.368+0000 7f196c928800 20 remove_watcher() i=0 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.368+0000 7f196c928800 2 removed watcher, disabling cache 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.368+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94910628728304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f7da0 con 0x56521a4e9ec0 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.369+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94910628728304] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.369+0000 7f196c928800 20 remove_watcher() i=1 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.369+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94910628721872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f8df0 con 0x56521a4f3300 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.370+0000 7f1968660640 1 -- 172.21.15.161:0/655596645 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94910628721872] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1958075030 con 0x56521a4f3300 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.370+0000 7f196c928800 20 remove_watcher() i=2 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.370+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94910628734880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f74d0 con 0x7f1958078060 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94910628734880] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x7f1958078060 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f196c928800 20 remove_watcher() i=3 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94910628739120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f74d0 con 0x56521a4e9ec0 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94910628739120] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f195c03d040 con 0x56521a4e9ec0 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f196c928800 20 remove_watcher() i=4 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.372+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94910628729360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f74d0 con 0x56521a4ee730 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.373+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94910628729360] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.373+0000 7f196c928800 20 remove_watcher() i=5 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.373+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94910628743120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4f74d0 con 0x56521a4ee730 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.375+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94910628743120] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.375+0000 7f196c928800 20 remove_watcher() i=6 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.375+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94910628746896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56521a4fc7d0 con 0x56521a4ee730 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f1968e61640 1 -- 172.21.15.161:0/655596645 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94910628746896] v27'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f196002a070 con 0x56521a4ee730 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 20 remove_watcher() i=7 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4ee730 msgr2=0x56521a4f0b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4ee730 0x56521a4f0b20 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a4e9ec0 msgr2=0x56521a4ec380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a4e9ec0 0x56521a4ec380 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1958078060 msgr2=0x7f195808d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f1958078060 0x7f195808d3f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56521a4f3300 msgr2=0x56521a4f57c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56521a4f3300 0x56521a4f57c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1838036900 msgr2=0x7f1838038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1838036900 0x7f1838038dc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f195808c290 tx=0x7f1958090000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 msgr2=0x56521a4de310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f196003e040 tx=0x7f196004c910 comp rx=0 tx=0).stop 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f1967e5f640 1 -- 172.21.15.161:0/655596645 reap_dead start 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 shutdown_connections 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 --2- 172.21.15.161:0/655596645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4d6d00 0x56521a4de310 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.377+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 >> 172.21.15.161:0/655596645 conn(0x56521a4d3020 msgr2=0x56521a4d0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 shutdown_connections 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/655596645 wait complete. 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 msgr2=0x7f1840038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 0x7f1840038e10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x56521a4b5f60 tx=0x7f195805ee80 comp rx=0 tx=0).stop 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 msgr2=0x56521a4c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x56521a4b5e70 tx=0x7f1960018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 shutdown_connections 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1840036950 0x7f1840038e10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/1829554834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a4c9a40 0x56521a4c9e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 >> 172.21.15.161:0/1829554834 conn(0x56521a4bdae0 msgr2=0x56521a4bdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 shutdown_connections 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/1829554834 wait complete. 2024-05-08T09:21:48.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 msgr2=0x56521a4ba1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 0x56521a4ba1e0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 msgr2=0x56521a4b5550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 0x56521a4b5550 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 msgr2=0x7f1850038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 0x7f1850038e10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f195c001e40 tx=0x7f195c0013a0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 msgr2=0x56521a4ae310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1958052540 tx=0x7f1958003020 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 shutdown_connections 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56521a4b7df0 0x56521a4ba1e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56521a3b6500 0x56521a4b5550 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1850036950 0x7f1850038e10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 --2- 172.21.15.161:0/559713341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56521a3b3bd0 0x56521a4ae310 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 >> 172.21.15.161:0/559713341 conn(0x56521a3ad5a0 msgr2=0x56521a3b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 shutdown_connections 2024-05-08T09:21:48.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.379+0000 7f196c928800 1 -- 172.21.15.161:0/559713341 wait complete. 2024-05-08T09:21:48.390 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.390 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T09:21:48.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T09:21:48.390 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T09:21:48.434 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.434 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.434+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f7326a10800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561971edc540 0x561971ee5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f7326a10800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561971e4f900 con 0x561971edaa00 2024-05-08T09:21:48.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f7326a10800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x561971d6d050 con 0x561971edc540 2024-05-08T09:21:48.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73199b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561971edc540 0x561971ee5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73199b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561971edc540 0x561971ee5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51962/0 (socket says 172.21.15.161:51962) 2024-05-08T09:21:48.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73221b9640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x561971edaa00 0x561971edae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42742/0 (socket says 172.21.15.161:42742) 2024-05-08T09:21:48.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73199b8640 1 -- 172.21.15.161:0/3322595888 learned_addr learned my addr 172.21.15.161:0/3322595888 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73199b8640 1 -- 172.21.15.161:0/3322595888 >> v1:172.21.15.45:6789/0 conn(0x561971edaa00 legacy=0x561971edae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73219b8640 1 -- 172.21.15.161:0/3322595888 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2133063666 0 0) 0x561971e4f900 con 0x561971edaa00 2024-05-08T09:21:48.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.435+0000 7f73199b8640 1 -- 172.21.15.161:0/3322595888 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561971e4fad0 con 0x561971edc540 2024-05-08T09:21:48.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.437+0000 7f73199b8640 1 --2- 172.21.15.161:0/3322595888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edc540 0x561971ee5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a520 tx=0x7f730c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2223fafd47d6aa73 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f73219b8640 1 -- 172.21.15.161:0/3322595888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c057070 con 0x561971edc540 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f73219b8640 1 -- 172.21.15.161:0/3322595888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730c052570 con 0x561971edc540 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f73219b8640 1 -- 172.21.15.161:0/3322595888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f730c04ae60 con 0x561971edc540 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 -- 172.21.15.161:0/3322595888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edc540 msgr2=0x561971ee5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 --2- 172.21.15.161:0/3322595888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edc540 0x561971ee5040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f730c00a520 tx=0x7f730c01d010 comp rx=0 tx=0).stop 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 -- 172.21.15.161:0/3322595888 shutdown_connections 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 --2- 172.21.15.161:0/3322595888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edc540 0x561971ee5040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 -- 172.21.15.161:0/3322595888 >> 172.21.15.161:0/3322595888 conn(0x561971ed65a0 msgr2=0x561971ed89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 -- 172.21.15.161:0/3322595888 shutdown_connections 2024-05-08T09:21:48.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.438+0000 7f7326a10800 1 -- 172.21.15.161:0/3322595888 wait complete. 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.452+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.452+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.452+0000 7f7326a10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.452+0000 7f7326a10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561971e271d0 con 0x561971edaa00 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f73221b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f73221b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51970/0 (socket says 172.21.15.161:51970) 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f73221b9640 1 -- 172.21.15.161:0/2977373077 learned_addr learned my addr 172.21.15.161:0/2977373077 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f73221b9640 1 -- 172.21.15.161:0/2977373077 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561971fcfcd0 con 0x561971edaa00 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f73221b9640 1 --2- 172.21.15.161:0/2977373077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f731400b210 tx=0x7f731400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6374d44f8aeddc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f7210608640 1 -- 172.21.15.161:0/2977373077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7314008070 con 0x561971edaa00 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f7210608640 1 -- 172.21.15.161:0/2977373077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731400d500 con 0x561971edaa00 2024-05-08T09:21:48.454 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.453+0000 7f7210608640 1 -- 172.21.15.161:0/2977373077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731400d840 con 0x561971edaa00 2024-05-08T09:21:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 -- 172.21.15.161:0/2977373077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 msgr2=0x561971fcf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 --2- 172.21.15.161:0/2977373077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f731400b210 tx=0x7f731400b6d0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 -- 172.21.15.161:0/2977373077 shutdown_connections 2024-05-08T09:21:48.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 --2- 172.21.15.161:0/2977373077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fcf700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 -- 172.21.15.161:0/2977373077 >> 172.21.15.161:0/2977373077 conn(0x561971ed65a0 msgr2=0x561971fcb020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 -- 172.21.15.161:0/2977373077 shutdown_connections 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 -- 172.21.15.161:0/2977373077 wait complete. 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.454+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f7326a10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f7326a10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561971ee5850 con 0x561971edaa00 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f73221b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f73221b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51974/0 (socket says 172.21.15.161:51974) 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f73221b9640 1 -- 172.21.15.161:0/3500810297 learned_addr learned my addr 172.21.15.161:0/3500810297 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f73221b9640 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561971fd77c0 con 0x561971edaa00 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f73221b9640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f731400b210 tx=0x7f7314000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f720ee05640 1 -- 172.21.15.161:0/3500810297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731400f950 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f720ee05640 1 -- 172.21.15.161:0/3500810297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731400faf0 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f720ee05640 1 -- 172.21.15.161:0/3500810297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731400fdd0 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.455+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561971fd7a50 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.456+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561971fda700 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.456+0000 7f720ee05640 1 -- 172.21.15.161:0/3500810297 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7314017040 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.456+0000 7f720ee05640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f720ee05640 1 -- 172.21.15.161:0/3500810297 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7314015020 con 0x561971edaa00 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f73199b8640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 0x561971fde4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561971fdea00 con 0x561971edc540 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f73229ba640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 0x561971fde4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f73199b8640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 0x7f7208038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f730c054000 tx=0x7f730c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f73229ba640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 0x561971fde4c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f73229ba640 1 -- 172.21.15.161:0/3500810297 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f731c00a4a0 con 0x561971edc540 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.457+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561971fdba90 con 0x561971edc540 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.458+0000 7f73229ba640 1 -- 172.21.15.161:0/3500810297 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f731c00a4a0 con 0x561971edc540 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.458+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 0x561971fe3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.458+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561971fe37f0 con 0x561971fe0d10 2024-05-08T09:21:48.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.458+0000 7f73221b9640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 0x561971fe3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.458+0000 7f73221b9640 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 0x561971fe3100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.459+0000 7f73221b9640 1 -- 172.21.15.161:0/3500810297 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f731402d070 con 0x561971fe0d10 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.459+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561971fdfcc0 con 0x561971edc540 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.459+0000 7f73229ba640 1 -- 172.21.15.161:0/3500810297 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f731c00a4a0 con 0x561971edc540 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.459+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561971fe01a0 con 0x561971edc540 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.459+0000 7f73229ba640 1 -- 172.21.15.161:0/3500810297 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f731c00a4a0 con 0x561971edc540 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f7326a10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f7326a10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561971dcdcf0 con 0x561971ff2960 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51986/0 (socket says 172.21.15.161:51986) 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f73229ba640 1 -- 172.21.15.161:0/4074129364 learned_addr learned my addr 172.21.15.161:0/4074129364 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.460+0000 7f73229ba640 1 -- 172.21.15.161:0/4074129364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561971ff32c0 con 0x561971ff2960 2024-05-08T09:21:48.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f73229ba640 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x561971fdedc0 tx=0x7f731c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f7207fff640 1 -- 172.21.15.161:0/4074129364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c014450 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f7207fff640 1 -- 172.21.15.161:0/4074129364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c014610 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561971ff3d30 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f7207fff640 1 -- 172.21.15.161:0/4074129364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c014930 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.461+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561971ff4230 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7207fff640 1 -- 172.21.15.161:0/4074129364 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f731c011040 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7207fff640 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 0x7f71fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7207fff640 1 -- 172.21.15.161:0/4074129364 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f731c01e070 con 0x561971ff2960 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73221b9640 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 0x7f71fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73221b9640 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 0x7f71fc038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561971fdee60 tx=0x7f731401b440 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7326a10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7326a10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561971fd0050 con 0x561971fffcc0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:51990/0 (socket says 172.21.15.161:51990) 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73229ba640 1 -- 172.21.15.161:0/1465017515 learned_addr learned my addr 172.21.15.161:0/1465017515 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73229ba640 1 -- 172.21.15.161:0/1465017515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619720006b0 con 0x561971fffcc0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f73229ba640 1 --2- 172.21.15.161:0/1465017515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f731c04c8a0 tx=0x7f731c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bacf62961f8bf50 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7205ffb640 1 -- 172.21.15.161:0/1465017515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c013ca0 con 0x561971fffcc0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7205ffb640 1 -- 172.21.15.161:0/1465017515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c014ad0 con 0x561971fffcc0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7205ffb640 1 -- 172.21.15.161:0/1465017515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c013e60 con 0x561971fffcc0 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.463+0000 7f7326a10800 1 -- 172.21.15.161:0/1465017515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 msgr2=0x5619720000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 --2- 172.21.15.161:0/1465017515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f731c04c8a0 tx=0x7f731c011700 comp rx=0 tx=0).stop 2024-05-08T09:21:48.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- 172.21.15.161:0/1465017515 shutdown_connections 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 --2- 172.21.15.161:0/1465017515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x5619720000e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- 172.21.15.161:0/1465017515 >> 172.21.15.161:0/1465017515 conn(0x561971ffbf40 msgr2=0x561971ff9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- 172.21.15.161:0/1465017515 shutdown_connections 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- 172.21.15.161:0/1465017515 wait complete. 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 Processor -- start 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- start start 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x561972007210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f7326a10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561972000de0 con 0x561971fffcc0 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x561972007210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f73229ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x561972007210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52004/0 (socket says 172.21.15.161:52004) 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 learned_addr learned my addr 172.21.15.161:0/65257226 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.464+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561972007750 con 0x561971fffcc0 2024-05-08T09:21:48.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f73229ba640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x561972007210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f731c0117d0 tx=0x7f731c04c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f71f3fff640 1 -- 172.21.15.161:0/65257226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c014c80 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f71f3fff640 1 -- 172.21.15.161:0/65257226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f731c04b3e0 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5619720079e0 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f71f3fff640 1 -- 172.21.15.161:0/65257226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f731c022be0 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56197200a690 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.465+0000 7f71f3fff640 1 -- 172.21.15.161:0/65257226 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f731c04c9e0 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f71f3fff640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71ec036950 0x7f71ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f71f3fff640 1 -- 172.21.15.161:0/65257226 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f731c046040 con 0x561971fffcc0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f73221b9640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71ec036950 0x7f71ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f73221b9640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71ec036950 0x7f71ec038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f731400b6f0 tx=0x7f7314031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561972012ec0 0x561972015380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.466+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972015ad0 con 0x561972012ec0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f73199b8640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561972012ec0 0x561972015380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f73199b8640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561972012ec0 0x561972015380 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 realm 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972015ea0 con 0x561972012ec0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972016770 con 0x561972012ec0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.467+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972016b10 con 0x561972012ec0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f7326a10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561972017870 0x561972019c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197201a270 con 0x561972017870 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.468+0000 7f73229ba640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561972017870 0x561972019c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f73229ba640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561972017870 0x561972019c60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f7326a10800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f7326a10800 20 searching for the correct realm 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56197201c220 0x56197201e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f73221b9640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56197201c220 0x56197201e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.469+0000 7f73221b9640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56197201c220 0x56197201e6e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73221b9640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7314040900 0x7f731403f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73199b8640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7314040900 0x7f731403f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73199b8640 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7314040900 0x7f731403f190 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.471+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.472+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.473+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.474+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.475+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.476+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.476+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.478+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.479+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.479+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.479+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.479+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x56197201c220 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972017870 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.480+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x561972012ec0 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56197201edb0 con 0x7f7314040900 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197201ac30 con 0x561972012ec0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197201a840 con 0x561972012ec0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197201b5a0 con 0x561972012ec0 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 zone default found 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 4 Realm: () 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 zonegroup default 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197201f230 con 0x561972017870 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.481+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5619720214e0 con 0x56197201c220 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972021880 con 0x56197201c220 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 20 started sync module instance, tier type = 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.482+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972020970 con 0x7f7314040900 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.483+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.483+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94667286908528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972020970 con 0x7f7314040900 2024-05-08T09:21:48.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.483+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720222d0 con 0x561972012ec0 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.486+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.486+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94667286912480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972022790 con 0x561972012ec0 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.486+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720232a0 con 0x56197201c220 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.486+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94667286908528] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.488+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94667286912480] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.488+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.488+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94667286916432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972022240 con 0x56197201c220 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.488+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023b40 con 0x7f7314040900 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.489+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94667286916432] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.489+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.489+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94667286918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023ab0 con 0x7f7314040900 2024-05-08T09:21:48.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.489+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720248f0 con 0x561972012ec0 2024-05-08T09:21:48.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.491+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.491+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94667286922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720248b0 con 0x561972012ec0 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.491+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972025850 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.495+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94667286918800] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.495+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.495+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94667286926176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972025c40 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.495+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972026600 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.497+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94667286922208] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.497+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.497+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94667286924512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972026600 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.497+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972027040 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v27'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94667286932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720274b0 con 0x561972017870 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=0 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=1 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=2 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=3 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=4 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(55 notify.5 [watch watch cookie 94667286926176] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.500+0000 7f7326a10800 20 add_watcher() i=5 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94667286932240] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94667286924512] v27'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f7326a10800 20 add_watcher() i=6 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f7326a10800 20 add_watcher() i=7 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f7326a10800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561972027000 con 0x561972012ec0 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.502+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94667286921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972027000 con 0x561972012ec0 2024-05-08T09:21:48.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.503+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94667286921008] v27'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f71d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 5 note: GC not initialized 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f71537fe640 20 reqs_thread_entry: start 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 20 Filter name: none 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f71517fa640 20 reqs_thread_entry: start 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.504+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197205d410 con 0x561972012ec0 2024-05-08T09:21:48.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197205fd40 con 0x7f7314040900 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.505+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972063360 con 0x561972012ec0 2024-05-08T09:21:48.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7326a10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7326a10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7326a10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94667287178768 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56197205ed30 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94667286922208 notify 115964116993 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561971e4fad0 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7205ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94667286922208 notifier 4307 bl.length()=567 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7205ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7205ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(65 notify.4 [notify cookie 94667287178768 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.506+0000 7f7205ffb640 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f71e8003ea0 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94667287178768 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f730c05d940 con 0x561972012ec0 2024-05-08T09:21:48.509 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f71d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94667286921008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972062230 con 0x561972012ec0 2024-05-08T09:21:48.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94667286921008] v27'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.508+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94667286908528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023f30 con 0x7f7314040900 2024-05-08T09:21:48.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.511+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94667286908528] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.511+0000 7f7326a10800 20 remove_watcher() i=0 2024-05-08T09:21:48.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.511+0000 7f7326a10800 2 removed watcher, disabling cache 2024-05-08T09:21:48.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.511+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94667286912480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023f30 con 0x561972012ec0 2024-05-08T09:21:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.513+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94667286912480] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.513+0000 7f7326a10800 20 remove_watcher() i=1 2024-05-08T09:21:48.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.513+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94667286916432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972021de0 con 0x56197201c220 2024-05-08T09:21:48.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f73221b9640 1 -- 172.21.15.161:0/65257226 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94667286916432] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731402d070 con 0x56197201c220 2024-05-08T09:21:48.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f7326a10800 20 remove_watcher() i=2 2024-05-08T09:21:48.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94667286918800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023f30 con 0x7f7314040900 2024-05-08T09:21:48.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94667286918800] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x7f7314040900 2024-05-08T09:21:48.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f7326a10800 20 remove_watcher() i=3 2024-05-08T09:21:48.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.514+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94667286922208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972022d50 con 0x561972012ec0 2024-05-08T09:21:48.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94667286922208] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f730c05a040 con 0x561972012ec0 2024-05-08T09:21:48.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f7326a10800 20 remove_watcher() i=4 2024-05-08T09:21:48.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94667286926176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023690 con 0x561972017870 2024-05-08T09:21:48.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94667286926176] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f7326a10800 20 remove_watcher() i=5 2024-05-08T09:21:48.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.517+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94667286924512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561972023f30 con 0x561972017870 2024-05-08T09:21:48.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.519+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94667286924512] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.519+0000 7f7326a10800 20 remove_watcher() i=6 2024-05-08T09:21:48.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.519+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94667286932240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5619720243e0 con 0x561972017870 2024-05-08T09:21:48.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.519+0000 7f73229ba640 1 -- 172.21.15.161:0/65257226 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94667286932240] v27'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f731c03c020 con 0x561972017870 2024-05-08T09:21:48.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 20 remove_watcher() i=7 2024-05-08T09:21:48.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561972017870 msgr2=0x561972019c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561972017870 0x561972019c60 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561972012ec0 msgr2=0x561972015380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561972012ec0 0x561972015380 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7314040900 msgr2=0x7f731403f190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7314040900 0x7f731403f190 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56197201c220 msgr2=0x56197201e6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56197201c220 0x56197201e6e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71ec036950 msgr2=0x7f71ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71ec036950 0x7f71ec038e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f731400b6f0 tx=0x7f7314031000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 msgr2=0x561972007210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/65257226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971fffcc0 0x561972007210 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f731c0117d0 tx=0x7f731c04c830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 reap_dead start 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f73199b8640 1 -- 172.21.15.161:0/65257226 reap_dead start 2024-05-08T09:21:48.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 shutdown_connections 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 >> 172.21.15.161:0/65257226 conn(0x561971ffbf40 msgr2=0x561971ff95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 shutdown_connections 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/65257226 wait complete. 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 msgr2=0x7f71fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 0x7f71fc038e10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x561971fdee60 tx=0x7f731401b440 comp rx=0 tx=0).stop 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 msgr2=0x561971ff2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x561971fdedc0 tx=0x7f731c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 shutdown_connections 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f71fc036950 0x7f71fc038e10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 --2- 172.21.15.161:0/4074129364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971ff2960 0x561971ff2d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 >> 172.21.15.161:0/4074129364 conn(0x561971fe6a00 msgr2=0x561971fe6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 shutdown_connections 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.520+0000 7f7326a10800 1 -- 172.21.15.161:0/4074129364 wait complete. 2024-05-08T09:21:48.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 msgr2=0x561971fe3100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 0x561971fe3100 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 msgr2=0x561971fde4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 0x561971fde4c0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 msgr2=0x7f7208038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 0x7f7208038dc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f730c054000 tx=0x7f730c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 msgr2=0x561971fd7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f731400b210 tx=0x7f7314000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 shutdown_connections 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561971fe0d10 0x561971fe3100 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561971edc540 0x561971fde4c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7208036900 0x7f7208038dc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 --2- 172.21.15.161:0/3500810297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561971edaa00 0x561971fd7280 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 >> 172.21.15.161:0/3500810297 conn(0x561971ed65a0 msgr2=0x561971fc9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 shutdown_connections 2024-05-08T09:21:48.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.521+0000 7f7326a10800 1 -- 172.21.15.161:0/3500810297 wait complete. 2024-05-08T09:21:48.529 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.529 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.529 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:48.573 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.573 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.573+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.573+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f892ca91800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f37d0be610 0x55f37d152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f892ca91800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f37d0beb80 con 0x55f37d0bf9f0 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f892ca91800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55f37cfdb050 con 0x55f37d0be610 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f8923fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f37d0be610 0x55f37d152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f8923fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f37d0be610 0x55f37d152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52016/0 (socket says 172.21.15.161:52016) 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f8923fff640 1 -- 172.21.15.161:0/1562082583 learned_addr learned my addr 172.21.15.161:0/1562082583 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f8923fff640 1 -- 172.21.15.161:0/1562082583 >> v1:172.21.15.45:6789/0 conn(0x55f37d0bf9f0 legacy=0x55f37d0bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.574+0000 7f8923fff640 1 -- 172.21.15.161:0/1562082583 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d1544f0 con 0x55f37d0be610 2024-05-08T09:21:48.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.576+0000 7f8923fff640 1 --2- 172.21.15.161:0/1562082583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d152fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f891400a520 tx=0x7f891401d0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35486c557696eda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.576+0000 7f8929d8f640 1 -- 172.21.15.161:0/1562082583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8914057070 con 0x55f37d0be610 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.576+0000 7f8929d8f640 1 -- 172.21.15.161:0/1562082583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891404ae50 con 0x55f37d0be610 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.576+0000 7f8929d8f640 1 -- 172.21.15.161:0/1562082583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89140526c0 con 0x55f37d0be610 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 -- 172.21.15.161:0/1562082583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 msgr2=0x55f37d152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 --2- 172.21.15.161:0/1562082583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d152fa0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f891400a520 tx=0x7f891401d0a0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 -- 172.21.15.161:0/1562082583 shutdown_connections 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 --2- 172.21.15.161:0/1562082583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d152fa0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 -- 172.21.15.161:0/1562082583 >> 172.21.15.161:0/1562082583 conn(0x55f37d145780 msgr2=0x55f37d147ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 -- 172.21.15.161:0/1562082583 shutdown_connections 2024-05-08T09:21:48.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.578+0000 7f892ca91800 1 -- 172.21.15.161:0/1562082583 wait complete. 2024-05-08T09:21:48.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892ca91800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892ca91800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f37d0951d0 con 0x55f37d0be610 2024-05-08T09:21:48.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892a590640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892a590640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52022/0 (socket says 172.21.15.161:52022) 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.591+0000 7f892a590640 1 -- 172.21.15.161:0/1813528950 learned_addr learned my addr 172.21.15.161:0/1813528950 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.593+0000 7f892a590640 1 -- 172.21.15.161:0/1813528950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d23de50 con 0x55f37d0be610 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.593+0000 7f892a590640 1 --2- 172.21.15.161:0/1813528950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f891c001d50 tx=0x7f891c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc0f510ad320d41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.593+0000 7f8818608640 1 -- 172.21.15.161:0/1813528950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c00f400 con 0x55f37d0be610 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.593+0000 7f8818608640 1 -- 172.21.15.161:0/1813528950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c00f5c0 con 0x55f37d0be610 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.593+0000 7f8818608640 1 -- 172.21.15.161:0/1813528950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c00f7f0 con 0x55f37d0be610 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- 172.21.15.161:0/1813528950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 msgr2=0x55f37d23d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 --2- 172.21.15.161:0/1813528950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f891c001d50 tx=0x7f891c00b5b0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- 172.21.15.161:0/1813528950 shutdown_connections 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 --2- 172.21.15.161:0/1813528950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d23d880 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- 172.21.15.161:0/1813528950 >> 172.21.15.161:0/1813528950 conn(0x55f37d145780 msgr2=0x55f37d2391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- 172.21.15.161:0/1813528950 shutdown_connections 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- 172.21.15.161:0/1813528950 wait complete. 2024-05-08T09:21:48.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892ca91800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f37d153750 con 0x55f37d0be610 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892a590640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892a590640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52036/0 (socket says 172.21.15.161:52036) 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.594+0000 7f892a590640 1 -- 172.21.15.161:0/2760661206 learned_addr learned my addr 172.21.15.161:0/2760661206 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f892a590640 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d245930 con 0x55f37d0be610 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f892a590640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55f37d23e610 tx=0x7f891c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f8816e05640 1 -- 172.21.15.161:0/2760661206 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c01a690 con 0x55f37d0be610 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f8816e05640 1 -- 172.21.15.161:0/2760661206 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891c01a830 con 0x55f37d0be610 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37d245bc0 con 0x55f37d0be610 2024-05-08T09:21:48.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f8816e05640 1 -- 172.21.15.161:0/2760661206 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f891c01ab30 con 0x55f37d0be610 2024-05-08T09:21:48.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.595+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d248870 con 0x55f37d0be610 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f8816e05640 1 -- 172.21.15.161:0/2760661206 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f891c017070 con 0x55f37d0be610 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f8816e05640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 0x7f8810038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f8816e05640 1 -- 172.21.15.161:0/2760661206 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f891c015020 con 0x55f37d0be610 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f8923fff640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 0x7f8810038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 0x55f37d24c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d24cbb0 con 0x55f37d0bf9f0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f892ad91640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 0x55f37d24c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.596+0000 7f8923fff640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 0x7f8810038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8914054000 tx=0x7f891404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ad91640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 0x55f37d24c630 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ad91640 1 -- 172.21.15.161:0/2760661206 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f892400a4a0 con 0x55f37d0bf9f0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d249c00 con 0x55f37d0bf9f0 2024-05-08T09:21:48.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ad91640 1 -- 172.21.15.161:0/2760661206 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f892400a4a0 con 0x55f37d0bf9f0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 0x55f37d2512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2519c0 con 0x55f37d24eee0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.597+0000 7f892a590640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 0x55f37d2512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.598+0000 7f892a590640 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 0x55f37d2512d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.598+0000 7f892a590640 1 -- 172.21.15.161:0/2760661206 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d24eee0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.598+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d24de90 con 0x55f37d0bf9f0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.598+0000 7f892ad91640 1 -- 172.21.15.161:0/2760661206 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f892400a4a0 con 0x55f37d0bf9f0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.598+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d24e370 con 0x55f37d0bf9f0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ad91640 1 -- 172.21.15.161:0/2760661206 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f892400a4a0 con 0x55f37d0bf9f0 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ca91800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ca91800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f37d03bcf0 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52040/0 (socket says 172.21.15.161:52040) 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.599+0000 7f892ad91640 1 -- 172.21.15.161:0/1592835323 learned_addr learned my addr 172.21.15.161:0/1592835323 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ad91640 1 -- 172.21.15.161:0/1592835323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d261490 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ad91640 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f37d24cf90 tx=0x7f8924018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 -- 172.21.15.161:0/1592835323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8924014450 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 -- 172.21.15.161:0/1592835323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924014610 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37d261f00 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 -- 172.21.15.161:0/1592835323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8924014930 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d262400 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 -- 172.21.15.161:0/1592835323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8924011040 con 0x55f37d260b30 2024-05-08T09:21:48.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 0x7f8804038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f880ffff640 1 -- 172.21.15.161:0/1592835323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f892401e070 con 0x55f37d260b30 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892a590640 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 0x7f8804038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892a590640 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 0x7f8804038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55f37d24d030 tx=0x7f891c01c9f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.600+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ca91800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ca91800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f37d23e1d0 con 0x55f37d26ddb0 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52050/0 (socket says 172.21.15.161:52050) 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ad91640 1 -- 172.21.15.161:0/3995544316 learned_addr learned my addr 172.21.15.161:0/3995544316 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ad91640 1 -- 172.21.15.161:0/3995544316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d26e7a0 con 0x55f37d26ddb0 2024-05-08T09:21:48.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f892ad91640 1 --2- 172.21.15.161:0/3995544316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f892404c8d0 tx=0x7f8924011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cb2cfa8cc2f1dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f880dffb640 1 -- 172.21.15.161:0/3995544316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89240167e0 con 0x55f37d26ddb0 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f880dffb640 1 -- 172.21.15.161:0/3995544316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924014ad0 con 0x55f37d26ddb0 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.602+0000 7f880dffb640 1 -- 172.21.15.161:0/3995544316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8924016980 con 0x55f37d26ddb0 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- 172.21.15.161:0/3995544316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 msgr2=0x55f37d26e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 --2- 172.21.15.161:0/3995544316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f892404c8d0 tx=0x7f8924011ef0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- 172.21.15.161:0/3995544316 shutdown_connections 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 --2- 172.21.15.161:0/3995544316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d26e1d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- 172.21.15.161:0/3995544316 >> 172.21.15.161:0/3995544316 conn(0x55f37d26a110 msgr2=0x55f37d268170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- 172.21.15.161:0/3995544316 shutdown_connections 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- 172.21.15.161:0/3995544316 wait complete. 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 Processor -- start 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- start start 2024-05-08T09:21:48.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ca91800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f37d26eeb0 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ad91640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52060/0 (socket says 172.21.15.161:52060) 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.603+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 learned_addr learned my addr 172.21.15.161:0/458041868 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f37d275870 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f892ad91640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8924040040 tx=0x7f892404c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f87fbfff640 1 -- 172.21.15.161:0/458041868 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8924014c80 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f87fbfff640 1 -- 172.21.15.161:0/458041868 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892403bb20 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f37d275b00 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f87fbfff640 1 -- 172.21.15.161:0/458041868 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892403be00 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.604+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f37d2787b0 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f87fbfff640 1 -- 172.21.15.161:0/458041868 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f892404ca10 con 0x55f37d26ddb0 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f87fbfff640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f4036900 0x7f87f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f87fbfff640 1 -- 172.21.15.161:0/458041868 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f892400e040 con 0x55f37d26ddb0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f892a590640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f4036900 0x7f87f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d280e10 0x55f37d2832d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d283a20 con 0x55f37d280e10 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f892a590640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f4036900 0x7f87f4038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f891c01afd0 tx=0x7f891c039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.605+0000 7f8923fff640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d280e10 0x55f37d2832d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f8923fff640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d280e10 0x55f37d2832d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 realm 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d283df0 con 0x55f37d280e10 2024-05-08T09:21:48.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2846c0 con 0x55f37d280e10 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.606+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d284a60 con 0x55f37d280e10 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ca91800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d285510 0x55f37d287920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d288080 con 0x55f37d285510 2024-05-08T09:21:48.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ad91640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d285510 0x55f37d287920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.607+0000 7f892ad91640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d285510 0x55f37d287920 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892ca91800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892ca91800 20 searching for the correct realm 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f37d28a130 0x55f37d28c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892a590640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f37d28a130 0x55f37d28c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.608+0000 7f892a590640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f37d28a130 0x55f37d28c5f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f892a590640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f891c059040 0x7f891c00e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f8923fff640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f891c059040 0x7f891c00e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f8923fff640 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f891c059040 0x7f891c00e590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.609+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.610+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.611+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.612+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.613+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.615+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.616+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d28a130 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d285510 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x55f37d280e10 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ccc0 con 0x7f891c059040 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.617+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d288b30 con 0x55f37d280e10 2024-05-08T09:21:48.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d288fb0 con 0x55f37d280e10 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d289490 con 0x55f37d280e10 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 zone default found 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 4 Realm: () 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 zonegroup default 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.618+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28d140 con 0x55f37d285510 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28f370 con 0x55f37d28a130 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28f710 con 0x55f37d28a130 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 started sync module instance, tier type = 2024-05-08T09:21:48.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.619+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28e7b0 con 0x7f891c059040 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.620+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.620+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504265247648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28e7b0 con 0x7f891c059040 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.620+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ffe0 con 0x55f37d280e10 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.622+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.622+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504265251504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28ffa0 con 0x55f37d280e10 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.622+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d290fc0 con 0x55f37d28a130 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.622+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504265247648] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.624+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504265251504] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.626+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.626+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504265253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28e300 con 0x55f37d28a130 2024-05-08T09:21:48.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.626+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d291860 con 0x7f891c059040 2024-05-08T09:21:48.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.627+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.627+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504265258384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d292020 con 0x7f891c059040 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.627+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d292b40 con 0x55f37d280e10 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.627+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504265253840] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.628+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.628+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504265262608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d292b00 con 0x55f37d280e10 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.628+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d293570 con 0x55f37d285510 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.629+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504265258384] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.629+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504265262608] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.629+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.629+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504265255632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d291a70 con 0x55f37d285510 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.629+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d293e40 con 0x55f37d285510 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504265255632] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504265265312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d293e40 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d294840 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504265265312] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504265270096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d294a40 con 0x55f37d285510 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=0 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=1 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=2 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=3 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=4 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=5 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.631+0000 7f892ca91800 20 add_watcher() i=6 2024-05-08T09:21:48.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.632+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504265270096] v27'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.632+0000 7f892ca91800 20 add_watcher() i=7 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.632+0000 7f892ca91800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.632+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d297e80 con 0x55f37d280e10 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.634+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.634+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504265271712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d295270 con 0x55f37d280e10 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504265271712] v27'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f87e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 5 note: GC not initialized 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f875b7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:48.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 20 Filter name: none 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f87597fa640 20 reqs_thread_entry: start 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.635+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2caca0 con 0x55f37d280e10 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.636+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.636+0000 7f892ca91800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.642 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.637+0000 7f87e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.637+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504265271712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2c9c10 con 0x55f37d280e10 2024-05-08T09:21:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.638+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94504265271712] v27'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.638+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504265247648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2c9c10 con 0x7f891c059040 2024-05-08T09:21:48.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.639+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94504265247648] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.639+0000 7f892ca91800 20 remove_watcher() i=0 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.639+0000 7f892ca91800 2 removed watcher, disabling cache 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.639+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504265251504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28eba0 con 0x55f37d280e10 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.640+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94504265251504] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.640+0000 7f892ca91800 20 remove_watcher() i=1 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.640+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504265253840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d28eba0 con 0x55f37d28a130 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f892a590640 1 -- 172.21.15.161:0/458041868 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94504265253840] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891c02e070 con 0x55f37d28a130 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f892ca91800 20 remove_watcher() i=2 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504265258384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2903d0 con 0x7f891c059040 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94504265258384] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x7f891c059040 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f892ca91800 20 remove_watcher() i=3 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.641+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504265262608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d291590 con 0x55f37d280e10 2024-05-08T09:21:48.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94504265262608] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f891405a040 con 0x55f37d280e10 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f892ca91800 20 remove_watcher() i=4 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504265255632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2903d0 con 0x55f37d285510 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94504265255632] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f892ca91800 20 remove_watcher() i=5 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.643+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504265265312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d291590 con 0x55f37d285510 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.644+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94504265265312] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.644+0000 7f892ca91800 20 remove_watcher() i=6 2024-05-08T09:21:48.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.644+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504265270096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f37d2903d0 con 0x55f37d285510 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ad91640 1 -- 172.21.15.161:0/458041868 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94504265270096] v27'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892402a070 con 0x55f37d285510 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 20 remove_watcher() i=7 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d285510 msgr2=0x55f37d287920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d285510 0x55f37d287920 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d280e10 msgr2=0x55f37d2832d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d280e10 0x55f37d2832d0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f891c059040 msgr2=0x7f891c00e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f891c059040 0x7f891c00e590 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f37d28a130 msgr2=0x55f37d28c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f37d28a130 0x55f37d28c5f0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f4036900 msgr2=0x7f87f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f4036900 0x7f87f4038dc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f891c01afd0 tx=0x7f891c039000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 msgr2=0x55f37d275330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f8923fff640 1 -- 172.21.15.161:0/458041868 reap_dead start 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8924040040 tx=0x7f892404c860 comp rx=0 tx=0).stop 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 shutdown_connections 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/458041868 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d26ddb0 0x55f37d275330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 >> 172.21.15.161:0/458041868 conn(0x55f37d26a110 msgr2=0x55f37d267770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 shutdown_connections 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/458041868 wait complete. 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 msgr2=0x7f8804038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 0x7f8804038e10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55f37d24d030 tx=0x7f891c01c9f0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 msgr2=0x55f37d260f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x55f37d24cf90 tx=0x7f8924018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 shutdown_connections 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8804036950 0x7f8804038e10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/1592835323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d260b30 0x55f37d260f50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 >> 172.21.15.161:0/1592835323 conn(0x55f37d254bd0 msgr2=0x55f37d254fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 shutdown_connections 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/1592835323 wait complete. 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 msgr2=0x55f37d2512d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 0x55f37d2512d0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 msgr2=0x55f37d24c630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 0x55f37d24c630 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 msgr2=0x7f8810038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.646+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 0x7f8810038e10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8914054000 tx=0x7f891404e000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 msgr2=0x55f37d2453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x55f37d23e610 tx=0x7f891c000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 shutdown_connections 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f37d24eee0 0x55f37d2512d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f37d0bf9f0 0x55f37d24c630 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8810036950 0x7f8810038e10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 --2- 172.21.15.161:0/2760661206 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f37d0be610 0x55f37d2453f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 >> 172.21.15.161:0/2760661206 conn(0x55f37d145780 msgr2=0x55f37d2379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 shutdown_connections 2024-05-08T09:21:48.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.647+0000 7f892ca91800 1 -- 172.21.15.161:0/2760661206 wait complete. 2024-05-08T09:21:48.656 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.656 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T09:21:48.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T09:21:48.656 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T09:21:48.700 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.700 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.700+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.700+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a4f46800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e4e02fe3e0 0x55e4e0300880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a4f46800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e4e0300f00 con 0x55e4e026d8c0 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a4f46800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e4e018b050 con 0x55e4e02fe3e0 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a224b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e4e02fe3e0 0x55e4e0300880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a2a4c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e4e026d8c0 0x55e4e02fcc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42770/0 (socket says 172.21.15.161:42770) 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a2a4c640 1 -- 172.21.15.161:0/2105146370 learned_addr learned my addr 172.21.15.161:0/2105146370 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a224b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e4e02fe3e0 0x55e4e0300880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52074/0 (socket says 172.21.15.161:52074) 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a224b640 1 -- 172.21.15.161:0/2105146370 >> v1:172.21.15.45:6789/0 conn(0x55e4e026d8c0 legacy=0x55e4e02fcc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.702+0000 7f92a224b640 1 -- 172.21.15.161:0/2105146370 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e0302130 con 0x55e4e02fe3e0 2024-05-08T09:21:48.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.703+0000 7f92a224b640 1 --2- 172.21.15.161:0/2105146370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fe3e0 0x55e4e0300880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f929800a470 tx=0x7f929801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4251b47efb27060 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.703+0000 7f92a1a4a640 1 -- 172.21.15.161:0/2105146370 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9298057070 con 0x55e4e02fe3e0 2024-05-08T09:21:48.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.703+0000 7f92a1a4a640 1 -- 172.21.15.161:0/2105146370 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9298052570 con 0x55e4e02fe3e0 2024-05-08T09:21:48.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.703+0000 7f92a1a4a640 1 -- 172.21.15.161:0/2105146370 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9298052870 con 0x55e4e02fe3e0 2024-05-08T09:21:48.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 -- 172.21.15.161:0/2105146370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fe3e0 msgr2=0x55e4e0300880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 --2- 172.21.15.161:0/2105146370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fe3e0 0x55e4e0300880 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f929800a470 tx=0x7f929801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:48.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 -- 172.21.15.161:0/2105146370 shutdown_connections 2024-05-08T09:21:48.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 --2- 172.21.15.161:0/2105146370 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fe3e0 0x55e4e0300880 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 -- 172.21.15.161:0/2105146370 >> 172.21.15.161:0/2105146370 conn(0x55e4e02f45a0 msgr2=0x55e4e02f69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 -- 172.21.15.161:0/2105146370 shutdown_connections 2024-05-08T09:21:48.705 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.704+0000 7f92a4f46800 1 -- 172.21.15.161:0/2105146370 wait complete. 2024-05-08T09:21:48.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.718+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.718+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.718+0000 7f92a4f46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.718+0000 7f92a4f46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e4e02451d0 con 0x55e4e026d8c0 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.719+0000 7f92a2a4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.719+0000 7f92a2a4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52078/0 (socket says 172.21.15.161:52078) 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.719+0000 7f92a2a4c640 1 -- 172.21.15.161:0/1369928565 learned_addr learned my addr 172.21.15.161:0/1369928565 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.719+0000 7f92a2a4c640 1 -- 172.21.15.161:0/1369928565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e03ebca0 con 0x55e4e026d8c0 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/1369928565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9294001de0 tx=0x7f929400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1665a355fbf6917c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f9190e09640 1 -- 172.21.15.161:0/1369928565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294012020 con 0x55e4e026d8c0 2024-05-08T09:21:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f9190e09640 1 -- 172.21.15.161:0/1369928565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929400e5a0 con 0x55e4e026d8c0 2024-05-08T09:21:48.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f9190e09640 1 -- 172.21.15.161:0/1369928565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929400e8c0 con 0x55e4e026d8c0 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f92a4f46800 1 -- 172.21.15.161:0/1369928565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 msgr2=0x55e4e03eb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.720+0000 7f92a4f46800 1 --2- 172.21.15.161:0/1369928565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9294001de0 tx=0x7f929400b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/1369928565 shutdown_connections 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 --2- 172.21.15.161:0/1369928565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03eb6d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/1369928565 >> 172.21.15.161:0/1369928565 conn(0x55e4e02f45a0 msgr2=0x55e4e03e6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/1369928565 shutdown_connections 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/1369928565 wait complete. 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e4e03013d0 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a2a4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a2a4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52080/0 (socket says 172.21.15.161:52080) 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a2a4c640 1 -- 172.21.15.161:0/4215462964 learned_addr learned my addr 172.21.15.161:0/4215462964 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a2a4c640 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e03f3780 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f929400c010 tx=0x7f9294000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f918f606640 1 -- 172.21.15.161:0/4215462964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9294012070 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f918f606640 1 -- 172.21.15.161:0/4215462964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929401a7a0 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4e03f3a10 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f918f606640 1 -- 172.21.15.161:0/4215462964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929401aa80 con 0x55e4e026d8c0 2024-05-08T09:21:48.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.721+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4e03f66c0 con 0x55e4e026d8c0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f918f606640 1 -- 172.21.15.161:0/4215462964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9294015020 con 0x55e4e026d8c0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f918f606640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 0x7f9188038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f918f606640 1 -- 172.21.15.161:0/4215462964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f9294020070 con 0x55e4e026d8c0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f92a224b640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 0x7f9188038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 0x55e4e03fa480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.723+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e03faa00 con 0x55e4e02fe3e0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a324d640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 0x55e4e03fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a224b640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 0x7f9188038e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9298054000 tx=0x7f929804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a324d640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 0x55e4e03fa480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a324d640 1 -- 172.21.15.161:0/4215462964 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f929c00a4a0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e03f7a50 con 0x55e4e02fe3e0 2024-05-08T09:21:48.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a324d640 1 -- 172.21.15.161:0/4215462964 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f929c00a4a0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 0x55e4e03ff100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.724+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e03ff7a0 con 0x55e4e03fcd10 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.725+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 0x55e4e03ff100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.725+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 0x55e4e03ff100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.725+0000 7f92a2a4c640 1 -- 172.21.15.161:0/4215462964 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f929402b070 con 0x55e4e03fcd10 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.725+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e03fbcc0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a324d640 1 -- 172.21.15.161:0/4215462964 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f929c00a4a0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e03fc1a0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a324d640 1 -- 172.21.15.161:0/4215462964 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f929c00a4a0 con 0x55e4e02fe3e0 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a4f46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.726+0000 7f92a4f46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e4e01ebcf0 con 0x55e4e040e940 2024-05-08T09:21:48.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52090/0 (socket says 172.21.15.161:52090) 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a324d640 1 -- 172.21.15.161:0/3919614004 learned_addr learned my addr 172.21.15.161:0/3919614004 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a324d640 1 -- 172.21.15.161:0/3919614004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e040f2a0 con 0x55e4e040e940 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a324d640 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e4e03fadc0 tx=0x7f929c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f918ce01640 1 -- 172.21.15.161:0/3919614004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c014450 con 0x55e4e040e940 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f918ce01640 1 -- 172.21.15.161:0/3919614004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c014610 con 0x55e4e040e940 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4e040fd10 con 0x55e4e040e940 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f918ce01640 1 -- 172.21.15.161:0/3919614004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c014930 con 0x55e4e040e940 2024-05-08T09:21:48.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.727+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4e0410210 con 0x55e4e040e940 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.728+0000 7f918ce01640 1 -- 172.21.15.161:0/3919614004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f929c011040 con 0x55e4e040e940 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.728+0000 7f918ce01640 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 0x7f917c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.728+0000 7f918ce01640 1 -- 172.21.15.161:0/3919614004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f929c01e070 con 0x55e4e040e940 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.728+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 0x7f917c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 0x7f917c038e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e4e03fae30 tx=0x7f92940013c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a4f46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a4f46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e4e03ec020 con 0x55e4e02fa350 2024-05-08T09:21:48.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52106/0 (socket says 172.21.15.161:52106) 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a324d640 1 -- 172.21.15.161:0/2278320624 learned_addr learned my addr 172.21.15.161:0/2278320624 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a324d640 1 -- 172.21.15.161:0/2278320624 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e02fa800 con 0x55e4e02fa350 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.729+0000 7f92a324d640 1 --2- 172.21.15.161:0/2278320624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f929c011dc0 tx=0x7f929c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbfa1dfd53d3886 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f91867fc640 1 -- 172.21.15.161:0/2278320624 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c014ad0 con 0x55e4e02fa350 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f91867fc640 1 -- 172.21.15.161:0/2278320624 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c014c90 con 0x55e4e02fa350 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f91867fc640 1 -- 172.21.15.161:0/2278320624 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c04e240 con 0x55e4e02fa350 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- 172.21.15.161:0/2278320624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 msgr2=0x55e4e02f8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 --2- 172.21.15.161:0/2278320624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f929c011dc0 tx=0x7f929c011700 comp rx=0 tx=0).stop 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- 172.21.15.161:0/2278320624 shutdown_connections 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 --2- 172.21.15.161:0/2278320624 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e02f8a40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- 172.21.15.161:0/2278320624 >> 172.21.15.161:0/2278320624 conn(0x55e4e0417f20 msgr2=0x55e4e0415f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- 172.21.15.161:0/2278320624 shutdown_connections 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- 172.21.15.161:0/2278320624 wait complete. 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 Processor -- start 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.730+0000 7f92a4f46800 1 -- start start 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a4f46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a4f46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e4e02f9100 con 0x55e4e02fa350 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a324d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52120/0 (socket says 172.21.15.161:52120) 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 learned_addr learned my addr 172.21.15.161:0/3416745495 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e4e04259b0 con 0x55e4e02fa350 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a324d640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f929c016ad0 tx=0x7f929c04c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f9184ff9640 1 -- 172.21.15.161:0/3416745495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c014ad0 con 0x55e4e02fa350 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f9184ff9640 1 -- 172.21.15.161:0/3416745495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c031070 con 0x55e4e02fa350 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e4e0425c40 con 0x55e4e02fa350 2024-05-08T09:21:48.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f9184ff9640 1 -- 172.21.15.161:0/3416745495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f929c04c9e0 con 0x55e4e02fa350 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.731+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4e04288f0 con 0x55e4e02fa350 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.732+0000 7f9184ff9640 1 -- 172.21.15.161:0/3416745495 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f929c04cb80 con 0x55e4e02fa350 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.732+0000 7f9184ff9640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f916c036900 0x7f916c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.732+0000 7f9184ff9640 1 -- 172.21.15.161:0/3416745495 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f929c00e040 con 0x55e4e02fa350 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.732+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f916c036900 0x7f916c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f916c036900 0x7f916c038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9294027ff0 tx=0x7f929404c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e04310f0 0x55e4e04335b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0433d00 con 0x55e4e04310f0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a224b640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e04310f0 0x55e4e04335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.733+0000 7f92a224b640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e04310f0 0x55e4e04335b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 realm 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04340d0 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04349a0 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0434d40 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e0435aa0 0x55e4e0437e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.734+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0438450 con 0x55e4e0435aa0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a324d640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e0435aa0 0x55e4e0437e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a324d640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e0435aa0 0x55e4e0437e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a4f46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a4f46800 20 searching for the correct realm 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e4e043a420 0x55e4e043c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.735+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.736+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e4e043a420 0x55e4e043c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.736+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e4e043a420 0x55e4e043c8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.736+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.736+0000 7f92a2a4c640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9294017050 0x7f929404c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.736+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.737+0000 7f92a224b640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9294017050 0x7f929404c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.737+0000 7f92a224b640 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9294017050 0x7f929404c730 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.737+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.737+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.738+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.739+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.740+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.741+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.742+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.743+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e043a420 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.744+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e0435aa0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x55e4e04310f0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043cfb0 con 0x7f9294017050 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.745+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0438e10 con 0x55e4e04310f0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0438a50 con 0x55e4e04310f0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04397b0 con 0x55e4e04310f0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 zone default found 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 4 Realm: () 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 zonegroup default 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043d450 con 0x55e4e0435aa0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.746+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043f720 con 0x55e4e043a420 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043fac0 con 0x55e4e043a420 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 started sync module instance, tier type = 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.747+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043eb60 con 0x7f9294017050 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.748+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.748+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94441503453312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043eb60 con 0x7f9294017050 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.748+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04404c0 con 0x55e4e04310f0 2024-05-08T09:21:48.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.749+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94441503453312] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.749+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.749+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94441503457232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043eb60 con 0x55e4e04310f0 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.749+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0440f40 con 0x55e4e043a420 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.750+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94441503457232] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.751+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.751+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94441503450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043ead0 con 0x55e4e043a420 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.751+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0441e00 con 0x7f9294017050 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.752+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.752+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94441503464272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04426a0 con 0x7f9294017050 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.752+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443120 con 0x55e4e04310f0 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.753+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94441503450800] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.753+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.753+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94441503468592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443120 con 0x55e4e04310f0 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.753+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443b40 con 0x55e4e0435aa0 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.753+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94441503464272] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.754+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94441503468592] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.754+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.754+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94441503462192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443b00 con 0x55e4e0435aa0 2024-05-08T09:21:48.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.754+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04443e0 con 0x55e4e0435aa0 2024-05-08T09:21:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.755+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94441503462192] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.755+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.755+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94441503471152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443b00 con 0x55e4e0435aa0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.755+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e04449f0 con 0x55e4e0435aa0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94441503474944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0444e50 con 0x55e4e0435aa0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=1 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=2 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=3 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=4 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=5 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94441503471152] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=6 2024-05-08T09:21:48.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94441503474944] v27'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 20 add_watcher() i=7 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.756+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443ee0 con 0x55e4e04310f0 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.758+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.758+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94441503476000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0443ee0 con 0x55e4e04310f0 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94441503476000] v27'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f91597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 5 note: GC not initialized 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f90d3fff640 20 reqs_thread_entry: start 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 20 Filter name: none 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f90d1ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.759+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e047b2e0 con 0x55e4e04310f0 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e047dc10 con 0x7f9294017050 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.760+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0481210 con 0x55e4e04310f0 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v27'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a4f46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a4f46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a4f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94441503722720 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e4e047cc00 con 0x55e4e04310f0 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94441503468592 notify 115964116994 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55e4e0302130 con 0x55e4e04310f0 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f91867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94441503468592 notifier 4321 bl.length()=567 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f91867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f91867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(65 notify.4 [notify cookie 94441503722720 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.761+0000 7f91867fc640 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f9168003ea0 con 0x55e4e04310f0 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.762+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.762+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94441503722720 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f929805db30 con 0x55e4e04310f0 2024-05-08T09:21:48.772 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.763+0000 7f91597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.763+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94441503476000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e042e710 con 0x55e4e04310f0 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.764+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94441503476000] v27'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.764+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94441503453312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0444920 con 0x7f9294017050 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.765+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94441503453312] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.765+0000 7f92a4f46800 20 remove_watcher() i=0 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.765+0000 7f92a4f46800 2 removed watcher, disabling cache 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.765+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94441503457232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043f080 con 0x55e4e04310f0 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.766+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94441503457232] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.766+0000 7f92a4f46800 20 remove_watcher() i=1 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.766+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94441503450800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043f080 con 0x55e4e043a420 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.767+0000 7f92a2a4c640 1 -- 172.21.15.161:0/3416745495 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94441503450800] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929402b070 con 0x55e4e043a420 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.767+0000 7f92a4f46800 20 remove_watcher() i=2 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.767+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94441503464272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043e6b0 con 0x7f9294017050 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.768+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94441503464272] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x7f9294017050 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.768+0000 7f92a4f46800 20 remove_watcher() i=3 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.768+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94441503468592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043f080 con 0x55e4e04310f0 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.769+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94441503468592] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929805a040 con 0x55e4e04310f0 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.769+0000 7f92a4f46800 20 remove_watcher() i=4 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.769+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94441503462192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043e6b0 con 0x55e4e0435aa0 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.770+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94441503462192] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.770+0000 7f92a4f46800 20 remove_watcher() i=5 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.770+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94441503471152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e0442c30 con 0x55e4e0435aa0 2024-05-08T09:21:48.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.771+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94441503471152] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.771+0000 7f92a4f46800 20 remove_watcher() i=6 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.771+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94441503474944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e4e043f080 con 0x55e4e0435aa0 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a324d640 1 -- 172.21.15.161:0/3416745495 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94441503474944] v27'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f929c02a070 con 0x55e4e0435aa0 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 20 remove_watcher() i=7 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e0435aa0 msgr2=0x55e4e0437e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e0435aa0 0x55e4e0437e90 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e04310f0 msgr2=0x55e4e04335b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e04310f0 0x55e4e04335b0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9294017050 msgr2=0x7f929404c730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9294017050 0x7f929404c730 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e4e043a420 msgr2=0x55e4e043c8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e4e043a420 0x55e4e043c8e0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f916c036900 msgr2=0x7f916c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f916c036900 0x7f916c038dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9294027ff0 tx=0x7f929404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 msgr2=0x55e4e0425470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f929c016ad0 tx=0x7f929c04c830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a224b640 1 -- 172.21.15.161:0/3416745495 reap_dead start 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 shutdown_connections 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3416745495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e02fa350 0x55e4e0425470 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 >> 172.21.15.161:0/3416745495 conn(0x55e4e0417f20 msgr2=0x55e4e0415580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 shutdown_connections 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.772+0000 7f92a4f46800 1 -- 172.21.15.161:0/3416745495 wait complete. 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 msgr2=0x7f917c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 0x7f917c038e60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x55e4e03fae30 tx=0x7f92940013c0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 msgr2=0x55e4e040ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55e4e03fadc0 tx=0x7f929c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 shutdown_connections 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f917c0369a0 0x7f917c038e60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/3919614004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e040e940 0x55e4e040ed60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 >> 172.21.15.161:0/3919614004 conn(0x55e4e04029e0 msgr2=0x55e4e0402de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 shutdown_connections 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/3919614004 wait complete. 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 msgr2=0x55e4e03ff100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 0x55e4e03ff100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 msgr2=0x55e4e03fa480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 0x55e4e03fa480 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 msgr2=0x7f9188038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 0x7f9188038e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9298054000 tx=0x7f929804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 msgr2=0x55e4e03f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f929400c010 tx=0x7f9294000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 shutdown_connections 2024-05-08T09:21:48.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e4e03fcd10 0x55e4e03ff100 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e4e02fe3e0 0x55e4e03fa480 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91880369a0 0x7f9188038e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 --2- 172.21.15.161:0/4215462964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4e026d8c0 0x55e4e03f3240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 >> 172.21.15.161:0/4215462964 conn(0x55e4e02f45a0 msgr2=0x55e4e03e57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 shutdown_connections 2024-05-08T09:21:48.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.773+0000 7f92a4f46800 1 -- 172.21.15.161:0/4215462964 wait complete. 2024-05-08T09:21:48.783 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.783 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:48.783 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:48.828 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.828 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.829+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.829+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.829+0000 7f50cac16800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5632452dda00 0x5632452dde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.829+0000 7f50cac16800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563245252a40 con 0x5632452de360 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50cac16800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x563245170050 con 0x5632452dda00 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50c635c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5632452dda00 0x5632452dde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50bffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5632452de360 0x5632452de810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42778/0 (socket says 172.21.15.161:42778) 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50bffff640 1 -- 172.21.15.161:0/3608864059 learned_addr learned my addr 172.21.15.161:0/3608864059 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50c635c640 1 -- 172.21.15.161:0/3608864059 >> v1:172.21.15.45:6789/0 conn(0x5632452de360 legacy=0x5632452de810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.830+0000 7f50c635c640 1 -- 172.21.15.161:0/3608864059 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632452def20 con 0x5632452dda00 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.832+0000 7f50c635c640 1 --2- 172.21.15.161:0/3608864059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632452dde20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50b800a470 tx=0x7f50b801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0807a60a3c679d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.832+0000 7f50c5b5b640 1 -- 172.21.15.161:0/3608864059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8057070 con 0x5632452dda00 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.832+0000 7f50c5b5b640 1 -- 172.21.15.161:0/3608864059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b8052570 con 0x5632452dda00 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.832+0000 7f50c5b5b640 1 -- 172.21.15.161:0/3608864059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8052870 con 0x5632452dda00 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 -- 172.21.15.161:0/3608864059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 msgr2=0x5632452dde20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 --2- 172.21.15.161:0/3608864059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632452dde20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f50b800a470 tx=0x7f50b801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:48.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 -- 172.21.15.161:0/3608864059 shutdown_connections 2024-05-08T09:21:48.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 --2- 172.21.15.161:0/3608864059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632452dde20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 -- 172.21.15.161:0/3608864059 >> 172.21.15.161:0/3608864059 conn(0x5632452d9560 msgr2=0x5632452db980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 -- 172.21.15.161:0/3608864059 shutdown_connections 2024-05-08T09:21:48.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.833+0000 7f50cac16800 1 -- 172.21.15.161:0/3608864059 wait complete. 2024-05-08T09:21:48.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.847+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.847+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.847+0000 7f50cac16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.847+0000 7f50cac16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324522a1d0 con 0x5632452dda00 2024-05-08T09:21:48.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.849+0000 7f50c635c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.849+0000 7f50c635c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52138/0 (socket says 172.21.15.161:52138) 2024-05-08T09:21:48.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.849+0000 7f50c635c640 1 -- 172.21.15.161:0/2081094730 learned_addr learned my addr 172.21.15.161:0/2081094730 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.850+0000 7f50c635c640 1 -- 172.21.15.161:0/2081094730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632453d30f0 con 0x5632452dda00 2024-05-08T09:21:48.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.851+0000 7f50c635c640 1 --2- 172.21.15.161:0/2081094730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50b8055040 tx=0x7f50b804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44269c337518cde4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.851+0000 7f4fb4608640 1 -- 172.21.15.161:0/2081094730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8057040 con 0x5632452dda00 2024-05-08T09:21:48.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.851+0000 7f4fb4608640 1 -- 172.21.15.161:0/2081094730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b8052990 con 0x5632452dda00 2024-05-08T09:21:48.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.851+0000 7f4fb4608640 1 -- 172.21.15.161:0/2081094730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8052c70 con 0x5632452dda00 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 -- 172.21.15.161:0/2081094730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 msgr2=0x5632453d2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 --2- 172.21.15.161:0/2081094730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f50b8055040 tx=0x7f50b804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 -- 172.21.15.161:0/2081094730 shutdown_connections 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 --2- 172.21.15.161:0/2081094730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453d2b20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 -- 172.21.15.161:0/2081094730 >> 172.21.15.161:0/2081094730 conn(0x5632452d9560 msgr2=0x5632453ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.855 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 -- 172.21.15.161:0/2081094730 shutdown_connections 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 -- 172.21.15.161:0/2081094730 wait complete. 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.852+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50cac16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50cac16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5632452df450 con 0x5632452dda00 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50c635c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50c635c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52148/0 (socket says 172.21.15.161:52148) 2024-05-08T09:21:48.856 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50c635c640 1 -- 172.21.15.161:0/3057979056 learned_addr learned my addr 172.21.15.161:0/3057979056 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50c635c640 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632453daae0 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50c635c640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50b800a470 tx=0x7f50b8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f4fb2e05640 1 -- 172.21.15.161:0/3057979056 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8073070 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f4fb2e05640 1 -- 172.21.15.161:0/3057979056 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b805d780 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632453dad70 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.853+0000 7f4fb2e05640 1 -- 172.21.15.161:0/3057979056 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50b8057070 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.854+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632453dd9d0 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.854+0000 7f4fb2e05640 1 -- 172.21.15.161:0/3057979056 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f50b8076070 con 0x5632452dda00 2024-05-08T09:21:48.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.854+0000 7f4fb2e05640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 0x7f4fac038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.854+0000 7f4fb2e05640 1 -- 172.21.15.161:0/3057979056 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f50b808e060 con 0x5632452dda00 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50bffff640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 0x7f4fac038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 0x5632453e1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632453e1cd0 con 0x5632452de360 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 0x5632453e1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50bffff640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 0x7f4fac038e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50b0000f60 tx=0x7f50b00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 0x5632453e1790 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50c6b5d640 1 -- 172.21.15.161:0/3057979056 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50c000a4a0 con 0x5632452de360 2024-05-08T09:21:48.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.855+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632453ded60 con 0x5632452de360 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50c6b5d640 1 -- 172.21.15.161:0/3057979056 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50c000a4a0 con 0x5632452de360 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 0x5632453e6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632453e6b00 con 0x5632453e4020 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50c635c640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 0x5632453e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50c635c640 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 0x5632453e6410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50c635c640 1 -- 172.21.15.161:0/3057979056 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f50b8075030 con 0x5632453e4020 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.856+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632453e2fa0 con 0x5632452de360 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.857+0000 7f50c6b5d640 1 -- 172.21.15.161:0/3057979056 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50c000a4a0 con 0x5632452de360 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.857+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632453e3480 con 0x5632452de360 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.857+0000 7f50c6b5d640 1 -- 172.21.15.161:0/3057979056 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f50c000a4a0 con 0x5632452de360 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.857+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.857+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50cac16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50cac16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5632451d0cf0 con 0x5632453f5c70 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52160/0 (socket says 172.21.15.161:52160) 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1208786359 learned_addr learned my addr 172.21.15.161:0/1208786359 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1208786359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632453f65d0 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5632453e20d0 tx=0x7f50c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f4fabfff640 1 -- 172.21.15.161:0/1208786359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c0014450 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f4fabfff640 1 -- 172.21.15.161:0/1208786359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c0014610 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.858+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5632453f7040 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.859+0000 7f4fabfff640 1 -- 172.21.15.161:0/1208786359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c0014930 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.859+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632453f7540 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.859+0000 7f4fabfff640 1 -- 172.21.15.161:0/1208786359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f50c0011040 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f4fabfff640 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 0x7f4fa0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f4fabfff640 1 -- 172.21.15.161:0/1208786359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f50c001e070 con 0x5632453f5c70 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50c635c640 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 0x7f4fa0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50c635c640 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 0x7f4fa0038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b806d000 tx=0x7f50b804ac40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50cac16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.860+0000 7f50cac16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5632453d33b0 con 0x563245402f60 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52174/0 (socket says 172.21.15.161:52174) 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f50c6b5d640 1 -- 172.21.15.161:0/2786180572 learned_addr learned my addr 172.21.15.161:0/2786180572 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f50c6b5d640 1 -- 172.21.15.161:0/2786180572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563245403950 con 0x563245402f60 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/2786180572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50c004c850 tx=0x7f50c0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542de2034fec7c75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f4fa9ffb640 1 -- 172.21.15.161:0/2786180572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c004e0d0 con 0x563245402f60 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f4fa9ffb640 1 -- 172.21.15.161:0/2786180572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c00167e0 con 0x563245402f60 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.861+0000 7f4fa9ffb640 1 -- 172.21.15.161:0/2786180572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c002bc50 con 0x563245402f60 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- 172.21.15.161:0/2786180572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 msgr2=0x563245403380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 --2- 172.21.15.161:0/2786180572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f50c004c850 tx=0x7f50c0011ef0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- 172.21.15.161:0/2786180572 shutdown_connections 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 --2- 172.21.15.161:0/2786180572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x563245403380 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- 172.21.15.161:0/2786180572 >> 172.21.15.161:0/2786180572 conn(0x5632453ff1e0 msgr2=0x5632453fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- 172.21.15.161:0/2786180572 shutdown_connections 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- 172.21.15.161:0/2786180572 wait complete. 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 Processor -- start 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- start start 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50cac16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563245404020 con 0x563245402f60 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50c6b5d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52182/0 (socket says 172.21.15.161:52182) 2024-05-08T09:21:48.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.862+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 learned_addr learned my addr 172.21.15.161:0/1455125755 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324540a950 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f50c004b740 tx=0x7f50c004c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f4f97fff640 1 -- 172.21.15.161:0/1455125755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c0011510 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f4f97fff640 1 -- 172.21.15.161:0/1455125755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c00116b0 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56324540abe0 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f4f97fff640 1 -- 172.21.15.161:0/1455125755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c003ba70 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.863+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324540abe0 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f4f97fff640 1 -- 172.21.15.161:0/1455125755 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f50c003bc50 con 0x563245402f60 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f4f97fff640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f900368e0 0x7f4f90038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f4f97fff640 1 -- 172.21.15.161:0/1455125755 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f50c000e040 con 0x563245402f60 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f50c635c640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f900368e0 0x7f4f90038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f50c635c640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f900368e0 0x7f4f90038da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50b805cfd0 tx=0x7f50b808d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.864+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563245415ea0 0x563245418360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563245418ab0 con 0x563245415ea0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50bffff640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563245415ea0 0x563245418360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50bffff640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563245415ea0 0x563245418360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50b0009050 con 0x563245415ea0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 20 realm 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632454152f0 con 0x563245415ea0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50b0009050 con 0x563245415ea0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.865+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563245419590 con 0x563245415ea0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50b0009050 con 0x563245415ea0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563245419e60 con 0x563245415ea0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f50b0009050 con 0x563245415ea0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324541a710 0x56324541cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324541d240 con 0x56324541a710 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.866+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324541a710 0x56324541cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50c6b5d640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324541a710 0x56324541cb00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50cac16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50cac16800 20 searching for the correct realm 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324541f2f0 0x5632454217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50c635c640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324541f2f0 0x5632454217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.867+0000 7f50c635c640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324541f2f0 0x5632454217b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50c635c640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f50b8078060 0x7f50b805ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50bffff640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f50b8078060 0x7f50b805ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50bffff640 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f50b8078060 0x7f50b805ba80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0009050 con 0x7f50b8078060 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.868+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0009050 con 0x563245415ea0 2024-05-08T09:21:48.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.869+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.870+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.871+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.872+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.873+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.874+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.875+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541f2f0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x56324541a710 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.876+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x563245415ea0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x563245421e80 con 0x7f50b8078060 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324541dcf0 con 0x563245415ea0 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324541e170 con 0x563245415ea0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.877+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324541e650 con 0x563245415ea0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 zone default found 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 4 Realm: () 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:48.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 zonegroup default 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563245422300 con 0x56324541a710 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.878+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563245424530 con 0x56324541f2f0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632454248d0 con 0x56324541f2f0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 20 started sync module instance, tier type = 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.879+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245423970 con 0x7f50b8078060 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.880+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.880+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773910322576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245423970 con 0x7f50b8078060 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.880+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245425290 con 0x563245415ea0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.881+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773910322576] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.881+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.881+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773910320800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245425290 con 0x563245415ea0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.881+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245425c50 con 0x56324541f2f0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.882+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773910320800] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.883+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.883+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773910326752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245425200 con 0x56324541f2f0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.883+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245426a10 con 0x7f50b8078060 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.884+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.884+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773910326752] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.884+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773910332704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245426e30 con 0x7f50b8078060 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.884+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245427830 con 0x563245415ea0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.885+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.885+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773910336320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245427760 con 0x563245415ea0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.885+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245428780 con 0x56324541a710 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.887+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773910332704] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.890+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773910336320] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.890+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.890+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773910338640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245426070 con 0x56324541a710 2024-05-08T09:21:48.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.890+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245429020 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.891+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.891+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773910342432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245429450 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.891+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245429f70 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.891+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773910338640] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773910342432] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773910346304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245429f30 con 0x56324541a710 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=0 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=1 2024-05-08T09:21:48.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=2 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=3 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=4 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=5 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.892+0000 7f50cac16800 20 add_watcher() i=6 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.893+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773910346304] v27'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.893+0000 7f50cac16800 20 add_watcher() i=7 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.893+0000 7f50cac16800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.893+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324542cf60 con 0x563245415ea0 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.894+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.894+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773910340208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324542a3e0 con 0x563245415ea0 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773910340208] v27'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f4f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50cac16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50cac16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50cac16800 5 note: GC not initialized 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f4ef77fe640 20 reqs_thread_entry: start 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50cac16800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f50cac16800 20 Filter name: none 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.895+0000 7f4ef57fa640 20 reqs_thread_entry: start 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.896+0000 7f50cac16800 20 rados->read ofs=0 len=0 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.896+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324545feb0 con 0x563245415ea0 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.896+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.896+0000 7f50cac16800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:48.905 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:48.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.897+0000 7f4f7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:48.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.897+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773910340208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324545e990 con 0x563245415ea0 2024-05-08T09:21:48.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.898+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94773910340208] v27'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.898+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773910322576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245428270 con 0x7f50b8078060 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.899+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94773910322576] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.899+0000 7f50cac16800 20 remove_watcher() i=0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.899+0000 7f50cac16800 2 removed watcher, disabling cache 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.899+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773910320800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245428270 con 0x563245415ea0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.900+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94773910320800] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.900+0000 7f50cac16800 20 remove_watcher() i=1 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.900+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773910326752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632454236a0 con 0x56324541f2f0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.901+0000 7f50c635c640 1 -- 172.21.15.161:0/1455125755 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94773910326752] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b8075030 con 0x56324541f2f0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.901+0000 7f50cac16800 20 remove_watcher() i=2 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.901+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773910332704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245428270 con 0x7f50b8078060 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.902+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94773910332704] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x7f50b8078060 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.902+0000 7f50cac16800 20 remove_watcher() i=3 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.902+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773910336320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245424de0 con 0x563245415ea0 2024-05-08T09:21:48.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.903+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94773910336320] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50b0029040 con 0x563245415ea0 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.903+0000 7f50cac16800 20 remove_watcher() i=4 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.903+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773910338640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245428270 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.904+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94773910338640] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.904+0000 7f50cac16800 20 remove_watcher() i=5 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.904+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773910342432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245427340 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.905+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94773910342432] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.905+0000 7f50cac16800 20 remove_watcher() i=6 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.905+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773910346304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563245424de0 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50c6b5d640 1 -- 172.21.15.161:0/1455125755 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94773910346304] v27'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f50c002a070 con 0x56324541a710 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 20 remove_watcher() i=7 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324541a710 msgr2=0x56324541cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324541a710 0x56324541cb00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563245415ea0 msgr2=0x563245418360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563245415ea0 0x563245418360 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f50b8078060 msgr2=0x7f50b805ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f50b8078060 0x7f50b805ba80 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324541f2f0 msgr2=0x5632454217b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.907+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324541f2f0 0x5632454217b0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f900368e0 msgr2=0x7f4f90038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f900368e0 0x7f4f90038da0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50b805cfd0 tx=0x7f50b808d000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 msgr2=0x56324540a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f50c004b740 tx=0x7f50c004c7b0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50bffff640 1 -- 172.21.15.161:0/1455125755 reap_dead start 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 shutdown_connections 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1455125755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563245402f60 0x56324540a410 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 >> 172.21.15.161:0/1455125755 conn(0x5632453ff1e0 msgr2=0x5632453fc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 shutdown_connections 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1455125755 wait complete. 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 msgr2=0x7f4fa0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 0x7f4fa0038e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f50b806d000 tx=0x7f50b804ac40 comp rx=0 tx=0).stop 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 msgr2=0x5632453f6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5632453e20d0 tx=0x7f50c0018830 comp rx=0 tx=0).stop 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 shutdown_connections 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fa0036950 0x7f4fa0038e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/1208786359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632453f5c70 0x5632453f6090 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 >> 172.21.15.161:0/1208786359 conn(0x5632453e9d10 msgr2=0x5632453ea110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 shutdown_connections 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/1208786359 wait complete. 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 msgr2=0x5632453e6410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 0x5632453e6410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 msgr2=0x5632453e1790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.908+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 0x5632453e1790 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 msgr2=0x7f4fac038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 0x7f4fac038e60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f50b0000f60 tx=0x7f50b00012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 msgr2=0x5632453da5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50b800a470 tx=0x7f50b8003020 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 shutdown_connections 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5632453e4020 0x5632453e6410 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5632452de360 0x5632453e1790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fac0369a0 0x7f4fac038e60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 --2- 172.21.15.161:0/3057979056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632452dda00 0x5632453da5a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 >> 172.21.15.161:0/3057979056 conn(0x5632452d9560 msgr2=0x5632453ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 shutdown_connections 2024-05-08T09:21:48.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.909+0000 7f50cac16800 1 -- 172.21.15.161:0/3057979056 wait complete. 2024-05-08T09:21:48.917 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:48.917 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T09:21:48.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-05-08T09:21:48.917 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-05-08T09:21:48.966 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:48.967 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:48.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:48.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:48.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066f71f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e67dabdc10 0x55e67dac0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066f71f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e67dac4050 con 0x55e67dac0540 2024-05-08T09:21:48.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066f71f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e67d94e050 con 0x55e67dabdc10 2024-05-08T09:21:48.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.968+0000 7f066b3e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e67dabdc10 0x55e67dac0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.969+0000 7f066b3e7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e67dabdc10 0x55e67dac0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52196/0 (socket says 172.21.15.161:52196) 2024-05-08T09:21:48.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.969+0000 7f066b3e7640 1 -- 172.21.15.161:0/3639656758 learned_addr learned my addr 172.21.15.161:0/3639656758 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.969+0000 7f066b3e7640 1 -- 172.21.15.161:0/3639656758 >> v1:172.21.15.45:6789/0 conn(0x55e67dac0540 legacy=0x55e67dac2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.969+0000 7f066b3e7640 1 -- 172.21.15.161:0/3639656758 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dac5230 con 0x55e67dabdc10 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066b3e7640 1 --2- 172.21.15.161:0/3639656758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dac0000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f065c005fd0 tx=0x7f065c01cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c3638bf06dc03f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066a3e5640 1 -- 172.21.15.161:0/3639656758 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c052540 con 0x55e67dabdc10 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066a3e5640 1 -- 172.21.15.161:0/3639656758 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c04e070 con 0x55e67dabdc10 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066a3e5640 1 -- 172.21.15.161:0/3639656758 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c052890 con 0x55e67dabdc10 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 -- 172.21.15.161:0/3639656758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 msgr2=0x55e67dac0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 --2- 172.21.15.161:0/3639656758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dac0000 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f065c005fd0 tx=0x7f065c01cd80 comp rx=0 tx=0).stop 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 -- 172.21.15.161:0/3639656758 shutdown_connections 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 --2- 172.21.15.161:0/3639656758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dac0000 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 -- 172.21.15.161:0/3639656758 >> 172.21.15.161:0/3639656758 conn(0x55e67dab75c0 msgr2=0x55e67dab99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 -- 172.21.15.161:0/3639656758 shutdown_connections 2024-05-08T09:21:48.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.971+0000 7f066f71f800 1 -- 172.21.15.161:0/3639656758 wait complete. 2024-05-08T09:21:48.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.985+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:48.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:48.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066f71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066f71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e67da081f0 con 0x55e67dabdc10 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066b3e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066b3e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52202/0 (socket says 172.21.15.161:52202) 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066b3e7640 1 -- 172.21.15.161:0/2235754059 learned_addr learned my addr 172.21.15.161:0/2235754059 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.986+0000 7f066b3e7640 1 -- 172.21.15.161:0/2235754059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dbaecf0 con 0x55e67dabdc10 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066b3e7640 1 --2- 172.21.15.161:0/2235754059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f065c01ba70 tx=0x7f065c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504cf06115407801 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f055960a640 1 -- 172.21.15.161:0/2235754059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c052820 con 0x55e67dabdc10 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f055960a640 1 -- 172.21.15.161:0/2235754059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c062070 con 0x55e67dabdc10 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f055960a640 1 -- 172.21.15.161:0/2235754059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c052b10 con 0x55e67dabdc10 2024-05-08T09:21:48.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- 172.21.15.161:0/2235754059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 msgr2=0x55e67dbae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 --2- 172.21.15.161:0/2235754059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f065c01ba70 tx=0x7f065c04c000 comp rx=0 tx=0).stop 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- 172.21.15.161:0/2235754059 shutdown_connections 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 --2- 172.21.15.161:0/2235754059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dabdc10 0x55e67dbae720 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- 172.21.15.161:0/2235754059 >> 172.21.15.161:0/2235754059 conn(0x55e67dab75c0 msgr2=0x55e67dbaa040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- 172.21.15.161:0/2235754059 shutdown_connections 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- 172.21.15.161:0/2235754059 wait complete. 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066f71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e67dac44c0 con 0x55e67dac0540 2024-05-08T09:21:48.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066b3e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066b3e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52208/0 (socket says 172.21.15.161:52208) 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066b3e7640 1 -- 172.21.15.161:0/3410929211 learned_addr learned my addr 172.21.15.161:0/3410929211 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.987+0000 7f066b3e7640 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dbb68e0 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f066b3e7640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f065c00a190 tx=0x7f065c003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f0557e07640 1 -- 172.21.15.161:0/3410929211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c071570 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f0557e07640 1 -- 172.21.15.161:0/3410929211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f065c058040 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e67dbb6b70 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f0557e07640 1 -- 172.21.15.161:0/3410929211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f065c071880 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.989+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67dbb9820 con 0x55e67dac0540 2024-05-08T09:21:48.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f0557e07640 1 -- 172.21.15.161:0/3410929211 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f065c050070 con 0x55e67dac0540 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f0557e07640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 0x7f0550038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f0557e07640 1 -- 172.21.15.161:0/3410929211 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f065c08e450 con 0x55e67dac0540 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066abe6640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 0x7f0550038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 0x55e67dbbd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbbdf90 con 0x55e67dbbb5d0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066bbe8640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 0x55e67dbbd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066abe6640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 0x7f0550038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660001410 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.990+0000 7f066bbe8640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 0x55e67dbbd9c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066bbe8640 1 -- 172.21.15.161:0/3410929211 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f06640083e0 con 0x55e67dbbb5d0 2024-05-08T09:21:48.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbbabb0 con 0x55e67dbbb5d0 2024-05-08T09:21:48.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066bbe8640 1 -- 172.21.15.161:0/3410929211 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f06640083e0 con 0x55e67dbbb5d0 2024-05-08T09:21:48.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 0x55e67dbc26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:48.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbc2da0 con 0x55e67dbc02c0 2024-05-08T09:21:48.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.991+0000 7f066b3e7640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 0x55e67dbc26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:48.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.992+0000 7f066b3e7640 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 0x55e67dbc26b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.992+0000 7f066b3e7640 1 -- 172.21.15.161:0/3410929211 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbc02c0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.992+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbbf270 con 0x55e67dbbb5d0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.992+0000 7f066bbe8640 1 -- 172.21.15.161:0/3410929211 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f06640083e0 con 0x55e67dbbb5d0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.992+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbbf730 con 0x55e67dbbb5d0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066bbe8640 1 -- 172.21.15.161:0/3410929211 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f06640083e0 con 0x55e67dbbb5d0 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066f71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066f71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e67d9aecf0 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52212/0 (socket says 172.21.15.161:52212) 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.993+0000 7f066bbe8640 1 -- 172.21.15.161:0/323082323 learned_addr learned my addr 172.21.15.161:0/323082323 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f066bbe8640 1 -- 172.21.15.161:0/323082323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dbd28b0 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f066bbe8640 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55e67dbb77a0 tx=0x7f066400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f0555602640 1 -- 172.21.15.161:0/323082323 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0664007d00 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f0555602640 1 -- 172.21.15.161:0/323082323 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066401e020 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e67dbd3320 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f0555602640 1 -- 172.21.15.161:0/323082323 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0664019420 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.994+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67dbd3820 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f0555602640 1 -- 172.21.15.161:0/323082323 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0664016040 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f0555602640 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 0x7f0544038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f0555602640 1 -- 172.21.15.161:0/323082323 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f066401f030 con 0x55e67dbd1f50 2024-05-08T09:21:49.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f066b3e7640 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 0x7f0544038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f066b3e7640 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 0x7f0544038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55e67dbbe410 tx=0x7f065c084370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.995+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066f71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066f71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e67dbaefb0 con 0x55e67dbdf270 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52214/0 (socket says 172.21.15.161:52214) 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066bbe8640 1 -- 172.21.15.161:0/547015960 learned_addr learned my addr 172.21.15.161:0/547015960 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066bbe8640 1 -- 172.21.15.161:0/547015960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dbdfc60 con 0x55e67dbdf270 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f066bbe8640 1 --2- 172.21.15.161:0/547015960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f066404c820 tx=0x7f0664014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c4dcfd1bfdb22a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f054effd640 1 -- 172.21.15.161:0/547015960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066401d070 con 0x55e67dbdf270 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f054effd640 1 -- 172.21.15.161:0/547015960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066404e2e0 con 0x55e67dbdf270 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.996+0000 7f054effd640 1 -- 172.21.15.161:0/547015960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f066404b360 con 0x55e67dbdf270 2024-05-08T09:21:49.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- 172.21.15.161:0/547015960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 msgr2=0x55e67dbdf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 --2- 172.21.15.161:0/547015960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f066404c820 tx=0x7f0664014640 comp rx=0 tx=0).stop 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- 172.21.15.161:0/547015960 shutdown_connections 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 --2- 172.21.15.161:0/547015960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbdf690 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- 172.21.15.161:0/547015960 >> 172.21.15.161:0/547015960 conn(0x55e67dbdb5d0 msgr2=0x55e67dbd9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- 172.21.15.161:0/547015960 shutdown_connections 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- 172.21.15.161:0/547015960 wait complete. 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 Processor -- start 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- start start 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.997+0000 7f066f71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e67dbe03d0 con 0x55e67dbdf270 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066bbe8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52226/0 (socket says 172.21.15.161:52226) 2024-05-08T09:21:49.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 learned_addr learned my addr 172.21.15.161:0/264464548 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e67dbe6e10 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066bbe8640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06640157d0 tx=0x7f066404c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f054d7fa640 1 -- 172.21.15.161:0/264464548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0664031030 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f054d7fa640 1 -- 172.21.15.161:0/264464548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066403bdb0 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e67dbe70a0 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f054d7fa640 1 -- 172.21.15.161:0/264464548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0664014ac0 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.998+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e67dbe9d50 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.999+0000 7f054d7fa640 1 -- 172.21.15.161:0/264464548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0664034070 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.999+0000 7f054d7fa640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0534036950 0x7f0534038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.999+0000 7f054d7fa640 1 -- 172.21.15.161:0/264464548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0664032070 con 0x55e67dbdf270 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:48.999+0000 7f066b3e7640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0534036950 0x7f0534038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066b3e7640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0534036950 0x7f0534038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f065c052570 tx=0x7f065c091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbf2360 0x55e67dbf4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf4f70 con 0x55e67dbf2360 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066abe6640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbf2360 0x55e67dbf4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.000+0000 7f066abe6640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbf2360 0x55e67dbf4820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0660010620 con 0x55e67dbf2360 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 realm 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf17b0 con 0x55e67dbf2360 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0660010620 con 0x55e67dbf2360 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf5a60 con 0x55e67dbf2360 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0660010620 con 0x55e67dbf2360 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf6330 con 0x55e67dbf2360 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0660010620 con 0x55e67dbf2360 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbf6d50 0x55e67dbf9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.001+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf98b0 con 0x55e67dbf6d50 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066bbe8640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbf6d50 0x55e67dbf9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066bbe8640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbf6d50 0x55e67dbf9140 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066f71f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066f71f800 20 searching for the correct realm 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.002+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e67dbfb860 0x55e67dbfdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.003+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.003+0000 7f066b3e7640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e67dbfb860 0x55e67dbfdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.003+0000 7f066b3e7640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e67dbfb860 0x55e67dbfdd20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066b3e7640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x55e67dabdc10 0x7f065c066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066abe6640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x55e67dabdc10 0x7f065c066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066abe6640 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x55e67dabdc10 0x7f065c066ac0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0660010620 con 0x55e67dabdc10 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.004+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0660010620 con 0x55e67dbf2360 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.005+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dabdc10 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.006+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f066002a040 con 0x55e67dabdc10 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.007+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.008+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.009+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dabdc10 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.010+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dabdc10 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbfb860 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.011+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf6d50 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dbf2360 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe3f0 con 0x55e67dabdc10 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f066002a040 con 0x55e67dabdc10 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfa270 con 0x55e67dbf2360 2024-05-08T09:21:49.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f066002a040 con 0x55e67dbf2360 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.012+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbf9eb0 con 0x55e67dbf2360 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfac50 con 0x55e67dbf2360 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 zone default found 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 4 Realm: () 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 zonegroup default 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbfe900 con 0x55e67dbf6d50 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.013+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc00bd0 con 0x55e67dbfb860 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc00f70 con 0x55e67dbfb860 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 20 started sync module instance, tier type = 2024-05-08T09:21:49.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.014+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc00060 con 0x55e67dabdc10 2024-05-08T09:21:49.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.015+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.015+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94448440575376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc00060 con 0x55e67dabdc10 2024-05-08T09:21:49.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.015+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc01980 con 0x55e67dbf2360 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.016+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94448440575376] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.017+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.017+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94448440573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc01980 con 0x55e67dbf2360 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.017+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc02380 con 0x55e67dbfb860 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.018+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.018+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94448440581776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc02c20 con 0x55e67dbfb860 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.018+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc036a0 con 0x55e67dabdc10 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.018+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94448440573328] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.019+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.019+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94448440586640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc03a90 con 0x55e67dabdc10 2024-05-08T09:21:49.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.019+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc04490 con 0x55e67dbf2360 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.019+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94448440581776] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.020+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94448440586640] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.021+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.021+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94448440579280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc03fa0 con 0x55e67dbf2360 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.021+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc04d30 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.022+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94448440579280] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.022+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.022+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94448440584048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc03fa0 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.022+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05350 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.023+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94448440584048] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.023+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.023+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94448440592512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05350 con 0x55e67dbf6d50 2024-05-08T09:21:49.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.023+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05d60 con 0x55e67dbf6d50 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94448440596656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc061c0 con 0x55e67dbf6d50 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=0 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=1 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=2 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=3 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=4 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=5 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94448440592512] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.024+0000 7f066f71f800 20 add_watcher() i=6 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94448440596656] v27'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066f71f800 20 add_watcher() i=7 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066f71f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc04ea0 con 0x55e67dbf2360 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.025+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94448440597712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc04ea0 con 0x55e67dbf2360 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.026+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94448440597712] v27'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f0521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 5 note: GC not initialized 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f0520fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 Filter name: none 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f049a7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc3c770 con 0x55e67dbf2360 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.027+0000 7f066f71f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc3d080 con 0x55e67dbf6d50 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:49.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.028+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc428f0 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v27'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066f71f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066f71f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066f71f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94448440845152 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc3e120 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94448440579280 notify 115964116995 ret 0) ==== 720+0+0 (crc 0 0 0) 0x55e67dac4050 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f054effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94448440579280 notifier 4335 bl.length()=678 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f054effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f054effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f054effd640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f0530003ea0 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.029+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(65 notify.4 [notify cookie 94448440845152 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.030+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.030+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94448440845152 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f066003dc40 con 0x55e67dbf2360 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.030+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc3e120 con 0x55e67dbf6d50 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066f71f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066f71f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066f71f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94448440845152 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc3e120 con 0x55e67dbfb860 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94448440581776 notify 115964116992 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55e67dbb9820 con 0x55e67dbfb860 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f054e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116992 cookie 94448440581776 notifier 4335 bl.length()=177 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 notify.2 [notify cookie 94448440845152 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f054e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f054e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f054e7fc640 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f04a0003400 con 0x55e67dbfb860 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.031+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.032+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94448440845152 notify 115964116992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e67dbb6b70 con 0x55e67dbfb860 2024-05-08T09:21:49.044 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T09:21:49.029132Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.032+0000 7f0521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.032+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94448440597712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc413a0 con 0x55e67dbf2360 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.033+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94448440597712] v27'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.033+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94448440575376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05cd0 con 0x55e67dabdc10 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.034+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94448440575376] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.034+0000 7f066f71f800 20 remove_watcher() i=0 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.034+0000 7f066f71f800 2 removed watcher, disabling cache 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.034+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94448440573328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05cd0 con 0x55e67dbf2360 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.035+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94448440573328] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.035+0000 7f066f71f800 20 remove_watcher() i=1 2024-05-08T09:21:49.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.035+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94448440581776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbffd90 con 0x55e67dbfb860 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.036+0000 7f066b3e7640 1 -- 172.21.15.161:0/264464548 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94448440581776] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f065c077020 con 0x55e67dbfb860 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.036+0000 7f066f71f800 20 remove_watcher() i=2 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.036+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94448440586640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05cd0 con 0x55e67dabdc10 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.037+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94448440586640] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dabdc10 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.037+0000 7f066f71f800 20 remove_watcher() i=3 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.037+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94448440579280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc01e90 con 0x55e67dbf2360 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.039+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94448440579280] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f066003c040 con 0x55e67dbf2360 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.039+0000 7f066f71f800 20 remove_watcher() i=4 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.039+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94448440584048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dbffd90 con 0x55e67dbf6d50 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.040+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94448440584048] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.040+0000 7f066f71f800 20 remove_watcher() i=5 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.040+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94448440592512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc05cd0 con 0x55e67dbf6d50 2024-05-08T09:21:49.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.041+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94448440592512] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.041+0000 7f066f71f800 20 remove_watcher() i=6 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.041+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94448440596656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e67dc01e90 con 0x55e67dbf6d50 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066bbe8640 1 -- 172.21.15.161:0/264464548 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94448440596656] v27'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0664057040 con 0x55e67dbf6d50 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 20 remove_watcher() i=7 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbf6d50 msgr2=0x55e67dbf9140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbf6d50 0x55e67dbf9140 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbf2360 msgr2=0x55e67dbf4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbf2360 0x55e67dbf4820 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x55e67dabdc10 msgr2=0x7f065c066ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x55e67dabdc10 0x7f065c066ac0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e67dbfb860 msgr2=0x55e67dbfdd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e67dbfb860 0x55e67dbfdd20 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0534036950 msgr2=0x7f0534038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0534036950 0x7f0534038e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f065c052570 tx=0x7f065c091000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 msgr2=0x55e67dbe68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066abe6640 1 -- 172.21.15.161:0/264464548 reap_dead start 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f06640157d0 tx=0x7f066404c7b0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 shutdown_connections 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/264464548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbdf270 0x55e67dbe68d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 >> 172.21.15.161:0/264464548 conn(0x55e67dbdb5d0 msgr2=0x55e67dbd8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 shutdown_connections 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/264464548 wait complete. 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 msgr2=0x7f0544038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 0x7f0544038e10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55e67dbbe410 tx=0x7f065c084370 comp rx=0 tx=0).stop 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 msgr2=0x55e67dbd2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55e67dbb77a0 tx=0x7f066400aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 shutdown_connections 2024-05-08T09:21:49.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0544036950 0x7f0544038e10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 --2- 172.21.15.161:0/323082323 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dbd1f50 0x55e67dbd2370 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.042+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 >> 172.21.15.161:0/323082323 conn(0x55e67dbc5ff0 msgr2=0x55e67dbc63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 shutdown_connections 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/323082323 wait complete. 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 msgr2=0x55e67dbc26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 0x55e67dbc26b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 msgr2=0x55e67dbbd9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 0x55e67dbbd9c0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 msgr2=0x7f0550038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 0x7f0550038e10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0660000f60 tx=0x7f0660001410 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 msgr2=0x55e67dbb63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f065c00a190 tx=0x7f065c003330 comp rx=0 tx=0).stop 2024-05-08T09:21:49.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 shutdown_connections 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e67dbc02c0 0x55e67dbc26b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e67dbbb5d0 0x55e67dbbd9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0550036950 0x7f0550038e10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 --2- 172.21.15.161:0/3410929211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e67dac0540 0x55e67dbb63a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 >> 172.21.15.161:0/3410929211 conn(0x55e67dab75c0 msgr2=0x55e67dba8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 shutdown_connections 2024-05-08T09:21:49.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.043+0000 7f066f71f800 1 -- 172.21.15.161:0/3410929211 wait complete. 2024-05-08T09:21:49.055 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T09:21:49.029132Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.055 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.055 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.055 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:49.100 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.100 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6fe146800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558d7a2bf550 0x558d7a2c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6fe146800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558d7a232070 con 0x558d7a2bda10 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6fe146800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x558d7a150050 con 0x558d7a2bf550 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558d7a2bf550 0x558d7a2c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558d7a2bf550 0x558d7a2c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52232/0 (socket says 172.21.15.161:52232) 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6f3fff640 1 -- 172.21.15.161:0/1377253467 learned_addr learned my addr 172.21.15.161:0/1377253467 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6f3fff640 1 -- 172.21.15.161:0/1377253467 >> v1:172.21.15.45:6789/0 conn(0x558d7a2bda10 legacy=0x558d7a2bde30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T09:21:49.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.102+0000 7fb6f3fff640 1 -- 172.21.15.161:0/1377253467 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a232240 con 0x558d7a2bf550 2024-05-08T09:21:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/1377253467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a2c8050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400a520 tx=0x7fb6e401cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31fe57f99adead server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fb44b640 1 -- 172.21.15.161:0/1377253467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e4057070 con 0x558d7a2bf550 2024-05-08T09:21:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fb44b640 1 -- 172.21.15.161:0/1377253467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e4052570 con 0x558d7a2bf550 2024-05-08T09:21:49.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fb44b640 1 -- 172.21.15.161:0/1377253467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6e4052870 con 0x558d7a2bf550 2024-05-08T09:21:49.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 -- 172.21.15.161:0/1377253467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 msgr2=0x558d7a2c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 --2- 172.21.15.161:0/1377253467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a2c8050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb6e400a520 tx=0x7fb6e401cf70 comp rx=0 tx=0).stop 2024-05-08T09:21:49.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 -- 172.21.15.161:0/1377253467 shutdown_connections 2024-05-08T09:21:49.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 --2- 172.21.15.161:0/1377253467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a2c8050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 -- 172.21.15.161:0/1377253467 >> 172.21.15.161:0/1377253467 conn(0x558d7a2b95b0 msgr2=0x558d7a2bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 -- 172.21.15.161:0/1377253467 shutdown_connections 2024-05-08T09:21:49.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.105+0000 7fb6fe146800 1 -- 172.21.15.161:0/1377253467 wait complete. 2024-05-08T09:21:49.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.119+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.119+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fe146800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fe146800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558d7a20a1d0 con 0x558d7a2bda10 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fbc4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fbc4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52240/0 (socket says 172.21.15.161:52240) 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/211069849 learned_addr learned my addr 172.21.15.161:0/211069849 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/211069849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a3b2ef0 con 0x558d7a2bda10 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.120+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/211069849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a480 tx=0x7fb6ec00a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9001af1c81f6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb5e9e0b640 1 -- 172.21.15.161:0/211069849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec008860 con 0x558d7a2bda10 2024-05-08T09:21:49.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb5e9e0b640 1 -- 172.21.15.161:0/211069849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec008a00 con 0x558d7a2bda10 2024-05-08T09:21:49.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb5e9e0b640 1 -- 172.21.15.161:0/211069849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec008d00 con 0x558d7a2bda10 2024-05-08T09:21:49.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 -- 172.21.15.161:0/211069849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 msgr2=0x558d7a3b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 --2- 172.21.15.161:0/211069849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a480 tx=0x7fb6ec00a940 comp rx=0 tx=0).stop 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 -- 172.21.15.161:0/211069849 shutdown_connections 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 --2- 172.21.15.161:0/211069849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bda10 0x558d7a3b2920 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 -- 172.21.15.161:0/211069849 >> 172.21.15.161:0/211069849 conn(0x558d7a2b95b0 msgr2=0x558d7a3ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 -- 172.21.15.161:0/211069849 shutdown_connections 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.121+0000 7fb6fe146800 1 -- 172.21.15.161:0/211069849 wait complete. 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fe146800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fe146800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558d7a2c8860 con 0x558d7a2bf550 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fbc4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fbc4c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52248/0 (socket says 172.21.15.161:52248) 2024-05-08T09:21:49.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3084716001 learned_addr learned my addr 172.21.15.161:0/3084716001 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a3bac40 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.122+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a420 tx=0x7fb6ec002fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb5e3fff640 1 -- 172.21.15.161:0/3084716001 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec022020 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb5e3fff640 1 -- 172.21.15.161:0/3084716001 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec019040 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb5e3fff640 1 -- 172.21.15.161:0/3084716001 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6ec013980 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d7a3baed0 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7a3bdb80 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.123+0000 7fb5e3fff640 1 -- 172.21.15.161:0/3084716001 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb6ec025020 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb5e3fff640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 0x7fb5e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb5e3fff640 1 -- 172.21.15.161:0/3084716001 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb6ec04c1a0 con 0x558d7a2bf550 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 0x7fb5e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 0x558d7a3c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3c2260 con 0x558d7a3bf930 2024-05-08T09:21:49.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 0x558d7a3c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 0x7fb5e4038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4054000 tx=0x7fb6e404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.124+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 0x558d7a3c1d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3084716001 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6f400a4a0 con 0x558d7a3bf930 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3bef10 con 0x558d7a3bf930 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3084716001 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6f400a4a0 con 0x558d7a3bf930 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 0x558d7a3c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3c7030 con 0x558d7a3c4550 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 0x558d7a3c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.125+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 0x558d7a3c6940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.126+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3084716001 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3c4550 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.126+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3c3500 con 0x558d7a3bf930 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.126+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3084716001 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6f400a4a0 con 0x558d7a3bf930 2024-05-08T09:21:49.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.126+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3c39e0 con 0x558d7a3bf930 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3084716001 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb6f400a4a0 con 0x558d7a3bf930 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fe146800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fe146800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558d7a1b0cf0 con 0x558d7a3d61a0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52250/0 (socket says 172.21.15.161:52250) 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.127+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3326373742 learned_addr learned my addr 172.21.15.161:0/3326373742 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3326373742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a3d6b00 con 0x558d7a3d61a0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x558d7a3c2600 tx=0x7fb6f4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb5e17fa640 1 -- 172.21.15.161:0/3326373742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4014450 con 0x558d7a3d61a0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb5e17fa640 1 -- 172.21.15.161:0/3326373742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4014610 con 0x558d7a3d61a0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d7a3d7570 con 0x558d7a3d61a0 2024-05-08T09:21:49.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb5e17fa640 1 -- 172.21.15.161:0/3326373742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4014930 con 0x558d7a3d61a0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.128+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7a3d7a70 con 0x558d7a3d61a0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb5e17fa640 1 -- 172.21.15.161:0/3326373742 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb6f4011040 con 0x558d7a3d61a0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb5e17fa640 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 0x7fb5d4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb5e17fa640 1 -- 172.21.15.161:0/3326373742 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb6f401e070 con 0x558d7a3d61a0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 0x7fb5d4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.129+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 0x7fb5d4038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x558d7a3c26a0 tx=0x7fb6ec04a4a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fe146800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fe146800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558d7a3b3270 con 0x558d7a3e3420 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52252/0 (socket says 172.21.15.161:52252) 2024-05-08T09:21:49.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fc44d640 1 -- 172.21.15.161:0/2094490570 learned_addr learned my addr 172.21.15.161:0/2094490570 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fc44d640 1 -- 172.21.15.161:0/2094490570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a3e3e10 con 0x558d7a3e3420 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/2094490570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6f404c8a0 tx=0x7fb6f4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10dc54d31f18d0f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb5daffd640 1 -- 172.21.15.161:0/2094490570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f40167c0 con 0x558d7a3e3420 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb5daffd640 1 -- 172.21.15.161:0/2094490570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4013ca0 con 0x558d7a3e3420 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.130+0000 7fb5daffd640 1 -- 172.21.15.161:0/2094490570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f4014ad0 con 0x558d7a3e3420 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- 172.21.15.161:0/2094490570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 msgr2=0x558d7a3e3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 --2- 172.21.15.161:0/2094490570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb6f404c8a0 tx=0x7fb6f4011700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- 172.21.15.161:0/2094490570 shutdown_connections 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 --2- 172.21.15.161:0/2094490570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3e3840 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- 172.21.15.161:0/2094490570 >> 172.21.15.161:0/2094490570 conn(0x558d7a3df730 msgr2=0x558d7a3dd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- 172.21.15.161:0/2094490570 shutdown_connections 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- 172.21.15.161:0/2094490570 wait complete. 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 Processor -- start 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- start start 2024-05-08T09:21:49.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.131+0000 7fb6fe146800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558d7a3e45e0 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fc44d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52258/0 (socket says 172.21.15.161:52258) 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 learned_addr learned my addr 172.21.15.161:0/3152716775 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7a3eaf60 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4011740 tx=0x7fb6f404c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb5d97fa640 1 -- 172.21.15.161:0/3152716775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f404e2e0 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb5d97fa640 1 -- 172.21.15.161:0/3152716775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f404b1d0 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb5d97fa640 1 -- 172.21.15.161:0/3152716775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb6f404b4f0 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558d7a3eb1f0 con 0x558d7a3e3420 2024-05-08T09:21:49.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.132+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7a3edea0 con 0x558d7a3e3420 2024-05-08T09:21:49.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.133+0000 7fb5d97fa640 1 -- 172.21.15.161:0/3152716775 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb6f4022a50 con 0x558d7a3e3420 2024-05-08T09:21:49.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.133+0000 7fb5d97fa640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5c4036900 0x7fb5c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.133+0000 7fb5d97fa640 1 -- 172.21.15.161:0/3152716775 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb6f4046040 con 0x558d7a3e3420 2024-05-08T09:21:49.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5c4036900 0x7fb5c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3f6610 0x558d7a3f8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3f9220 con 0x558d7a3f6610 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3f6610 0x558d7a3f8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5c4036900 0x7fb5c4038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00ae90 tx=0x7fb6ec032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3f6610 0x558d7a3f8ad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 20 realm 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.134+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3f95f0 con 0x558d7a3f6610 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3f9ec0 con 0x558d7a3f6610 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3fa260 con 0x558d7a3f6610 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3fad10 0x558d7a3fd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.135+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3fd880 con 0x558d7a3fad10 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3fad10 0x558d7a3fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fc44d640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3fad10 0x558d7a3fd120 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fe146800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fe146800 20 searching for the correct realm 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558d7a3ff930 0x558d7a401df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.136+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558d7a3ff930 0x558d7a401df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.137+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558d7a3ff930 0x558d7a401df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.137+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.137+0000 7fb6fbc4c640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb6ec03d070 0x7fb6ec01d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.137+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.137+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb6ec03d070 0x7fb6ec01d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6f3fff640 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb6ec03d070 0x7fb6ec01d380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.138+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.139+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.139+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.139+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.139+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.140+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.141+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.142+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.154 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.143+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.144+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.145+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3ff930 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.146+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3fad10 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x558d7a3f6610 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4024c0 con 0x7fb6ec03d070 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.147+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3fe330 con 0x558d7a3f6610 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3fe780 con 0x558d7a3f6610 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a3fec60 con 0x558d7a3f6610 2024-05-08T09:21:49.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 zone default found 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 4 Realm: () 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 zonegroup default 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.148+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a402940 con 0x558d7a3fad10 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.149+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.149+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.149+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.149+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a404b70 con 0x558d7a3ff930 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a404f10 con 0x558d7a3ff930 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 20 started sync module instance, tier type = 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.150+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a403fb0 con 0x7fb6ec03d070 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.151+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.151+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94066129781968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a403fb0 con 0x7fb6ec03d070 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.151+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4058d0 con 0x558d7a3f6610 2024-05-08T09:21:49.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.152+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94066129781968] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.152+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.152+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94066129779936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4058d0 con 0x558d7a3f6610 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.152+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4062d0 con 0x558d7a3ff930 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.153+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94066129779936] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.153+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.153+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94066129785888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a405840 con 0x558d7a3ff930 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.154+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a407190 con 0x7fb6ec03d070 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.155+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.155+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94066129785888] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.155+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94066129792224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4075b0 con 0x7fb6ec03d070 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.155+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a407f70 con 0x558d7a3f6610 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.156+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94066129792224] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.156+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.156+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94066129793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a407f70 con 0x558d7a3f6610 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.156+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a408930 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.157+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.157+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94066129798272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a409180 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.157+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a409c40 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.157+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94066129793760] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.158+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94066129798272] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.158+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.158+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94066129803024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a408d10 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.158+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a40a2d0 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94066129804832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a40a6f0 con 0x558d7a3fad10 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=0 2024-05-08T09:21:49.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=1 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=2 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=3 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=4 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=5 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94066129803024] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.159+0000 7fb6fe146800 20 add_watcher() i=6 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94066129804832] v27'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6fe146800 20 add_watcher() i=7 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6fe146800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a40d720 con 0x558d7a3f6610 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.160+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94066129805888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a40ab10 con 0x558d7a3f6610 2024-05-08T09:21:49.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94066129805888] v27'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb5b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb6fe146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb6fe146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb6fe146800 5 note: GC not initialized 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb5b0fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.161+0000 7fb6fe146800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb6fe146800 20 Filter name: none 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb52a7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb6fe146800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4405c0 con 0x558d7a3f6610 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.162+0000 7fb6fe146800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T09:21:49.172 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T09:21:49.029132Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.163+0000 7fb5b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.163+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94066129805888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a43f190 con 0x558d7a3f6610 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.164+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94066129805888] v27'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.164+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94066129781968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a43f640 con 0x7fb6ec03d070 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.165+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94066129781968] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.165+0000 7fb6fe146800 20 remove_watcher() i=0 2024-05-08T09:21:49.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.165+0000 7fb6fe146800 2 removed watcher, disabling cache 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.165+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94066129779936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4044d0 con 0x558d7a3f6610 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.166+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94066129779936] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.166+0000 7fb6fe146800 20 remove_watcher() i=1 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.166+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94066129785888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4044d0 con 0x558d7a3ff930 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.167+0000 7fb6fbc4c640 1 -- 172.21.15.161:0/3152716775 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94066129785888] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6ec013d00 con 0x558d7a3ff930 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.167+0000 7fb6fe146800 20 remove_watcher() i=2 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.167+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94066129792224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a405420 con 0x7fb6ec03d070 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.168+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94066129792224] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x7fb6ec03d070 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.168+0000 7fb6fe146800 20 remove_watcher() i=3 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.168+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94066129793760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a405420 con 0x558d7a3f6610 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.169+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94066129793760] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6e405a040 con 0x558d7a3f6610 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.169+0000 7fb6fe146800 20 remove_watcher() i=4 2024-05-08T09:21:49.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.169+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94066129798272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a4072e0 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.170+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94066129798272] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.170+0000 7fb6fe146800 20 remove_watcher() i=5 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.170+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94066129803024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a405420 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.171+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94066129803024] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.171+0000 7fb6fe146800 20 remove_watcher() i=6 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.171+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94066129804832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558d7a408480 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fc44d640 1 -- 172.21.15.161:0/3152716775 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94066129804832] v27'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb6f403c020 con 0x558d7a3fad10 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 20 remove_watcher() i=7 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3fad10 msgr2=0x558d7a3fd120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3fad10 0x558d7a3fd120 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3f6610 msgr2=0x558d7a3f8ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3f6610 0x558d7a3f8ad0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb6ec03d070 msgr2=0x7fb6ec01d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb6ec03d070 0x7fb6ec01d380 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558d7a3ff930 msgr2=0x558d7a401df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558d7a3ff930 0x558d7a401df0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5c4036900 msgr2=0x7fb5c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5c4036900 0x7fb5c4038dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00ae90 tx=0x7fb6ec032000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 msgr2=0x558d7a3eaa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb6f4011740 tx=0x7fb6f404c830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6f3fff640 1 -- 172.21.15.161:0/3152716775 reap_dead start 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 shutdown_connections 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3152716775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3e3420 0x558d7a3eaa20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 >> 172.21.15.161:0/3152716775 conn(0x558d7a3df730 msgr2=0x558d7a3dcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 shutdown_connections 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.172+0000 7fb6fe146800 1 -- 172.21.15.161:0/3152716775 wait complete. 2024-05-08T09:21:49.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 msgr2=0x7fb5d4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 0x7fb5d4038e10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x558d7a3c26a0 tx=0x7fb6ec04a4a0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 msgr2=0x558d7a3d65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x558d7a3c2600 tx=0x7fb6f4018830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 shutdown_connections 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5d4036950 0x7fb5d4038e10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3326373742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a3d61a0 0x558d7a3d65c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 >> 172.21.15.161:0/3326373742 conn(0x558d7a3ca240 msgr2=0x558d7a3ca640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 shutdown_connections 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3326373742 wait complete. 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 msgr2=0x558d7a3c6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 0x558d7a3c6940 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 msgr2=0x558d7a3c1d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 0x558d7a3c1d20 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 msgr2=0x7fb5e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 0x7fb5e4038e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6e4054000 tx=0x7fb6e404e000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 msgr2=0x558d7a3ba700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00a420 tx=0x7fb6ec002fd0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 shutdown_connections 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558d7a3c4550 0x558d7a3c6940 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558d7a3bf930 0x558d7a3c1d20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb5e4036950 0x7fb5e4038e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 --2- 172.21.15.161:0/3084716001 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d7a2bf550 0x558d7a3ba700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 >> 172.21.15.161:0/3084716001 conn(0x558d7a2b95b0 msgr2=0x558d7a3aca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 shutdown_connections 2024-05-08T09:21:49.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.173+0000 7fb6fe146800 1 -- 172.21.15.161:0/3084716001 wait complete. 2024-05-08T09:21:49.183 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T09:21:49.029132Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.183 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T09:21:49.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-05-08T09:21:49.184 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-05-08T09:21:49.230 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.230 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb751c98800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b476567470 0x55b476569860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb751c98800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b476569e30 con 0x55b476562fe0 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb751c98800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55b4763f5050 con 0x55b476567470 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.231+0000 7fb747fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b476567470 0x55b476569860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb74f79e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55b476562fe0 0x55b476563400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42806/0 (socket says 172.21.15.161:42806) 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb747fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b476567470 0x55b476569860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52272/0 (socket says 172.21.15.161:52272) 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb74f79e640 1 -- 172.21.15.161:0/3589008442 learned_addr learned my addr 172.21.15.161:0/3589008442 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb747fff640 1 -- 172.21.15.161:0/3589008442 >> v1:172.21.15.45:6789/0 conn(0x55b476562fe0 legacy=0x55b476563400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb747fff640 1 -- 172.21.15.161:0/3589008442 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47656b060 con 0x55b476567470 2024-05-08T09:21:49.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.232+0000 7fb74ef9d640 1 -- 172.21.15.161:0/3589008442 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402366635 0 0) 0x55b476569e30 con 0x55b476562fe0 2024-05-08T09:21:49.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb747fff640 1 --2- 172.21.15.161:0/3589008442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476567470 0x55b476569860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb73800a470 tx=0x7fb73801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dd2bc70b56249c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb74ef9d640 1 -- 172.21.15.161:0/3589008442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738057070 con 0x55b476567470 2024-05-08T09:21:49.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb74ef9d640 1 -- 172.21.15.161:0/3589008442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb738052570 con 0x55b476567470 2024-05-08T09:21:49.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb74ef9d640 1 -- 172.21.15.161:0/3589008442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb738052870 con 0x55b476567470 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 -- 172.21.15.161:0/3589008442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476567470 msgr2=0x55b476569860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 --2- 172.21.15.161:0/3589008442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476567470 0x55b476569860 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb73800a470 tx=0x7fb73801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 -- 172.21.15.161:0/3589008442 shutdown_connections 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 --2- 172.21.15.161:0/3589008442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476567470 0x55b476569860 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 -- 172.21.15.161:0/3589008442 >> 172.21.15.161:0/3589008442 conn(0x55b47655e5c0 msgr2=0x55b4765609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 -- 172.21.15.161:0/3589008442 shutdown_connections 2024-05-08T09:21:49.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.234+0000 7fb751c98800 1 -- 172.21.15.161:0/3589008442 wait complete. 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.248+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.248+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.248+0000 7fb751c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.248+0000 7fb751c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4764af1c0 con 0x55b476562fe0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb74f79e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb74f79e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52278/0 (socket says 172.21.15.161:52278) 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb74f79e640 1 -- 172.21.15.161:0/1860677929 learned_addr learned my addr 172.21.15.161:0/1860677929 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb74f79e640 1 -- 172.21.15.161:0/1860677929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4766582e0 con 0x55b476562fe0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1860677929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb74000b240 tx=0x7fb74000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afabeaa1c0ec74d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb63d60a640 1 -- 172.21.15.161:0/1860677929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740008070 con 0x55b476562fe0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb63d60a640 1 -- 172.21.15.161:0/1860677929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74000d500 con 0x55b476562fe0 2024-05-08T09:21:49.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.249+0000 7fb63d60a640 1 -- 172.21.15.161:0/1860677929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74000d860 con 0x55b476562fe0 2024-05-08T09:21:49.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- 172.21.15.161:0/1860677929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 msgr2=0x55b4764d6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 --2- 172.21.15.161:0/1860677929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb74000b240 tx=0x7fb74000b700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- 172.21.15.161:0/1860677929 shutdown_connections 2024-05-08T09:21:49.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 --2- 172.21.15.161:0/1860677929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b4764d6e50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- 172.21.15.161:0/1860677929 >> 172.21.15.161:0/1860677929 conn(0x55b47655e5c0 msgr2=0x55b47664fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- 172.21.15.161:0/1860677929 shutdown_connections 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- 172.21.15.161:0/1860677929 wait complete. 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.250+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb751c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb751c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b47656a300 con 0x55b476562fe0 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb74f79e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb74f79e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52284/0 (socket says 172.21.15.161:52284) 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb74f79e640 1 -- 172.21.15.161:0/1667341088 learned_addr learned my addr 172.21.15.161:0/1667341088 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb74f79e640 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47665d690 con 0x55b476562fe0 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55b4764d6480 tx=0x7fb740000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb63be07640 1 -- 172.21.15.161:0/1667341088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740019870 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb63be07640 1 -- 172.21.15.161:0/1667341088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb740019a10 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.251+0000 7fb63be07640 1 -- 172.21.15.161:0/1667341088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb740019d30 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.252+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b47665d920 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.252+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4766605d0 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.252+0000 7fb63be07640 1 -- 172.21.15.161:0/1667341088 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb740017040 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.252+0000 7fb63be07640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 0x7fb634038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb63be07640 1 -- 172.21.15.161:0/1667341088 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb740015020 con 0x55b476562fe0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb747fff640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 0x7fb634038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 0x55b476664390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766648d0 con 0x55b476567470 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 0x55b476664390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb747fff640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 0x7fb634038dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb738054000 tx=0x7fb73804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 0x55b476664390 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1667341088 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb74800a4a0 con 0x55b476567470 2024-05-08T09:21:49.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.253+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b476661960 con 0x55b476567470 2024-05-08T09:21:49.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.254+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1667341088 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb74800a4a0 con 0x55b476567470 2024-05-08T09:21:49.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.254+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 0x55b476669040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.254+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766696e0 con 0x55b476666c50 2024-05-08T09:21:49.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.254+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 0x55b476669040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.254+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 0x55b476669040 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.255+0000 7fb74f79e640 1 -- 172.21.15.161:0/1667341088 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb74002d070 con 0x55b476666c50 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.255+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b476665c00 con 0x55b476567470 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.255+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1667341088 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb74800a4a0 con 0x55b476567470 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.255+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766660e0 con 0x55b476567470 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1667341088 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb74800a4a0 con 0x55b476567470 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb751c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb751c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b476455cf0 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52294/0 (socket says 172.21.15.161:52294) 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.256+0000 7fb74ff9f640 1 -- 172.21.15.161:0/3641270502 learned_addr learned my addr 172.21.15.161:0/3641270502 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb74ff9f640 1 -- 172.21.15.161:0/3641270502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b476679230 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b476664cb0 tx=0x7fb748018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb639602640 1 -- 172.21.15.161:0/3641270502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb748014450 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb639602640 1 -- 172.21.15.161:0/3641270502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7480145f0 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b476679ca0 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb639602640 1 -- 172.21.15.161:0/3641270502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7480148d0 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.257+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b47667a1a0 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb639602640 1 -- 172.21.15.161:0/3641270502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb748011040 con 0x55b4766788d0 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb639602640 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 0x7fb628038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb639602640 1 -- 172.21.15.161:0/3641270502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb74801e070 con 0x55b4766788d0 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb74f79e640 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 0x7fb628038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb74f79e640 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 0x7fb628038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55b476664d70 tx=0x7fb74001b540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb751c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.258+0000 7fb751c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b476658630 con 0x55b476685b50 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52308/0 (socket says 172.21.15.161:52308) 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb74ff9f640 1 -- 172.21.15.161:0/344720504 learned_addr learned my addr 172.21.15.161:0/344720504 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb74ff9f640 1 -- 172.21.15.161:0/344720504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b476686540 con 0x55b476685b50 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/344720504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb74804c980 tx=0x7fb748011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662539b5934c3ffc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb632ffd640 1 -- 172.21.15.161:0/344720504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb748013cb0 con 0x55b476685b50 2024-05-08T09:21:49.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb632ffd640 1 -- 172.21.15.161:0/344720504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb748040e50 con 0x55b476685b50 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.259+0000 7fb632ffd640 1 -- 172.21.15.161:0/344720504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74803bba0 con 0x55b476685b50 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- 172.21.15.161:0/344720504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 msgr2=0x55b476685f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 --2- 172.21.15.161:0/344720504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb74804c980 tx=0x7fb748011700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- 172.21.15.161:0/344720504 shutdown_connections 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 --2- 172.21.15.161:0/344720504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b476685f70 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- 172.21.15.161:0/344720504 >> 172.21.15.161:0/344720504 conn(0x55b476681e10 msgr2=0x55b47667fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- 172.21.15.161:0/344720504 shutdown_connections 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- 172.21.15.161:0/344720504 wait complete. 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 Processor -- start 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- start start 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb751c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b476686cc0 con 0x55b476685b50 2024-05-08T09:21:49.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb74ff9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52318/0 (socket says 172.21.15.161:52318) 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 learned_addr learned my addr 172.21.15.161:0/1962112285 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.260+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47668d5f0 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb74804b870 tx=0x7fb74804c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb6317fa640 1 -- 172.21.15.161:0/1962112285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74804e380 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb6317fa640 1 -- 172.21.15.161:0/1962112285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb74804b410 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b47668d880 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb6317fa640 1 -- 172.21.15.161:0/1962112285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb74802ba60 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b476690530 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.261+0000 7fb6317fa640 1 -- 172.21.15.161:0/1962112285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb74802bc00 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb6317fa640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb618036950 0x7fb618038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb6317fa640 1 -- 172.21.15.161:0/1962112285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fb74800e040 con 0x55b476685b50 2024-05-08T09:21:49.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb618036950 0x7fb618038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb618036950 0x7fb618038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ffd0 tx=0x7fb740031000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476698c10 0x55b47669b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.262+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b47669b820 con 0x55b476698c10 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb747fff640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476698c10 0x55b47669b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb747fff640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476698c10 0x55b47669b0d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 20 realm 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b47669bbf0 con 0x55b476698c10 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.263+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b47669c4c0 con 0x55b476698c10 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b47669c860 con 0x55b476698c10 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b47669d5c0 0x55b47669f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b47669ffc0 con 0x55b47669d5c0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.264+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b47669d5c0 0x55b47669f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb74ff9f640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b47669d5c0 0x55b47669f9b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb751c98800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb751c98800 20 searching for the correct realm 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4766a1f50 0x55b4766a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4766a1f50 0x55b4766a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.265+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4766a1f50 0x55b4766a4410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.266+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.266+0000 7fb74f79e640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb74003f190 0x7fb74004b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.266+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.266+0000 7fb747fff640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb74003f190 0x7fb74004b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.266+0000 7fb747fff640 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb74003f190 0x7fb74004b800 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.267+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.268+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.269+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.270+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.271+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.272+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b4766a1f50 2024-05-08T09:21:49.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.273+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b47669d5c0 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x55b476698c10 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a4ae0 con 0x7fb74003f190 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a14a0 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.274+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a0450 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a0e10 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 zone default found 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 4 Realm: () 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 zonegroup default 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a5410 con 0x55b47669d5c0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.275+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a7640 con 0x55b4766a1f50 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a79e0 con 0x55b4766a1f50 2024-05-08T09:21:49.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 20 started sync module instance, tier type = 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.276+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a6a80 con 0x7fb74003f190 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.277+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.277+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94233569161136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a6a80 con 0x7fb74003f190 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.277+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a83a0 con 0x55b476698c10 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.278+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94233569161136] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.278+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.278+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94233569165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a6a80 con 0x55b476698c10 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.278+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a8df0 con 0x55b4766a1f50 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.279+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94233569165520] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.280+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.280+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94233569158608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a69f0 con 0x55b4766a1f50 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.280+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a9ba0 con 0x7fb74003f190 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.281+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.281+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94233569171088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766aa440 con 0x7fb74003f190 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.281+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766aaee0 con 0x55b476698c10 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.281+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94233569158608] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.282+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.282+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94233569175984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766aaea0 con 0x55b476698c10 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.282+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766ab8f0 con 0x55b47669d5c0 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.282+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94233569171088] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.283+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.283+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94233569178688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766abce0 con 0x55b47669d5c0 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.283+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766ac6e0 con 0x55b47669d5c0 2024-05-08T09:21:49.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.283+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94233569175984] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.284+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94233569178688] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.284+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.284+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94233569173392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766ac1f0 con 0x55b47669d5c0 2024-05-08T09:21:49.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.284+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acbb0 con 0x55b47669d5c0 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94233569183488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766ad010 con 0x55b47669d5c0 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=0 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=1 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94233569173392] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=2 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=3 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=4 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=5 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.285+0000 7fb751c98800 20 add_watcher() i=6 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94233569183488] v27'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb751c98800 20 add_watcher() i=7 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb751c98800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a91e0 con 0x55b476698c10 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.286+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94233569184544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a91e0 con 0x55b476698c10 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.287+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94233569184544] v27'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.287+0000 7fb605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.298 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.287+0000 7fb751c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.287+0000 7fb751c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.287+0000 7fb751c98800 5 note: GC not initialized 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb604fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 20 Filter name: none 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb57e7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e35d0 con 0x55b476698c10 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 20 rados_obj.operate() r=0 bl.length=502 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.288+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e9940 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.289+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.289+0000 7fb751c98800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.289+0000 7fb751c98800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.289+0000 7fb751c98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.289+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94233569432496 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e84d0 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94233569175984 notify 115964116996 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55b47656b060 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb632ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94233569175984 notifier 4348 bl.length()=567 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb632ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb632ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb632ffd640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb614003ea0 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94233569432496 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94233569432496 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fb73805da00 con 0x55b476698c10 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.290+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e93b0 con 0x55b47669d5c0 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v27'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb751c98800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94233569432496 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e8020 con 0x55b4766a1f50 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94233569158608 notify 115964116993 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55b4766605d0 con 0x55b4766a1f50 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb6327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116993 cookie 94233569158608 notifier 4348 bl.length()=170 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb6327fc640 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb5840032c0 con 0x55b4766a1f50 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.291+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94233569432496 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.292+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== watch-notify(notify_complete (2) cookie 94233569432496 notify 115964116993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b47665d920 con 0x55b4766a1f50 2024-05-08T09:21:49.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.292+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.302 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.293+0000 7fb605fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.293+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94233569184544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766e3af0 con 0x55b476698c10 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.293+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94233569184544] v27'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.293+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94233569161136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acb20 con 0x7fb74003f190 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.294+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94233569161136] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.294+0000 7fb751c98800 20 remove_watcher() i=0 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.294+0000 7fb751c98800 2 removed watcher, disabling cache 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.294+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94233569165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acb20 con 0x55b476698c10 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.295+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94233569165520] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.295+0000 7fb751c98800 20 remove_watcher() i=1 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.295+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94233569158608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acb20 con 0x55b4766a1f50 2024-05-08T09:21:49.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.296+0000 7fb74f79e640 1 -- 172.21.15.161:0/1962112285 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94233569158608] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74002d070 con 0x55b4766a1f50 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.296+0000 7fb751c98800 20 remove_watcher() i=2 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.296+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94233569171088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a65d0 con 0x7fb74003f190 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.297+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94233569171088] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x7fb74003f190 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.297+0000 7fb751c98800 20 remove_watcher() i=3 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.297+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94233569175984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acb20 con 0x55b476698c10 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.298+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94233569175984] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb73805a040 con 0x55b476698c10 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.298+0000 7fb751c98800 20 remove_watcher() i=4 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.298+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94233569178688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a65d0 con 0x55b47669d5c0 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.299+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94233569178688] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.299+0000 7fb751c98800 20 remove_watcher() i=5 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.299+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94233569173392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766acb20 con 0x55b47669d5c0 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.300+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94233569173392] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.300+0000 7fb751c98800 20 remove_watcher() i=6 2024-05-08T09:21:49.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.300+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94233569183488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b4766a65d0 con 0x55b47669d5c0 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb74ff9f640 1 -- 172.21.15.161:0/1962112285 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94233569183488] v27'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb74802a070 con 0x55b47669d5c0 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 20 remove_watcher() i=7 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b47669d5c0 msgr2=0x55b47669f9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b47669d5c0 0x55b47669f9b0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476698c10 msgr2=0x55b47669b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476698c10 0x55b47669b0d0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb74003f190 msgr2=0x7fb74004b800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fb74003f190 0x7fb74004b800 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4766a1f50 msgr2=0x55b4766a4410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4766a1f50 0x55b4766a4410 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb618036950 msgr2=0x7fb618038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb618036950 0x7fb618038e10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb74000ffd0 tx=0x7fb740031000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 msgr2=0x55b47668d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb747fff640 1 -- 172.21.15.161:0/1962112285 reap_dead start 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb74804b870 tx=0x7fb74804c8e0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 shutdown_connections 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 --2- 172.21.15.161:0/1962112285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476685b50 0x55b47668d0b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.301+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 >> 172.21.15.161:0/1962112285 conn(0x55b476681e10 msgr2=0x55b47667f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 shutdown_connections 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1962112285 wait complete. 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 msgr2=0x7fb628038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 0x7fb628038e10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x55b476664d70 tx=0x7fb74001b540 comp rx=0 tx=0).stop 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 msgr2=0x55b476678cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x55b476664cb0 tx=0x7fb748018830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 shutdown_connections 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb628036950 0x7fb628038e10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/3641270502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4766788d0 0x55b476678cf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 >> 172.21.15.161:0/3641270502 conn(0x55b47666c970 msgr2=0x55b47666cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 shutdown_connections 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/3641270502 wait complete. 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 msgr2=0x55b476669040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 0x55b476669040 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 msgr2=0x55b476664390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 0x55b476664390 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 msgr2=0x7fb634038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 0x7fb634038dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb738054000 tx=0x7fb73804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 msgr2=0x55b47665d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55b4764d6480 tx=0x7fb740000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 shutdown_connections 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b476666c50 0x55b476669040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b476567470 0x55b476664390 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb634036900 0x7fb634038dc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 --2- 172.21.15.161:0/1667341088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b476562fe0 0x55b47665d150 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.302+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 >> 172.21.15.161:0/1667341088 conn(0x55b47655e5c0 msgr2=0x55b47664e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.303+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 shutdown_connections 2024-05-08T09:21:49.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.303+0000 7fb751c98800 1 -- 172.21.15.161:0/1667341088 wait complete. 2024-05-08T09:21:49.313 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.313 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T09:21:49.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-05-08T09:21:49.313 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-05-08T09:21:49.359 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.359 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff45a3f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x565065b86550 0x565065b8f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff45a3f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x565065af9910 con 0x565065b84a10 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff45a3f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x565065a17050 con 0x565065b86550 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff42d3d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x565065b86550 0x565065b8f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff42d3d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x565065b86550 0x565065b8f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52320/0 (socket says 172.21.15.161:52320) 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff4353e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x565065b84a10 0x565065b84e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42822/0 (socket says 172.21.15.161:42822) 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff42d3d640 1 -- 172.21.15.161:0/3243902456 learned_addr learned my addr 172.21.15.161:0/3243902456 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff42d3d640 1 -- 172.21.15.161:0/3243902456 >> v1:172.21.15.45:6789/0 conn(0x565065b84a10 legacy=0x565065b84e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.361+0000 7eff42d3d640 1 -- 172.21.15.161:0/3243902456 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065af9ae0 con 0x565065b86550 2024-05-08T09:21:49.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.363+0000 7eff42d3d640 1 --2- 172.21.15.161:0/3243902456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b86550 0x565065b8f050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a520 tx=0x7eff2c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87725b0baba78a4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff4253c640 1 -- 172.21.15.161:0/3243902456 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff2c057070 con 0x565065b86550 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff4253c640 1 -- 172.21.15.161:0/3243902456 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff2c052570 con 0x565065b86550 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff4253c640 1 -- 172.21.15.161:0/3243902456 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff2c04ae60 con 0x565065b86550 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 -- 172.21.15.161:0/3243902456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b86550 msgr2=0x565065b8f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3243902456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b86550 0x565065b8f050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00a520 tx=0x7eff2c01d010 comp rx=0 tx=0).stop 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 -- 172.21.15.161:0/3243902456 shutdown_connections 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3243902456 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b86550 0x565065b8f050 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 -- 172.21.15.161:0/3243902456 >> 172.21.15.161:0/3243902456 conn(0x565065b805b0 msgr2=0x565065b829d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 -- 172.21.15.161:0/3243902456 shutdown_connections 2024-05-08T09:21:49.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.364+0000 7eff45a3f800 1 -- 172.21.15.161:0/3243902456 wait complete. 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.378+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff45a3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff45a3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565065ad11c0 con 0x565065b84a10 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff4353e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff4353e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52336/0 (socket says 172.21.15.161:52336) 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff4353e640 1 -- 172.21.15.161:0/2460806541 learned_addr learned my addr 172.21.15.161:0/2460806541 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff4353e640 1 -- 172.21.15.161:0/2460806541 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065c79ec0 con 0x565065b84a10 2024-05-08T09:21:49.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.379+0000 7eff4353e640 1 --2- 172.21.15.161:0/2460806541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff34001e90 tx=0x7eff3400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea85d8e848b32dc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7efe3160a640 1 -- 172.21.15.161:0/2460806541 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3400e5c0 con 0x565065b84a10 2024-05-08T09:21:49.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7efe3160a640 1 -- 172.21.15.161:0/2460806541 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff34006070 con 0x565065b84a10 2024-05-08T09:21:49.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7efe3160a640 1 -- 172.21.15.161:0/2460806541 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3400e890 con 0x565065b84a10 2024-05-08T09:21:49.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 -- 172.21.15.161:0/2460806541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 msgr2=0x565065c798f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 --2- 172.21.15.161:0/2460806541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7eff34001e90 tx=0x7eff3400b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 -- 172.21.15.161:0/2460806541 shutdown_connections 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 --2- 172.21.15.161:0/2460806541 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c798f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 -- 172.21.15.161:0/2460806541 >> 172.21.15.161:0/2460806541 conn(0x565065b805b0 msgr2=0x565065c75210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 -- 172.21.15.161:0/2460806541 shutdown_connections 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.380+0000 7eff45a3f800 1 -- 172.21.15.161:0/2460806541 wait complete. 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff45a3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff45a3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565065b8f860 con 0x565065b84a10 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff4353e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff4353e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52348/0 (socket says 172.21.15.161:52348) 2024-05-08T09:21:49.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff4353e640 1 -- 172.21.15.161:0/1633675850 learned_addr learned my addr 172.21.15.161:0/1633675850 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.381+0000 7eff4353e640 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065c819d0 con 0x565065b84a10 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.382+0000 7eff4353e640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7eff34001ed0 tx=0x7eff34000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.383+0000 7efe2fe07640 1 -- 172.21.15.161:0/1633675850 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3401a880 con 0x565065b84a10 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.383+0000 7efe2fe07640 1 -- 172.21.15.161:0/1633675850 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3401aa20 con 0x565065b84a10 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.383+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565065c81c60 con 0x565065b84a10 2024-05-08T09:21:49.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.383+0000 7efe2fe07640 1 -- 172.21.15.161:0/1633675850 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3401ad40 con 0x565065b84a10 2024-05-08T09:21:49.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.383+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565065c84910 con 0x565065b84a10 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7efe2fe07640 1 -- 172.21.15.161:0/1633675850 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff34017070 con 0x565065b84a10 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7efe2fe07640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 0x7efe28038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7efe2fe07640 1 -- 172.21.15.161:0/1633675850 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7eff34015020 con 0x565065b84a10 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7eff42d3d640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 0x7efe28038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 0x565065c886d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065c88c60 con 0x565065b86550 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.385+0000 7eff43d3f640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 0x565065c886d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff42d3d640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 0x7efe28038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff2c054000 tx=0x7eff2c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff43d3f640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 0x565065c886d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff43d3f640 1 -- 172.21.15.161:0/1633675850 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff3c00a4a0 con 0x565065b86550 2024-05-08T09:21:49.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065c85ca0 con 0x565065b86550 2024-05-08T09:21:49.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff43d3f640 1 -- 172.21.15.161:0/1633675850 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff3c00a4a0 con 0x565065b86550 2024-05-08T09:21:49.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 0x565065c8d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.386+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065c8da90 con 0x565065c8afb0 2024-05-08T09:21:49.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.387+0000 7eff4353e640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 0x565065c8d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.387+0000 7eff4353e640 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 0x565065c8d3a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.387+0000 7eff4353e640 1 -- 172.21.15.161:0/1633675850 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff3402e070 con 0x565065c8afb0 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.387+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065c89f60 con 0x565065b86550 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff43d3f640 1 -- 172.21.15.161:0/1633675850 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff3c00a4a0 con 0x565065b86550 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065c8a440 con 0x565065b86550 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff43d3f640 1 -- 172.21.15.161:0/1633675850 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff3c00a4a0 con 0x565065b86550 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff45a3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.388+0000 7eff45a3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565065a77cf0 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52354/0 (socket says 172.21.15.161:52354) 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff43d3f640 1 -- 172.21.15.161:0/1052877152 learned_addr learned my addr 172.21.15.161:0/1052877152 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff43d3f640 1 -- 172.21.15.161:0/1052877152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065c9d560 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff43d3f640 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x565065c89060 tx=0x7eff3c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7efe2d602640 1 -- 172.21.15.161:0/1052877152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c014450 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7efe2d602640 1 -- 172.21.15.161:0/1052877152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c014610 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565065c9dfd0 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7efe2d602640 1 -- 172.21.15.161:0/1052877152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c014930 con 0x565065c9cc00 2024-05-08T09:21:49.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.389+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565065c9e4d0 con 0x565065c9cc00 2024-05-08T09:21:49.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.390+0000 7efe2d602640 1 -- 172.21.15.161:0/1052877152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff3c011040 con 0x565065c9cc00 2024-05-08T09:21:49.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.390+0000 7efe2d602640 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 0x7efe1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.390+0000 7efe2d602640 1 -- 172.21.15.161:0/1052877152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7eff3c01e070 con 0x565065c9cc00 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.390+0000 7eff4353e640 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 0x7efe1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff4353e640 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 0x7efe1c038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x565065c89100 tx=0x7eff3404b320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff45a3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff45a3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565065c7a240 con 0x565065ca9e80 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52370/0 (socket says 172.21.15.161:52370) 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff43d3f640 1 -- 172.21.15.161:0/3010628213 learned_addr learned my addr 172.21.15.161:0/3010628213 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff43d3f640 1 -- 172.21.15.161:0/3010628213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065caa870 con 0x565065ca9e80 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7eff43d3f640 1 --2- 172.21.15.161:0/3010628213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c04c8a0 tx=0x7eff3c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e48a4710d5ba70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7efe26ffd640 1 -- 172.21.15.161:0/3010628213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c0167c0 con 0x565065ca9e80 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7efe26ffd640 1 -- 172.21.15.161:0/3010628213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c013ca0 con 0x565065ca9e80 2024-05-08T09:21:49.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.391+0000 7efe26ffd640 1 -- 172.21.15.161:0/3010628213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c014ad0 con 0x565065ca9e80 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- 172.21.15.161:0/3010628213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 msgr2=0x565065caa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3010628213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff3c04c8a0 tx=0x7eff3c011700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- 172.21.15.161:0/3010628213 shutdown_connections 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3010628213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065caa2a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- 172.21.15.161:0/3010628213 >> 172.21.15.161:0/3010628213 conn(0x565065ca61e0 msgr2=0x565065ca4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- 172.21.15.161:0/3010628213 shutdown_connections 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- 172.21.15.161:0/3010628213 wait complete. 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 Processor -- start 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- start start 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.392+0000 7eff45a3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x565065caafe0 con 0x565065ca9e80 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff43d3f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52378/0 (socket says 172.21.15.161:52378) 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 learned_addr learned my addr 172.21.15.161:0/3969579602 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565065cb19d0 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff43d3f640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff3c011740 tx=0x7eff3c04c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7efe257fa640 1 -- 172.21.15.161:0/3969579602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c013e50 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7efe257fa640 1 -- 172.21.15.161:0/3969579602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff3c04e2e0 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7efe257fa640 1 -- 172.21.15.161:0/3969579602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff3c04b320 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565065cb1c60 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.393+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565065cb4910 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.394+0000 7efe257fa640 1 -- 172.21.15.161:0/3969579602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7eff3c022a50 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.394+0000 7efe257fa640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe0c036af0 0x7efe0c038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.394+0000 7efe257fa640 1 -- 172.21.15.161:0/3969579602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7eff3c046040 con 0x565065ca9e80 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.394+0000 7eff4353e640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe0c036af0 0x7efe0c038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff4353e640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe0c036af0 0x7efe0c038fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff340178f0 tx=0x7eff34035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065cbd140 0x565065cbf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cbfd50 con 0x565065cbd140 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff42d3d640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065cbd140 0x565065cbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.395+0000 7eff42d3d640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065cbd140 0x565065cbf600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 realm 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc0120 con 0x565065cbd140 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc09f0 con 0x565065cbd140 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc0d90 con 0x565065cbd140 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065cc1af0 0x565065cc3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.396+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc44f0 con 0x565065cc1af0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff43d3f640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065cc1af0 0x565065cc3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff43d3f640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065cc1af0 0x565065cc3ee0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff45a3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff45a3f800 20 searching for the correct realm 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x565065cc64c0 0x565065cc8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.397+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff4353e640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x565065cc64c0 0x565065cc8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff4353e640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x565065cc64c0 0x565065cc8980 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff4353e640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7eff3400f070 0x7eff34019840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.398+0000 7eff42d3d640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7eff3400f070 0x7eff34019840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.399+0000 7eff42d3d640 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7eff3400f070 0x7eff34019840 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.399+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.399+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.399+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.399+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.400+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.401+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.402+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.403+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.404+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.405+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc64c0 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cc1af0 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.406+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x565065cbd140 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x565065cc9050 con 0x7eff3400f070 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc4eb0 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc4af0 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.407+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc5850 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 zone default found 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 4 Realm: () 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 zonegroup default 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cc94d0 con 0x565065cc1af0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065ccb780 con 0x565065cc64c0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.408+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065ccbb20 con 0x565065cc64c0 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.409+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.409+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.409+0000 7eff45a3f800 20 started sync module instance, tier type = 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.409+0000 7eff45a3f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.409+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccabc0 con 0x7eff3400f070 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.410+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.410+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94903305285872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccabc0 con 0x7eff3400f070 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.410+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccc520 con 0x565065cbd140 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.411+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94903305285872] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.411+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.411+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94903305289776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccabc0 con 0x565065cbd140 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.411+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cccfe0 con 0x565065cc64c0 2024-05-08T09:21:49.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.412+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.412+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94903305292464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccd880 con 0x565065cc64c0 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.412+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cce340 con 0x7eff3400f070 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.412+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94903305289776] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.413+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.413+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94903305297424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cce730 con 0x7eff3400f070 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.413+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94903305292464] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.413+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccd3d0 con 0x565065cbd140 2024-05-08T09:21:49.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.414+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.414+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94903305301056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccd3d0 con 0x565065cbd140 2024-05-08T09:21:49.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.414+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccfb30 con 0x565065cc1af0 2024-05-08T09:21:49.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.414+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94903305297424] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.415+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.415+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94903305301056] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.415+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94903305303680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cca710 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.415+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cd0380 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.416+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94903305303680] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.416+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.416+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94903305302112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cd0380 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.416+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cd0dc0 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94903305302112] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94903305308304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cd0d80 con 0x565065cc1af0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=0 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=1 2024-05-08T09:21:49.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=2 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=3 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=4 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=5 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.417+0000 7eff45a3f800 20 add_watcher() i=6 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94903305308304] v27'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff45a3f800 20 add_watcher() i=7 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff45a3f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065cd4210 con 0x565065cbd140 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.418+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94903305305808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cd1730 con 0x565065cbd140 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.419+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94903305305808] v27'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7efdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 5 note: GC not initialized 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7efdf8fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 20 Filter name: none 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7efd727fc640 20 reqs_thread_entry: start 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.420+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065d07770 con 0x565065cbd140 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:49.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065d072c0 con 0x565065cbd140 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.421+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065d0dc30 con 0x565065cbd140 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v27'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff45a3f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff45a3f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff45a3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:49.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94903305557664 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065d095c0 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.422+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify (1) cookie 94903305301056 notify 115964116997 ret 0) ==== 774+0+0 (crc 0 0 0) 0x565065af9ae0 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7efe26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94903305301056 notifier 4355 bl.length()=732 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7efe26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify cookie 94903305557664 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7efe26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7efe26ffd640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7efe08003ea0 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94903305557664 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff2c05d760 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.423+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065d0d6a0 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff45a3f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff45a3f800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T09:21:49.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff45a3f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94903305557664 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x565065d09570 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== watch-notify(notify (1) cookie 94903305285872 notify 115964116994 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7eff2c05d760 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7efe26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116994 cookie 94903305285872 notifier 4355 bl.length()=166 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7efe26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7efe26ffd640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7efe26ffd640 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7efe08003ea0 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.424+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(68 notify.0 [notify cookie 94903305557664 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.425+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== watch-notify(notify_complete (2) cookie 94903305557664 notify 115964116994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff2c05db50 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.425+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.434 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"Xx9DkqwNf1DZrExpvoTMKsGF32zX6A6hrcwzqFDB","active":true,"create_date":"2024-05-08T09:21:49.422363Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.425+0000 7efdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.426+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94903305305808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065d0cbd0 con 0x565065cbd140 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.426+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94903305305808] v27'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.426+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94903305285872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccfed0 con 0x7eff3400f070 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.427+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94903305285872] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.427+0000 7eff45a3f800 20 remove_watcher() i=0 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.427+0000 7eff45a3f800 2 removed watcher, disabling cache 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.427+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94903305289776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccb0f0 con 0x565065cbd140 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.428+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94903305289776] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.428+0000 7eff45a3f800 20 remove_watcher() i=1 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.429+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94903305292464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccb0f0 con 0x565065cc64c0 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff4353e640 1 -- 172.21.15.161:0/3969579602 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94903305292464] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3402e070 con 0x565065cc64c0 2024-05-08T09:21:49.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff45a3f800 20 remove_watcher() i=2 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94903305297424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cccab0 con 0x7eff3400f070 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94903305297424] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x7eff3400f070 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff45a3f800 20 remove_watcher() i=3 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.430+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94903305301056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccde10 con 0x565065cbd140 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.431+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94903305301056] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff2c05a040 con 0x565065cbd140 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.431+0000 7eff45a3f800 20 remove_watcher() i=4 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.431+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94903305303680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cccab0 con 0x565065cc1af0 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.433+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94903305303680] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.433+0000 7eff45a3f800 20 remove_watcher() i=5 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.433+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94903305302112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065ccec40 con 0x565065cc1af0 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.434+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94903305302112] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.434+0000 7eff45a3f800 20 remove_watcher() i=6 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.434+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94903305308304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x565065cccab0 con 0x565065cc1af0 2024-05-08T09:21:49.441 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff43d3f640 1 -- 172.21.15.161:0/3969579602 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94903305308304] v27'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff3c056040 con 0x565065cc1af0 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 20 remove_watcher() i=7 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065cc1af0 msgr2=0x565065cc3ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065cc1af0 0x565065cc3ee0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065cbd140 msgr2=0x565065cbf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065cbd140 0x565065cbf600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7eff3400f070 msgr2=0x7eff34019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7eff3400f070 0x7eff34019840 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x565065cc64c0 msgr2=0x565065cc8980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x565065cc64c0 0x565065cc8980 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe0c036af0 msgr2=0x7efe0c038fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe0c036af0 0x7efe0c038fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff340178f0 tx=0x7eff34035000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 msgr2=0x565065cb1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff42d3d640 1 -- 172.21.15.161:0/3969579602 reap_dead start 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.435+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7eff3c011740 tx=0x7eff3c04c830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 shutdown_connections 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/3969579602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065ca9e80 0x565065cb1490 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 >> 172.21.15.161:0/3969579602 conn(0x565065ca61e0 msgr2=0x565065ca3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 shutdown_connections 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/3969579602 wait complete. 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 msgr2=0x7efe1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 0x7efe1c038e10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x565065c89100 tx=0x7eff3404b320 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 msgr2=0x565065c9d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x565065c89060 tx=0x7eff3c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 shutdown_connections 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe1c036950 0x7efe1c038e10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1052877152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065c9cc00 0x565065c9d020 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 >> 172.21.15.161:0/1052877152 conn(0x565065c90ca0 msgr2=0x565065c910a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 shutdown_connections 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1052877152 wait complete. 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 msgr2=0x565065c8d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 0x565065c8d3a0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 msgr2=0x565065c886d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 0x565065c886d0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 msgr2=0x7efe28038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 0x7efe28038e10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7eff2c054000 tx=0x7eff2c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 msgr2=0x565065c81490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7eff34001ed0 tx=0x7eff34000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 shutdown_connections 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x565065c8afb0 0x565065c8d3a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x565065b86550 0x565065c886d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efe28036950 0x7efe28038e10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 --2- 172.21.15.161:0/1633675850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x565065b84a10 0x565065c81490 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.436+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 >> 172.21.15.161:0/1633675850 conn(0x565065b805b0 msgr2=0x565065c73a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.437+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 shutdown_connections 2024-05-08T09:21:49.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.437+0000 7eff45a3f800 1 -- 172.21.15.161:0/1633675850 wait complete. 2024-05-08T09:21:49.446 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'Xx9DkqwNf1DZrExpvoTMKsGF32zX6A6hrcwzqFDB', 'active': True, 'create_date': '2024-05-08T09:21:49.422363Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.446 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T09:21:49.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-05-08T09:21:49.446 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-05-08T09:21:49.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.495+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.495+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f202b010800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c601b88ff0 0x55c601b89410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f202b010800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c601b89a90 con 0x55c601b8a250 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f202b010800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55c601a1b050 con 0x55c601b88ff0 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f20265ee640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c601b88ff0 0x55c601b89410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f20265ee640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c601b88ff0 0x55c601b89410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52386/0 (socket says 172.21.15.161:52386) 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f20265ee640 1 -- 172.21.15.161:0/2117655904 learned_addr learned my addr 172.21.15.161:0/2117655904 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f201ffff640 1 --1- 172.21.15.161:0/2117655904 >> v1:172.21.15.45:6789/0 conn(0x55c601b8a250 0x55c601b8a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42826/0 (socket says 172.21.15.161:42826) 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f20265ee640 1 -- 172.21.15.161:0/2117655904 >> v1:172.21.15.45:6789/0 conn(0x55c601b8a250 legacy=0x55c601b8a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.496+0000 7f20265ee640 1 -- 172.21.15.161:0/2117655904 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601b8ae10 con 0x55c601b88ff0 2024-05-08T09:21:49.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.498+0000 7f20265ee640 1 --2- 172.21.15.161:0/2117655904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601b89410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f201800a520 tx=0x7f201801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399b58cb255a575 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.498+0000 7f2025ded640 1 -- 172.21.15.161:0/2117655904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018057070 con 0x55c601b88ff0 2024-05-08T09:21:49.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.498+0000 7f2025ded640 1 -- 172.21.15.161:0/2117655904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018052570 con 0x55c601b88ff0 2024-05-08T09:21:49.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.498+0000 7f2025ded640 1 -- 172.21.15.161:0/2117655904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018052870 con 0x55c601b88ff0 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 -- 172.21.15.161:0/2117655904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 msgr2=0x55c601b89410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 --2- 172.21.15.161:0/2117655904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601b89410 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f201800a520 tx=0x7f201801d010 comp rx=0 tx=0).stop 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 -- 172.21.15.161:0/2117655904 shutdown_connections 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 --2- 172.21.15.161:0/2117655904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601b89410 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 -- 172.21.15.161:0/2117655904 >> 172.21.15.161:0/2117655904 conn(0x55c601b845d0 msgr2=0x55c601b869f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 -- 172.21.15.161:0/2117655904 shutdown_connections 2024-05-08T09:21:49.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.499+0000 7f202b010800 1 -- 172.21.15.161:0/2117655904 wait complete. 2024-05-08T09:21:49.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.512+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f202b010800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f202b010800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c601ad51f0 con 0x55c601b88ff0 2024-05-08T09:21:49.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f20265ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f20265ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52400/0 (socket says 172.21.15.161:52400) 2024-05-08T09:21:49.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f20265ee640 1 -- 172.21.15.161:0/180562856 learned_addr learned my addr 172.21.15.161:0/180562856 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f20265ee640 1 -- 172.21.15.161:0/180562856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601c7ada0 con 0x55c601b88ff0 2024-05-08T09:21:49.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.513+0000 7f20265ee640 1 --2- 172.21.15.161:0/180562856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2018055040 tx=0x7f201804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c7b933c1849e24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f1f14608640 1 -- 172.21.15.161:0/180562856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018057040 con 0x55c601b88ff0 2024-05-08T09:21:49.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f1f14608640 1 -- 172.21.15.161:0/180562856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2018052850 con 0x55c601b88ff0 2024-05-08T09:21:49.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f1f14608640 1 -- 172.21.15.161:0/180562856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018052b50 con 0x55c601b88ff0 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 -- 172.21.15.161:0/180562856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 msgr2=0x55c601c7a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 --2- 172.21.15.161:0/180562856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2018055040 tx=0x7f201804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 -- 172.21.15.161:0/180562856 shutdown_connections 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 --2- 172.21.15.161:0/180562856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601c7a7d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 -- 172.21.15.161:0/180562856 >> 172.21.15.161:0/180562856 conn(0x55c601b845d0 msgr2=0x55c601c760f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 -- 172.21.15.161:0/180562856 shutdown_connections 2024-05-08T09:21:49.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.514+0000 7f202b010800 1 -- 172.21.15.161:0/180562856 wait complete. 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.515+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.515+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.515+0000 7f202b010800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.515+0000 7f202b010800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c601b92720 con 0x55c601b88ff0 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.516+0000 7f20265ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.516+0000 7f20265ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52406/0 (socket says 172.21.15.161:52406) 2024-05-08T09:21:49.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.516+0000 7f20265ee640 1 -- 172.21.15.161:0/3163511312 learned_addr learned my addr 172.21.15.161:0/3163511312 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.517+0000 7f20265ee640 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601c85fa0 con 0x55c601b88ff0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f20265ee640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f201800a520 tx=0x7f2018003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f1f12e05640 1 -- 172.21.15.161:0/3163511312 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018073070 con 0x55c601b88ff0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f1f12e05640 1 -- 172.21.15.161:0/3163511312 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f201805d570 con 0x55c601b88ff0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c601c86170 con 0x55c601b88ff0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f1f12e05640 1 -- 172.21.15.161:0/3163511312 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2018057070 con 0x55c601b88ff0 2024-05-08T09:21:49.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.518+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c601c86690 con 0x55c601b88ff0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f1f12e05640 1 -- 172.21.15.161:0/3163511312 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2018076070 con 0x55c601b88ff0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f1f12e05640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 0x7f1f0c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f1f12e05640 1 -- 172.21.15.161:0/3163511312 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f201808dd00 con 0x55c601b88ff0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f201ffff640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 0x7f1f0c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 0x55c601c8a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.519+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601c8aa80 con 0x55c601b8a250 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f2026def640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 0x55c601c8a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f201ffff640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 0x7f1f0c038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2010000f60 tx=0x7f2010001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f2026def640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 0x55c601c8a4b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f2026def640 1 -- 172.21.15.161:0/3163511312 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f202000a4a0 con 0x55c601b8a250 2024-05-08T09:21:49.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601c87a80 con 0x55c601b8a250 2024-05-08T09:21:49.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.520+0000 7f2026def640 1 -- 172.21.15.161:0/3163511312 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f202000a4a0 con 0x55c601b8a250 2024-05-08T09:21:49.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 0x55c601c8f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601c8f840 con 0x55c601c8cdb0 2024-05-08T09:21:49.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f20265ee640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 0x55c601c8f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f20265ee640 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 0x55c601c8f1a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f20265ee640 1 -- 172.21.15.161:0/3163511312 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2018075030 con 0x55c601c8cdb0 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.521+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601c8bd60 con 0x55c601b8a250 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f2026def640 1 -- 172.21.15.161:0/3163511312 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f202000a4a0 con 0x55c601b8a250 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601c8c240 con 0x55c601b8a250 2024-05-08T09:21:49.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f2026def640 1 -- 172.21.15.161:0/3163511312 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f202000a4a0 con 0x55c601b8a250 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f202b010800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.522+0000 7f202b010800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c601a7bcf0 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52418/0 (socket says 172.21.15.161:52418) 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f2026def640 1 -- 172.21.15.161:0/1273281237 learned_addr learned my addr 172.21.15.161:0/1273281237 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f2026def640 1 -- 172.21.15.161:0/1273281237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601c9f350 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f2026def640 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55c601afc890 tx=0x7f20200188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f1f0bfff640 1 -- 172.21.15.161:0/1273281237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2020014450 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f1f0bfff640 1 -- 172.21.15.161:0/1273281237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20200145f0 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c601c9fdc0 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f1f0bfff640 1 -- 172.21.15.161:0/1273281237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20200148d0 con 0x55c601c9e9f0 2024-05-08T09:21:49.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.523+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c601ca02c0 con 0x55c601c9e9f0 2024-05-08T09:21:49.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.524+0000 7f1f0bfff640 1 -- 172.21.15.161:0/1273281237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2020011040 con 0x55c601c9e9f0 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.524+0000 7f1f0bfff640 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 0x7f1f00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.524+0000 7f1f0bfff640 1 -- 172.21.15.161:0/1273281237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f202001e070 con 0x55c601c9e9f0 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.524+0000 7f20265ee640 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 0x7f1f00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f20265ee640 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 0x7f1f00038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55c601c8aed0 tx=0x7f2018006990 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f202b010800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f202b010800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c601c7b060 con 0x55c601c83600 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52426/0 (socket says 172.21.15.161:52426) 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f2026def640 1 -- 172.21.15.161:0/3757668937 learned_addr learned my addr 172.21.15.161:0/3757668937 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.525+0000 7f2026def640 1 -- 172.21.15.161:0/3757668937 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601c81e10 con 0x55c601c83600 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f2026def640 1 --2- 172.21.15.161:0/3757668937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f202004c8c0 tx=0x7f2020011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16399f3d6924d8ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f1f09ffb640 1 -- 172.21.15.161:0/3757668937 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f202004e0d0 con 0x55c601c83600 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f1f09ffb640 1 -- 172.21.15.161:0/3757668937 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202004e270 con 0x55c601c83600 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f1f09ffb640 1 -- 172.21.15.161:0/3757668937 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f202004b330 con 0x55c601c83600 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- 172.21.15.161:0/3757668937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 msgr2=0x55c601c83a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 --2- 172.21.15.161:0/3757668937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f202004c8c0 tx=0x7f2020011700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- 172.21.15.161:0/3757668937 shutdown_connections 2024-05-08T09:21:49.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 --2- 172.21.15.161:0/3757668937 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601c83a20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- 172.21.15.161:0/3757668937 >> 172.21.15.161:0/3757668937 conn(0x55c601ca8030 msgr2=0x55c601ca6090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- 172.21.15.161:0/3757668937 shutdown_connections 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- 172.21.15.161:0/3757668937 wait complete. 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 Processor -- start 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.526+0000 7f202b010800 1 -- start start 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f202b010800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f202b010800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c601c82310 con 0x55c601c83600 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f2026def640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52438/0 (socket says 172.21.15.161:52438) 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 learned_addr learned my addr 172.21.15.161:0/1191672519 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c601cb5aa0 con 0x55c601c83600 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f2026def640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2020040040 tx=0x7f202004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f1ef7fff640 1 -- 172.21.15.161:0/1191672519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f202004e0d0 con 0x55c601c83600 2024-05-08T09:21:49.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f1ef7fff640 1 -- 172.21.15.161:0/1191672519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202003be00 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f1ef7fff640 1 -- 172.21.15.161:0/1191672519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2020022a80 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c601cb5d30 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.527+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c601cb89e0 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.528+0000 7f1ef7fff640 1 -- 172.21.15.161:0/1191672519 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f202002b350 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f1ef7fff640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ef0036900 0x7f1ef0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f1ef7fff640 1 -- 172.21.15.161:0/1191672519 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f202000e040 con 0x55c601c83600 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f20265ee640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ef0036900 0x7f1ef0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f20265ee640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ef0036900 0x7f1ef0038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2018006a60 tx=0x7f2018093000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601cc0f60 0x55c601cc3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc3b70 con 0x55c601cc0f60 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.529+0000 7f201ffff640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601cc0f60 0x55c601cc3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f201ffff640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601cc0f60 0x55c601cc3420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201000f610 con 0x55c601cc0f60 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 realm 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc03b0 con 0x55c601cc0f60 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201000f610 con 0x55c601cc0f60 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc4660 con 0x55c601cc0f60 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201000f610 con 0x55c601cc0f60 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc4f30 con 0x55c601cc0f60 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f201000f610 con 0x55c601cc0f60 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.530+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601cc5950 0x55c601cc7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc8430 con 0x55c601cc5950 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f2026def640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601cc5950 0x55c601cc7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f2026def640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601cc5950 0x55c601cc7d40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 20 searching for the correct realm 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c601cca400 0x55c601ccc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.531+0000 7f20265ee640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c601cca400 0x55c601ccc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.532+0000 7f20265ee640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c601cca400 0x55c601ccc8c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.532+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.532+0000 7f20265ee640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20180a7040 0x7f201805d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.532+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.532+0000 7f201ffff640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20180a7040 0x7f201805d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.533+0000 7f201ffff640 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20180a7040 0x7f201805d850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.533+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201000f610 con 0x7f20180a7040 2024-05-08T09:21:49.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.533+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.533+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.533+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201000f610 con 0x55c601cc0f60 2024-05-08T09:21:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x7f20180a7040 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.534+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.535+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f201002b040 con 0x7f20180a7040 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.536+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.537+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x7f20180a7040 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.538+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.539+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x7f20180a7040 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cca400 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc5950 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.540+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x55c601cc0f60 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c601cccf90 con 0x7f20180a7040 2024-05-08T09:21:49.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f201002b040 con 0x7f20180a7040 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc8df0 con 0x55c601cc0f60 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f201002b040 con 0x55c601cc0f60 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc8a00 con 0x55c601cc0f60 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.541+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cc9760 con 0x55c601cc0f60 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 zone default found 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 4 Realm: () 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 zonegroup default 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601ccd410 con 0x55c601cc5950 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601ccf6c0 con 0x55c601cca400 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601ccfa60 con 0x55c601cca400 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.542+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.543+0000 7f202b010800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.543+0000 7f202b010800 20 started sync module instance, tier type = 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.543+0000 7f202b010800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.543+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cceb50 con 0x7f20180a7040 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.544+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.544+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94308922093696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cceb50 con 0x7f20180a7040 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.544+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd04b0 con 0x55c601cc0f60 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.545+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94308922093696] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.545+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.545+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94308922097600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cceb50 con 0x55c601cc0f60 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.545+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd0f00 con 0x55c601cca400 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.546+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94308922097600] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.546+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.546+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94308922091168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cceac0 con 0x55c601cca400 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.546+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd1cc0 con 0x7f20180a7040 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.547+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.547+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94308922103760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd2560 con 0x7f20180a7040 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.547+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd3000 con 0x55c601cc0f60 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.548+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94308922091168] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.548+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.548+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94308922108656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd2fc0 con 0x55c601cc0f60 2024-05-08T09:21:49.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.548+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd3a20 con 0x55c601cc5950 2024-05-08T09:21:49.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.548+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94308922103760] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.549+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94308922108656] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.550+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.550+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94308922102560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd2040 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.550+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4430 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.551+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94308922102560] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.551+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.551+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94308922111232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4430 con 0x55c601cc5950 2024-05-08T09:21:49.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.551+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4ce0 con 0x55c601cc5950 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94308922115120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd5390 con 0x55c601cc5950 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=0 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=1 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=2 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=3 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=4 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=5 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94308922111232] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=6 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94308922115120] v27'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 20 add_watcher() i=7 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.552+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd8290 con 0x55c601cc0f60 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.553+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.553+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94308922117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd5680 con 0x55c601cc0f60 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94308922117552] v27'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f1edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f202b010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f202b010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f202b010800 5 note: GC not initialized 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f1e577fe640 20 reqs_thread_entry: start 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f202b010800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.554+0000 7f202b010800 20 Filter name: none 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f1e557fa640 20 reqs_thread_entry: start 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601d0b6e0 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.555+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601d11b70 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.556+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.556+0000 7f202b010800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.556+0000 7f202b010800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.556+0000 7f202b010800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.556+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94308922365408 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c601d106c0 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94308922108656 notify 115964116998 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f2010018040 con 0x55c601cc0f60 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f1f09ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94308922108656 notifier 4362 bl.length()=732 2024-05-08T09:21:49.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f1f09ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f1f09ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f1f09ffb640 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1eec003ea0 con 0x55c601cc0f60 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94308922365408 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.557+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94308922365408 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2010009050 con 0x55c601cc0f60 2024-05-08T09:21:49.565 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.558+0000 7f1edcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.558+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94308922117552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601d10210 con 0x55c601cc0f60 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.559+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94308922117552] v27'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.559+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94308922093696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4db0 con 0x7f20180a7040 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.560+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94308922093696] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.560+0000 7f202b010800 20 remove_watcher() i=0 2024-05-08T09:21:49.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.560+0000 7f202b010800 2 removed watcher, disabling cache 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.560+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94308922097600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4db0 con 0x55c601cc0f60 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.561+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94308922097600] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.561+0000 7f202b010800 20 remove_watcher() i=1 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.561+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94308922091168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd4db0 con 0x55c601cca400 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.562+0000 7f20265ee640 1 -- 172.21.15.161:0/1191672519 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94308922091168] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2018075030 con 0x55c601cca400 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.562+0000 7f202b010800 20 remove_watcher() i=2 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.562+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94308922103760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cce6a0 con 0x7f20180a7040 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.563+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94308922103760] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x7f20180a7040 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.563+0000 7f202b010800 20 remove_watcher() i=3 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.563+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94308922108656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cce6a0 con 0x55c601cc0f60 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.564+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94308922108656] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f201003d040 con 0x55c601cc0f60 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.564+0000 7f202b010800 20 remove_watcher() i=4 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.564+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94308922102560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd2af0 con 0x55c601cc5950 2024-05-08T09:21:49.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.565+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94308922102560] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.565+0000 7f202b010800 20 remove_watcher() i=5 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.565+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94308922111232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cce6a0 con 0x55c601cc5950 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.566+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94308922111232] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.566+0000 7f202b010800 20 remove_watcher() i=6 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.566+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94308922115120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c601cd2af0 con 0x55c601cc5950 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f2026def640 1 -- 172.21.15.161:0/1191672519 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94308922115120] v27'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f202002a070 con 0x55c601cc5950 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 20 remove_watcher() i=7 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601cc5950 msgr2=0x55c601cc7d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601cc5950 0x55c601cc7d40 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601cc0f60 msgr2=0x55c601cc3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601cc0f60 0x55c601cc3420 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20180a7040 msgr2=0x7f201805d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20180a7040 0x7f201805d850 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c601cca400 msgr2=0x55c601ccc8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c601cca400 0x55c601ccc8c0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ef0036900 msgr2=0x7f1ef0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1ef0036900 0x7f1ef0038dc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2018006a60 tx=0x7f2018093000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 msgr2=0x55c601cb5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f201ffff640 1 -- 172.21.15.161:0/1191672519 reap_dead start 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2020040040 tx=0x7f202004c820 comp rx=0 tx=0).stop 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 shutdown_connections 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 --2- 172.21.15.161:0/1191672519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c83600 0x55c601cb5560 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.567+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 >> 172.21.15.161:0/1191672519 conn(0x55c601ca8030 msgr2=0x55c601ca5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 shutdown_connections 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1191672519 wait complete. 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 msgr2=0x7f1f00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 0x7f1f00038e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55c601c8aed0 tx=0x7f2018006990 comp rx=0 tx=0).stop 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 msgr2=0x55c601c9ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55c601afc890 tx=0x7f20200188f0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 shutdown_connections 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f00036950 0x7f1f00038e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/1273281237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601c9e9f0 0x55c601c9ee10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 >> 172.21.15.161:0/1273281237 conn(0x55c601c92a90 msgr2=0x55c601c92e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 shutdown_connections 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/1273281237 wait complete. 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 msgr2=0x55c601c8f1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 0x55c601c8f1a0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 msgr2=0x55c601c8a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 0x55c601c8a4b0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 msgr2=0x7f1f0c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 0x7f1f0c038e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2010000f60 tx=0x7f2010001370 comp rx=0 tx=0).stop 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 msgr2=0x55c601afcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f201800a520 tx=0x7f2018003020 comp rx=0 tx=0).stop 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 shutdown_connections 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c601c8cdb0 0x55c601c8f1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c601b8a250 0x55c601c8a4b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f0c036950 0x7f1f0c038e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 --2- 172.21.15.161:0/3163511312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c601b88ff0 0x55c601afcea0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 >> 172.21.15.161:0/3163511312 conn(0x55c601b845d0 msgr2=0x55c601c748f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 shutdown_connections 2024-05-08T09:21:49.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.568+0000 7f202b010800 1 -- 172.21.15.161:0/3163511312 wait complete. 2024-05-08T09:21:49.577 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.577 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.578 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:49.621 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.622 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41ed31800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5587bacc6460 0x5587bacc8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41ed31800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5587bacc8e20 con 0x5587bacc1fd0 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41ed31800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5587bab54050 con 0x5587bacc6460 2024-05-08T09:21:49.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.623+0000 7fc41a22e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5587bacc6460 0x5587bacc8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.624+0000 7fc41a22e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5587bacc6460 0x5587bacc8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52454/0 (socket says 172.21.15.161:52454) 2024-05-08T09:21:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.624+0000 7fc41a22e640 1 -- 172.21.15.161:0/2358590987 learned_addr learned my addr 172.21.15.161:0/2358590987 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.624+0000 7fc41aa2f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5587bacc1fd0 0x5587bacc23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42828/0 (socket says 172.21.15.161:42828) 2024-05-08T09:21:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.624+0000 7fc41a22e640 1 -- 172.21.15.161:0/2358590987 >> v1:172.21.15.45:6789/0 conn(0x5587bacc1fd0 legacy=0x5587bacc23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.624+0000 7fc41a22e640 1 -- 172.21.15.161:0/2358590987 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587bacca050 con 0x5587bacc6460 2024-05-08T09:21:49.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41a22e640 1 --2- 172.21.15.161:0/2358590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc6460 0x5587bacc8850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc41000a6b0 tx=0x7fc41001eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc010755df0feee5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc419a2d640 1 -- 172.21.15.161:0/2358590987 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc410059070 con 0x5587bacc6460 2024-05-08T09:21:49.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc419a2d640 1 -- 172.21.15.161:0/2358590987 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc410050050 con 0x5587bacc6460 2024-05-08T09:21:49.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc419a2d640 1 -- 172.21.15.161:0/2358590987 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc41000a350 con 0x5587bacc6460 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 -- 172.21.15.161:0/2358590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc6460 msgr2=0x5587bacc8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 --2- 172.21.15.161:0/2358590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc6460 0x5587bacc8850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc41000a6b0 tx=0x7fc41001eed0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 -- 172.21.15.161:0/2358590987 shutdown_connections 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 --2- 172.21.15.161:0/2358590987 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc6460 0x5587bacc8850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 -- 172.21.15.161:0/2358590987 >> 172.21.15.161:0/2358590987 conn(0x5587bacbd5b0 msgr2=0x5587bacbf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 -- 172.21.15.161:0/2358590987 shutdown_connections 2024-05-08T09:21:49.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.626+0000 7fc41ed31800 1 -- 172.21.15.161:0/2358590987 wait complete. 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.640+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.640+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.640+0000 7fc41ed31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.640+0000 7fc41ed31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587bac0e1d0 con 0x5587bacc1fd0 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.640+0000 7fc41aa2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc41aa2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52468/0 (socket says 172.21.15.161:52468) 2024-05-08T09:21:49.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc41aa2f640 1 -- 172.21.15.161:0/792849182 learned_addr learned my addr 172.21.15.161:0/792849182 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc41aa2f640 1 -- 172.21.15.161:0/792849182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587badb2ae0 con 0x5587bacc1fd0 2024-05-08T09:21:49.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/792849182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00b230 tx=0x7fc40c00b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaaf4b1cea5a7ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc308e09640 1 -- 172.21.15.161:0/792849182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c00e5c0 con 0x5587bacc1fd0 2024-05-08T09:21:49.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc308e09640 1 -- 172.21.15.161:0/792849182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c006070 con 0x5587bacc1fd0 2024-05-08T09:21:49.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.641+0000 7fc308e09640 1 -- 172.21.15.161:0/792849182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c00e890 con 0x5587bacc1fd0 2024-05-08T09:21:49.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- 172.21.15.161:0/792849182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 msgr2=0x5587badb2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 --2- 172.21.15.161:0/792849182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00b230 tx=0x7fc40c00b6f0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- 172.21.15.161:0/792849182 shutdown_connections 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 --2- 172.21.15.161:0/792849182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badb2510 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- 172.21.15.161:0/792849182 >> 172.21.15.161:0/792849182 conn(0x5587bacbd5b0 msgr2=0x5587badade30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- 172.21.15.161:0/792849182 shutdown_connections 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- 172.21.15.161:0/792849182 wait complete. 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.642+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.643+0000 7fc41ed31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.643+0000 7fc41ed31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587bacc92f0 con 0x5587bacc1fd0 2024-05-08T09:21:49.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.644+0000 7fc41aa2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.644+0000 7fc41aa2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52478/0 (socket says 172.21.15.161:52478) 2024-05-08T09:21:49.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.644+0000 7fc41aa2f640 1 -- 172.21.15.161:0/3084032732 learned_addr learned my addr 172.21.15.161:0/3084032732 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.644+0000 7fc41aa2f640 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587badba660 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.644+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc40c000fd0 tx=0x7fc40c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc307606640 1 -- 172.21.15.161:0/3084032732 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c00f8d0 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc307606640 1 -- 172.21.15.161:0/3084032732 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40c00fa90 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587badba8f0 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc307606640 1 -- 172.21.15.161:0/3084032732 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc40c00fdb0 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587badbd550 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.645+0000 7fc307606640 1 -- 172.21.15.161:0/3084032732 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc40c017070 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc307606640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 0x7fc300038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc307606640 1 -- 172.21.15.161:0/3084032732 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc40c015020 con 0x5587bacc1fd0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41a22e640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 0x7fc300038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 0x5587badc1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badc1890 con 0x5587bacc6460 2024-05-08T09:21:49.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41b230640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 0x5587badc1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41a22e640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 0x7fc300038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc410056000 tx=0x7fc41000a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.646+0000 7fc41b230640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 0x5587badc1310 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41b230640 1 -- 172.21.15.161:0/3084032732 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc41400a4a0 con 0x5587bacc6460 2024-05-08T09:21:49.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badbe8e0 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41b230640 1 -- 172.21.15.161:0/3084032732 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc41400a4a0 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 0x5587badc5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badc66a0 con 0x5587badc3bc0 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 0x5587badc5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.647+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 0x5587badc5fb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.648+0000 7fc41aa2f640 1 -- 172.21.15.161:0/3084032732 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badc3bc0 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.648+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badc2b40 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.648+0000 7fc41b230640 1 -- 172.21.15.161:0/3084032732 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc41400a4a0 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.648+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badc3020 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.648+0000 7fc41b230640 1 -- 172.21.15.161:0/3084032732 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc41400a4a0 con 0x5587bacc6460 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41ed31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41ed31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587babb4cf0 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52480/0 (socket says 172.21.15.161:52480) 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.649+0000 7fc41b230640 1 -- 172.21.15.161:0/3258031808 learned_addr learned my addr 172.21.15.161:0/3258031808 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc41b230640 1 -- 172.21.15.161:0/3258031808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587badd60c0 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc41b230640 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5587badc1c70 tx=0x7fc414018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc304e01640 1 -- 172.21.15.161:0/3258031808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc414014450 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc304e01640 1 -- 172.21.15.161:0/3258031808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414014610 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587badd6b30 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc304e01640 1 -- 172.21.15.161:0/3258031808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc414014930 con 0x5587badd5760 2024-05-08T09:21:49.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.650+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587badd7030 con 0x5587badd5760 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc304e01640 1 -- 172.21.15.161:0/3258031808 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc414011040 con 0x5587badd5760 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc304e01640 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 0x7fc2f4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc304e01640 1 -- 172.21.15.161:0/3258031808 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc41401e070 con 0x5587badd5760 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 0x7fc2f4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 0x7fc2f4038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc40c017930 tx=0x7fc40c04b350 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.651+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41ed31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41ed31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587badb2e60 con 0x5587bade2aa0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52496/0 (socket says 172.21.15.161:52496) 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41b230640 1 -- 172.21.15.161:0/1061492557 learned_addr learned my addr 172.21.15.161:0/1061492557 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41b230640 1 -- 172.21.15.161:0/1061492557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587bade3490 con 0x5587bade2aa0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc41b230640 1 --2- 172.21.15.161:0/1061492557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc41404c8a0 tx=0x7fc414011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f1074aa468fb3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc2fe7fc640 1 -- 172.21.15.161:0/1061492557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4140168f0 con 0x5587bade2aa0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc2fe7fc640 1 -- 172.21.15.161:0/1061492557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc414013ca0 con 0x5587bade2aa0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.652+0000 7fc2fe7fc640 1 -- 172.21.15.161:0/1061492557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc414014ad0 con 0x5587bade2aa0 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- 172.21.15.161:0/1061492557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 msgr2=0x5587bade2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1061492557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc41404c8a0 tx=0x7fc414011700 comp rx=0 tx=0).stop 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- 172.21.15.161:0/1061492557 shutdown_connections 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1061492557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587bade2ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- 172.21.15.161:0/1061492557 >> 172.21.15.161:0/1061492557 conn(0x5587badded20 msgr2=0x5587baddcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- 172.21.15.161:0/1061492557 shutdown_connections 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- 172.21.15.161:0/1061492557 wait complete. 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 Processor -- start 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- start start 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41ed31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5587bade3bc0 con 0x5587bade2aa0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41b230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52510/0 (socket says 172.21.15.161:52510) 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.653+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 learned_addr learned my addr 172.21.15.161:0/1755492056 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587badea560 con 0x5587bade2aa0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc41b230640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc41404b7c0 tx=0x7fc41404c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc2fcff9640 1 -- 172.21.15.161:0/1755492056 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc41404e2e0 con 0x5587bade2aa0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc2fcff9640 1 -- 172.21.15.161:0/1755492056 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc41404b1d0 con 0x5587bade2aa0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587badea7f0 con 0x5587bade2aa0 2024-05-08T09:21:49.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc2fcff9640 1 -- 172.21.15.161:0/1755492056 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc41404b4f0 con 0x5587bade2aa0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.654+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587baded4a0 con 0x5587bade2aa0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc2fcff9640 1 -- 172.21.15.161:0/1755492056 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc414022a50 con 0x5587bade2aa0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc2fcff9640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2e4036900 0x7fc2e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc2fcff9640 1 -- 172.21.15.161:0/1755492056 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc414046040 con 0x5587bade2aa0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2e4036900 0x7fc2e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587badf5c80 0x5587badf8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badf8890 con 0x5587badf5c80 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41a22e640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587badf5c80 0x5587badf8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.655+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2e4036900 0x7fc2e4038dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc40c04b6e0 tx=0x7fc40c035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41a22e640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587badf5c80 0x5587badf8140 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 realm 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badf8cc0 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badf9590 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.656+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badf9930 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.657+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.657+0000 7fc41ed31800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.657+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.657+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badfa690 0x5587badfca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.657+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfcfc0 con 0x5587badfa690 2024-05-08T09:21:49.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.658+0000 7fc41b230640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badfa690 0x5587badfca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41b230640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badfa690 0x5587badfca80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41ed31800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41ed31800 20 searching for the correct realm 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5587badff0a0 0x5587bae01560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5587badff0a0 0x5587bae01560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.659+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5587badff0a0 0x5587bae01560 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41aa2f640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc40c00f070 0x7fc40c04b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41a22e640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc40c00f070 0x7fc40c04b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41a22e640 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc40c00f070 0x7fc40c04b7d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.660+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.661+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.662+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.663+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.664+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.665+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.666+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.667+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badff0a0 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badfa690 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.668+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x5587badf5c80 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5587bae01c30 con 0x7fc40c00f070 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfe5c0 con 0x5587badf5c80 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfd960 con 0x5587badf5c80 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.669+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfd450 con 0x5587badf5c80 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 zone default found 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 4 Realm: () 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 zonegroup default 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfd880 con 0x5587badfa690 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587badfde40 con 0x5587badff0a0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.670+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587bae03fc0 con 0x5587badff0a0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.671+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.671+0000 7fc41ed31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.671+0000 7fc41ed31800 20 started sync module instance, tier type = 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.671+0000 7fc41ed31800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.671+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae033d0 con 0x7fc40c00f070 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.672+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.672+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94041444202736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae033d0 con 0x7fc40c00f070 2024-05-08T09:21:49.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.672+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae04b20 con 0x5587badf5c80 2024-05-08T09:21:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.672+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94041444202736] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.673+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.673+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94041444206064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae033d0 con 0x5587badf5c80 2024-05-08T09:21:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.673+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae05530 con 0x5587badff0a0 2024-05-08T09:21:49.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.674+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94041444206064] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.674+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.674+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94041444200224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae03340 con 0x5587badff0a0 2024-05-08T09:21:49.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.674+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae06420 con 0x7fc40c00f070 2024-05-08T09:21:49.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.675+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94041444200224] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.675+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.675+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94041444212592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae06840 con 0x7fc40c00f070 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.675+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae07200 con 0x5587badf5c80 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.676+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.676+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94041444216144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae07170 con 0x5587badf5c80 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.676+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae081a0 con 0x5587badfa690 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.676+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94041444212592] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.677+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.677+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94041444220016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae08590 con 0x5587badfa690 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.677+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae08fb0 con 0x5587badfa690 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.677+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94041444216144] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.678+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94041444220016] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.678+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.678+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94041444213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae075f0 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.678+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae09590 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94041444225248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae099b0 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=0 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=1 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=2 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=3 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=4 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=5 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94041444213648] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.679+0000 7fc41ed31800 20 add_watcher() i=6 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.680+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94041444225248] v27'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.680+0000 7fc41ed31800 20 add_watcher() i=7 2024-05-08T09:21:49.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.680+0000 7fc41ed31800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.680+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587bae08aa0 con 0x5587badf5c80 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.680+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.681+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94041444226304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae08aa0 con 0x5587badf5c80 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.681+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94041444226304] v27'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc2d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 5 note: GC not initialized 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc24bfff640 20 reqs_thread_entry: start 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 20 Filter name: none 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc249ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:49.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.682+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5587bae3f890 con 0x5587badf5c80 2024-05-08T09:21:49.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.683+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.683+0000 7fc41ed31800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T09:21:49.690 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.683+0000 7fc2d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.683+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94041444226304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae3e440 con 0x5587badf5c80 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.684+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94041444226304] v27'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.684+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94041444202736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae09500 con 0x7fc40c00f070 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.685+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94041444202736] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.685+0000 7fc41ed31800 20 remove_watcher() i=0 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.685+0000 7fc41ed31800 2 removed watcher, disabling cache 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.685+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94041444206064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae09500 con 0x5587badf5c80 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.686+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94041444206064] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.686+0000 7fc41ed31800 20 remove_watcher() i=1 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.686+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94041444200224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae045f0 con 0x5587badff0a0 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.687+0000 7fc41aa2f640 1 -- 172.21.15.161:0/1755492056 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94041444200224] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc40c02e070 con 0x5587badff0a0 2024-05-08T09:21:49.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.687+0000 7fc41ed31800 20 remove_watcher() i=2 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.687+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94041444212592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae09500 con 0x7fc40c00f070 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.688+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94041444212592] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x7fc40c00f070 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.688+0000 7fc41ed31800 20 remove_watcher() i=3 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.688+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94041444216144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae02f20 con 0x5587badf5c80 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.689+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94041444216144] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc41005c040 con 0x5587badf5c80 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.689+0000 7fc41ed31800 20 remove_watcher() i=4 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.689+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94041444220016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae05f70 con 0x5587badfa690 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.690+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94041444220016] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.690+0000 7fc41ed31800 20 remove_watcher() i=5 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.690+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94041444213648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae09500 con 0x5587badfa690 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.691+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94041444213648] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.691+0000 7fc41ed31800 20 remove_watcher() i=6 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.691+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94041444225248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5587bae06d50 con 0x5587badfa690 2024-05-08T09:21:49.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41b230640 1 -- 172.21.15.161:0/1755492056 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94041444225248] v27'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc414056040 con 0x5587badfa690 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 20 remove_watcher() i=7 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badfa690 msgr2=0x5587badfca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badfa690 0x5587badfca80 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587badf5c80 msgr2=0x5587badf8140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587badf5c80 0x5587badf8140 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc40c00f070 msgr2=0x7fc40c04b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc40c00f070 0x7fc40c04b7d0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5587badff0a0 msgr2=0x5587bae01560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5587badff0a0 0x5587bae01560 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2e4036900 msgr2=0x7fc2e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2e4036900 0x7fc2e4038dc0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc40c04b6e0 tx=0x7fc40c035000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41a22e640 1 -- 172.21.15.161:0/1755492056 reap_dead start 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 msgr2=0x5587badea020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc41404b7c0 tx=0x7fc41404c830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 shutdown_connections 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 --2- 172.21.15.161:0/1755492056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bade2aa0 0x5587badea020 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.692+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 >> 172.21.15.161:0/1755492056 conn(0x5587badded20 msgr2=0x5587baddc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 shutdown_connections 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/1755492056 wait complete. 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 msgr2=0x7fc2f4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 0x7fc2f4038e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc40c017930 tx=0x7fc40c04b350 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 msgr2=0x5587badd5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5587badc1c70 tx=0x7fc414018830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 shutdown_connections 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc2f4036950 0x7fc2f4038e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3258031808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587badd5760 0x5587badd5b80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 >> 172.21.15.161:0/3258031808 conn(0x5587badc9800 msgr2=0x5587badc9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 shutdown_connections 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3258031808 wait complete. 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 msgr2=0x5587badc5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 0x5587badc5fb0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 msgr2=0x5587badc1310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 0x5587badc1310 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 msgr2=0x7fc300038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 0x7fc300038e10 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc410056000 tx=0x7fc41000a000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 msgr2=0x5587badba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc40c000fd0 tx=0x7fc40c000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 shutdown_connections 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5587badc3bc0 0x5587badc5fb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5587bacc6460 0x5587badc1310 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc300036950 0x7fc300038e10 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.693+0000 7fc41ed31800 1 --2- 172.21.15.161:0/3084032732 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5587bacc1fd0 0x5587badba120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.694+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 >> 172.21.15.161:0/3084032732 conn(0x5587bacbd5b0 msgr2=0x5587badac630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.694+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 shutdown_connections 2024-05-08T09:21:49.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.694+0000 7fc41ed31800 1 -- 172.21.15.161:0/3084032732 wait complete. 2024-05-08T09:21:49.702 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.702 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.702 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:49.746 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.746 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5189a38800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b3beca1a00 0x55b3beca1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5189a38800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b3bec16a40 con 0x55b3beca2360 2024-05-08T09:21:49.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5189a38800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55b3beb34050 con 0x55b3beca1a00 2024-05-08T09:21:49.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5187537640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b3beca1a00 0x55b3beca1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f517ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55b3beca2360 0x55b3beca2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42842/0 (socket says 172.21.15.161:42842) 2024-05-08T09:21:49.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5187537640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b3beca1a00 0x55b3beca1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52520/0 (socket says 172.21.15.161:52520) 2024-05-08T09:21:49.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f517ffff640 1 -- 172.21.15.161:0/512268711 learned_addr learned my addr 172.21.15.161:0/512268711 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:49.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.748+0000 7f5187537640 1 -- 172.21.15.161:0/512268711 >> v1:172.21.15.45:6789/0 conn(0x55b3beca2360 legacy=0x55b3beca2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.749+0000 7f5187537640 1 -- 172.21.15.161:0/512268711 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3beca2f20 con 0x55b3beca1a00 2024-05-08T09:21:49.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.750+0000 7f5187537640 1 --2- 172.21.15.161:0/512268711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3beca1e20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f517800a470 tx=0x7f517801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7512e837044d053b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.750+0000 7f5186d36640 1 -- 172.21.15.161:0/512268711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178057070 con 0x55b3beca1a00 2024-05-08T09:21:49.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5186d36640 1 -- 172.21.15.161:0/512268711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178052570 con 0x55b3beca1a00 2024-05-08T09:21:49.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5186d36640 1 -- 172.21.15.161:0/512268711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178052870 con 0x55b3beca1a00 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 -- 172.21.15.161:0/512268711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 msgr2=0x55b3beca1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 --2- 172.21.15.161:0/512268711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3beca1e20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f517800a470 tx=0x7f517801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 -- 172.21.15.161:0/512268711 shutdown_connections 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 --2- 172.21.15.161:0/512268711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3beca1e20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 -- 172.21.15.161:0/512268711 >> 172.21.15.161:0/512268711 conn(0x55b3bec9d560 msgr2=0x55b3bec9f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 -- 172.21.15.161:0/512268711 shutdown_connections 2024-05-08T09:21:49.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.751+0000 7f5189a38800 1 -- 172.21.15.161:0/512268711 wait complete. 2024-05-08T09:21:49.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.764+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5189a38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5189a38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3bebee1d0 con 0x55b3beca1a00 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5187537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5187537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52530/0 (socket says 172.21.15.161:52530) 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5187537640 1 -- 172.21.15.161:0/803160864 learned_addr learned my addr 172.21.15.161:0/803160864 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.765+0000 7f5187537640 1 -- 172.21.15.161:0/803160864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bed970f0 con 0x55b3beca1a00 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f5187537640 1 --2- 172.21.15.161:0/803160864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5178055040 tx=0x7f517804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e581cbafc2c36cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f507560a640 1 -- 172.21.15.161:0/803160864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178057040 con 0x55b3beca1a00 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f507560a640 1 -- 172.21.15.161:0/803160864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5178052990 con 0x55b3beca1a00 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f507560a640 1 -- 172.21.15.161:0/803160864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178052c70 con 0x55b3beca1a00 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f5189a38800 1 -- 172.21.15.161:0/803160864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 msgr2=0x55b3bed96b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.766+0000 7f5189a38800 1 --2- 172.21.15.161:0/803160864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5178055040 tx=0x7f517804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- 172.21.15.161:0/803160864 shutdown_connections 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 --2- 172.21.15.161:0/803160864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed96b20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- 172.21.15.161:0/803160864 >> 172.21.15.161:0/803160864 conn(0x55b3bec9d560 msgr2=0x55b3bed92440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- 172.21.15.161:0/803160864 shutdown_connections 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- 172.21.15.161:0/803160864 wait complete. 2024-05-08T09:21:49.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5189a38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3beca3450 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5187537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5187537640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52546/0 (socket says 172.21.15.161:52546) 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.767+0000 7f5187537640 1 -- 172.21.15.161:0/1372531216 learned_addr learned my addr 172.21.15.161:0/1372531216 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5187537640 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bed9eb80 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5187537640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f517800a470 tx=0x7f5178003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5073e07640 1 -- 172.21.15.161:0/1372531216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178073070 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5073e07640 1 -- 172.21.15.161:0/1372531216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f517805d650 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5073e07640 1 -- 172.21.15.161:0/1372531216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5178057070 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3bed9ee10 con 0x55b3beca1a00 2024-05-08T09:21:49.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.768+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3beda1a20 con 0x55b3beca1a00 2024-05-08T09:21:49.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5073e07640 1 -- 172.21.15.161:0/1372531216 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5178076070 con 0x55b3beca1a00 2024-05-08T09:21:49.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5073e07640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 0x7f506c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5073e07640 1 -- 172.21.15.161:0/1372531216 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f517808dfc0 con 0x55b3beca1a00 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f517ffff640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 0x7f506c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 0x55b3beda57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beda5d20 con 0x55b3beca2360 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f5187d38640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 0x55b3beda57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.769+0000 7f517ffff640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 0x7f506c038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5170000f60 tx=0x7f51700012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5187d38640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 0x55b3beda57e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5187d38640 1 -- 172.21.15.161:0/1372531216 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f518000a4a0 con 0x55b3beca2360 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beda2db0 con 0x55b3beca2360 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5187d38640 1 -- 172.21.15.161:0/1372531216 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f518000a4a0 con 0x55b3beca2360 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 0x55b3bedaa460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedaab50 con 0x55b3beda8070 2024-05-08T09:21:49.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.770+0000 7f5187537640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 0x55b3bedaa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.771+0000 7f5187537640 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 0x55b3bedaa460 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.771+0000 7f5187537640 1 -- 172.21.15.161:0/1372531216 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5178075030 con 0x55b3beda8070 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.771+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beda7020 con 0x55b3beca2360 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.771+0000 7f5187d38640 1 -- 172.21.15.161:0/1372531216 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f518000a4a0 con 0x55b3beca2360 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.771+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beda7500 con 0x55b3beca2360 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.772+0000 7f5187d38640 1 -- 172.21.15.161:0/1372531216 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f518000a4a0 con 0x55b3beca2360 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.772+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.772+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.772+0000 7f5189a38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.772+0000 7f5189a38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3beb94cf0 con 0x55b3bedb9cc0 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52548/0 (socket says 172.21.15.161:52548) 2024-05-08T09:21:49.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5187d38640 1 -- 172.21.15.161:0/380555802 learned_addr learned my addr 172.21.15.161:0/380555802 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5187d38640 1 -- 172.21.15.161:0/380555802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bedba620 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5187d38640 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55b3beda6120 tx=0x7f5180018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5071602640 1 -- 172.21.15.161:0/380555802 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180014450 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5071602640 1 -- 172.21.15.161:0/380555802 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180014610 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3bedbb090 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5071602640 1 -- 172.21.15.161:0/380555802 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180014930 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.773+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bedbb590 con 0x55b3bedb9cc0 2024-05-08T09:21:49.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.774+0000 7f5071602640 1 -- 172.21.15.161:0/380555802 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5180011040 con 0x55b3bedb9cc0 2024-05-08T09:21:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5071602640 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 0x7f5060038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5071602640 1 -- 172.21.15.161:0/380555802 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f518001e070 con 0x55b3bedb9cc0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187537640 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 0x7f5060038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187537640 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 0x7f5060038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b3beda61c0 tx=0x7f5178066f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5189a38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5189a38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3bed973b0 con 0x55b3bedc6fa0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52558/0 (socket says 172.21.15.161:52558) 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187d38640 1 -- 172.21.15.161:0/3924195759 learned_addr learned my addr 172.21.15.161:0/3924195759 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.775+0000 7f5187d38640 1 -- 172.21.15.161:0/3924195759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bedc7990 con 0x55b3bedc6fa0 2024-05-08T09:21:49.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5187d38640 1 --2- 172.21.15.161:0/3924195759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f518004c8b0 tx=0x7f5180011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84dbe16aec1d3f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f506affd640 1 -- 172.21.15.161:0/3924195759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180028070 con 0x55b3bedc6fa0 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f506affd640 1 -- 172.21.15.161:0/3924195759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180022d90 con 0x55b3bedc6fa0 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f506affd640 1 -- 172.21.15.161:0/3924195759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180016ab0 con 0x55b3bedc6fa0 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 -- 172.21.15.161:0/3924195759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 msgr2=0x55b3bedc73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 --2- 172.21.15.161:0/3924195759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f518004c8b0 tx=0x7f5180011a80 comp rx=0 tx=0).stop 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 -- 172.21.15.161:0/3924195759 shutdown_connections 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 --2- 172.21.15.161:0/3924195759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedc73c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 -- 172.21.15.161:0/3924195759 >> 172.21.15.161:0/3924195759 conn(0x55b3bedc3300 msgr2=0x55b3bedc1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 -- 172.21.15.161:0/3924195759 shutdown_connections 2024-05-08T09:21:49.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.776+0000 7f5189a38800 1 -- 172.21.15.161:0/3924195759 wait complete. 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5189a38800 1 Processor -- start 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5189a38800 1 -- start start 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5189a38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5189a38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b3bedc8100 con 0x55b3bedc6fa0 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5187d38640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52574/0 (socket says 172.21.15.161:52574) 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 learned_addr learned my addr 172.21.15.161:0/3368890741 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3bedceaf0 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.777+0000 7f5187d38640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedce5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f518004b780 tx=0x7f518004c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f50697fa640 1 -- 172.21.15.161:0/3368890741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180032070 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f50697fa640 1 -- 172.21.15.161:0/3368890741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5180046070 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b3bedced80 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f50697fa640 1 -- 172.21.15.161:0/3368890741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5180028050 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3bedd1a30 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.778+0000 7f50697fa640 1 -- 172.21.15.161:0/3368890741 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5180035070 con 0x55b3bedc6fa0 2024-05-08T09:21:49.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f50697fa640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5050036950 0x7f5050038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f50697fa640 1 -- 172.21.15.161:0/3368890741 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f518000e040 con 0x55b3bedc6fa0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f5187537640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5050036950 0x7f5050038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3bedda1a0 0x55b3beddc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beddcdb0 con 0x55b3bedda1a0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f517ffff640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3bedda1a0 0x55b3beddc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f5187537640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5050036950 0x7f5050038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5178006e60 tx=0x7f5178089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.779+0000 7f517ffff640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3bedda1a0 0x55b3beddc660 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5170009050 con 0x55b3bedda1a0 2024-05-08T09:21:49.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 realm 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedd9640 con 0x55b3bedda1a0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5170009050 con 0x55b3bedda1a0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3beddd890 con 0x55b3bedda1a0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5170009050 con 0x55b3bedda1a0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedde160 con 0x55b3bedda1a0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5170009050 con 0x55b3bedda1a0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beddea10 0x55b3bede0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.780+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede1540 con 0x55b3beddea10 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5187d38640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beddea10 0x55b3bede0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5187d38640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beddea10 0x55b3bede0e00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5189a38800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5189a38800 20 searching for the correct realm 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b3bede35f0 0x55b3bede5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.781+0000 7f5187537640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b3bede35f0 0x55b3bede5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.782+0000 7f5187537640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b3bede35f0 0x55b3bede5ab0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.782+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.782+0000 7f5187537640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f51780a0040 0x7f517807a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.782+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.782+0000 7f517ffff640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f51780a0040 0x7f517807a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f517ffff640 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f51780a0040 0x7f517807a9a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170009050 con 0x7f51780a0040 2024-05-08T09:21:49.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170009050 con 0x55b3bedda1a0 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.783+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.784+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.784+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.784+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.784+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.785+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.786+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.787+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.788+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.789+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bede35f0 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.790+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3beddea10 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x55b3bedda1a0 2024-05-08T09:21:49.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6180 con 0x7f51780a0040 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.791+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede1ff0 con 0x55b3bedda1a0 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede2470 con 0x55b3bedda1a0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede2950 con 0x55b3bedda1a0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 zone default found 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 4 Realm: () 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 zonegroup default 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.792+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede6600 con 0x55b3beddea10 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede8830 con 0x55b3bede35f0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede8bd0 con 0x55b3bede35f0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 started sync module instance, tier type = 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.793+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede7c70 con 0x7f51780a0040 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.794+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.794+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94230489759840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede7c70 con 0x7f51780a0040 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.794+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede9590 con 0x55b3bedda1a0 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.795+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94230489759840] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.795+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.795+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94230489758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede9590 con 0x55b3bedda1a0 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.795+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede9fb0 con 0x55b3bede35f0 2024-05-08T09:21:49.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.796+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94230489758112] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.797+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.797+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94230489764064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede9500 con 0x55b3bede35f0 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.797+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedeae70 con 0x7f51780a0040 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.798+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94230489764064] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.798+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.798+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94230489770432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedeb290 con 0x7f51780a0040 2024-05-08T09:21:49.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.798+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedebc50 con 0x55b3bedda1a0 2024-05-08T09:21:49.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.799+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.799+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94230489773984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedec070 con 0x55b3bedda1a0 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.799+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedecb70 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.799+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94230489770432] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.800+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94230489773984] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.800+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.800+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94230489771488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedec070 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.800+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3beded440 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.801+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94230489771488] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.801+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.801+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94230489775040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3beded3c0 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.801+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedede60 con 0x55b3beddea10 2024-05-08T09:21:49.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94230489775040] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94230489782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedee2d0 con 0x55b3beddea10 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=0 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=1 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=2 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=3 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=4 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=5 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.802+0000 7f5189a38800 20 add_watcher() i=6 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94230489782576] v27'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f5189a38800 20 add_watcher() i=7 2024-05-08T09:21:49.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f5189a38800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedee2d0 con 0x55b3bedda1a0 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.803+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94230489783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedee270 con 0x55b3bedda1a0 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.804+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94230489783840] v27'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.804+0000 7f503dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.804+0000 7f5189a38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.804+0000 7f5189a38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.804+0000 7f5189a38800 5 note: GC not initialized 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f503cfe1640 20 reqs_thread_entry: start 2024-05-08T09:21:49.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f5189a38800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f5189a38800 20 Filter name: none 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f4fb67fc640 20 reqs_thread_entry: start 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f5189a38800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b3bee24300 con 0x55b3bedda1a0 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.805+0000 7f5189a38800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T09:21:49.823 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.806+0000 7f503dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.806+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94230489783840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bee22eb0 con 0x55b3bedda1a0 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.807+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94230489783840] v27'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.807+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94230489759840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedede20 con 0x7f51780a0040 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.808+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94230489759840] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.808+0000 7f5189a38800 20 remove_watcher() i=0 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.808+0000 7f5189a38800 2 removed watcher, disabling cache 2024-05-08T09:21:49.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.808+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94230489758112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedede20 con 0x55b3bedda1a0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.809+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94230489758112] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.809+0000 7f5189a38800 20 remove_watcher() i=1 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.809+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94230489764064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede79a0 con 0x55b3bede35f0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.810+0000 7f5187537640 1 -- 172.21.15.161:0/3368890741 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94230489764064] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5178075030 con 0x55b3bede35f0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.810+0000 7f5189a38800 20 remove_watcher() i=2 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.810+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94230489770432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedede20 con 0x7f51780a0040 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.811+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94230489770432] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x7f51780a0040 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.811+0000 7f5189a38800 20 remove_watcher() i=3 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.811+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94230489773984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede90e0 con 0x55b3bedda1a0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.812+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94230489773984] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5170029040 con 0x55b3bedda1a0 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.812+0000 7f5189a38800 20 remove_watcher() i=4 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.812+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94230489771488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedea9c0 con 0x55b3beddea10 2024-05-08T09:21:49.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.813+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94230489771488] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.813+0000 7f5189a38800 20 remove_watcher() i=5 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.813+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94230489775040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bedede20 con 0x55b3beddea10 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.814+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94230489775040] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.815+0000 7f5189a38800 20 remove_watcher() i=6 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.815+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94230489782576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b3bede90e0 con 0x55b3beddea10 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5187d38640 1 -- 172.21.15.161:0/3368890741 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94230489782576] v27'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5180034030 con 0x55b3beddea10 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 20 remove_watcher() i=7 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beddea10 msgr2=0x55b3bede0e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beddea10 0x55b3bede0e00 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3bedda1a0 msgr2=0x55b3beddc660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3bedda1a0 0x55b3beddc660 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f51780a0040 msgr2=0x7f517807a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f51780a0040 0x7f517807a9a0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b3bede35f0 msgr2=0x55b3bede5ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b3bede35f0 0x55b3bede5ab0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5050036950 msgr2=0x7f5050038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5050036950 0x7f5050038e10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5178006e60 tx=0x7f5178089000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 msgr2=0x55b3bedce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/3368890741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedc6fa0 0x55b3bedce5b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f518004b780 tx=0x7f518004c840 comp rx=0 tx=0).stop 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 reap_dead start 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f517ffff640 1 -- 172.21.15.161:0/3368890741 reap_dead start 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 shutdown_connections 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 >> 172.21.15.161:0/3368890741 conn(0x55b3bedc3300 msgr2=0x55b3bedc0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 shutdown_connections 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/3368890741 wait complete. 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 msgr2=0x7f5060038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 0x7f5060038dc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55b3beda61c0 tx=0x7f5178066f90 comp rx=0 tx=0).stop 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 msgr2=0x55b3bedba0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55b3beda6120 tx=0x7f5180018830 comp rx=0 tx=0).stop 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 shutdown_connections 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.816+0000 7f5189a38800 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5060036900 0x7f5060038dc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/380555802 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3bedb9cc0 0x55b3bedba0e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 >> 172.21.15.161:0/380555802 conn(0x55b3bedadd60 msgr2=0x55b3bedae160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 shutdown_connections 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/380555802 wait complete. 2024-05-08T09:21:49.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 msgr2=0x55b3bedaa460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 0x55b3bedaa460 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 msgr2=0x55b3beda57e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 0x55b3beda57e0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 msgr2=0x7f506c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 0x7f506c038e10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5170000f60 tx=0x7f51700012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 msgr2=0x55b3bed9e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f517800a470 tx=0x7f5178003020 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 shutdown_connections 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b3beda8070 0x55b3bedaa460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b3beca2360 0x55b3beda57e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f506c036950 0x7f506c038e10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 --2- 172.21.15.161:0/1372531216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b3beca1a00 0x55b3bed9e640 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 >> 172.21.15.161:0/1372531216 conn(0x55b3bec9d560 msgr2=0x55b3bed90c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 shutdown_connections 2024-05-08T09:21:49.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.817+0000 7f5189a38800 1 -- 172.21.15.161:0/1372531216 wait complete. 2024-05-08T09:21:49.836 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.836 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T09:21:49.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-05-08T09:21:49.837 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-05-08T09:21:49.885 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:49.885 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:49.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.886+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f140332f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55625481d050 0x5562548acc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f140332f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562548b0f30 con 0x5562548ad230 2024-05-08T09:21:49.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f140332f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55625473b050 con 0x55625481d050 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fefb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55625481d050 0x5562548acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fe7b4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5562548ad230 0x5562548af6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42858/0 (socket says 172.21.15.161:42858) 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fefb5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55625481d050 0x5562548acc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52590/0 (socket says 172.21.15.161:52590) 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fe7b4640 1 -- 172.21.15.161:0/1203008772 learned_addr learned my addr 172.21.15.161:0/1203008772 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fefb5640 1 -- 172.21.15.161:0/1203008772 >> v1:172.21.15.45:6789/0 conn(0x5562548ad230 legacy=0x5562548af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.887+0000 7f13fefb5640 1 -- 172.21.15.161:0/1203008772 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562548b2160 con 0x55625481d050 2024-05-08T09:21:49.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.889+0000 7f13fefb5640 1 --2- 172.21.15.161:0/1203008772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55625481d050 0x5562548acc90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f0005fd0 tx=0x7f13f001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad77abe2619642a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.889+0000 7f13fdfb3640 1 -- 172.21.15.161:0/1203008772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f0052560 con 0x55625481d050 2024-05-08T09:21:49.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.889+0000 7f13fdfb3640 1 -- 172.21.15.161:0/1203008772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f0052700 con 0x55625481d050 2024-05-08T09:21:49.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.889+0000 7f13fdfb3640 1 -- 172.21.15.161:0/1203008772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f0052a60 con 0x55625481d050 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 -- 172.21.15.161:0/1203008772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55625481d050 msgr2=0x5562548acc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 --2- 172.21.15.161:0/1203008772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55625481d050 0x5562548acc90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13f0005fd0 tx=0x7f13f001ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 -- 172.21.15.161:0/1203008772 shutdown_connections 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 --2- 172.21.15.161:0/1203008772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55625481d050 0x5562548acc90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 -- 172.21.15.161:0/1203008772 >> 172.21.15.161:0/1203008772 conn(0x5562548a45d0 msgr2=0x5562548a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 -- 172.21.15.161:0/1203008772 shutdown_connections 2024-05-08T09:21:49.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.890+0000 7f140332f800 1 -- 172.21.15.161:0/1203008772 wait complete. 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f140332f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f140332f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5562547f51f0 con 0x5562548ad230 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f13fefb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f13fefb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52596/0 (socket says 172.21.15.161:52596) 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.904+0000 7f13fefb5640 1 -- 172.21.15.161:0/556843852 learned_addr learned my addr 172.21.15.161:0/556843852 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.905+0000 7f13fefb5640 1 -- 172.21.15.161:0/556843852 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625499be70 con 0x5562548ad230 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.905+0000 7f13fefb5640 1 --2- 172.21.15.161:0/556843852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13f0007000 tx=0x7f13f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690cefd0fc76f96a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.905+0000 7f12ece09640 1 -- 172.21.15.161:0/556843852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f0052e00 con 0x5562548ad230 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.905+0000 7f12ece09640 1 -- 172.21.15.161:0/556843852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f00528b0 con 0x5562548ad230 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.905+0000 7f12ece09640 1 -- 172.21.15.161:0/556843852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f005c430 con 0x5562548ad230 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- 172.21.15.161:0/556843852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 msgr2=0x55625499b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 --2- 172.21.15.161:0/556843852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f13f0007000 tx=0x7f13f004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- 172.21.15.161:0/556843852 shutdown_connections 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 --2- 172.21.15.161:0/556843852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x55625499b8a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- 172.21.15.161:0/556843852 >> 172.21.15.161:0/556843852 conn(0x5562548a45d0 msgr2=0x556254997120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- 172.21.15.161:0/556843852 shutdown_connections 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- 172.21.15.161:0/556843852 wait complete. 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f140332f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5562548b13a0 con 0x5562548ad230 2024-05-08T09:21:49.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f13fefb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f13fefb5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52602/0 (socket says 172.21.15.161:52602) 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.906+0000 7f13fefb5640 1 -- 172.21.15.161:0/912158254 learned_addr learned my addr 172.21.15.161:0/912158254 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f13fefb5640 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562549a3900 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f13fefb5640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f13f0000f80 tx=0x7f13f0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f12eb606640 1 -- 172.21.15.161:0/912158254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f0071420 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f12eb606640 1 -- 172.21.15.161:0/912158254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f00715c0 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562549a3b90 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f12eb606640 1 -- 172.21.15.161:0/912158254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f00718e0 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.907+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562549a6840 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f12eb606640 1 -- 172.21.15.161:0/912158254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13f007a440 con 0x5562548ad230 2024-05-08T09:21:49.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f12eb606640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 0x7f12e4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f12eb606640 1 -- 172.21.15.161:0/912158254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f13f006d070 con 0x5562548ad230 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 0x7f12e4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 0x5562549aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549aaf20 con 0x5562549a85f0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.908+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 0x5562549aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 0x7f12e4038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000f60 tx=0x7f13f40012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 0x5562549aa9e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f13ff7b6640 1 -- 172.21.15.161:0/912158254 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13f80083e0 con 0x5562549a85f0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549a7bb0 con 0x5562549a85f0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f13ff7b6640 1 -- 172.21.15.161:0/912158254 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13f80083e0 con 0x5562549a85f0 2024-05-08T09:21:49.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 0x5562549af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549afd20 con 0x5562549ad240 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.909+0000 7f13fefb5640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 0x5562549af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.910+0000 7f13fefb5640 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 0x5562549af630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.910+0000 7f13fefb5640 1 -- 172.21.15.161:0/912158254 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f13f0077020 con 0x5562549ad240 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.910+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549ac1c0 con 0x5562549a85f0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.910+0000 7f13ff7b6640 1 -- 172.21.15.161:0/912158254 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13f80083e0 con 0x5562549a85f0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.910+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549ac660 con 0x5562549a85f0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f13ff7b6640 1 -- 172.21.15.161:0/912158254 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f13f80083e0 con 0x5562549a85f0 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f140332f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f140332f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55625479bcf0 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52610/0 (socket says 172.21.15.161:52610) 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.911+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3545331514 learned_addr learned my addr 172.21.15.161:0/3545331514 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3545331514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562549bf7f0 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5562549a4290 tx=0x7f13f8008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f12e8e01640 1 -- 172.21.15.161:0/3545331514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f8007ca0 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f12e8e01640 1 -- 172.21.15.161:0/3545331514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f801e020 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f12e8e01640 1 -- 172.21.15.161:0/3545331514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f8019420 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562549c0260 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.912+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562549c0760 con 0x5562549bee90 2024-05-08T09:21:49.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f12e8e01640 1 -- 172.21.15.161:0/3545331514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13f8016040 con 0x5562549bee90 2024-05-08T09:21:49.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f12e8e01640 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 0x7f12d8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f12e8e01640 1 -- 172.21.15.161:0/3545331514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f13f801f030 con 0x5562549bee90 2024-05-08T09:21:49.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 0x7f12d8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 0x7f12d8038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f13f008d6e0 tx=0x7f13f006fa40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f140332f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.913+0000 7f140332f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55625499c190 con 0x5562549cc110 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52626/0 (socket says 172.21.15.161:52626) 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f13ff7b6640 1 -- 172.21.15.161:0/4035835555 learned_addr learned my addr 172.21.15.161:0/4035835555 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f13ff7b6640 1 -- 172.21.15.161:0/4035835555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562549ccb00 con 0x5562549cc110 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/4035835555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13f804cac0 tx=0x7f13f8017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91874940cb99d09c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f12e27fc640 1 -- 172.21.15.161:0/4035835555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f801d040 con 0x5562549cc110 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f12e27fc640 1 -- 172.21.15.161:0/4035835555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8015d00 con 0x5562549cc110 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.914+0000 7f12e27fc640 1 -- 172.21.15.161:0/4035835555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f80153e0 con 0x5562549cc110 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- 172.21.15.161:0/4035835555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 msgr2=0x5562549cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 --2- 172.21.15.161:0/4035835555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13f804cac0 tx=0x7f13f8017fa0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- 172.21.15.161:0/4035835555 shutdown_connections 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 --2- 172.21.15.161:0/4035835555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549cc530 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- 172.21.15.161:0/4035835555 >> 172.21.15.161:0/4035835555 conn(0x5562549c8420 msgr2=0x5562549c64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- 172.21.15.161:0/4035835555 shutdown_connections 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- 172.21.15.161:0/4035835555 wait complete. 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 Processor -- start 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- start start 2024-05-08T09:21:49.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f140332f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5562549cd2d0 con 0x5562549cc110 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f13ff7b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52634/0 (socket says 172.21.15.161:52634) 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.915+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 learned_addr learned my addr 172.21.15.161:0/3902199347 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562549d3b50 con 0x5562549cc110 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f13f8017930 tx=0x7f13f804ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f12e0ff9640 1 -- 172.21.15.161:0/3902199347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f801d070 con 0x5562549cc110 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f12e0ff9640 1 -- 172.21.15.161:0/3902199347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f8046040 con 0x5562549cc110 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562549d3de0 con 0x5562549cc110 2024-05-08T09:21:49.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f12e0ff9640 1 -- 172.21.15.161:0/3902199347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f13f804e2e0 con 0x5562549cc110 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.916+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562549d6a90 con 0x5562549cc110 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.917+0000 7f12e0ff9640 1 -- 172.21.15.161:0/3902199347 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13f803bd10 con 0x5562549cc110 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.917+0000 7f12e0ff9640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12c8036950 0x7f12c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.917+0000 7f12e0ff9640 1 -- 172.21.15.161:0/3902199347 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f13f8037ca0 con 0x5562549cc110 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.917+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12c8036950 0x7f12c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.917+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12c8036950 0x7f12c8038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13f006fad0 tx=0x7f13f0086000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549df0a0 0x5562549e1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e1cb0 con 0x5562549df0a0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549df0a0 0x5562549e1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549df0a0 0x5562549e1560 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13f4009050 con 0x5562549df0a0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 realm 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549de4f0 con 0x5562549df0a0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13f4009050 con 0x5562549df0a0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:49.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.918+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e27a0 con 0x5562549df0a0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13f4009050 con 0x5562549df0a0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e3070 con 0x5562549df0a0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f13f4009050 con 0x5562549df0a0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549e39b0 0x5562549e5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e6550 con 0x5562549e39b0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.919+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549e39b0 0x5562549e5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f13ff7b6640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549e39b0 0x5562549e5dc0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f140332f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f140332f800 20 searching for the correct realm 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5562549e8520 0x5562549ea9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5562549e8520 0x5562549ea9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.920+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5562549e8520 0x5562549ea9e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fefb5640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f13f009e070 0x7f13f00703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:49.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f13f009e070 0x7f13f00703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fe7b4640 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f13f009e070 0x7f13f00703c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4009050 con 0x7f13f009e070 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.921+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4009050 con 0x5562549df0a0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.922+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.923+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.924+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.925+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.926+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.927+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.928+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e8520 2024-05-08T09:21:49.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549e39b0 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.929+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x5562549df0a0 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb0b0 con 0x7f13f009e070 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:49.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e6f10 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e77b0 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.930+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549e6b50 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:49.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 zone default found 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 4 Realm: () 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 zonegroup default 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549eb590 con 0x5562549e39b0 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549ed860 con 0x5562549e8520 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.931+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549edc00 con 0x5562549e8520 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.932+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.932+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.932+0000 7f140332f800 20 started sync module instance, tier type = 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.932+0000 7f140332f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.932+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549eccf0 con 0x7f13f009e070 2024-05-08T09:21:49.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.933+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.933+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93880814850592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549eccf0 con 0x7f13f009e070 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.933+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ee610 con 0x5562549df0a0 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.934+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93880814850592] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.934+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.934+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93880814854976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549eccf0 con 0x5562549df0a0 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.934+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ef060 con 0x5562549e8520 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.935+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93880814854976] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.935+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.935+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93880814848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ecc60 con 0x5562549e8520 2024-05-08T09:21:49.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.935+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549eff20 con 0x7f13f009e070 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.936+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.936+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93880814861392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f0640 con 0x7f13f009e070 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.936+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f1160 con 0x5562549df0a0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.936+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93880814848064] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.937+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.937+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93880814865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f1120 con 0x5562549df0a0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.937+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f1b70 con 0x5562549e39b0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.938+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93880814861392] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.938+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93880814865456] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.938+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.938+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93880814859344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f16c0 con 0x5562549e39b0 2024-05-08T09:21:49.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.938+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f2440 con 0x5562549e39b0 2024-05-08T09:21:49.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.939+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.939+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93880814870416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f2860 con 0x5562549e39b0 2024-05-08T09:21:49.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.939+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f30b0 con 0x5562549e39b0 2024-05-08T09:21:49.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.939+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93880814859344] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93880814870416] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93880814872672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f2c80 con 0x5562549e39b0 2024-05-08T09:21:49.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=0 2024-05-08T09:21:49.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=1 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=2 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=3 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=4 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=5 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.940+0000 7f140332f800 20 add_watcher() i=6 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.941+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93880814872672] v27'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.941+0000 7f140332f800 20 add_watcher() i=7 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.941+0000 7f140332f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.941+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5562549f6160 con 0x5562549df0a0 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.942+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.942+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93880814873728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549f3550 con 0x5562549df0a0 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93880814873728] v27'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f12b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 5 note: GC not initialized 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f122ffff640 20 reqs_thread_entry: start 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:49.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 20 Filter name: none 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f122dffb640 20 reqs_thread_entry: start 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.943+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556254a29420 con 0x5562549df0a0 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T09:21:49.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556254a2a030 con 0x7f13f009e070 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.944+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556254a2fc40 con 0x5562549df0a0 2024-05-08T09:21:49.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.945+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v27'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.945+0000 7f140332f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.945+0000 7f140332f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.945+0000 7f140332f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.945+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93880815122256 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556254a2c920 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 93880814865456 notify 115964116999 ret 0) ==== 891+0+0 (crc 0 0 0) 0x5562548b0f30 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f12e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 93880814865456 notifier 4383 bl.length()=849 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f12e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f12e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(65 notify.4 [notify cookie 93880815122256 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f12e27fc640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f12c4003ea0 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 93880815122256 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f13f403dab0 con 0x5562549df0a0 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.946+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556254a2f750 con 0x7f13f009e070 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v27'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f140332f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f140332f800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f140332f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93880815122256 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556254a2c8d0 con 0x7f13f009e070 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== watch-notify(notify (1) cookie 93880814850592 notify 115964116995 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f13f403dab0 con 0x7f13f009e070 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f12e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 93880814850592 notifier 4383 bl.length()=166 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f12e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f12e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(68 notify.0 [notify cookie 93880815122256 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.947+0000 7f12e1ffb640 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f1234003400 con 0x7f13f009e070 2024-05-08T09:21:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.948+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.948+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== watch-notify(notify_complete (2) cookie 93880815122256 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f13f403de20 con 0x7f13f009e070 2024-05-08T09:21:49.974 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T09:21:49.945413Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.949+0000 7f12b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.949+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93880814873728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556254a28720 con 0x5562549df0a0 2024-05-08T09:21:49.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.949+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93880814873728] v27'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.949+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93880814850592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556254a28720 con 0x7f13f009e070 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.950+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93880814850592] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.950+0000 7f140332f800 20 remove_watcher() i=0 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.950+0000 7f140332f800 2 removed watcher, disabling cache 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.950+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93880814854976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ed220 con 0x5562549df0a0 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.951+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93880814854976] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.951+0000 7f140332f800 20 remove_watcher() i=1 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.951+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93880814848064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ee340 con 0x5562549e8520 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.952+0000 7f13fefb5640 1 -- 172.21.15.161:0/3902199347 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93880814848064] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f009a070 con 0x5562549e8520 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.952+0000 7f140332f800 20 remove_watcher() i=2 2024-05-08T09:21:49.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.952+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93880814861392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ec840 con 0x7f13f009e070 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.953+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93880814861392] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x7f13f009e070 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.953+0000 7f140332f800 20 remove_watcher() i=3 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.953+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93880814865456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ec840 con 0x5562549df0a0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.955+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93880814865456] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f4029040 con 0x5562549df0a0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.955+0000 7f140332f800 20 remove_watcher() i=4 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.955+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93880814859344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ec840 con 0x5562549e39b0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.956+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93880814859344] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.956+0000 7f140332f800 20 remove_watcher() i=5 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.956+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93880814870416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ec840 con 0x5562549e39b0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.957+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93880814870416] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.957+0000 7f140332f800 20 remove_watcher() i=6 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.957+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93880814872672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5562549ec840 con 0x5562549e39b0 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f13ff7b6640 1 -- 172.21.15.161:0/3902199347 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93880814872672] v27'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f13f8056040 con 0x5562549e39b0 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 20 remove_watcher() i=7 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549e39b0 msgr2=0x5562549e5dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549e39b0 0x5562549e5dc0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549df0a0 msgr2=0x5562549e1560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549df0a0 0x5562549e1560 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f13f009e070 msgr2=0x7f13f00703c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f13f009e070 0x7f13f00703c0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5562549e8520 msgr2=0x5562549ea9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5562549e8520 0x5562549ea9e0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12c8036950 msgr2=0x7f12c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12c8036950 0x7f12c8038e10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f13f006fad0 tx=0x7f13f0086000 comp rx=0 tx=0).stop 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 msgr2=0x5562549d3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f13fe7b4640 1 -- 172.21.15.161:0/3902199347 reap_dead start 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f13f8017930 tx=0x7f13f804ca50 comp rx=0 tx=0).stop 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 shutdown_connections 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3902199347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549cc110 0x5562549d3610 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 >> 172.21.15.161:0/3902199347 conn(0x5562549c8420 msgr2=0x5562549c5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 shutdown_connections 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3902199347 wait complete. 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 msgr2=0x7f12d8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 0x7f12d8038e10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f13f008d6e0 tx=0x7f13f006fa40 comp rx=0 tx=0).stop 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 msgr2=0x5562549bf2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5562549a4290 tx=0x7f13f8008f90 comp rx=0 tx=0).stop 2024-05-08T09:21:49.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 shutdown_connections 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12d8036950 0x7f12d8038e10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 --2- 172.21.15.161:0/3545331514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562549bee90 0x5562549bf2b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.958+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 >> 172.21.15.161:0/3545331514 conn(0x5562549b2f30 msgr2=0x5562549b3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 shutdown_connections 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/3545331514 wait complete. 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 msgr2=0x5562549af630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 0x5562549af630 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 msgr2=0x5562549aa9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 0x5562549aa9e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 msgr2=0x7f12e4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 0x7f12e4038e10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f13f4000f60 tx=0x7f13f40012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 msgr2=0x5562549a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f13f0000f80 tx=0x7f13f0003330 comp rx=0 tx=0).stop 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 shutdown_connections 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5562549ad240 0x5562549af630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5562549a85f0 0x5562549aa9e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f12e4036950 0x7f12e4038e10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 --2- 172.21.15.161:0/912158254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5562548ad230 0x5562549a33c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 >> 172.21.15.161:0/912158254 conn(0x5562548a45d0 msgr2=0x556254995920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 shutdown_connections 2024-05-08T09:21:49.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:49.959+0000 7f140332f800 1 -- 172.21.15.161:0/912158254 wait complete. 2024-05-08T09:21:49.986 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T09:21:49.945413Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:49.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:21:49.987 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:21:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.031 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc907719800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5571e9c65460 0x5571e9c67850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc907719800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5571e9c67e20 con 0x5571e9c60fd0 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc907719800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5571e9af3050 con 0x5571e9c65460 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc904a17640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5571e9c65460 0x5571e9c67850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc905218640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5571e9c60fd0 0x5571e9c613f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42874/0 (socket says 172.21.15.161:42874) 2024-05-08T09:21:50.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.033+0000 7fc905218640 1 -- 172.21.15.161:0/848060134 learned_addr learned my addr 172.21.15.161:0/848060134 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:50.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.034+0000 7fc904a17640 1 -- 172.21.15.161:0/848060134 >> v1:172.21.15.45:6789/0 conn(0x5571e9c60fd0 legacy=0x5571e9c613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.034+0000 7fc8f7fff640 1 -- 172.21.15.161:0/848060134 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941701897 0 0) 0x5571e9c67e20 con 0x5571e9c60fd0 2024-05-08T09:21:50.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.034+0000 7fc904a17640 1 -- 172.21.15.161:0/848060134 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9c69050 con 0x5571e9c65460 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.035+0000 7fc904a17640 1 --2- 172.21.15.161:0/848060134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c65460 0x5571e9c67850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00a470 tx=0x7fc8fc01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4e1b5b249740e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc8f7fff640 1 -- 172.21.15.161:0/848060134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8fc057070 con 0x5571e9c65460 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc8f7fff640 1 -- 172.21.15.161:0/848060134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8fc052570 con 0x5571e9c65460 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc8f7fff640 1 -- 172.21.15.161:0/848060134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8fc052870 con 0x5571e9c65460 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 -- 172.21.15.161:0/848060134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c65460 msgr2=0x5571e9c67850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 --2- 172.21.15.161:0/848060134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c65460 0x5571e9c67850 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc00a470 tx=0x7fc8fc01ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 -- 172.21.15.161:0/848060134 shutdown_connections 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 --2- 172.21.15.161:0/848060134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c65460 0x5571e9c67850 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 -- 172.21.15.161:0/848060134 >> 172.21.15.161:0/848060134 conn(0x5571e9c5c5b0 msgr2=0x5571e9c5e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 -- 172.21.15.161:0/848060134 shutdown_connections 2024-05-08T09:21:50.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.036+0000 7fc907719800 1 -- 172.21.15.161:0/848060134 wait complete. 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc907719800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc907719800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5571e9bad1d0 con 0x5571e9c60fd0 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc905218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc905218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52642/0 (socket says 172.21.15.161:52642) 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.050+0000 7fc905218640 1 -- 172.21.15.161:0/554482692 learned_addr learned my addr 172.21.15.161:0/554482692 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.051+0000 7fc905218640 1 -- 172.21.15.161:0/554482692 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9d51840 con 0x5571e9c60fd0 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.051+0000 7fc905218640 1 --2- 172.21.15.161:0/554482692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800b240 tx=0x7fc8f800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6615c30ca55258e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.051+0000 7fc7f3606640 1 -- 172.21.15.161:0/554482692 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f8008070 con 0x5571e9c60fd0 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.051+0000 7fc7f3606640 1 -- 172.21.15.161:0/554482692 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f800d500 con 0x5571e9c60fd0 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.051+0000 7fc7f3606640 1 -- 172.21.15.161:0/554482692 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f800d860 con 0x5571e9c60fd0 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- 172.21.15.161:0/554482692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 msgr2=0x5571e9d51270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 --2- 172.21.15.161:0/554482692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800b240 tx=0x7fc8f800b700 comp rx=0 tx=0).stop 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- 172.21.15.161:0/554482692 shutdown_connections 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 --2- 172.21.15.161:0/554482692 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d51270 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- 172.21.15.161:0/554482692 >> 172.21.15.161:0/554482692 conn(0x5571e9c5c5b0 msgr2=0x5571e9d4cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- 172.21.15.161:0/554482692 shutdown_connections 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- 172.21.15.161:0/554482692 wait complete. 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.052+0000 7fc907719800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5571e9c682f0 con 0x5571e9c60fd0 2024-05-08T09:21:50.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc905218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc905218640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52656/0 (socket says 172.21.15.161:52656) 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc905218640 1 -- 172.21.15.161:0/1254508737 learned_addr learned my addr 172.21.15.161:0/1254508737 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc905218640 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9d59440 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc905218640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5571e9d52000 tx=0x7fc8f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc7f1e03640 1 -- 172.21.15.161:0/1254508737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f8019870 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc7f1e03640 1 -- 172.21.15.161:0/1254508737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f8019a10 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc7f1e03640 1 -- 172.21.15.161:0/1254508737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc8f8019d30 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571e9d596d0 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.053+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e9d5c330 con 0x5571e9c60fd0 2024-05-08T09:21:50.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc7f1e03640 1 -- 172.21.15.161:0/1254508737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc8f8017040 con 0x5571e9c60fd0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc7f1e03640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 0x7fc7ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc7f1e03640 1 -- 172.21.15.161:0/1254508737 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc8f8015020 con 0x5571e9c60fd0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc904a17640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 0x7fc7ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 0x5571e9d600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.054+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d60680 con 0x5571e9c65460 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc905a19640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 0x5571e9d600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc904a17640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 0x7fc7ec038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc054000 tx=0x7fc8fc04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc905a19640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 0x5571e9d600f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc905a19640 1 -- 172.21.15.161:0/1254508737 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc90000a4a0 con 0x5571e9c65460 2024-05-08T09:21:50.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d5d6c0 con 0x5571e9c65460 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc905a19640 1 -- 172.21.15.161:0/1254508737 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc90000a4a0 con 0x5571e9c65460 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 0x5571e9d64da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.055+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d65440 con 0x5571e9d629b0 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.056+0000 7fc905218640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 0x5571e9d64da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.056+0000 7fc905218640 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 0x5571e9d64da0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.056+0000 7fc905218640 1 -- 172.21.15.161:0/1254508737 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9d629b0 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.056+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d61960 con 0x5571e9c65460 2024-05-08T09:21:50.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc905a19640 1 -- 172.21.15.161:0/1254508737 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc90000a4a0 con 0x5571e9c65460 2024-05-08T09:21:50.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d61e40 con 0x5571e9c65460 2024-05-08T09:21:50.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc905a19640 1 -- 172.21.15.161:0/1254508737 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc90000a4a0 con 0x5571e9c65460 2024-05-08T09:21:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc907719800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.057+0000 7fc907719800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5571e9b53cf0 con 0x5571e9d74580 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52670/0 (socket says 172.21.15.161:52670) 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc905a19640 1 -- 172.21.15.161:0/1897811343 learned_addr learned my addr 172.21.15.161:0/1897811343 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc905a19640 1 -- 172.21.15.161:0/1897811343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9d74ee0 con 0x5571e9d74580 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc905a19640 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5571e9d59d80 tx=0x7fc9000188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc7eaffd640 1 -- 172.21.15.161:0/1897811343 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc900014450 con 0x5571e9d74580 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc7eaffd640 1 -- 172.21.15.161:0/1897811343 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9000145f0 con 0x5571e9d74580 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc7eaffd640 1 -- 172.21.15.161:0/1897811343 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9000148d0 con 0x5571e9d74580 2024-05-08T09:21:50.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571e9d75950 con 0x5571e9d74580 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.058+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e9d75e50 con 0x5571e9d74580 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.059+0000 7fc7eaffd640 1 -- 172.21.15.161:0/1897811343 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc900011040 con 0x5571e9d74580 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.059+0000 7fc7eaffd640 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 0x7fc7e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.059+0000 7fc7eaffd640 1 -- 172.21.15.161:0/1897811343 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc90001e070 con 0x5571e9d74580 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.059+0000 7fc905218640 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 0x7fc7e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905218640 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 0x7fc7e0038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5571e9d60ad0 tx=0x7fc8f801b520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc907719800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc907719800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5571e9d51bc0 con 0x5571e9d81840 2024-05-08T09:21:50.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52684/0 (socket says 172.21.15.161:52684) 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905a19640 1 -- 172.21.15.161:0/1028964866 learned_addr learned my addr 172.21.15.161:0/1028964866 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905a19640 1 -- 172.21.15.161:0/1028964866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9d82230 con 0x5571e9d81840 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc905a19640 1 --2- 172.21.15.161:0/1028964866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc90004c8c0 tx=0x7fc900011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78386cd320017333 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.060+0000 7fc7e8ff9640 1 -- 172.21.15.161:0/1028964866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90004e0d0 con 0x5571e9d81840 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc7e8ff9640 1 -- 172.21.15.161:0/1028964866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90004e270 con 0x5571e9d81840 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc7e8ff9640 1 -- 172.21.15.161:0/1028964866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90004b330 con 0x5571e9d81840 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- 172.21.15.161:0/1028964866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 msgr2=0x5571e9d81c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 --2- 172.21.15.161:0/1028964866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc90004c8c0 tx=0x7fc900011700 comp rx=0 tx=0).stop 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- 172.21.15.161:0/1028964866 shutdown_connections 2024-05-08T09:21:50.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 --2- 172.21.15.161:0/1028964866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d81c60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- 172.21.15.161:0/1028964866 >> 172.21.15.161:0/1028964866 conn(0x5571e9d7dba0 msgr2=0x5571e9d7bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- 172.21.15.161:0/1028964866 shutdown_connections 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- 172.21.15.161:0/1028964866 wait complete. 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 Processor -- start 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- start start 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d8d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.061+0000 7fc907719800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5571e9d829a0 con 0x5571e9d81840 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d8d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc905a19640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d8d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52688/0 (socket says 172.21.15.161:52688) 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 learned_addr learned my addr 172.21.15.161:0/1219056155 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571e9d8d760 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc905a19640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d8d220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc900040040 tx=0x7fc90004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc7d6ffd640 1 -- 172.21.15.161:0/1219056155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc90004e0d0 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc7d6ffd640 1 -- 172.21.15.161:0/1219056155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90002bc70 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5571e9d8d9f0 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc7d6ffd640 1 -- 172.21.15.161:0/1219056155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc900022a80 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.062+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571e9d906a0 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc7d6ffd640 1 -- 172.21.15.161:0/1219056155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc900022c20 con 0x5571e9d81840 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc7d6ffd640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7d0036950 0x7fc7d0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc7d6ffd640 1 -- 172.21.15.161:0/1219056155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc90000e040 con 0x5571e9d81840 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc905218640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7d0036950 0x7fc7d0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9d98d70 0x5571e9d9b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.063+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d9b980 con 0x5571e9d98d70 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc904a17640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9d98d70 0x5571e9d9b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc905218640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7d0036950 0x7fc7d0038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800e6d0 tx=0x7fc8f8044000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc904a17640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9d98d70 0x5571e9d9b230 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 20 realm 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d9bd50 con 0x5571e9d98d70 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.064+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d9c620 con 0x5571e9d98d70 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d9c9c0 con 0x5571e9d98d70 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d9d470 0x5571e9d9f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9d9ffc0 con 0x5571e9d9d470 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.065+0000 7fc905a19640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d9d470 0x5571e9d9f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc905a19640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d9d470 0x5571e9d9f860 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc907719800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc907719800 20 searching for the correct realm 2024-05-08T09:21:50.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5571e9da2070 0x5571e9da4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc905218640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5571e9da2070 0x5571e9da4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.066+0000 7fc905218640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5571e9da2070 0x5571e9da4530 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc905218640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc8f803f0f0 0x7fc8f8018810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc904a17640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc8f803f0f0 0x7fc8f8018810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc904a17640 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc8f803f0f0 0x7fc8f8018810 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.067+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.068+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.069+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.070+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.071+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.072+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.073+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.074+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9da2070 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d9d470 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.075+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x5571e9d98d70 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da4c00 con 0x7fc8f803f0f0 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da0a70 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da0ec0 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.076+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da13a0 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 zone default found 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 4 Realm: () 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 zonegroup default 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da5080 con 0x5571e9d9d470 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.077+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da72b0 con 0x5571e9da2070 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da7650 con 0x5571e9da2070 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 20 started sync module instance, tier type = 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.078+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da66f0 con 0x7fc8f803f0f0 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.079+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.079+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93947743070992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da66f0 con 0x7fc8f803f0f0 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.079+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da8010 con 0x5571e9d98d70 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.080+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93947743070992] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.080+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.080+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93947743069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da8010 con 0x5571e9d98d70 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.080+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da8a10 con 0x5571e9da2070 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.081+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93947743069216] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.081+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.081+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93947743075168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da7f80 con 0x5571e9da2070 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.081+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da98d0 con 0x7fc8f803f0f0 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.082+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.082+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93947743081984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daa070 con 0x7fc8f803f0f0 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.082+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daab70 con 0x5571e9d98d70 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.083+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93947743075168] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.084+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93947743081984] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.084+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.084+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93947743086176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daab30 con 0x5571e9d98d70 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.084+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dab440 con 0x5571e9d9d470 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.085+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93947743086176] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.085+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.085+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93947743088528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daab30 con 0x5571e9d9d470 2024-05-08T09:21:50.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.085+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dabe40 con 0x5571e9d9d470 2024-05-08T09:21:50.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.086+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93947743088528] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.086+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.086+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93947743079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dabe00 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.086+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dac850 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93947743079936] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93947743093568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daca30 con 0x5571e9d9d470 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=0 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=1 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=2 2024-05-08T09:21:50.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=3 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=4 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=5 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.087+0000 7fc907719800 20 add_watcher() i=6 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93947743093568] v27'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc907719800 20 add_watcher() i=7 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc907719800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dafe00 con 0x5571e9d98d70 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.088+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93947743095072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9dad220 con 0x5571e9d98d70 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.089+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93947743095072] v27'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.089+0000 7fc7bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.089+0000 7fc907719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.089+0000 7fc907719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.089+0000 7fc907719800 5 note: GC not initialized 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc7bafe5640 20 reqs_thread_entry: start 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc907719800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc907719800 20 Filter name: none 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc7b8fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc907719800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5571e9de2ce0 con 0x5571e9d98d70 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.090+0000 7fc907719800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T09:21:50.111 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T09:21:49.945413Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.091+0000 7fc7bbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.091+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93947743095072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9de30c0 con 0x5571e9d98d70 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.092+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93947743095072] v27'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.092+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93947743070992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9de30c0 con 0x7fc8f803f0f0 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.093+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93947743070992] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.093+0000 7fc907719800 20 remove_watcher() i=0 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.093+0000 7fc907719800 2 removed watcher, disabling cache 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.093+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93947743069216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da6b10 con 0x5571e9d98d70 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.094+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93947743069216] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.094+0000 7fc907719800 20 remove_watcher() i=1 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.094+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93947743075168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da6b10 con 0x5571e9da2070 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.095+0000 7fc905218640 1 -- 172.21.15.161:0/1219056155 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93947743075168] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8f802d070 con 0x5571e9da2070 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.095+0000 7fc907719800 20 remove_watcher() i=2 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.095+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93947743081984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da7b60 con 0x7fc8f803f0f0 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.096+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93947743081984] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x7fc8f803f0f0 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.096+0000 7fc907719800 20 remove_watcher() i=3 2024-05-08T09:21:50.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.096+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93947743086176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da7b60 con 0x5571e9d98d70 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.097+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93947743086176] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc8fc05a040 con 0x5571e9d98d70 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.097+0000 7fc907719800 20 remove_watcher() i=4 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.097+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93947743088528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daa660 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.098+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93947743088528] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.098+0000 7fc907719800 20 remove_watcher() i=5 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.098+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93947743079936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9da7b60 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.099+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93947743079936] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.099+0000 7fc907719800 20 remove_watcher() i=6 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.099+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93947743093568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5571e9daa660 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.100+0000 7fc905a19640 1 -- 172.21.15.161:0/1219056155 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93947743093568] v27'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc90002a070 con 0x5571e9d9d470 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.100+0000 7fc907719800 20 remove_watcher() i=7 2024-05-08T09:21:50.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d9d470 msgr2=0x5571e9d9f860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d9d470 0x5571e9d9f860 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9d98d70 msgr2=0x5571e9d9b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9d98d70 0x5571e9d9b230 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc8f803f0f0 msgr2=0x7fc8f8018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc8f803f0f0 0x7fc8f8018810 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5571e9da2070 msgr2=0x5571e9da4530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5571e9da2070 0x5571e9da4530 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7d0036950 msgr2=0x7fc7d0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7d0036950 0x7fc7d0038e10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800e6d0 tx=0x7fc8f8044000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 msgr2=0x5571e9d8d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1219056155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d81840 0x5571e9d8d220 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc900040040 tx=0x7fc90004c820 comp rx=0 tx=0).stop 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 reap_dead start 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc904a17640 1 -- 172.21.15.161:0/1219056155 reap_dead start 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 shutdown_connections 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 >> 172.21.15.161:0/1219056155 conn(0x5571e9d7dba0 msgr2=0x5571e9d7b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 shutdown_connections 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1219056155 wait complete. 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 msgr2=0x7fc7e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 0x7fc7e0038e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x5571e9d60ad0 tx=0x7fc8f801b520 comp rx=0 tx=0).stop 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 msgr2=0x5571e9d749a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x5571e9d59d80 tx=0x7fc9000188f0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 shutdown_connections 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7e0036950 0x7fc7e0038e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 --2- 172.21.15.161:0/1897811343 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9d74580 0x5571e9d749a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 >> 172.21.15.161:0/1897811343 conn(0x5571e9d68620 msgr2=0x5571e9d68a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 shutdown_connections 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.101+0000 7fc907719800 1 -- 172.21.15.161:0/1897811343 wait complete. 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 msgr2=0x5571e9d64da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 0x5571e9d64da0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 msgr2=0x5571e9d600f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 0x5571e9d600f0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 msgr2=0x7fc7ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 0x7fc7ec038e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc054000 tx=0x7fc8fc04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 msgr2=0x5571e9d58f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x5571e9d52000 tx=0x7fc8f8000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 shutdown_connections 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5571e9d629b0 0x5571e9d64da0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5571e9c65460 0x5571e9d600f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc7ec036950 0x7fc7ec038e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 --2- 172.21.15.161:0/1254508737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5571e9c60fd0 0x5571e9d58f00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 >> 172.21.15.161:0/1254508737 conn(0x5571e9c5c5b0 msgr2=0x5571e9d4b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 shutdown_connections 2024-05-08T09:21:50.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.102+0000 7fc907719800 1 -- 172.21.15.161:0/1254508737 wait complete. 2024-05-08T09:21:50.123 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T09:21:49.945413Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:50.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T09:21:50.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-05-08T09:21:50.124 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-05-08T09:21:50.170 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.170 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.171+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.171+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e6d2a800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55621dc569f0 0x55621dc56e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e6d2a800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55621dbcba70 con 0x55621dc57350 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e6d2a800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55621dae9050 con 0x55621dc569f0 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e2a64640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55621dc569f0 0x55621dc56e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e2a64640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55621dc569f0 0x55621dc56e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52702/0 (socket says 172.21.15.161:52702) 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e2a64640 1 -- 172.21.15.161:0/1234272615 learned_addr learned my addr 172.21.15.161:0/1234272615 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39dbfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55621dc57350 0x55621dc57800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42880/0 (socket says 172.21.15.161:42880) 2024-05-08T09:21:50.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e2a64640 1 -- 172.21.15.161:0/1234272615 >> v1:172.21.15.45:6789/0 conn(0x55621dc57350 legacy=0x55621dc57800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.172+0000 7f39e2a64640 1 -- 172.21.15.161:0/1234272615 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dc57f10 con 0x55621dc569f0 2024-05-08T09:21:50.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.175+0000 7f39e2a64640 1 --2- 172.21.15.161:0/1234272615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dc56e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39d400a520 tx=0x7f39d401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161076c7cd8b0619 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.175+0000 7f39e2263640 1 -- 172.21.15.161:0/1234272615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d4057070 con 0x55621dc569f0 2024-05-08T09:21:50.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.175+0000 7f39e2263640 1 -- 172.21.15.161:0/1234272615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4052570 con 0x55621dc569f0 2024-05-08T09:21:50.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.175+0000 7f39e2263640 1 -- 172.21.15.161:0/1234272615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d404ae60 con 0x55621dc569f0 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1234272615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 msgr2=0x55621dc56e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1234272615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dc56e10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39d400a520 tx=0x7f39d401d010 comp rx=0 tx=0).stop 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1234272615 shutdown_connections 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1234272615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dc56e10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1234272615 >> 172.21.15.161:0/1234272615 conn(0x55621dc525b0 msgr2=0x55621dc549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1234272615 shutdown_connections 2024-05-08T09:21:50.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.176+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1234272615 wait complete. 2024-05-08T09:21:50.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e6d2a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e6d2a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55621dba31c0 con 0x55621dc569f0 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e2a64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e2a64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52706/0 (socket says 172.21.15.161:52706) 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.190+0000 7f39e2a64640 1 -- 172.21.15.161:0/382200303 learned_addr learned my addr 172.21.15.161:0/382200303 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.191+0000 7f39e2a64640 1 -- 172.21.15.161:0/382200303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dd4c0e0 con 0x55621dc569f0 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.191+0000 7f39e2a64640 1 --2- 172.21.15.161:0/382200303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39d4055040 tx=0x7f39d404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8b521a154a0d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.191+0000 7f38d0e09640 1 -- 172.21.15.161:0/382200303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d4057040 con 0x55621dc569f0 2024-05-08T09:21:50.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.191+0000 7f38d0e09640 1 -- 172.21.15.161:0/382200303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d4052720 con 0x55621dc569f0 2024-05-08T09:21:50.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.191+0000 7f38d0e09640 1 -- 172.21.15.161:0/382200303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d4052a20 con 0x55621dc569f0 2024-05-08T09:21:50.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- 172.21.15.161:0/382200303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 msgr2=0x55621dd4bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/382200303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39d4055040 tx=0x7f39d404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- 172.21.15.161:0/382200303 shutdown_connections 2024-05-08T09:21:50.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/382200303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd4bb10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- 172.21.15.161:0/382200303 >> 172.21.15.161:0/382200303 conn(0x55621dc525b0 msgr2=0x55621dd47430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- 172.21.15.161:0/382200303 shutdown_connections 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- 172.21.15.161:0/382200303 wait complete. 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.192+0000 7f39e6d2a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55621dc58440 con 0x55621dc569f0 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e2a64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e2a64640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52710/0 (socket says 172.21.15.161:52710) 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e2a64640 1 -- 172.21.15.161:0/2724051100 learned_addr learned my addr 172.21.15.161:0/2724051100 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e2a64640 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dd53a70 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e2a64640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39d4052540 tx=0x7f39d4003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f38cf606640 1 -- 172.21.15.161:0/2724051100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d4073070 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f38cf606640 1 -- 172.21.15.161:0/2724051100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39d405d440 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55621dd53d00 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.193+0000 7f38cf606640 1 -- 172.21.15.161:0/2724051100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39d4057070 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.194+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621dd569b0 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.194+0000 7f38cf606640 1 -- 172.21.15.161:0/2724051100 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39d4076070 con 0x55621dc569f0 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.194+0000 7f38cf606640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 0x7f38c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.194+0000 7f38cf606640 1 -- 172.21.15.161:0/2724051100 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f39d408dc40 con 0x55621dc569f0 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39dbfff640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 0x7f38c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 0x55621dd5a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd5acb0 con 0x55621dc57350 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e3265640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 0x55621dd5a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39dbfff640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 0x7f38c8038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001e40 tx=0x7f39cc0013a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e3265640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 0x55621dd5a770 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e3265640 1 -- 172.21.15.161:0/2724051100 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39dc00a4a0 con 0x55621dc57350 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.195+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd57d40 con 0x55621dc57350 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.196+0000 7f39e3265640 1 -- 172.21.15.161:0/2724051100 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39dc00a4a0 con 0x55621dc57350 2024-05-08T09:21:50.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.196+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 0x55621dd5f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.196+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd5fa60 con 0x55621dd5cfa0 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.196+0000 7f39e2a64640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 0x55621dd5f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.196+0000 7f39e2a64640 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 0x55621dd5f390 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e2a64640 1 -- 172.21.15.161:0/2724051100 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd5cfa0 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd5bf50 con 0x55621dc57350 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e3265640 1 -- 172.21.15.161:0/2724051100 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39dc00a4a0 con 0x55621dc57350 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd5c3f0 con 0x55621dc57350 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e3265640 1 -- 172.21.15.161:0/2724051100 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f39dc00a4a0 con 0x55621dc57350 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.197+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e6d2a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e6d2a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55621db49cf0 con 0x55621dd6ebf0 2024-05-08T09:21:50.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52714/0 (socket says 172.21.15.161:52714) 2024-05-08T09:21:50.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e3265640 1 -- 172.21.15.161:0/1101144087 learned_addr learned my addr 172.21.15.161:0/1101144087 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e3265640 1 -- 172.21.15.161:0/1101144087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dd6f550 con 0x55621dd6ebf0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f39e3265640 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55621dd5b050 tx=0x7f39dc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f38cce01640 1 -- 172.21.15.161:0/1101144087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc014450 con 0x55621dd6ebf0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f38cce01640 1 -- 172.21.15.161:0/1101144087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc0145f0 con 0x55621dd6ebf0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.198+0000 7f38cce01640 1 -- 172.21.15.161:0/1101144087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc014910 con 0x55621dd6ebf0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.199+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55621dd6ffc0 con 0x55621dd6ebf0 2024-05-08T09:21:50.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.199+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621dd704c0 con 0x55621dd6ebf0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.199+0000 7f38cce01640 1 -- 172.21.15.161:0/1101144087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39dc011040 con 0x55621dd6ebf0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.199+0000 7f38cce01640 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 0x7f38bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f38cce01640 1 -- 172.21.15.161:0/1101144087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f39dc01e070 con 0x55621dd6ebf0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e2a64640 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 0x7f38bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e2a64640 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 0x7f38bc038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55621dd5b0f0 tx=0x7f39d405ee80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e6d2a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e6d2a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55621dd4c3a0 con 0x55621dd7bed0 2024-05-08T09:21:50.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52716/0 (socket says 172.21.15.161:52716) 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.200+0000 7f39e3265640 1 -- 172.21.15.161:0/658656579 learned_addr learned my addr 172.21.15.161:0/658656579 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e3265640 1 -- 172.21.15.161:0/658656579 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dd7c8c0 con 0x55621dd7bed0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e3265640 1 --2- 172.21.15.161:0/658656579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39dc04c8a0 tx=0x7f39dc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64ffa70e049a3fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f38c67fc640 1 -- 172.21.15.161:0/658656579 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc016940 con 0x55621dd7bed0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f38c67fc640 1 -- 172.21.15.161:0/658656579 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc04e0d0 con 0x55621dd7bed0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f38c67fc640 1 -- 172.21.15.161:0/658656579 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc04b1d0 con 0x55621dd7bed0 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 -- 172.21.15.161:0/658656579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 msgr2=0x55621dd7c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/658656579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f39dc04c8a0 tx=0x7f39dc011700 comp rx=0 tx=0).stop 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 -- 172.21.15.161:0/658656579 shutdown_connections 2024-05-08T09:21:50.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/658656579 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd7c2f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 -- 172.21.15.161:0/658656579 >> 172.21.15.161:0/658656579 conn(0x55621dd781f0 msgr2=0x55621dd76250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 -- 172.21.15.161:0/658656579 shutdown_connections 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.201+0000 7f39e6d2a800 1 -- 172.21.15.161:0/658656579 wait complete. 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e6d2a800 1 Processor -- start 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e6d2a800 1 -- start start 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e6d2a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd83520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e6d2a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55621dd7d040 con 0x55621dd7bed0 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd83520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e3265640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd83520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52718/0 (socket says 172.21.15.161:52718) 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 learned_addr learned my addr 172.21.15.161:0/75419928 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621dd83a60 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e3265640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd83520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f39dc011740 tx=0x7f39dc04c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f38c4ff9640 1 -- 172.21.15.161:0/75419928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc016940 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f38c4ff9640 1 -- 172.21.15.161:0/75419928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39dc022a50 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.202+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55621dd83cf0 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.203+0000 7f38c4ff9640 1 -- 172.21.15.161:0/75419928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39dc022d30 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.203+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621dd869a0 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.203+0000 7f38c4ff9640 1 -- 172.21.15.161:0/75419928 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f39dc02b350 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.203+0000 7f38c4ff9640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38ac036950 0x7f38ac038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.203+0000 7f38c4ff9640 1 -- 172.21.15.161:0/75419928 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f39dc046040 con 0x55621dd7bed0 2024-05-08T09:21:50.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39e2a64640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38ac036950 0x7f38ac038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39e2a64640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38ac036950 0x7f38ac038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39d40066d0 tx=0x7f39d4090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dd8f140 0x55621dd91600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd91d50 con 0x55621dd8f140 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.204+0000 7f39dbfff640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dd8f140 0x55621dd91600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39dbfff640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dd8f140 0x55621dd91600 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc00f670 con 0x55621dd8f140 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 realm 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd8e590 con 0x55621dd8f140 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc00f670 con 0x55621dd8f140 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd92840 con 0x55621dd8f140 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc00f670 con 0x55621dd8f140 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd93110 con 0x55621dd8f140 2024-05-08T09:21:50.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f39cc00f670 con 0x55621dd8f140 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.205+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd93a10 0x55621dd95e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd965d0 con 0x55621dd93a10 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e3265640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd93a10 0x55621dd95e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e3265640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd93a10 0x55621dd95e40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e6d2a800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e6d2a800 20 searching for the correct realm 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55621dd985a0 0x55621dd9aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.206+0000 7f39e2a64640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55621dd985a0 0x55621dd9aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.207+0000 7f39e2a64640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55621dd985a0 0x55621dd9aa60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.207+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.207+0000 7f39e2a64640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f39d4078060 0x7f39d408d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.207+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.207+0000 7f39dbfff640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f39d4078060 0x7f39d408d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.208+0000 7f39dbfff640 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f39d4078060 0x7f39d408d3f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.208+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc00f670 con 0x7f39d4078060 2024-05-08T09:21:50.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.208+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.208+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.208+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc00f670 con 0x55621dd8f140 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.209+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x7f39d4078060 2024-05-08T09:21:50.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.210+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f39cc02b040 con 0x7f39d4078060 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.211+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.212+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x7f39d4078060 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.213+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.214+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x7f39d4078060 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd985a0 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd93a10 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x55621dd8f140 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.215+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9b130 con 0x7f39d4078060 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f39cc02b040 con 0x7f39d4078060 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd96f90 con 0x55621dd8f140 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f39cc02b040 con 0x55621dd8f140 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd96bd0 con 0x55621dd8f140 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd97970 con 0x55621dd8f140 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.216+0000 7f39e6d2a800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 zone default found 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 4 Realm: () 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 zonegroup default 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd97470 con 0x55621dd93a10 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9d940 con 0x55621dd985a0 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.217+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9dce0 con 0x55621dd985a0 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.218+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.218+0000 7f39e6d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.218+0000 7f39e6d2a800 20 started sync module instance, tier type = 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.218+0000 7f39e6d2a800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.218+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9cd80 con 0x7f39d4078060 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.219+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.219+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93879895970480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9cd80 con 0x7f39d4078060 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.219+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9e700 con 0x55621dd8f140 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.220+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.220+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93879895970480] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.220+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93879895974384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9e6c0 con 0x55621dd8f140 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.220+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9c910 con 0x55621dd985a0 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.221+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93879895974384] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.221+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.221+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93879895976688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9f6a0 con 0x55621dd985a0 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.221+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9ff70 con 0x7f39d4078060 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.222+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93879895976688] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.222+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.222+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93879895980608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda0360 con 0x7f39d4078060 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.222+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda0d60 con 0x55621dd8f140 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.223+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.223+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93879895984240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda0c90 con 0x55621dd8f140 2024-05-08T09:21:50.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.223+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda1c50 con 0x55621dd93a10 2024-05-08T09:21:50.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.223+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93879895980608] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.224+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93879895984240] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.224+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.224+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93879895986512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda1770 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.224+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2610 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.225+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93879895986512] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.225+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.225+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93879895978480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2610 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.225+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2fd0 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93879895978480] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93879895993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda3430 con 0x55621dd93a10 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=0 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=1 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=2 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=3 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=4 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=5 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.226+0000 7f39e6d2a800 20 add_watcher() i=6 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93879895993120] v27'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39e6d2a800 20 add_watcher() i=7 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39e6d2a800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dda21f0 con 0x55621dd8f140 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.227+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93879895994176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda21f0 con 0x55621dd8f140 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93879895994176] v27'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f38997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 5 note: GC not initialized 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f3813fff640 20 reqs_thread_entry: start 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 20 Filter name: none 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f3811ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.229+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621ddd99b0 con 0x55621dd8f140 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39e6d2a800 20 rados_obj.operate() r=0 bl.length=673 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39e6d2a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39e6d2a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39e6d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.230+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dde0190 con 0x55621dd8f140 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v27'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39e6d2a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39e6d2a800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39e6d2a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93879896243200 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621dddedf0 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 93879895984240 notify 115964117000 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7f39cc018040 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f38c67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93879895984240 notifier 4397 bl.length()=758 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f38c67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f38c67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 93879896243200 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f38c67fc640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f38a8003ea0 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 93879896243200 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f39cc009050 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.231+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dddfc00 con 0x55621dd8f140 2024-05-08T09:21:50.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.232+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 foo:foo1 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.232+0000 7f39e6d2a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.232+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93879896243200 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55621ddde940 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== watch-notify(notify (1) cookie 93879895970480 notify 115964116996 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f39cc009050 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f38c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 93879895970480 notifier 4397 bl.length()=159 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [notify cookie 93879896243200 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f38c5ffb640 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f38180032c0 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== watch-notify(notify_complete (2) cookie 93879896243200 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55621dbcba70 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.233+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.253 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T09:21:49.945413Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.234+0000 7f38997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.234+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93879895994176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621ddda420 con 0x55621dd8f140 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.235+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93879895994176] v27'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.235+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93879895970480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2f40 con 0x7f39d4078060 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.236+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93879895970480] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.236+0000 7f39e6d2a800 20 remove_watcher() i=0 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.236+0000 7f39e6d2a800 2 removed watcher, disabling cache 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.236+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93879895974384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2f40 con 0x55621dd8f140 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.237+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93879895974384] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.237+0000 7f39e6d2a800 20 remove_watcher() i=1 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.237+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93879895976688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda2f40 con 0x55621dd985a0 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.239+0000 7f39e2a64640 1 -- 172.21.15.161:0/75419928 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93879895976688] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39d4075030 con 0x55621dd985a0 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.239+0000 7f39e6d2a800 20 remove_watcher() i=2 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.239+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93879895980608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9eaf0 con 0x7f39d4078060 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.240+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93879895980608] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x7f39d4078060 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.240+0000 7f39e6d2a800 20 remove_watcher() i=3 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.240+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93879895984240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dd9fa40 con 0x55621dd8f140 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.241+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93879895984240] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39cc03d040 con 0x55621dd8f140 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.241+0000 7f39e6d2a800 20 remove_watcher() i=4 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.241+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93879895986512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda0870 con 0x55621dd93a10 2024-05-08T09:21:50.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.242+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93879895986512] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.242+0000 7f39e6d2a800 20 remove_watcher() i=5 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.242+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93879895978480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda1150 con 0x55621dd93a10 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.243+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93879895978480] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.243+0000 7f39e6d2a800 20 remove_watcher() i=6 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.243+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93879895993120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55621dda0870 con 0x55621dd93a10 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e3265640 1 -- 172.21.15.161:0/75419928 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93879895993120] v27'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f39dc03c020 con 0x55621dd93a10 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 20 remove_watcher() i=7 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd93a10 msgr2=0x55621dd95e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd93a10 0x55621dd95e40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dd8f140 msgr2=0x55621dd91600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dd8f140 0x55621dd91600 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f39d4078060 msgr2=0x7f39d408d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f39d4078060 0x7f39d408d3f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55621dd985a0 msgr2=0x55621dd9aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55621dd985a0 0x55621dd9aa60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38ac036950 msgr2=0x7f38ac038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38ac036950 0x7f38ac038e10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f39d40066d0 tx=0x7f39d4090000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 msgr2=0x55621dd83520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/75419928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd7bed0 0x55621dd83520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f39dc011740 tx=0x7f39dc04c830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 reap_dead start 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39dbfff640 1 -- 172.21.15.161:0/75419928 reap_dead start 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 shutdown_connections 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 >> 172.21.15.161:0/75419928 conn(0x55621dd781f0 msgr2=0x55621dd75850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 shutdown_connections 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/75419928 wait complete. 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 msgr2=0x7f38bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 0x7f38bc038e10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x55621dd5b0f0 tx=0x7f39d405ee80 comp rx=0 tx=0).stop 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 msgr2=0x55621dd6f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55621dd5b050 tx=0x7f39dc018830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 shutdown_connections 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38bc036950 0x7f38bc038e10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/1101144087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dd6ebf0 0x55621dd6f010 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 >> 172.21.15.161:0/1101144087 conn(0x55621dd62c90 msgr2=0x55621dd63090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 shutdown_connections 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.245+0000 7f39e6d2a800 1 -- 172.21.15.161:0/1101144087 wait complete. 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 msgr2=0x55621dd5f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 0x55621dd5f390 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 msgr2=0x55621dd5a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 0x55621dd5a770 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 msgr2=0x7f38c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 0x7f38c8038e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f39cc001e40 tx=0x7f39cc0013a0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 msgr2=0x55621dd53530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39d4052540 tx=0x7f39d4003020 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 shutdown_connections 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55621dd5cfa0 0x55621dd5f390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55621dc57350 0x55621dd5a770 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f38c8036950 0x7f38c8038e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 --2- 172.21.15.161:0/2724051100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55621dc569f0 0x55621dd53530 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 >> 172.21.15.161:0/2724051100 conn(0x55621dc525b0 msgr2=0x55621dd45c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 shutdown_connections 2024-05-08T09:21:50.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.246+0000 7f39e6d2a800 1 -- 172.21.15.161:0/2724051100 wait complete. 2024-05-08T09:21:50.266 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T09:21:49.945413Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:50.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T09:21:50.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-05-08T09:21:50.266 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-05-08T09:21:50.313 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.314 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.314+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.314+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.314+0000 7f892952b800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ad1749fd0 0x564ad174a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.314+0000 7f892952b800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ad174aa70 con 0x564ad174b230 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.314+0000 7f892952b800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564ad15dc050 con 0x564ad1749fd0 2024-05-08T09:21:50.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.315+0000 7f89252ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ad1749fd0 0x564ad174a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.315+0000 7f89252ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ad1749fd0 0x564ad174a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52732/0 (socket says 172.21.15.161:52732) 2024-05-08T09:21:50.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.315+0000 7f89252ef640 1 -- 172.21.15.161:0/3727659867 learned_addr learned my addr 172.21.15.161:0/3727659867 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.315+0000 7f89252ef640 1 -- 172.21.15.161:0/3727659867 >> v1:172.21.15.45:6789/0 conn(0x564ad174b230 legacy=0x564ad174b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:50.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.315+0000 7f89252ef640 1 -- 172.21.15.161:0/3727659867 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad174bdf0 con 0x564ad1749fd0 2024-05-08T09:21:50.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.317+0000 7f89252ef640 1 --2- 172.21.15.161:0/3727659867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad174a3f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f891800a520 tx=0x7f891801cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356318be244f1afb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.317+0000 7f8924aee640 1 -- 172.21.15.161:0/3727659867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918057070 con 0x564ad1749fd0 2024-05-08T09:21:50.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.317+0000 7f8924aee640 1 -- 172.21.15.161:0/3727659867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918052570 con 0x564ad1749fd0 2024-05-08T09:21:50.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.317+0000 7f8924aee640 1 -- 172.21.15.161:0/3727659867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918052870 con 0x564ad1749fd0 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 -- 172.21.15.161:0/3727659867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 msgr2=0x564ad174a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 --2- 172.21.15.161:0/3727659867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad174a3f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f891800a520 tx=0x7f891801cf70 comp rx=0 tx=0).stop 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 -- 172.21.15.161:0/3727659867 shutdown_connections 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 --2- 172.21.15.161:0/3727659867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad174a3f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 -- 172.21.15.161:0/3727659867 >> 172.21.15.161:0/3727659867 conn(0x564ad17455b0 msgr2=0x564ad17479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 -- 172.21.15.161:0/3727659867 shutdown_connections 2024-05-08T09:21:50.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.318+0000 7f892952b800 1 -- 172.21.15.161:0/3727659867 wait complete. 2024-05-08T09:21:50.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f892952b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f892952b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ad16961d0 con 0x564ad1749fd0 2024-05-08T09:21:50.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f89252ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f89252ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52748/0 (socket says 172.21.15.161:52748) 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f89252ef640 1 -- 172.21.15.161:0/1703356397 learned_addr learned my addr 172.21.15.161:0/1703356397 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f89252ef640 1 -- 172.21.15.161:0/1703356397 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad183f5d0 con 0x564ad1749fd0 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.332+0000 7f89252ef640 1 --2- 172.21.15.161:0/1703356397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8918055040 tx=0x7f891804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca884868487816d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f8813606640 1 -- 172.21.15.161:0/1703356397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918057040 con 0x564ad1749fd0 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f8813606640 1 -- 172.21.15.161:0/1703356397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8918052850 con 0x564ad1749fd0 2024-05-08T09:21:50.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f8813606640 1 -- 172.21.15.161:0/1703356397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918052b50 con 0x564ad1749fd0 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 -- 172.21.15.161:0/1703356397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 msgr2=0x564ad16bde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 --2- 172.21.15.161:0/1703356397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8918055040 tx=0x7f891804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 -- 172.21.15.161:0/1703356397 shutdown_connections 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 --2- 172.21.15.161:0/1703356397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad16bde40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 -- 172.21.15.161:0/1703356397 >> 172.21.15.161:0/1703356397 conn(0x564ad17455b0 msgr2=0x564ad18370c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 -- 172.21.15.161:0/1703356397 shutdown_connections 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.333+0000 7f892952b800 1 -- 172.21.15.161:0/1703356397 wait complete. 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f892952b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f892952b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ad1753700 con 0x564ad1749fd0 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f89252ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f89252ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52758/0 (socket says 172.21.15.161:52758) 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f89252ef640 1 -- 172.21.15.161:0/1362629919 learned_addr learned my addr 172.21.15.161:0/1362629919 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.334+0000 7f89252ef640 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad183b5d0 con 0x564ad1749fd0 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f89252ef640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8918052540 tx=0x7f8918003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f8811e03640 1 -- 172.21.15.161:0/1362629919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918073070 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f8811e03640 1 -- 172.21.15.161:0/1362629919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f891805d570 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f8811e03640 1 -- 172.21.15.161:0/1362629919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8918057070 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad183b860 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.335+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad183bd80 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f8811e03640 1 -- 172.21.15.161:0/1362629919 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8918076070 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f8811e03640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 0x7f880c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f8811e03640 1 -- 172.21.15.161:0/1362629919 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f891808ddc0 con 0x564ad1749fd0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f891caee640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 0x7f880c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 0x564ad184d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad184dc70 con 0x564ad174b230 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f8925af0640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 0x564ad184d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f891caee640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 0x7f880c038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f891000a430 tx=0x7f8910005540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.336+0000 7f8925af0640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 0x564ad184d730 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f8925af0640 1 -- 172.21.15.161:0/1362629919 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f892000a4a0 con 0x564ad174b230 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad183c0f0 con 0x564ad174b230 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f8925af0640 1 -- 172.21.15.161:0/1362629919 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f892000a4a0 con 0x564ad174b230 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 0x564ad1852370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1852a60 con 0x564ad184ff80 2024-05-08T09:21:50.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.337+0000 7f89252ef640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 0x564ad1852370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.338+0000 7f89252ef640 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 0x564ad1852370 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.338+0000 7f89252ef640 1 -- 172.21.15.161:0/1362629919 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8918075030 con 0x564ad184ff80 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.338+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad184ef00 con 0x564ad174b230 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f8925af0640 1 -- 172.21.15.161:0/1362629919 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f892000a4a0 con 0x564ad174b230 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad184f3e0 con 0x564ad174b230 2024-05-08T09:21:50.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f8925af0640 1 -- 172.21.15.161:0/1362629919 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f892000a4a0 con 0x564ad174b230 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f892952b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f892952b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ad163ccf0 con 0x564ad1861b90 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.339+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52770/0 (socket says 172.21.15.161:52770) 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f8925af0640 1 -- 172.21.15.161:0/3006718743 learned_addr learned my addr 172.21.15.161:0/3006718743 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f8925af0640 1 -- 172.21.15.161:0/3006718743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad18624f0 con 0x564ad1861b90 2024-05-08T09:21:50.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f8925af0640 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x564ad184e050 tx=0x7f8920018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f880affd640 1 -- 172.21.15.161:0/3006718743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920014450 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f880affd640 1 -- 172.21.15.161:0/3006718743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8920014610 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f880affd640 1 -- 172.21.15.161:0/3006718743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920014930 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad1862f60 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.340+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad1863460 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.341+0000 7f880affd640 1 -- 172.21.15.161:0/3006718743 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8920011040 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.341+0000 7f880affd640 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 0x7f8800038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.341+0000 7f880affd640 1 -- 172.21.15.161:0/3006718743 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f892001e070 con 0x564ad1861b90 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.341+0000 7f89252ef640 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 0x7f8800038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f89252ef640 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 0x7f8800038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f891808c1b0 tx=0x7f89180069f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f892952b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f892952b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ad183f860 con 0x564ad186eed0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52776/0 (socket says 172.21.15.161:52776) 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f8925af0640 1 -- 172.21.15.161:0/569347421 learned_addr learned my addr 172.21.15.161:0/569347421 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f8925af0640 1 -- 172.21.15.161:0/569347421 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad186f8c0 con 0x564ad186eed0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.342+0000 7f8925af0640 1 --2- 172.21.15.161:0/569347421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f892004c900 tx=0x7f8920011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b623aa3ae673d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f8808ff9640 1 -- 172.21.15.161:0/569347421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892000dd90 con 0x564ad186eed0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f8808ff9640 1 -- 172.21.15.161:0/569347421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89200167e0 con 0x564ad186eed0 2024-05-08T09:21:50.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f8808ff9640 1 -- 172.21.15.161:0/569347421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8920014ad0 con 0x564ad186eed0 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 -- 172.21.15.161:0/569347421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 msgr2=0x564ad186f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 --2- 172.21.15.161:0/569347421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f892004c900 tx=0x7f8920011b30 comp rx=0 tx=0).stop 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 -- 172.21.15.161:0/569347421 shutdown_connections 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 --2- 172.21.15.161:0/569347421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad186f2f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 -- 172.21.15.161:0/569347421 >> 172.21.15.161:0/569347421 conn(0x564ad186b150 msgr2=0x564ad18691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 -- 172.21.15.161:0/569347421 shutdown_connections 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 -- 172.21.15.161:0/569347421 wait complete. 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.343+0000 7f892952b800 1 Processor -- start 2024-05-08T09:21:50.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f892952b800 1 -- start start 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f892952b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f892952b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ad186fff0 con 0x564ad186eed0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f8925af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52782/0 (socket says 172.21.15.161:52782) 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 learned_addr learned my addr 172.21.15.161:0/3043649697 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.344+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ad1876960 con 0x564ad186eed0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f8925af0640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8920013e80 tx=0x7f892004c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f87f6ffd640 1 -- 172.21.15.161:0/3043649697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892004e2e0 con 0x564ad186eed0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f87f6ffd640 1 -- 172.21.15.161:0/3043649697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892004b200 con 0x564ad186eed0 2024-05-08T09:21:50.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564ad1876bf0 con 0x564ad186eed0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f87f6ffd640 1 -- 172.21.15.161:0/3043649697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f892004b540 con 0x564ad186eed0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ad18798a0 con 0x564ad186eed0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.345+0000 7f87f6ffd640 1 -- 172.21.15.161:0/3043649697 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f892003bb20 con 0x564ad186eed0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f87f6ffd640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f0036950 0x7f87f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f87f6ffd640 1 -- 172.21.15.161:0/3043649697 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f892000e040 con 0x564ad186eed0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f89252ef640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f0036950 0x7f87f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f89252ef640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f0036950 0x7f87f0038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f891805dab0 tx=0x7f8918091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad1881f50 0x564ad1884410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1884b60 con 0x564ad1881f50 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.346+0000 7f891caee640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad1881f50 0x564ad1884410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f891caee640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad1881f50 0x564ad1884410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891000b8f0 con 0x564ad1881f50 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 realm 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1881380 con 0x564ad1881f50 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891000b8f0 con 0x564ad1881f50 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1885630 con 0x564ad1881f50 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f891000b8f0 con 0x564ad1881f50 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.347+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1885f00 con 0x564ad1881f50 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f891000b8f0 con 0x564ad1881f50 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f892952b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad1886920 0x564ad1888d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1889450 con 0x564ad1886920 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f8925af0640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad1886920 0x564ad1888d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.348+0000 7f8925af0640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad1886920 0x564ad1888d10 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f892952b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f892952b800 20 searching for the correct realm 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564ad188b3e0 0x564ad188d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f89252ef640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564ad188b3e0 0x564ad188d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f89252ef640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564ad188b3e0 0x564ad188d8a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.349+0000 7f89252ef640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8918078060 0x7f8918079420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.350+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.350+0000 7f891caee640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8918078060 0x7f8918079420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.350+0000 7f891caee640 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8918078060 0x7f8918079420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.350+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f891000b8f0 con 0x7f8918078060 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.350+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.351+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x7f8918078060 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.352+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.353+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8910024040 con 0x7f8918078060 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.354+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.355+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x7f8918078060 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.356+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.357+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x7f8918078060 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad188b3e0 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.358+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1886920 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x564ad1881f50 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564ad188df20 con 0x7f8918078060 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8910024040 con 0x7f8918078060 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad188a930 con 0x564ad1881f50 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.359+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad188a1a0 con 0x564ad1881f50 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8910024040 con 0x564ad1881f50 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad18898e0 con 0x564ad1881f50 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 zone default found 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 4 Realm: () 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 zonegroup default 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.360+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad188e430 con 0x564ad1886920 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1890700 con 0x564ad188b3e0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1890aa0 con 0x564ad188b3e0 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 started sync module instance, tier type = 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.361+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188fb90 con 0x7f8918078060 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.362+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x7f8918078060 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.362+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94879342985392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188fb90 con 0x7f8918078060 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.362+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18914a0 con 0x564ad1881f50 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.363+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94879342985392] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x7f8918078060 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.363+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.363+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94879342989232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188fb90 con 0x564ad1881f50 2024-05-08T09:21:50.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.363+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1891ef0 con 0x564ad188b3e0 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.364+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94879342989232] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.365+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.365+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94879342982880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188fb00 con 0x564ad188b3e0 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.365+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1892db0 con 0x7f8918078060 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.366+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x7f8918078060 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.366+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94879342982880] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.366+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94879342995920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18932a0 con 0x7f8918078060 2024-05-08T09:21:50.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.366+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1893b30 con 0x564ad1881f50 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.367+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94879342995920] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x7f8918078060 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.367+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.367+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94879342996976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18936c0 con 0x564ad1881f50 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.367+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1894540 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.368+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94879342996976] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.368+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.368+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94879342998032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1893630 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.368+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18953b0 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.369+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94879342998032] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.369+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.369+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94879343003872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18953b0 con 0x564ad1886920 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.369+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1895db0 con 0x564ad1886920 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94879343003872] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94879343005440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1895f50 con 0x564ad1886920 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=0 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=1 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=2 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=3 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=4 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=5 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.370+0000 7f892952b800 20 add_watcher() i=6 2024-05-08T09:21:50.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.371+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94879343005440] v27'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.371+0000 7f892952b800 20 add_watcher() i=7 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.371+0000 7f892952b800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.371+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad1899130 con 0x564ad1881f50 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.372+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.372+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94879343008512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18963d0 con 0x564ad1881f50 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94879343008512] v27'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f87db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f892952b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f892952b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f892952b800 5 note: GC not initialized 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f87da7e4640 20 reqs_thread_entry: start 2024-05-08T09:21:50.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f892952b800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f892952b800 20 Filter name: none 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.373+0000 7f874bfff640 20 reqs_thread_entry: start 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad18cc6d0 con 0x564ad1881f50 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 20 rados_obj.operate() r=0 bl.length=582 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.374+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18d2aa0 con 0x564ad1881f50 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.375+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v27'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8910038040 con 0x564ad1881f50 2024-05-08T09:21:50.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.375+0000 7f892952b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.375+0000 7f892952b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.375+0000 7f892952b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.375+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94879343256848 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564ad18ce580 con 0x564ad1881f50 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94879342996976 notify 115964117001 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f891002ad20 con 0x564ad1881f50 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f8808ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94879342996976 notifier 4403 bl.length()=732 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f8808ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f8808ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f8808ff9640 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f87e8003ea0 con 0x564ad1881f50 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94879343256848 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8910005020 con 0x564ad1881f50 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910005020 con 0x564ad1881f50 2024-05-08T09:21:50.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.376+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94879343256848 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f891003c430 con 0x564ad1881f50 2024-05-08T09:21:50.398 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-05-08T09:21:49.945413Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:50.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.377+0000 7f87db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.377+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94879343008512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18cdba0 con 0x564ad1881f50 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.378+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94879343008512] v27'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8910005020 con 0x564ad1881f50 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.378+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94879342985392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18cdba0 con 0x7f8918078060 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.379+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94879342985392] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910005020 con 0x7f8918078060 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.379+0000 7f892952b800 20 remove_watcher() i=0 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.379+0000 7f892952b800 2 removed watcher, disabling cache 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.379+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94879342989232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18cdba0 con 0x564ad1881f50 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.380+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94879342989232] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910005020 con 0x564ad1881f50 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.380+0000 7f892952b800 20 remove_watcher() i=1 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.380+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94879342982880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad18cdba0 con 0x564ad188b3e0 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.381+0000 7f89252ef640 1 -- 172.21.15.161:0/3043649697 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94879342982880] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8918075030 con 0x564ad188b3e0 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.381+0000 7f892952b800 20 remove_watcher() i=2 2024-05-08T09:21:50.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.381+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94879342995920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1890fb0 con 0x7f8918078060 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.382+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94879342995920] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910005020 con 0x7f8918078060 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.382+0000 7f892952b800 20 remove_watcher() i=3 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.382+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94879342996976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188f6e0 con 0x564ad1881f50 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.383+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94879342996976] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8910005020 con 0x564ad1881f50 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.383+0000 7f892952b800 20 remove_watcher() i=4 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.383+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94879342998032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1890fb0 con 0x564ad1886920 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.384+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94879342998032] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.384+0000 7f892952b800 20 remove_watcher() i=5 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.384+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94879343003872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad188f6e0 con 0x564ad1886920 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.385+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94879343003872] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.385+0000 7f892952b800 20 remove_watcher() i=6 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.385+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94879343005440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564ad1890fb0 con 0x564ad1886920 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f8925af0640 1 -- 172.21.15.161:0/3043649697 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94879343005440] v27'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f892002a070 con 0x564ad1886920 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 20 remove_watcher() i=7 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad1886920 msgr2=0x564ad1888d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad1886920 0x564ad1888d10 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad1881f50 msgr2=0x564ad1884410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad1881f50 0x564ad1884410 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8918078060 msgr2=0x7f8918079420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8918078060 0x7f8918079420 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564ad188b3e0 msgr2=0x564ad188d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564ad188b3e0 0x564ad188d8a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f0036950 msgr2=0x7f87f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f87f0036950 0x7f87f0038e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f891805dab0 tx=0x7f8918091000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 msgr2=0x564ad1876420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8920013e80 tx=0x7f892004c860 comp rx=0 tx=0).stop 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f891caee640 1 -- 172.21.15.161:0/3043649697 reap_dead start 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 shutdown_connections 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 --2- 172.21.15.161:0/3043649697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad186eed0 0x564ad1876420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.386+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 >> 172.21.15.161:0/3043649697 conn(0x564ad186b150 msgr2=0x564ad18687d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 shutdown_connections 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3043649697 wait complete. 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 msgr2=0x7f8800038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 0x7f8800038e10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f891808c1b0 tx=0x7f89180069f0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 msgr2=0x564ad1861fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x564ad184e050 tx=0x7f8920018830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 shutdown_connections 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8800036950 0x7f8800038e10 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/3006718743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1861b90 0x564ad1861fb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 >> 172.21.15.161:0/3006718743 conn(0x564ad1855c30 msgr2=0x564ad1856030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 shutdown_connections 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/3006718743 wait complete. 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 msgr2=0x564ad1852370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 0x564ad1852370 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 msgr2=0x564ad184d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 0x564ad184d730 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 msgr2=0x7f880c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 0x7f880c038e10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f891000a430 tx=0x7f8910005540 comp rx=0 tx=0).stop 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 msgr2=0x564ad183cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8918052540 tx=0x7f8918003020 comp rx=0 tx=0).stop 2024-05-08T09:21:50.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 shutdown_connections 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564ad184ff80 0x564ad1852370 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564ad174b230 0x564ad184d730 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f880c036950 0x7f880c038e10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 --2- 172.21.15.161:0/1362629919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ad1749fd0 0x564ad183cee0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.387+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 >> 172.21.15.161:0/1362629919 conn(0x564ad17455b0 msgr2=0x564ad18358c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.388+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 shutdown_connections 2024-05-08T09:21:50.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.388+0000 7f892952b800 1 -- 172.21.15.161:0/1362629919 wait complete. 2024-05-08T09:21:50.411 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-05-08T09:21:49.945413Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:50.411 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T09:21:50.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-05-08T09:21:50.412 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-05-08T09:21:50.460 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.460 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.461+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.461+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.461+0000 7fc304a1f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561764bdea40 0x561764bdee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.461+0000 7fc304a1f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561764b53a40 con 0x561764bdf3a0 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc304a1f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x561764a71050 con 0x561764bdea40 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc30251e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561764bdea40 0x561764bdee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc301d1d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x561764bdf3a0 0x561764bdf850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42888/0 (socket says 172.21.15.161:42888) 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc30251e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x561764bdea40 0x561764bdee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52796/0 (socket says 172.21.15.161:52796) 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc301d1d640 1 -- 172.21.15.161:0/2876971334 learned_addr learned my addr 172.21.15.161:0/2876971334 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:50.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc30251e640 1 -- 172.21.15.161:0/2876971334 >> v1:172.21.15.45:6789/0 conn(0x561764bdf3a0 legacy=0x561764bdf850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.462+0000 7fc30251e640 1 -- 172.21.15.161:0/2876971334 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764bdff60 con 0x561764bdea40 2024-05-08T09:21:50.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.464+0000 7fc30251e640 1 --2- 172.21.15.161:0/2876971334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764bdee60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400a470 tx=0x7fc2f401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36a11fc83e123e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.464+0000 7fc30151c640 1 -- 172.21.15.161:0/2876971334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4057070 con 0x561764bdea40 2024-05-08T09:21:50.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.464+0000 7fc30151c640 1 -- 172.21.15.161:0/2876971334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f4052570 con 0x561764bdea40 2024-05-08T09:21:50.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.464+0000 7fc30151c640 1 -- 172.21.15.161:0/2876971334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4052870 con 0x561764bdea40 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 -- 172.21.15.161:0/2876971334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 msgr2=0x561764bdee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 --2- 172.21.15.161:0/2876971334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764bdee60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc2f400a470 tx=0x7fc2f401ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 -- 172.21.15.161:0/2876971334 shutdown_connections 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 --2- 172.21.15.161:0/2876971334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764bdee60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 -- 172.21.15.161:0/2876971334 >> 172.21.15.161:0/2876971334 conn(0x561764bda5c0 msgr2=0x561764bdc9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 -- 172.21.15.161:0/2876971334 shutdown_connections 2024-05-08T09:21:50.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.465+0000 7fc304a1f800 1 -- 172.21.15.161:0/2876971334 wait complete. 2024-05-08T09:21:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc304a1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc304a1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561764b2b1f0 con 0x561764bdea40 2024-05-08T09:21:50.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc30251e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc30251e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52802/0 (socket says 172.21.15.161:52802) 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc30251e640 1 -- 172.21.15.161:0/942454808 learned_addr learned my addr 172.21.15.161:0/942454808 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.479+0000 7fc30251e640 1 -- 172.21.15.161:0/942454808 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764cd41b0 con 0x561764bdea40 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc30251e640 1 --2- 172.21.15.161:0/942454808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4055040 tx=0x7fc2f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140b272d0045b038 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc1f0608640 1 -- 172.21.15.161:0/942454808 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4057070 con 0x561764bdea40 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc1f0608640 1 -- 172.21.15.161:0/942454808 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f4063070 con 0x561764bdea40 2024-05-08T09:21:50.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc1f0608640 1 -- 172.21.15.161:0/942454808 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4052720 con 0x561764bdea40 2024-05-08T09:21:50.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 -- 172.21.15.161:0/942454808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 msgr2=0x561764cd3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 --2- 172.21.15.161:0/942454808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4055040 tx=0x7fc2f404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 -- 172.21.15.161:0/942454808 shutdown_connections 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 --2- 172.21.15.161:0/942454808 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cd3be0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 -- 172.21.15.161:0/942454808 >> 172.21.15.161:0/942454808 conn(0x561764bda5c0 msgr2=0x561764ccf500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 -- 172.21.15.161:0/942454808 shutdown_connections 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.480+0000 7fc304a1f800 1 -- 172.21.15.161:0/942454808 wait complete. 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc304a1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc304a1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561764be0430 con 0x561764bdea40 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc30251e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc30251e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52818/0 (socket says 172.21.15.161:52818) 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc30251e640 1 -- 172.21.15.161:0/4104290351 learned_addr learned my addr 172.21.15.161:0/4104290351 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.481+0000 7fc30251e640 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764cdbba0 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc30251e640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4060040 tx=0x7fc2f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc1eee05640 1 -- 172.21.15.161:0/4104290351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f4052e30 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc1eee05640 1 -- 172.21.15.161:0/4104290351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f406c070 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc1eee05640 1 -- 172.21.15.161:0/4104290351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f405e5f0 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561764cdbe30 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.482+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561764cdeae0 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc1eee05640 1 -- 172.21.15.161:0/4104290351 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc2f405e790 con 0x561764bdea40 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc1eee05640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 0x7fc1e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc1eee05640 1 -- 172.21.15.161:0/4104290351 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc2f408e900 con 0x561764bdea40 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc301d1d640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 0x7fc1e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 0x561764ce28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764ce2de0 con 0x561764bdf3a0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc302d1f640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 0x561764ce28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc301d1d640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 0x7fc1e8038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f60 tx=0x7fc2f80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.483+0000 7fc302d1f640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 0x561764ce28a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc302d1f640 1 -- 172.21.15.161:0/4104290351 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2fc00a4a0 con 0x561764bdf3a0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764cdfe70 con 0x561764bdf3a0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc302d1f640 1 -- 172.21.15.161:0/4104290351 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2fc00a4a0 con 0x561764bdf3a0 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 0x561764ce7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764ce7bf0 con 0x561764ce5130 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.484+0000 7fc30251e640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 0x561764ce7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.485+0000 7fc30251e640 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 0x561764ce7520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.485+0000 7fc30251e640 1 -- 172.21.15.161:0/4104290351 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2f4071990 con 0x561764ce5130 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.485+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764ce40e0 con 0x561764bdf3a0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.485+0000 7fc302d1f640 1 -- 172.21.15.161:0/4104290351 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2fc00a4a0 con 0x561764bdf3a0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.485+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764ce4580 con 0x561764bdf3a0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc302d1f640 1 -- 172.21.15.161:0/4104290351 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2fc00a4a0 con 0x561764bdf3a0 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc304a1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc304a1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561764ad1cf0 con 0x561764cf6d80 2024-05-08T09:21:50.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52826/0 (socket says 172.21.15.161:52826) 2024-05-08T09:21:50.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.486+0000 7fc302d1f640 1 -- 172.21.15.161:0/3683452392 learned_addr learned my addr 172.21.15.161:0/3683452392 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc302d1f640 1 -- 172.21.15.161:0/3683452392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764cf76e0 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc302d1f640 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x561764ce31e0 tx=0x7fc2fc018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc1e7fff640 1 -- 172.21.15.161:0/3683452392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc014450 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc1e7fff640 1 -- 172.21.15.161:0/3683452392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc0145f0 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561764cf8150 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc1e7fff640 1 -- 172.21.15.161:0/3683452392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc014910 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.487+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561764cf8650 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc1e7fff640 1 -- 172.21.15.161:0/3683452392 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc2fc011040 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc1e7fff640 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 0x7fc1dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc1e7fff640 1 -- 172.21.15.161:0/3683452392 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc2fc01e070 con 0x561764cf6d80 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc30251e640 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 0x7fc1dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc30251e640 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 0x7fc1dc038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x561764ce3280 tx=0x7fc2f408cc80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.488+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc304a1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc304a1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561764cd4470 con 0x561764d04020 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52838/0 (socket says 172.21.15.161:52838) 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc302d1f640 1 -- 172.21.15.161:0/3059744467 learned_addr learned my addr 172.21.15.161:0/3059744467 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc302d1f640 1 -- 172.21.15.161:0/3059744467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764d04a10 con 0x561764d04020 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc302d1f640 1 --2- 172.21.15.161:0/3059744467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc04c850 tx=0x7fc2fc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67664526b8f462ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc1e5ffb640 1 -- 172.21.15.161:0/3059744467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc03ee60 con 0x561764d04020 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc1e5ffb640 1 -- 172.21.15.161:0/3059744467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc013cb0 con 0x561764d04020 2024-05-08T09:21:50.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.489+0000 7fc1e5ffb640 1 -- 172.21.15.161:0/3059744467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc04e0d0 con 0x561764d04020 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- 172.21.15.161:0/3059744467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 msgr2=0x561764d04440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3059744467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc04c850 tx=0x7fc2fc011700 comp rx=0 tx=0).stop 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- 172.21.15.161:0/3059744467 shutdown_connections 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3059744467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d04440 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- 172.21.15.161:0/3059744467 >> 172.21.15.161:0/3059744467 conn(0x561764d00380 msgr2=0x561764cfe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- 172.21.15.161:0/3059744467 shutdown_connections 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- 172.21.15.161:0/3059744467 wait complete. 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 Processor -- start 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- start start 2024-05-08T09:21:50.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc304a1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x561764d05180 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc302d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52846/0 (socket says 172.21.15.161:52846) 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.490+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 learned_addr learned my addr 172.21.15.161:0/1620794711 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561764d0bb20 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc302d1f640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc040040 tx=0x7fc2fc04c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc1d3fff640 1 -- 172.21.15.161:0/1620794711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc013e60 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc1d3fff640 1 -- 172.21.15.161:0/1620794711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2fc02ba60 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561764d0bdb0 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc1d3fff640 1 -- 172.21.15.161:0/1620794711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2fc02bd40 con 0x561764d04020 2024-05-08T09:21:50.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.491+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561764d0ea60 con 0x561764d04020 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.492+0000 7fc1d3fff640 1 -- 172.21.15.161:0/1620794711 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc2fc022a50 con 0x561764d04020 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.492+0000 7fc1d3fff640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1cc036950 0x7fc1cc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.492+0000 7fc1d3fff640 1 -- 172.21.15.161:0/1620794711 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc2fc00e040 con 0x561764d04020 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.492+0000 7fc30251e640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1cc036950 0x7fc1cc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.492+0000 7fc30251e640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1cc036950 0x7fc1cc038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2f408e010 tx=0x7fc2f408b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764d170f0 0x561764d195b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d19d00 con 0x561764d170f0 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc301d1d640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764d170f0 0x561764d195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc301d1d640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764d170f0 0x561764d195b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f8009050 con 0x561764d170f0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 realm 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d16540 con 0x561764d170f0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f8009050 con 0x561764d170f0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.493+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1a7f0 con 0x561764d170f0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f8009050 con 0x561764d170f0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1b0c0 con 0x561764d170f0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f8009050 con 0x561764d170f0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764d1ba00 0x561764d1ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1e580 con 0x561764d1ba00 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.494+0000 7fc302d1f640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764d1ba00 0x561764d1ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc302d1f640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764d1ba00 0x561764d1ddf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc304a1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc304a1f800 20 searching for the correct realm 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x561764d20550 0x561764d22a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc30251e640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x561764d20550 0x561764d22a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.495+0000 7fc30251e640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x561764d20550 0x561764d22a10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc30251e640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc2f408e0b0 0x7fc2f407a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc301d1d640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc2f408e0b0 0x7fc2f407a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc301d1d640 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc2f408e0b0 0x7fc2f407a3f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8009050 con 0x7fc2f408e0b0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.496+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8009050 con 0x561764d170f0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.497+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.498+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.499+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.500+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.501+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.502+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d20550 2024-05-08T09:21:50.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.503+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d1ba00 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x561764d170f0 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x561764d230e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.504+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1ef40 con 0x561764d170f0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1eb80 con 0x561764d170f0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d1f8e0 con 0x561764d170f0 2024-05-08T09:21:50.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 zone default found 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 4 Realm: () 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 zonegroup default 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d235c0 con 0x561764d1ba00 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.505+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d25890 con 0x561764d20550 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d25c30 con 0x561764d20550 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 20 started sync module instance, tier type = 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.506+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d24d20 con 0x7fc2f408e0b0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.507+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.507+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94658475741776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d24d20 con 0x7fc2f408e0b0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.507+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d26630 con 0x561764d170f0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.508+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94658475741776] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.508+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.508+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94658475745600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d24d20 con 0x561764d170f0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.508+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d270a0 con 0x561764d20550 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.509+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.509+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94658475748240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d27940 con 0x561764d20550 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.509+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d28430 con 0x7fc2f408e0b0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.510+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94658475745600] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.510+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94658475748240] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.511+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.511+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94658475750544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d24870 con 0x7fc2f408e0b0 2024-05-08T09:21:50.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.511+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d28cd0 con 0x561764d170f0 2024-05-08T09:21:50.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.512+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94658475750544] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.512+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.512+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94658475753216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d28c80 con 0x561764d170f0 2024-05-08T09:21:50.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.512+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d296b0 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.513+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94658475753216] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.513+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.513+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94658475758016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d28c80 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.513+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d2a130 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.514+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94658475758016] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.514+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.514+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94658475755472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d2a0f0 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.514+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d2ab50 con 0x561764d1ba00 2024-05-08T09:21:50.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94658475755472] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94658475760704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d2a060 con 0x561764d1ba00 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=0 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=1 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=2 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=3 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=4 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=5 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.515+0000 7fc304a1f800 20 add_watcher() i=6 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94658475760704] v27'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc304a1f800 20 add_watcher() i=7 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc304a1f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d2e030 con 0x561764d170f0 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.516+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94658475764560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d2b4f0 con 0x561764d170f0 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.517+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94658475764560] v27'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.517+0000 7fc1b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.517+0000 7fc304a1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.517+0000 7fc304a1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.517+0000 7fc304a1f800 5 note: GC not initialized 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc1337fe640 20 reqs_thread_entry: start 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 20 Filter name: none 2024-05-08T09:21:50.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc1317fa640 20 reqs_thread_entry: start 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d61560 con 0x561764d170f0 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 20 rados_obj.operate() r=0 bl.length=556 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.518+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d67a00 con 0x561764d170f0 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc304a1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc304a1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc304a1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94658476012656 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d66590 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94658475753216 notify 115964117002 ret 0) ==== 609+0+0 (crc 0 0 0) 0x561764b53a40 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc1e5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94658475753216 notifier 4410 bl.length()=567 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc1e5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc1e5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc1e5ffb640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc1c8003ea0 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94658476012656 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94658476012656 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2f803d8f0 con 0x561764d170f0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.520+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d67470 con 0x7fc2f408e0b0 2024-05-08T09:21:50.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 foo:foo2 [delete] v27'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc304a1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94658476012656 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x561764d660e0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== watch-notify(notify (1) cookie 94658475741776 notify 115964116997 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7fc2f803d8f0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc1e57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94658475741776 notifier 4410 bl.length()=159 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(67 notify.0 [notify cookie 94658476012656 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc1e57fa640 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc1380032c0 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.522+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== watch-notify(notify_complete (2) cookie 94658476012656 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc2f803dc60 con 0x7fc2f408e0b0 2024-05-08T09:21:50.541 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:50.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.523+0000 7fc1b8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.523+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94658475764560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d66590 con 0x561764d170f0 2024-05-08T09:21:50.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.524+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94658475764560] v27'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.524+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94658475741776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d66590 con 0x7fc2f408e0b0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.525+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94658475741776] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.525+0000 7fc304a1f800 20 remove_watcher() i=0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.525+0000 7fc304a1f800 2 removed watcher, disabling cache 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.525+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94658475745600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d66590 con 0x561764d170f0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.526+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94658475745600] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.526+0000 7fc304a1f800 20 remove_watcher() i=1 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.526+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94658475748240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d26140 con 0x561764d20550 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.527+0000 7fc30251e640 1 -- 172.21.15.161:0/1620794711 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94658475748240] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4071990 con 0x561764d20550 2024-05-08T09:21:50.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.527+0000 7fc304a1f800 20 remove_watcher() i=2 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.527+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94658475750544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d26b90 con 0x7fc2f408e0b0 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.528+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94658475750544] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x7fc2f408e0b0 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.528+0000 7fc304a1f800 20 remove_watcher() i=3 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.528+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94658475753216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d27490 con 0x561764d170f0 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.529+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94658475753216] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f8029040 con 0x561764d170f0 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.529+0000 7fc304a1f800 20 remove_watcher() i=4 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.529+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94658475758016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d26b90 con 0x561764d1ba00 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.530+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94658475758016] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.530+0000 7fc304a1f800 20 remove_watcher() i=5 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.530+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94658475755472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d27490 con 0x561764d1ba00 2024-05-08T09:21:50.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.532+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94658475755472] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.532+0000 7fc304a1f800 20 remove_watcher() i=6 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.532+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94658475760704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x561764d26b90 con 0x561764d1ba00 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc302d1f640 1 -- 172.21.15.161:0/1620794711 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94658475760704] v27'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2fc02a070 con 0x561764d1ba00 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 20 remove_watcher() i=7 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764d1ba00 msgr2=0x561764d1ddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764d1ba00 0x561764d1ddf0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764d170f0 msgr2=0x561764d195b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764d170f0 0x561764d195b0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc2f408e0b0 msgr2=0x7fc2f407a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc2f408e0b0 0x7fc2f407a3f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x561764d20550 msgr2=0x561764d22a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x561764d20550 0x561764d22a10 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1cc036950 msgr2=0x7fc1cc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1cc036950 0x7fc1cc038e10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc2f408e010 tx=0x7fc2f408b000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc301d1d640 1 -- 172.21.15.161:0/1620794711 reap_dead start 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 msgr2=0x561764d0b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc2fc040040 tx=0x7fc2fc04c7e0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 shutdown_connections 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/1620794711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764d04020 0x561764d0b5e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 >> 172.21.15.161:0/1620794711 conn(0x561764d00380 msgr2=0x561764cfd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 shutdown_connections 2024-05-08T09:21:50.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/1620794711 wait complete. 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 msgr2=0x7fc1dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 0x7fc1dc038e10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x561764ce3280 tx=0x7fc2f408cc80 comp rx=0 tx=0).stop 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 msgr2=0x561764cf71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x561764ce31e0 tx=0x7fc2fc018830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 shutdown_connections 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1dc036950 0x7fc1dc038e10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 --2- 172.21.15.161:0/3683452392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764cf6d80 0x561764cf71a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 >> 172.21.15.161:0/3683452392 conn(0x561764ceae20 msgr2=0x561764ceb220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 shutdown_connections 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.534+0000 7fc304a1f800 1 -- 172.21.15.161:0/3683452392 wait complete. 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 msgr2=0x561764ce7520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 0x561764ce7520 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 msgr2=0x561764ce28a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 0x561764ce28a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 msgr2=0x7fc1e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 0x7fc1e8038e10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8000f60 tx=0x7fc2f80012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 msgr2=0x561764cdb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4060040 tx=0x7fc2f4002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 shutdown_connections 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x561764ce5130 0x561764ce7520 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x561764bdf3a0 0x561764ce28a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc1e8036950 0x7fc1e8038e10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 --2- 172.21.15.161:0/4104290351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x561764bdea40 0x561764cdb660 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 >> 172.21.15.161:0/4104290351 conn(0x561764bda5c0 msgr2=0x561764ccdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 shutdown_connections 2024-05-08T09:21:50.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.535+0000 7fc304a1f800 1 -- 172.21.15.161:0/4104290351 wait complete. 2024-05-08T09:21:50.555 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:50.555 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T09:21:50.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T09:21:50.555 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T09:21:50.600 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.600 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.601+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.601+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1277a13800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ce36e8c490 0x55ce36e94f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1277a13800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce36dff130 con 0x55ce36e8a950 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1277a13800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55ce36d1d050 con 0x55ce36e8c490 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1272820640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ce36e8c490 0x55ce36e94f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1272820640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ce36e8c490 0x55ce36e94f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52862/0 (socket says 172.21.15.161:52862) 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1272820640 1 -- 172.21.15.161:0/1829541104 learned_addr learned my addr 172.21.15.161:0/1829541104 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1272820640 1 -- 172.21.15.161:0/1829541104 >> v1:172.21.15.45:6789/0 conn(0x55ce36e8a950 legacy=0x55ce36e8ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f127201f640 1 -- 172.21.15.161:0/1829541104 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472741029 0 0) 0x55ce36dff130 con 0x55ce36e8a950 2024-05-08T09:21:50.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.602+0000 7f1272820640 1 -- 172.21.15.161:0/1829541104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36e964e0 con 0x55ce36e8c490 2024-05-08T09:21:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.604+0000 7f1272820640 1 --2- 172.21.15.161:0/1829541104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8c490 0x55ce36e94f90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a520 tx=0x7f125c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=542d5bd58b1c2928 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.604+0000 7f127201f640 1 -- 172.21.15.161:0/1829541104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c057070 con 0x55ce36e8c490 2024-05-08T09:21:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.604+0000 7f127201f640 1 -- 172.21.15.161:0/1829541104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c052570 con 0x55ce36e8c490 2024-05-08T09:21:50.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.604+0000 7f127201f640 1 -- 172.21.15.161:0/1829541104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f125c04ae60 con 0x55ce36e8c490 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 -- 172.21.15.161:0/1829541104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8c490 msgr2=0x55ce36e94f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 --2- 172.21.15.161:0/1829541104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8c490 0x55ce36e94f90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a520 tx=0x7f125c01d010 comp rx=0 tx=0).stop 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 -- 172.21.15.161:0/1829541104 shutdown_connections 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 --2- 172.21.15.161:0/1829541104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8c490 0x55ce36e94f90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 -- 172.21.15.161:0/1829541104 >> 172.21.15.161:0/1829541104 conn(0x55ce36e865b0 msgr2=0x55ce36e889d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 -- 172.21.15.161:0/1829541104 shutdown_connections 2024-05-08T09:21:50.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.605+0000 7f1277a13800 1 -- 172.21.15.161:0/1829541104 wait complete. 2024-05-08T09:21:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1277a13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1277a13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce36dd71d0 con 0x55ce36e8a950 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1273021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1273021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52876/0 (socket says 172.21.15.161:52876) 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.619+0000 7f1273021640 1 -- 172.21.15.161:0/3963752637 learned_addr learned my addr 172.21.15.161:0/3963752637 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.620+0000 7f1273021640 1 -- 172.21.15.161:0/3963752637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36f7fc40 con 0x55ce36e8a950 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.620+0000 7f1273021640 1 --2- 172.21.15.161:0/3963752637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1264006fd0 tx=0x7f1264001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a35cc20cb01f31df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.620+0000 7f116160a640 1 -- 172.21.15.161:0/3963752637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1264017070 con 0x55ce36e8a950 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.620+0000 7f116160a640 1 -- 172.21.15.161:0/3963752637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12640025c0 con 0x55ce36e8a950 2024-05-08T09:21:50.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.620+0000 7f116160a640 1 -- 172.21.15.161:0/3963752637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1264002920 con 0x55ce36e8a950 2024-05-08T09:21:50.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- 172.21.15.161:0/3963752637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 msgr2=0x55ce36f7f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 --2- 172.21.15.161:0/3963752637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1264006fd0 tx=0x7f1264001ac0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- 172.21.15.161:0/3963752637 shutdown_connections 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 --2- 172.21.15.161:0/3963752637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f7f670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- 172.21.15.161:0/3963752637 >> 172.21.15.161:0/3963752637 conn(0x55ce36e865b0 msgr2=0x55ce36f7af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- 172.21.15.161:0/3963752637 shutdown_connections 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- 172.21.15.161:0/3963752637 wait complete. 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1277a13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce36e95710 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1273021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1273021640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52882/0 (socket says 172.21.15.161:52882) 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.621+0000 7f1273021640 1 -- 172.21.15.161:0/102473089 learned_addr learned my addr 172.21.15.161:0/102473089 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f1273021640 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36f87870 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f1273021640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1264006f70 tx=0x7f1264001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f115fe07640 1 -- 172.21.15.161:0/102473089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1264022020 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f115fe07640 1 -- 172.21.15.161:0/102473089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1264012790 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce36f87b00 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f115fe07640 1 -- 172.21.15.161:0/102473089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1264017040 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.622+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce36f8a7b0 con 0x55ce36e8a950 2024-05-08T09:21:50.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f115fe07640 1 -- 172.21.15.161:0/102473089 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1264025020 con 0x55ce36e8a950 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f115fe07640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 0x7f1158038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f115fe07640 1 -- 172.21.15.161:0/102473089 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f126404c170 con 0x55ce36e8a950 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f1272820640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 0x7f1158038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 0x55ce36f8e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36f8eaf0 con 0x55ce36e8c490 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.623+0000 7f1273822640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 0x55ce36f8e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1272820640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 0x7f1158038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f125c054000 tx=0x7f125c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1273822640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 0x55ce36f8e570 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1273822640 1 -- 172.21.15.161:0/102473089 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f126c0083e0 con 0x55ce36e8c490 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36f8bb20 con 0x55ce36e8c490 2024-05-08T09:21:50.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1273822640 1 -- 172.21.15.161:0/102473089 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f126c0083e0 con 0x55ce36e8c490 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 0x55ce36f931f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36f938e0 con 0x55ce36f90e00 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.624+0000 7f1273021640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 0x55ce36f931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.625+0000 7f1273021640 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 0x55ce36f931f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.625+0000 7f1273021640 1 -- 172.21.15.161:0/102473089 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f126400f070 con 0x55ce36f90e00 2024-05-08T09:21:50.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.625+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36f8fdb0 con 0x55ce36e8c490 2024-05-08T09:21:50.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1273822640 1 -- 172.21.15.161:0/102473089 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f126c0083e0 con 0x55ce36e8c490 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36f90250 con 0x55ce36e8c490 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1273822640 1 -- 172.21.15.161:0/102473089 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f126c0083e0 con 0x55ce36e8c490 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1277a13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.626+0000 7f1277a13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce36d7dcf0 con 0x55ce36fa2a10 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52896/0 (socket says 172.21.15.161:52896) 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1273822640 1 -- 172.21.15.161:0/1973440143 learned_addr learned my addr 172.21.15.161:0/1973440143 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1273822640 1 -- 172.21.15.161:0/1973440143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36fa3370 con 0x55ce36fa2a10 2024-05-08T09:21:50.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1273822640 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55ce36f88200 tx=0x7f126c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f115d602640 1 -- 172.21.15.161:0/1973440143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c007d00 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f115d602640 1 -- 172.21.15.161:0/1973440143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c01e020 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce36fa3de0 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f115d602640 1 -- 172.21.15.161:0/1973440143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c019420 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.627+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce36fa42e0 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.628+0000 7f115d602640 1 -- 172.21.15.161:0/1973440143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f126c016040 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.628+0000 7f115d602640 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 0x7f114c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.628+0000 7f115d602640 1 -- 172.21.15.161:0/1973440143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f126c01f030 con 0x55ce36fa2a10 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.628+0000 7f1273021640 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 0x7f114c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1273021640 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 0x7f114c038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55ce36f8ef70 tx=0x7f1264028f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1277a13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1277a13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce36f7ffc0 con 0x55ce36fafc90 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52900/0 (socket says 172.21.15.161:52900) 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.629+0000 7f1273822640 1 -- 172.21.15.161:0/1610714986 learned_addr learned my addr 172.21.15.161:0/1610714986 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1273822640 1 -- 172.21.15.161:0/1610714986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36fb0680 con 0x55ce36fafc90 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1273822640 1 --2- 172.21.15.161:0/1610714986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f126c04cc30 tx=0x7f126c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b1310b89512e47f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1156ffd640 1 -- 172.21.15.161:0/1610714986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c01d040 con 0x55ce36fafc90 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1156ffd640 1 -- 172.21.15.161:0/1610714986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c03be50 con 0x55ce36fafc90 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1156ffd640 1 -- 172.21.15.161:0/1610714986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c0197f0 con 0x55ce36fafc90 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 -- 172.21.15.161:0/1610714986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 msgr2=0x55ce36fb00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 --2- 172.21.15.161:0/1610714986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f126c04cc30 tx=0x7f126c017fa0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 -- 172.21.15.161:0/1610714986 shutdown_connections 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 --2- 172.21.15.161:0/1610714986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb00b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 -- 172.21.15.161:0/1610714986 >> 172.21.15.161:0/1610714986 conn(0x55ce36fabff0 msgr2=0x55ce36faa050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.630+0000 7f1277a13800 1 -- 172.21.15.161:0/1610714986 shutdown_connections 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1277a13800 1 -- 172.21.15.161:0/1610714986 wait complete. 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1277a13800 1 Processor -- start 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1277a13800 1 -- start start 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1277a13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1277a13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce36fb0df0 con 0x55ce36fafc90 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1273822640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52914/0 (socket says 172.21.15.161:52914) 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.631+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 learned_addr learned my addr 172.21.15.161:0/3638014411 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce36fb7780 con 0x55ce36fafc90 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f1273822640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f126c022f90 tx=0x7f126c04cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f11557fa640 1 -- 172.21.15.161:0/3638014411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c01d070 con 0x55ce36fafc90 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f11557fa640 1 -- 172.21.15.161:0/3638014411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f126c019b70 con 0x55ce36fafc90 2024-05-08T09:21:50.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f11557fa640 1 -- 172.21.15.161:0/3638014411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f126c0179a0 con 0x55ce36fafc90 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce36fb7a10 con 0x55ce36fafc90 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.632+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce36fb7a10 con 0x55ce36fafc90 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f11557fa640 1 -- 172.21.15.161:0/3638014411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f126c0153e0 con 0x55ce36fafc90 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f11557fa640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f113c036950 0x7f113c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f11557fa640 1 -- 172.21.15.161:0/3638014411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f126c03c050 con 0x55ce36fafc90 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1273021640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f113c036950 0x7f113c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36fc2a80 0x55ce36fc4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fc5690 con 0x55ce36fc2a80 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1273021640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f113c036950 0x7f113c038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f126401db40 tx=0x7f1264035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.633+0000 7f1272820640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36fc2a80 0x55ce36fc4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1272820640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36fc2a80 0x55ce36fc4f40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 20 realm 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fc5a60 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fc6330 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.634+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fc66d0 con 0x55ce36fc2a80 2024-05-08T09:21:50.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36fc7180 0x55ce36fc9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fc9cd0 con 0x55ce36fc7180 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1273822640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36fc7180 0x55ce36fc9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.635+0000 7f1273822640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36fc7180 0x55ce36fc9570 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1277a13800 20 searching for the correct realm 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce36fcbd80 0x55ce36fce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1273021640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce36fcbd80 0x55ce36fce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.636+0000 7f1273021640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce36fcbd80 0x55ce36fce240 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1273021640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f126403d070 0x7f126400f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1272820640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f126403d070 0x7f126400f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1272820640 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f126403d070 0x7f126400f9c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.637+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.638+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.639+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.640+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.641+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.642+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.643+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.644+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.644+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.644+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.644+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.644+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fcbd80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc7180 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x55ce36fc2a80 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.645+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fce910 con 0x7f126403d070 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fca780 con 0x55ce36fc2a80 2024-05-08T09:21:50.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fcac00 con 0x55ce36fc2a80 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.646+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fcb0e0 con 0x55ce36fc2a80 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 zone default found 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 4 Realm: () 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 zonegroup default 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fced90 con 0x55ce36fc7180 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.647+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd0fc0 con 0x55ce36fcbd80 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd1360 con 0x55ce36fcbd80 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 20 started sync module instance, tier type = 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.648+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd0400 con 0x7f126403d070 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.649+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.649+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94344174176512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd0400 con 0x7f126403d070 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.649+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd1d20 con 0x55ce36fc2a80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.650+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94344174176512] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.650+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.650+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94344174174512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd1d20 con 0x55ce36fc2a80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.650+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd2720 con 0x55ce36fcbd80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.651+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.651+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94344174182960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd2fc0 con 0x55ce36fcbd80 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.651+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd3a80 con 0x7f126403d070 2024-05-08T09:21:50.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.651+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94344174174512] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.652+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94344174182960] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.652+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.652+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94344174185232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd1870 con 0x7f126403d070 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.652+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd4320 con 0x55ce36fc2a80 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.653+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.653+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94344174190032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd4750 con 0x55ce36fc2a80 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.653+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd5240 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.654+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.654+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94344174193936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd5200 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.654+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd61f0 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.655+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.655+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94344174198016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd61f0 con 0x55ce36fc7180 2024-05-08T09:21:50.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.655+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd7180 con 0x55ce36fc7180 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.656+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94344174185232] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.656+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94344174193936] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.656+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94344174198016] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94344174190032] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94344174191088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd7180 con 0x55ce36fc7180 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=0 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=1 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=2 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=3 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=4 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=5 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.659+0000 7f1277a13800 20 add_watcher() i=6 2024-05-08T09:21:50.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94344174191088] v27'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1277a13800 20 add_watcher() i=7 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1277a13800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd55f0 con 0x55ce36fc2a80 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.660+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94344174187856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd55f0 con 0x55ce36fc2a80 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94344174187856] v27'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1277a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1277a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1277a13800 5 note: GC not initialized 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.661+0000 7f1128fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 20 Filter name: none 2024-05-08T09:21:50.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f10a27fc640 20 reqs_thread_entry: start 2024-05-08T09:21:50.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce3700c590 con 0x55ce36fc2a80 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.662+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce3700c970 con 0x55ce36fc2a80 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.663+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.663+0000 7f1277a13800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.663+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ce3700d980 con 0x7f126403d070 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.663+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.664+0000 7f1129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.664+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94344174187856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fbff70 con 0x55ce36fc2a80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.665+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94344174187856] v27'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.665+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94344174176512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd3550 con 0x7f126403d070 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.666+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94344174176512] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.666+0000 7f1277a13800 20 remove_watcher() i=0 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.666+0000 7f1277a13800 2 removed watcher, disabling cache 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.666+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94344174174512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd3550 con 0x55ce36fc2a80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.667+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94344174174512] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.667+0000 7f1277a13800 20 remove_watcher() i=1 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.667+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94344174182960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd3550 con 0x55ce36fcbd80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.668+0000 7f1273021640 1 -- 172.21.15.161:0/3638014411 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94344174182960] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126400f070 con 0x55ce36fcbd80 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.668+0000 7f1277a13800 20 remove_watcher() i=2 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.668+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94344174185232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd0900 con 0x7f126403d070 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.669+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94344174185232] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x7f126403d070 2024-05-08T09:21:50.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.669+0000 7f1277a13800 20 remove_watcher() i=3 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.669+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94344174190032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd2b10 con 0x55ce36fc2a80 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.670+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94344174190032] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f125c05a040 con 0x55ce36fc2a80 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.670+0000 7f1277a13800 20 remove_watcher() i=4 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.670+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94344174193936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd2b10 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.671+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94344174193936] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.671+0000 7f1277a13800 20 remove_watcher() i=5 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.671+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94344174198016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd2b10 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.672+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94344174198016] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.672+0000 7f1277a13800 20 remove_watcher() i=6 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.673+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94344174191088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ce36fd5d00 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.673+0000 7f1273822640 1 -- 172.21.15.161:0/3638014411 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94344174191088] v27'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f126c02a070 con 0x55ce36fc7180 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.673+0000 7f1277a13800 20 remove_watcher() i=7 2024-05-08T09:21:50.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36fc7180 msgr2=0x55ce36fc9570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36fc7180 0x55ce36fc9570 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36fc2a80 msgr2=0x55ce36fc4f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36fc2a80 0x55ce36fc4f40 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f126403d070 msgr2=0x7f126400f9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f126403d070 0x7f126400f9c0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce36fcbd80 msgr2=0x55ce36fce240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce36fcbd80 0x55ce36fce240 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f113c036950 msgr2=0x7f113c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f113c036950 0x7f113c038e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f126401db40 tx=0x7f1264035000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 msgr2=0x55ce36fb7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1272820640 1 -- 172.21.15.161:0/3638014411 reap_dead start 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f126c022f90 tx=0x7f126c04cb90 comp rx=0 tx=0).stop 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 shutdown_connections 2024-05-08T09:21:50.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/3638014411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fafc90 0x55ce36fb7240 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 >> 172.21.15.161:0/3638014411 conn(0x55ce36fabff0 msgr2=0x55ce36fa9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 shutdown_connections 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/3638014411 wait complete. 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 msgr2=0x7f114c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 0x7f114c038dc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55ce36f8ef70 tx=0x7f1264028f40 comp rx=0 tx=0).stop 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 msgr2=0x55ce36fa2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x55ce36f88200 tx=0x7f126c00aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 shutdown_connections 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f114c036900 0x7f114c038dc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 --2- 172.21.15.161:0/1973440143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36fa2a10 0x55ce36fa2e30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 >> 172.21.15.161:0/1973440143 conn(0x55ce36f96ab0 msgr2=0x55ce36f96eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 shutdown_connections 2024-05-08T09:21:50.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.674+0000 7f1277a13800 1 -- 172.21.15.161:0/1973440143 wait complete. 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 msgr2=0x55ce36f931f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 0x55ce36f931f0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 msgr2=0x55ce36f8e570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 0x55ce36f8e570 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 msgr2=0x7f1158038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 0x7f1158038e10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f125c054000 tx=0x7f125c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 msgr2=0x55ce36f87330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1264006f70 tx=0x7f1264001250 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 shutdown_connections 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce36f90e00 0x55ce36f931f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce36e8c490 0x55ce36f8e570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1158036950 0x7f1158038e10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 --2- 172.21.15.161:0/102473089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce36e8a950 0x55ce36f87330 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 >> 172.21.15.161:0/102473089 conn(0x55ce36e865b0 msgr2=0x55ce36f797d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 shutdown_connections 2024-05-08T09:21:50.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.675+0000 7f1277a13800 1 -- 172.21.15.161:0/102473089 wait complete. 2024-05-08T09:21:50.683 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2024-05-08T09:21:50.683 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T09:21:50.683 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T09:21:50.683 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T09:21:50.683 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T09:21:50.728 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.728 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.729+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.729+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.729+0000 7feca0c0f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e02a785140 0x55e02a785560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.729+0000 7feca0c0f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e02a785be0 con 0x55e02a786350 2024-05-08T09:21:50.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.729+0000 7feca0c0f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e02a616050 con 0x55e02a785140 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec93fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e02a786350 0x55e02a7867d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42906/0 (socket says 172.21.15.161:42906) 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec93fff640 1 -- 172.21.15.161:0/3885976290 learned_addr learned my addr 172.21.15.161:0/3885976290 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9c347640 1 --2- 172.21.15.161:0/3885976290 >> v2:172.21.15.45:3300/0 conn(0x55e02a785140 0x55e02a785560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506979654 0 0) 0x55e02a785be0 con 0x55e02a786350 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec88001e10 con 0x55e02a786350 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1161289247 0 0) 0x7fec88001e10 con 0x55e02a786350 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 >> v2:172.21.15.45:3300/0 conn(0x55e02a785140 msgr2=0x55e02a785560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 --2- 172.21.15.161:0/3885976290 >> v2:172.21.15.45:3300/0 conn(0x55e02a785140 0x55e02a785560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a786f10 con 0x55e02a786350 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1106978320 0 0) 0x7fec840015a0 con 0x55e02a786350 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 >> v1:172.21.15.45:6789/0 conn(0x55e02a786350 legacy=0x55e02a7867d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 --2- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 0x7fec880026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.730+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a616050 con 0x7fec880022a0 2024-05-08T09:21:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.731+0000 7fec9c347640 1 --2- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 0x7fec880026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.731+0000 7fec9c347640 1 -- 172.21.15.161:0/3885976290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec88001e10 con 0x7fec880022a0 2024-05-08T09:21:50.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.733+0000 7fec9c347640 1 --2- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 0x7fec880026a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097c0 tx=0x7fec8c01d2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5fb47c21083f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.733+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c057070 con 0x7fec880022a0 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.733+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c052570 con 0x7fec880022a0 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.733+0000 7fec9bb46640 1 -- 172.21.15.161:0/3885976290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c009410 con 0x7fec880022a0 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 -- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 msgr2=0x7fec880026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 0x7fec880026a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097c0 tx=0x7fec8c01d2b0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 -- 172.21.15.161:0/3885976290 shutdown_connections 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3885976290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec880022a0 0x7fec880026a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3885976290 >> v2:172.21.15.45:3300/0 conn(0x55e02a785140 0x55e02a785560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 -- 172.21.15.161:0/3885976290 >> 172.21.15.161:0/3885976290 conn(0x55e02a780780 msgr2=0x55e02a782ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 -- 172.21.15.161:0/3885976290 shutdown_connections 2024-05-08T09:21:50.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.734+0000 7feca0c0f800 1 -- 172.21.15.161:0/3885976290 wait complete. 2024-05-08T09:21:50.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.748+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.748+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.748+0000 7feca0c0f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.748+0000 7feca0c0f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a6d01d0 con 0x55e02a785140 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7fec9c347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7fec9c347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52944/0 (socket says 172.21.15.161:52944) 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7fec9c347640 1 -- 172.21.15.161:0/1342797027 learned_addr learned my addr 172.21.15.161:0/1342797027 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7fec9c347640 1 -- 172.21.15.161:0/1342797027 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a6f8db0 con 0x55e02a785140 2024-05-08T09:21:50.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7fec9c347640 1 --2- 172.21.15.161:0/1342797027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01d2f0 tx=0x7fec8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14a692e93589a1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.749+0000 7feb8a60c640 1 -- 172.21.15.161:0/1342797027 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c057040 con 0x55e02a785140 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feb8a60c640 1 -- 172.21.15.161:0/1342797027 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c052850 con 0x55e02a785140 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feb8a60c640 1 -- 172.21.15.161:0/1342797027 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c052b70 con 0x55e02a785140 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 -- 172.21.15.161:0/1342797027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 msgr2=0x55e02a6fa750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 --2- 172.21.15.161:0/1342797027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fec8c01d2f0 tx=0x7fec8c002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 -- 172.21.15.161:0/1342797027 shutdown_connections 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 --2- 172.21.15.161:0/1342797027 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a6fa750 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 -- 172.21.15.161:0/1342797027 >> 172.21.15.161:0/1342797027 conn(0x55e02a780780 msgr2=0x55e02a871c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 -- 172.21.15.161:0/1342797027 shutdown_connections 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 -- 172.21.15.161:0/1342797027 wait complete. 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.750+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7feca0c0f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7feca0c0f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a78e820 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7fec9c347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7fec9c347640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52958/0 (socket says 172.21.15.161:52958) 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7fec9c347640 1 -- 172.21.15.161:0/3592341815 learned_addr learned my addr 172.21.15.161:0/3592341815 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7fec9c347640 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a8804c0 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.751+0000 7fec9c347640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec8c055040 tx=0x7fec88004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feb88e09640 1 -- 172.21.15.161:0/3592341815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c073070 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feb88e09640 1 -- 172.21.15.161:0/3592341815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec8c05c480 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feb88e09640 1 -- 172.21.15.161:0/3592341815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c057040 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e02a880750 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02a883400 con 0x55e02a785140 2024-05-08T09:21:50.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.752+0000 7feb88e09640 1 -- 172.21.15.161:0/3592341815 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec8c076070 con 0x55e02a785140 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7feb88e09640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 0x7feb84038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7feb88e09640 1 -- 172.21.15.161:0/3592341815 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fec8c06b070 con 0x55e02a785140 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7fec93fff640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 0x7feb84038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 0x55e02a8871c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a887790 con 0x55e02a786350 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7fec9cb48640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 0x55e02a8871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7fec93fff640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 0x7feb84038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b2d0 tx=0x7fec840013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7fec9cb48640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 0x55e02a8871c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7fec9cb48640 1 -- 172.21.15.161:0/3592341815 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec9400a4a0 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.753+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a884770 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.754+0000 7fec9cb48640 1 -- 172.21.15.161:0/3592341815 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec9400a4a0 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.754+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 0x55e02a88bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.754+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a88c1a0 con 0x7fec880022a0 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.754+0000 7fec9c347640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 0x55e02a88bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.754+0000 7fec9c347640 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 0x55e02a88bb00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7fec9c347640 1 -- 172.21.15.161:0/3592341815 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fec8c075030 con 0x7fec880022a0 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a888aa0 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7fec9cb48640 1 -- 172.21.15.161:0/3592341815 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec9400a4a0 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a888f40 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7fec9cb48640 1 -- 172.21.15.161:0/3592341815 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fec9400a4a0 con 0x55e02a786350 2024-05-08T09:21:50.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.755+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feca0c0f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feca0c0f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a676cf0 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52960/0 (socket says 172.21.15.161:52960) 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7fec9cb48640 1 -- 172.21.15.161:0/2675994200 learned_addr learned my addr 172.21.15.161:0/2675994200 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7fec9cb48640 1 -- 172.21.15.161:0/2675994200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a89bc60 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7fec9cb48640 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55e02a887b70 tx=0x7fec94018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feb81ffb640 1 -- 172.21.15.161:0/2675994200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec94014450 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feb81ffb640 1 -- 172.21.15.161:0/2675994200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec940145f0 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feb81ffb640 1 -- 172.21.15.161:0/2675994200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec94014910 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e02a89c6d0 con 0x55e02a89b300 2024-05-08T09:21:50.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.756+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02a89cbd0 con 0x55e02a89b300 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.757+0000 7feb81ffb640 1 -- 172.21.15.161:0/2675994200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec94011040 con 0x55e02a89b300 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.757+0000 7feb81ffb640 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 0x7feb74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.757+0000 7feb81ffb640 1 -- 172.21.15.161:0/2675994200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fec9401e070 con 0x55e02a89b300 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.757+0000 7fec9c347640 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 0x7feb74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9c347640 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 0x7feb74038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e02a887c30 tx=0x7fec8c002fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7feca0c0f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7feca0c0f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a6f90d0 con 0x55e02a8a8690 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52976/0 (socket says 172.21.15.161:52976) 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9cb48640 1 -- 172.21.15.161:0/4080880880 learned_addr learned my addr 172.21.15.161:0/4080880880 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9cb48640 1 -- 172.21.15.161:0/4080880880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a8a9080 con 0x55e02a8a8690 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.758+0000 7fec9cb48640 1 --2- 172.21.15.161:0/4080880880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec9404c820 tx=0x7fec94011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d021837d53b340 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feb737fe640 1 -- 172.21.15.161:0/4080880880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec9404b400 con 0x55e02a8a8690 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feb737fe640 1 -- 172.21.15.161:0/4080880880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9404e0d0 con 0x55e02a8a8690 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feb737fe640 1 -- 172.21.15.161:0/4080880880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec9403bba0 con 0x55e02a8a8690 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 -- 172.21.15.161:0/4080880880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 msgr2=0x55e02a8a8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 --2- 172.21.15.161:0/4080880880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fec9404c820 tx=0x7fec94011f20 comp rx=0 tx=0).stop 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 -- 172.21.15.161:0/4080880880 shutdown_connections 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 --2- 172.21.15.161:0/4080880880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8a8ab0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 -- 172.21.15.161:0/4080880880 >> 172.21.15.161:0/4080880880 conn(0x55e02a8a4960 msgr2=0x55e02a8a29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 -- 172.21.15.161:0/4080880880 shutdown_connections 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 -- 172.21.15.161:0/4080880880 wait complete. 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.759+0000 7feca0c0f800 1 Processor -- start 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feca0c0f800 1 -- start start 2024-05-08T09:21:50.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feca0c0f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feca0c0f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e02a8a9810 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7fec9cb48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:52990/0 (socket says 172.21.15.161:52990) 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 learned_addr learned my addr 172.21.15.161:0/2468595687 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e02a8b0110 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7fec9cb48640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8afbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec9404c820 tx=0x7fec9404c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feb71ffb640 1 -- 172.21.15.161:0/2468595687 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec9404c960 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feb71ffb640 1 -- 172.21.15.161:0/2468595687 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec9404cb00 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feb71ffb640 1 -- 172.21.15.161:0/2468595687 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec9404cde0 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e02a8b0400 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.760+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e02a8b3050 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.761+0000 7feb71ffb640 1 -- 172.21.15.161:0/2468595687 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fec9403b200 con 0x55e02a8a8690 2024-05-08T09:21:50.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.761+0000 7feb71ffb640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb64036950 0x7feb64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.761+0000 7feb71ffb640 1 -- 172.21.15.161:0/2468595687 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fec9400e040 con 0x55e02a8a8690 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.761+0000 7fec9c347640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb64036950 0x7feb64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a8bb920 0x55e02a8bdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8be530 con 0x55e02a8bb920 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7fec93fff640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a8bb920 0x55e02a8bdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7fec9c347640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb64036950 0x7feb64038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0833f0 tx=0x7fec8c08a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7fec93fff640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a8bb920 0x55e02a8bdde0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec8400f770 con 0x55e02a8bb920 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 20 realm 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.762+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8bad70 con 0x55e02a8bb920 2024-05-08T09:21:50.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec8400f770 con 0x55e02a8bb920 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8bf010 con 0x55e02a8bb920 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec8400f770 con 0x55e02a8bb920 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8bf8e0 con 0x55e02a8bb920 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fec8400f770 con 0x55e02a8bb920 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e02a8c01e0 0x55e02a8c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c2d50 con 0x55e02a8c01e0 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.763+0000 7fec9cb48640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e02a8c01e0 0x55e02a8c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7fec9cb48640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e02a8c01e0 0x55e02a8c25f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7feca0c0f800 20 searching for the correct realm 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e02a8c4e00 0x55e02a8c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7fec9c347640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e02a8c4e00 0x55e02a8c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.764+0000 7fec9c347640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e02a8c4e00 0x55e02a8c72c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec9c347640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fec8c08d040 0x7fec8c083610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec93fff640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fec8c08d040 0x7fec8c083610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec93fff640 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fec8c08d040 0x7fec8c083610 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8400f770 con 0x7fec8c08d040 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.765+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8400f770 con 0x55e02a8bb920 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.766+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x7fec8c08d040 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.767+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.768+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fec8402b040 con 0x7fec8c08d040 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.769+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.770+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x7fec8c08d040 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.771+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.772+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x7fec8c08d040 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c4e00 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8c01e0 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.773+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x55e02a8bb920 2024-05-08T09:21:50.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7990 con 0x7fec8c08d040 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fec8402b040 con 0x7fec8c08d040 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c3800 con 0x55e02a8bb920 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fec8402b040 con 0x55e02a8bb920 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.774+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c3c80 con 0x55e02a8bb920 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c4160 con 0x55e02a8bb920 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 zone default found 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 4 Realm: () 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 zonegroup default 2024-05-08T09:21:50.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c7e10 con 0x55e02a8c01e0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c3460 con 0x55e02a8c4e00 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.775+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8ca180 con 0x55e02a8c4e00 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 20 started sync module instance, tier type = 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.776+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c94d0 con 0x7fec8c08d040 2024-05-08T09:21:50.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.777+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.777+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94421274892784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c94d0 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.777+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cac40 con 0x55e02a8bb920 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.778+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94421274892784] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.778+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.778+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94421274896208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c94d0 con 0x55e02a8bb920 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.778+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cb6e0 con 0x55e02a8c4e00 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.779+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.779+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94421274898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cbf80 con 0x55e02a8c4e00 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.779+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cca20 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.779+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94421274896208] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.780+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94421274898896] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.780+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.780+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94421274901200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8c9020 con 0x7fec8c08d040 2024-05-08T09:21:50.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.780+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cd2c0 con 0x55e02a8bb920 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.781+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.781+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94421274906048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cd1e0 con 0x55e02a8bb920 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.781+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8ce1e0 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.781+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94421274901200] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.782+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94421274906048] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.782+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.782+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94421274908336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cc4f0 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.782+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cea80 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.783+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94421274908336] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.783+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94421274909904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cea80 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf4a0 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94421274914704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf910 con 0x55e02a8c01e0 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=0 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=1 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94421274909904] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=2 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=3 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=4 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=5 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.784+0000 7feca0c0f800 20 add_watcher() i=6 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.785+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94421274914704] v27'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.785+0000 7feca0c0f800 20 add_watcher() i=7 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.785+0000 7feca0c0f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.785+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf910 con 0x55e02a8bb920 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.786+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.786+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94421274915936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf880 con 0x55e02a8bb920 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94421274915936] v27'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feb537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 5 note: GC not initialized 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feb527dc640 20 reqs_thread_entry: start 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 20 Filter name: none 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feb4b7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.787+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a905910 con 0x55e02a8bb920 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7feca0c0f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a905cf0 con 0x55e02a8bb920 2024-05-08T09:21:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7feca0c0f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e02a906d00 con 0x7fec8c08d040 2024-05-08T09:21:50.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.788+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.789+0000 7feb537de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.789+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94421274915936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a905cd0 con 0x55e02a8bb920 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.790+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94421274915936] v27'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.790+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94421274892784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf460 con 0x7fec8c08d040 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.791+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94421274892784] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.791+0000 7feca0c0f800 20 remove_watcher() i=0 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.791+0000 7feca0c0f800 2 removed watcher, disabling cache 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.791+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94421274896208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf460 con 0x55e02a8bb920 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.792+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94421274896208] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.792+0000 7feca0c0f800 20 remove_watcher() i=1 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.792+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94421274898896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cf460 con 0x55e02a8c4e00 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.793+0000 7fec9c347640 1 -- 172.21.15.161:0/2468595687 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94421274898896] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8c075030 con 0x55e02a8c4e00 2024-05-08T09:21:50.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.793+0000 7feca0c0f800 20 remove_watcher() i=2 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.793+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94421274901200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cb1d0 con 0x7fec8c08d040 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.794+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94421274901200] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x7fec8c08d040 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.794+0000 7feca0c0f800 20 remove_watcher() i=3 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.794+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94421274906048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cbad0 con 0x55e02a8bb920 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.795+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94421274906048] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec8403d040 con 0x55e02a8bb920 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.795+0000 7feca0c0f800 20 remove_watcher() i=4 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.795+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94421274908336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cb1d0 con 0x55e02a8c01e0 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.796+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94421274908336] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.796+0000 7feca0c0f800 20 remove_watcher() i=5 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.796+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94421274909904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8ccdc0 con 0x55e02a8c01e0 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.797+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94421274909904] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.797+0000 7feca0c0f800 20 remove_watcher() i=6 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.797+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94421274914704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e02a8cbad0 con 0x55e02a8c01e0 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7fec9cb48640 1 -- 172.21.15.161:0/2468595687 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94421274914704] v27'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fec9402a070 con 0x55e02a8c01e0 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 20 remove_watcher() i=7 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e02a8c01e0 msgr2=0x55e02a8c25f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e02a8c01e0 0x55e02a8c25f0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a8bb920 msgr2=0x55e02a8bdde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a8bb920 0x55e02a8bdde0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fec8c08d040 msgr2=0x7fec8c083610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fec8c08d040 0x7fec8c083610 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e02a8c4e00 msgr2=0x55e02a8c72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e02a8c4e00 0x55e02a8c72c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb64036950 msgr2=0x7feb64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb64036950 0x7feb64038e10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0833f0 tx=0x7fec8c08a000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 msgr2=0x55e02a8afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2468595687 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a8a8690 0x55e02a8afbd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fec9404c820 tx=0x7fec9404c7b0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 reap_dead start 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7fec93fff640 1 -- 172.21.15.161:0/2468595687 reap_dead start 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 shutdown_connections 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.798+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 >> 172.21.15.161:0/2468595687 conn(0x55e02a8a4960 msgr2=0x55e02a8a1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 shutdown_connections 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2468595687 wait complete. 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 msgr2=0x7feb74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 0x7feb74038dc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55e02a887c30 tx=0x7fec8c002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 msgr2=0x55e02a89b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55e02a887b70 tx=0x7fec94018830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 shutdown_connections 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb74036900 0x7feb74038dc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/2675994200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a89b300 0x55e02a89b720 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 >> 172.21.15.161:0/2675994200 conn(0x55e02a88f3a0 msgr2=0x55e02a88f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 shutdown_connections 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/2675994200 wait complete. 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 msgr2=0x55e02a88bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 0x55e02a88bb00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 msgr2=0x55e02a8871c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 0x55e02a8871c0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 msgr2=0x7feb84038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 0x7feb84038dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fec8400b2d0 tx=0x7fec840013b0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 msgr2=0x55e02a87ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fec8c055040 tx=0x7fec88004120 comp rx=0 tx=0).stop 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 shutdown_connections 2024-05-08T09:21:50.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fec880022a0 0x55e02a88bb00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e02a786350 0x55e02a8871c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7feb84036900 0x7feb84038dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 --2- 172.21.15.161:0/3592341815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e02a785140 0x55e02a87ff80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 >> 172.21.15.161:0/3592341815 conn(0x55e02a780780 msgr2=0x55e02a6f9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 shutdown_connections 2024-05-08T09:21:50.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.799+0000 7feca0c0f800 1 -- 172.21.15.161:0/3592341815 wait complete. 2024-05-08T09:21:50.812 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2024-05-08T09:21:50.812 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T09:21:50.825 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:50.826 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-05-08T09:21:50.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-05-08T09:21:50.826 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-05-08T09:21:50.870 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:50.870 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:50.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.871+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.871+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a8c34800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5625f20c2c30 0x5625f20c5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a8c34800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5625f20c9070 con 0x5625f20c5560 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a8c34800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5625f1f53050 con 0x5625f20c2c30 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f259bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5625f20c5560 0x5625f20c7950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42922/0 (socket says 172.21.15.161:42922) 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f259bfff640 1 -- 172.21.15.161:0/3242040789 learned_addr learned my addr 172.21.15.161:0/3242040789 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550272290 0 0) 0x5625f20c9070 con 0x5625f20c5560 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2590001e10 con 0x5625f20c5560 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3242040789 >> v2:172.21.15.45:3300/0 conn(0x5625f20c2c30 0x5625f20c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1377570321 0 0) 0x7f2590001e10 con 0x5625f20c5560 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 >> v2:172.21.15.45:3300/0 conn(0x5625f20c2c30 msgr2=0x5625f20c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:50.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 --2- 172.21.15.161:0/3242040789 >> v2:172.21.15.45:3300/0 conn(0x5625f20c2c30 0x5625f20c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f20ca250 con 0x5625f20c5560 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1106978320 0 0) 0x7f258c0015a0 con 0x5625f20c5560 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 >> v1:172.21.15.45:6789/0 conn(0x5625f20c5560 legacy=0x5625f20c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 --2- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 0x7f25900026f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.872+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f1f53050 con 0x7f25900022f0 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.873+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 0x7f25900026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.874+0000 7f25a3fc0640 1 -- 172.21.15.161:0/3242040789 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590001e10 con 0x7f25900022f0 2024-05-08T09:21:50.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.876+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 0x7f25900026f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f259400a7a0 tx=0x7f259401d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d11d6d7282e5b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.876+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259400a420 con 0x7f25900022f0 2024-05-08T09:21:50.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.876+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594057070 con 0x7f25900022f0 2024-05-08T09:21:50.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.876+0000 7f25a37bf640 1 -- 172.21.15.161:0/3242040789 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25940526a0 con 0x7f25900022f0 2024-05-08T09:21:50.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 -- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 msgr2=0x7f25900026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 0x7f25900026f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f259400a7a0 tx=0x7f259401d4a0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 -- 172.21.15.161:0/3242040789 shutdown_connections 2024-05-08T09:21:50.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3242040789 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25900022f0 0x7f25900026f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3242040789 >> v2:172.21.15.45:3300/0 conn(0x5625f20c2c30 0x5625f20c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 -- 172.21.15.161:0/3242040789 >> 172.21.15.161:0/3242040789 conn(0x5625f20bc560 msgr2=0x5625f20be980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 -- 172.21.15.161:0/3242040789 shutdown_connections 2024-05-08T09:21:50.877 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.877+0000 7f25a8c34800 1 -- 172.21.15.161:0/3242040789 wait complete. 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a8c34800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a8c34800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f200d1d0 con 0x5625f20c2c30 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a3fc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a3fc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53020/0 (socket says 172.21.15.161:53020) 2024-05-08T09:21:50.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.891+0000 7f25a3fc0640 1 -- 172.21.15.161:0/8007452 learned_addr learned my addr 172.21.15.161:0/8007452 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.892+0000 7f25a3fc0640 1 -- 172.21.15.161:0/8007452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f21b38a0 con 0x5625f20c2c30 2024-05-08T09:21:50.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.892+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/8007452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2594044cd0 tx=0x7f259404d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a507bc08bc61d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.892+0000 7f2491e0b640 1 -- 172.21.15.161:0/8007452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2594061070 con 0x5625f20c2c30 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.892+0000 7f2491e0b640 1 -- 172.21.15.161:0/8007452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594052420 con 0x5625f20c2c30 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.892+0000 7f2491e0b640 1 -- 172.21.15.161:0/8007452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2594052740 con 0x5625f20c2c30 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- 172.21.15.161:0/8007452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 msgr2=0x5625f21b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 --2- 172.21.15.161:0/8007452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2594044cd0 tx=0x7f259404d000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- 172.21.15.161:0/8007452 shutdown_connections 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 --2- 172.21.15.161:0/8007452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21b32d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- 172.21.15.161:0/8007452 >> 172.21.15.161:0/8007452 conn(0x5625f20bc560 msgr2=0x5625f21aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- 172.21.15.161:0/8007452 shutdown_connections 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- 172.21.15.161:0/8007452 wait complete. 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.893+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a8c34800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a8c34800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f20c94e0 con 0x5625f20c2c30 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a3fc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a3fc0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53022/0 (socket says 172.21.15.161:53022) 2024-05-08T09:21:50.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a3fc0640 1 -- 172.21.15.161:0/3324247499 learned_addr learned my addr 172.21.15.161:0/3324247499 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a3fc0640 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f21bb200 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f259401c190 tx=0x7f2590004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f248bfff640 1 -- 172.21.15.161:0/3324247499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2594061070 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.894+0000 7f248bfff640 1 -- 172.21.15.161:0/3324247499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594073070 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.895+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625f21bb490 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.895+0000 7f248bfff640 1 -- 172.21.15.161:0/3324247499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259406e480 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.895+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f21be140 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.895+0000 7f248bfff640 1 -- 172.21.15.161:0/3324247499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f259406e670 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.895+0000 7f248bfff640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 0x7f248c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f248bfff640 1 -- 172.21.15.161:0/3324247499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f259406a040 con 0x5625f20c2c30 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f259bfff640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 0x7f248c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 0x5625f21c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21c2490 con 0x5625f20c5560 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a47c1640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 0x5625f21c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f259bfff640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 0x7f248c038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b2d0 tx=0x7f258c001180 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a47c1640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 0x5625f21c1f00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a47c1640 1 -- 172.21.15.161:0/3324247499 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f259c00a4a0 con 0x5625f20c5560 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.896+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21bf4b0 con 0x5625f20c5560 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.897+0000 7f25a47c1640 1 -- 172.21.15.161:0/3324247499 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f259c00a4a0 con 0x5625f20c5560 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.897+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 0x5625f21c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.897+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21c6ec0 con 0x7f25900022f0 2024-05-08T09:21:50.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.897+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 0x5625f21c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.897+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 0x5625f21c67d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a3fc0640 1 -- 172.21.15.161:0/3324247499 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2594050050 con 0x7f25900022f0 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21c3770 con 0x5625f20c5560 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a47c1640 1 -- 172.21.15.161:0/3324247499 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f259c00a4a0 con 0x5625f20c5560 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21c3c50 con 0x5625f20c5560 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a47c1640 1 -- 172.21.15.161:0/3324247499 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f259c00a4a0 con 0x5625f20c5560 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.898+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a8c34800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a8c34800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f1fb3cf0 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53036/0 (socket says 172.21.15.161:53036) 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a47c1640 1 -- 172.21.15.161:0/2585245112 learned_addr learned my addr 172.21.15.161:0/2585245112 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a47c1640 1 -- 172.21.15.161:0/2585245112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f20c1180 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f25a47c1640 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5625f21c2890 tx=0x7f259c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.899+0000 7f24897fa640 1 -- 172.21.15.161:0/2585245112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c014450 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f24897fa640 1 -- 172.21.15.161:0/2585245112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c014610 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625f20c1410 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f24897fa640 1 -- 172.21.15.161:0/2585245112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c014930 con 0x5625f20c27d0 2024-05-08T09:21:50.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f20c1910 con 0x5625f20c27d0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f24897fa640 1 -- 172.21.15.161:0/2585245112 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f259c011040 con 0x5625f20c27d0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.900+0000 7f24897fa640 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 0x7f247c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f24897fa640 1 -- 172.21.15.161:0/2585245112 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f259c01e070 con 0x5625f20c27d0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 0x7f247c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 0x7f247c038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5625f21c2930 tx=0x7f2594085040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a8c34800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a8c34800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f21b3bc0 con 0x5625f21e5510 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53046/0 (socket says 172.21.15.161:53046) 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.901+0000 7f25a47c1640 1 -- 172.21.15.161:0/2684014281 learned_addr learned my addr 172.21.15.161:0/2684014281 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a47c1640 1 -- 172.21.15.161:0/2684014281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f21e5f00 con 0x5625f21e5510 2024-05-08T09:21:50.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a47c1640 1 --2- 172.21.15.161:0/2684014281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f259c04c8b0 tx=0x7f259c011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87aeb8aba140832 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f2482ffd640 1 -- 172.21.15.161:0/2684014281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c028070 con 0x5625f21e5510 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f2482ffd640 1 -- 172.21.15.161:0/2684014281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c022d90 con 0x5625f21e5510 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f2482ffd640 1 -- 172.21.15.161:0/2684014281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c016ab0 con 0x5625f21e5510 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 -- 172.21.15.161:0/2684014281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 msgr2=0x5625f21e5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2684014281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f259c04c8b0 tx=0x7f259c011a80 comp rx=0 tx=0).stop 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 -- 172.21.15.161:0/2684014281 shutdown_connections 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2684014281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21e5930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 -- 172.21.15.161:0/2684014281 >> 172.21.15.161:0/2684014281 conn(0x5625f21e1870 msgr2=0x5625f21df8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 -- 172.21.15.161:0/2684014281 shutdown_connections 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.902+0000 7f25a8c34800 1 -- 172.21.15.161:0/2684014281 wait complete. 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a8c34800 1 Processor -- start 2024-05-08T09:21:50.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a8c34800 1 -- start start 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a8c34800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a8c34800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5625f21e6670 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a47c1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21ecab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53058/0 (socket says 172.21.15.161:53058) 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 learned_addr learned my addr 172.21.15.161:0/2586511671 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.903+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625f21ecff0 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f25a47c1640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21ecab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f259c011f60 tx=0x7f259c00a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f24817fa640 1 -- 172.21.15.161:0/2586511671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c033070 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f24817fa640 1 -- 172.21.15.161:0/2586511671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c04cab0 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f24817fa640 1 -- 172.21.15.161:0/2586511671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f259c028050 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5625f21ed280 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.904+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625f21eff30 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f24817fa640 1 -- 172.21.15.161:0/2586511671 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f259c04b360 con 0x5625f21e5510 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f24817fa640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f246c036900 0x7f246c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f24817fa640 1 -- 172.21.15.161:0/2586511671 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f259c00e040 con 0x5625f21e5510 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f246c036900 0x7f246c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f21f8750 0x5625f21fac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21fb360 con 0x5625f21f8750 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f259bfff640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f21f8750 0x5625f21fac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.905+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f246c036900 0x7f246c038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5625f21c72c0 tx=0x7f259408f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f259bfff640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f21f8750 0x5625f21fac10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f258c00f6b0 con 0x5625f21f8750 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 realm 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21f7bf0 con 0x5625f21f8750 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f258c00f6b0 con 0x5625f21f8750 2024-05-08T09:21:50.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21fbe30 con 0x5625f21f8750 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f258c00f6b0 con 0x5625f21f8750 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21fc360 con 0x5625f21f8750 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f258c00f6b0 con 0x5625f21f8750 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5625f21fd160 0x5625f21ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.906+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f21ffad0 con 0x5625f21fd160 2024-05-08T09:21:50.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a47c1640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5625f21fd160 0x5625f21ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a47c1640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5625f21fd160 0x5625f21ff550 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a8c34800 20 searching for the correct realm 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5625f2201bb0 0x5625f2204070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.907+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5625f2201bb0 0x5625f2204070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5625f2201bb0 0x5625f2204070 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f25a3fc0640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2594065030 0x7f259408b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.908+0000 7f259bfff640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2594065030 0x7f259408b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.909+0000 7f259bfff640 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2594065030 0x7f259408b130 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.909+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c00f6b0 con 0x7f2594065030 2024-05-08T09:21:50.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.909+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.909+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.909+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c00f6b0 con 0x5625f21f8750 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.910+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x7f2594065030 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.911+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f258c02b040 con 0x7f2594065030 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.912+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.913+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.914+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x7f2594065030 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.915+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x7f2594065030 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.916+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f2201bb0 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21fd160 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x5625f21f8750 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204740 con 0x7f2594065030 2024-05-08T09:21:50.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f258c02b040 con 0x7f2594065030 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.917+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2200570 con 0x5625f21f8750 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f258c02b040 con 0x5625f21f8750 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2200180 con 0x5625f21f8750 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2200e60 con 0x5625f21f8750 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 zone default found 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 4 Realm: () 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 zonegroup default 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.918+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2204bc0 con 0x5625f21fd160 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f22069d0 con 0x5625f2201bb0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2206ea0 con 0x5625f2201bb0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 started sync module instance, tier type = 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.919+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2205e20 con 0x7f2594065030 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.920+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.920+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94720975984944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2207300 con 0x7f2594065030 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.920+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2207b50 con 0x5625f21f8750 2024-05-08T09:21:50.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.921+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94720975984944] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.921+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.922+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94720975991552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2207bd0 con 0x5625f21f8750 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.922+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2208590 con 0x5625f2201bb0 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.923+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.923+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94720975995104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2208de0 con 0x5625f2201bb0 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.923+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2209840 con 0x7f2594065030 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.923+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94720975991552] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.924+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94720975995104] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.924+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.924+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94720975997232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2209320 con 0x7f2594065030 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.924+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220a0e0 con 0x5625f21f8750 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.925+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94720975997232] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.925+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.925+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94720975992608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220a090 con 0x5625f21f8750 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.925+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220ab20 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.926+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94720975992608] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.926+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.926+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94720976002016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220a000 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.926+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220b860 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.927+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94720976002016] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.927+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.927+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94720976006848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220b860 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.927+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220c2c0 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94720976006848] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94720976010608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220c730 con 0x5625f21fd160 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=0 2024-05-08T09:21:50.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=1 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=2 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=3 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=4 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=5 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.928+0000 7f25a8c34800 20 add_watcher() i=6 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94720976010608] v27'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f25a8c34800 20 add_watcher() i=7 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f25a8c34800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f220c730 con 0x5625f21f8750 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.929+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94720976011904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220c710 con 0x5625f21f8750 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.930+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94720976011904] v27'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.930+0000 7f2459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.930+0000 7f25a8c34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.930+0000 7f25a8c34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.930+0000 7f25a8c34800 5 note: GC not initialized 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f2458fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 20 Filter name: none 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f23d27fc640 20 reqs_thread_entry: start 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2242730 con 0x5625f21f8750 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 20 rados->read ofs=0 len=0 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.931+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2242b10 con 0x5625f21f8750 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.932+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.932+0000 7f25a8c34800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:50.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.932+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5625f2242b10 con 0x7f2594065030 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.932+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.933+0000 7f2459fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.933+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94720976011904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2242a90 con 0x5625f21f8750 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.934+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94720976011904] v27'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.934+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94720975984944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f220c280 con 0x7f2594065030 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.935+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94720975984944] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.935+0000 7f25a8c34800 20 remove_watcher() i=0 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.935+0000 7f25a8c34800 2 removed watcher, disabling cache 2024-05-08T09:21:50.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.935+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94720975991552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2205930 con 0x5625f21f8750 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.936+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94720975991552] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.936+0000 7f25a8c34800 20 remove_watcher() i=1 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.936+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94720975995104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2207300 con 0x5625f2201bb0 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.937+0000 7f25a3fc0640 1 -- 172.21.15.161:0/2586511671 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94720975995104] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2594098040 con 0x5625f2201bb0 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.937+0000 7f25a8c34800 20 remove_watcher() i=2 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.937+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94720975997232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f22080e0 con 0x7f2594065030 2024-05-08T09:21:50.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.938+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94720975997232] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x7f2594065030 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.938+0000 7f25a8c34800 20 remove_watcher() i=3 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.938+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94720975992608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f22080e0 con 0x5625f21f8750 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.939+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94720975992608] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f258c03d040 con 0x5625f21f8750 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.939+0000 7f25a8c34800 20 remove_watcher() i=4 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.939+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94720976002016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f22080e0 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.940+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94720976002016] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.940+0000 7f25a8c34800 20 remove_watcher() i=5 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.940+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94720976006848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2209be0 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.941+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94720976006848] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.941+0000 7f25a8c34800 20 remove_watcher() i=6 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.941+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94720976010608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5625f2209be0 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a47c1640 1 -- 172.21.15.161:0/2586511671 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94720976010608] v27'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f259c02a070 con 0x5625f21fd160 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 20 remove_watcher() i=7 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5625f21fd160 msgr2=0x5625f21ff550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5625f21fd160 0x5625f21ff550 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f21f8750 msgr2=0x5625f21fac10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f21f8750 0x5625f21fac10 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2594065030 msgr2=0x7f259408b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2594065030 0x7f259408b130 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5625f2201bb0 msgr2=0x5625f2204070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5625f2201bb0 0x5625f2204070 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f246c036900 msgr2=0x7f246c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f246c036900 0x7f246c038dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x5625f21c72c0 tx=0x7f259408f000 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 msgr2=0x5625f21ecab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2586511671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f21e5510 0x5625f21ecab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f259c011f60 tx=0x7f259c00a9b0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 reap_dead start 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f259bfff640 1 -- 172.21.15.161:0/2586511671 reap_dead start 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 shutdown_connections 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 >> 172.21.15.161:0/2586511671 conn(0x5625f21e1870 msgr2=0x5625f21deed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 shutdown_connections 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2586511671 wait complete. 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.942+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 msgr2=0x7f247c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 0x7f247c038dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5625f21c2930 tx=0x7f2594085040 comp rx=0 tx=0).stop 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 msgr2=0x5625f20c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5625f21c2890 tx=0x7f259c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 shutdown_connections 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f247c036900 0x7f247c038dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/2585245112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c27d0 0x5625f20c0c40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 >> 172.21.15.161:0/2585245112 conn(0x5625f21ca0d0 msgr2=0x5625f21ca4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 shutdown_connections 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/2585245112 wait complete. 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 msgr2=0x5625f21c67d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 0x5625f21c67d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 msgr2=0x5625f21c1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 0x5625f21c1f00 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 msgr2=0x7f248c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 0x7f248c038dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f258c00b2d0 tx=0x7f258c001180 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 msgr2=0x5625f21bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f259401c190 tx=0x7f2590004120 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 shutdown_connections 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f25900022f0 0x5625f21c67d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5625f20c5560 0x5625f21c1f00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f248c036900 0x7f248c038dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 --2- 172.21.15.161:0/3324247499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5625f20c2c30 0x5625f21bacc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 >> 172.21.15.161:0/3324247499 conn(0x5625f20bc560 msgr2=0x5625f21ad3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 shutdown_connections 2024-05-08T09:21:50.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:50.943+0000 7f25a8c34800 1 -- 172.21.15.161:0/3324247499 wait complete. 2024-05-08T09:21:50.954 INFO:teuthology.orchestra.run.smithi161.stdout:["myfoo"] 2024-05-08T09:21:50.954 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T09:21:50.958 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:50.959 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-05-08T09:21:50.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-05-08T09:21:50.959 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-05-08T09:21:51.001 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.001 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.002+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.002+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f136cb33800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f0a3fd610 0x564f0a3ffa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f136cb33800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f0a3fff40 con 0x564f0a3f73a0 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f136cb33800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564f0a28a050 con 0x564f0a3fd610 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f135ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f0a3fd610 0x564f0a3ffa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f135ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f0a3fd610 0x564f0a3ffa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53068/0 (socket says 172.21.15.161:53068) 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f135ffff640 1 -- 172.21.15.161:0/1808399747 learned_addr learned my addr 172.21.15.161:0/1808399747 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f13687f5640 1 --1- 172.21.15.161:0/1808399747 >> v1:172.21.15.45:6789/0 conn(0x564f0a3f73a0 0x564f0a3f77c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42932/0 (socket says 172.21.15.161:42932) 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f135ffff640 1 -- 172.21.15.161:0/1808399747 >> v1:172.21.15.45:6789/0 conn(0x564f0a3f73a0 legacy=0x564f0a3f77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.003+0000 7f135ffff640 1 -- 172.21.15.161:0/1808399747 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a401150 con 0x564f0a3fd610 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.005+0000 7f135ffff640 1 --2- 172.21.15.161:0/1808399747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3fd610 0x564f0a3ffa00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f135000a520 tx=0x7f135001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7437488462188341 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.005+0000 7f1367ff4640 1 -- 172.21.15.161:0/1808399747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1350057070 con 0x564f0a3fd610 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.005+0000 7f1367ff4640 1 -- 172.21.15.161:0/1808399747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1350052570 con 0x564f0a3fd610 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.005+0000 7f1367ff4640 1 -- 172.21.15.161:0/1808399747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f135004ae60 con 0x564f0a3fd610 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 -- 172.21.15.161:0/1808399747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3fd610 msgr2=0x564f0a3ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 --2- 172.21.15.161:0/1808399747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3fd610 0x564f0a3ffa00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f135000a520 tx=0x7f135001d010 comp rx=0 tx=0).stop 2024-05-08T09:21:51.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 -- 172.21.15.161:0/1808399747 shutdown_connections 2024-05-08T09:21:51.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 --2- 172.21.15.161:0/1808399747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3fd610 0x564f0a3ffa00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 -- 172.21.15.161:0/1808399747 >> 172.21.15.161:0/1808399747 conn(0x564f0a3f2d20 msgr2=0x564f0a3f5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 -- 172.21.15.161:0/1808399747 shutdown_connections 2024-05-08T09:21:51.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.006+0000 7f136cb33800 1 -- 172.21.15.161:0/1808399747 wait complete. 2024-05-08T09:21:51.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f136cb33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f136cb33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f0a3441c0 con 0x564f0a3f73a0 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f13687f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f13687f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53072/0 (socket says 172.21.15.161:53072) 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f13687f5640 1 -- 172.21.15.161:0/429742230 learned_addr learned my addr 172.21.15.161:0/429742230 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.020+0000 7f13687f5640 1 -- 172.21.15.161:0/429742230 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a4eac30 con 0x564f0a3f73a0 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f13687f5640 1 --2- 172.21.15.161:0/429742230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1358001e40 tx=0x7f1358001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9fb585660df9f0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f125660c640 1 -- 172.21.15.161:0/429742230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f135800e5c0 con 0x564f0a3f73a0 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f125660c640 1 -- 172.21.15.161:0/429742230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1358006070 con 0x564f0a3f73a0 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f125660c640 1 -- 172.21.15.161:0/429742230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f135800e910 con 0x564f0a3f73a0 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f136cb33800 1 -- 172.21.15.161:0/429742230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 msgr2=0x564f0a4ea660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f136cb33800 1 --2- 172.21.15.161:0/429742230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1358001e40 tx=0x7f1358001e70 comp rx=0 tx=0).stop 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f136cb33800 1 -- 172.21.15.161:0/429742230 shutdown_connections 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f136cb33800 1 --2- 172.21.15.161:0/429742230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4ea660 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.021+0000 7f136cb33800 1 -- 172.21.15.161:0/429742230 >> 172.21.15.161:0/429742230 conn(0x564f0a3f2d20 msgr2=0x564f0a4e5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 -- 172.21.15.161:0/429742230 shutdown_connections 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 -- 172.21.15.161:0/429742230 wait complete. 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f136cb33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f0a400410 con 0x564f0a3f73a0 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f13687f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f13687f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53082/0 (socket says 172.21.15.161:53082) 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f13687f5640 1 -- 172.21.15.161:0/1345033745 learned_addr learned my addr 172.21.15.161:0/1345033745 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.022+0000 7f13687f5640 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a4f2780 con 0x564f0a3f73a0 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f13687f5640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1358000f60 tx=0x7f1358000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f1254e09640 1 -- 172.21.15.161:0/1345033745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f135800f8d0 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f1254e09640 1 -- 172.21.15.161:0/1345033745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f135800fa70 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f0a4f2a10 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f1254e09640 1 -- 172.21.15.161:0/1345033745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f135800fd90 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.023+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0a4f56c0 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f1254e09640 1 -- 172.21.15.161:0/1345033745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1358017070 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f1254e09640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 0x7f1250038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f1254e09640 1 -- 172.21.15.161:0/1345033745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1358015020 con 0x564f0a3f73a0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f135ffff640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 0x7f1250038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 0x564f0a4f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a4f9a50 con 0x564f0a3fd610 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f1368ff6640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 0x564f0a4f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f135ffff640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 0x7f1250038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1350054000 tx=0x7f135004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.024+0000 7f1368ff6640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 0x564f0a4f9480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f1368ff6640 1 -- 172.21.15.161:0/1345033745 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f136000a4a0 con 0x564f0a3fd610 2024-05-08T09:21:51.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a4f6a50 con 0x564f0a3fd610 2024-05-08T09:21:51.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f1368ff6640 1 -- 172.21.15.161:0/1345033745 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f136000a4a0 con 0x564f0a3fd610 2024-05-08T09:21:51.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 0x564f0a4fe150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a4fe7f0 con 0x564f0a4fbd60 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.025+0000 7f13687f5640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 0x564f0a4fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.026+0000 7f13687f5640 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 0x564f0a4fe150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.026+0000 7f13687f5640 1 -- 172.21.15.161:0/1345033745 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f135802e070 con 0x564f0a4fbd60 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.026+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a4fad10 con 0x564f0a3fd610 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.026+0000 7f1368ff6640 1 -- 172.21.15.161:0/1345033745 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f136000a4a0 con 0x564f0a3fd610 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.026+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a4fb1f0 con 0x564f0a3fd610 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f1368ff6640 1 -- 172.21.15.161:0/1345033745 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f136000a4a0 con 0x564f0a3fd610 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f136cb33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f136cb33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f0a2eacf0 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53088/0 (socket says 172.21.15.161:53088) 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.027+0000 7f1368ff6640 1 -- 172.21.15.161:0/3646135049 learned_addr learned my addr 172.21.15.161:0/3646135049 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f1368ff6640 1 -- 172.21.15.161:0/3646135049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a50e280 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f1368ff6640 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x564f0a4f9e10 tx=0x7f1360018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f124dffb640 1 -- 172.21.15.161:0/3646135049 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1360014450 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f124dffb640 1 -- 172.21.15.161:0/3646135049 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1360014610 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f0a50ecf0 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f124dffb640 1 -- 172.21.15.161:0/3646135049 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1360014930 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.028+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0a50f1f0 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f124dffb640 1 -- 172.21.15.161:0/3646135049 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1360011040 con 0x564f0a50d920 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f124dffb640 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 0x7f1240038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f124dffb640 1 -- 172.21.15.161:0/3646135049 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f136001e070 con 0x564f0a50d920 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f13687f5640 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 0x7f1240038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f13687f5640 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 0x7f1240038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564f0a4f9e80 tx=0x7f135801c450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f136cb33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.029+0000 7f136cb33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f0a4eafb0 con 0x564f0a51ac90 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53100/0 (socket says 172.21.15.161:53100) 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f1368ff6640 1 -- 172.21.15.161:0/4091509794 learned_addr learned my addr 172.21.15.161:0/4091509794 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f1368ff6640 1 -- 172.21.15.161:0/4091509794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a51b680 con 0x564f0a51ac90 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f1368ff6640 1 --2- 172.21.15.161:0/4091509794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f136004c8d0 tx=0x7f136004cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9356cb82013cbc41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f12477fe640 1 -- 172.21.15.161:0/4091509794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136004e0d0 con 0x564f0a51ac90 2024-05-08T09:21:51.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f12477fe640 1 -- 172.21.15.161:0/4091509794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f136004e270 con 0x564f0a51ac90 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.030+0000 7f12477fe640 1 -- 172.21.15.161:0/4091509794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136004b300 con 0x564f0a51ac90 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- 172.21.15.161:0/4091509794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 msgr2=0x564f0a51b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 --2- 172.21.15.161:0/4091509794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f136004c8d0 tx=0x7f136004cb50 comp rx=0 tx=0).stop 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- 172.21.15.161:0/4091509794 shutdown_connections 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 --2- 172.21.15.161:0/4091509794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a51b0b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- 172.21.15.161:0/4091509794 >> 172.21.15.161:0/4091509794 conn(0x564f0a516f60 msgr2=0x564f0a514fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- 172.21.15.161:0/4091509794 shutdown_connections 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- 172.21.15.161:0/4091509794 wait complete. 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 Processor -- start 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- start start 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f136cb33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f0a51be10 con 0x564f0a51ac90 2024-05-08T09:21:51.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f1368ff6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53110/0 (socket says 172.21.15.161:53110) 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.031+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 learned_addr learned my addr 172.21.15.161:0/294382945 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f0a3fa1a0 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f1368ff6640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1360011fd0 tx=0x7f136004c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f1245ffb640 1 -- 172.21.15.161:0/294382945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f136004e0d0 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f1245ffb640 1 -- 172.21.15.161:0/294382945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13600135c0 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f0a3f8350 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f1245ffb640 1 -- 172.21.15.161:0/294382945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1360011e10 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.032+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f0a3f8850 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f1245ffb640 1 -- 172.21.15.161:0/294382945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f13600138e0 con 0x564f0a51ac90 2024-05-08T09:21:51.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f1245ffb640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1238036900 0x7f1238038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f1245ffb640 1 -- 172.21.15.161:0/294382945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f1360046040 con 0x564f0a51ac90 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f13687f5640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1238036900 0x7f1238038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a530050 0x564f0a532510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a532c60 con 0x564f0a530050 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.033+0000 7f135ffff640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a530050 0x564f0a532510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f13687f5640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1238036900 0x7f1238038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x564f0a4febf0 tx=0x7f1358044000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f135ffff640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a530050 0x564f0a532510 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 realm 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a533030 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a533900 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.034+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a533ca0 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f136cb33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a534750 0x564f0a536b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5372a0 con 0x564f0a534750 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f1368ff6640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a534750 0x564f0a536b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.035+0000 7f1368ff6640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a534750 0x564f0a536b40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f136cb33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f136cb33800 20 searching for the correct realm 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f0a539350 0x564f0a53b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f13687f5640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f0a539350 0x564f0a53b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f13687f5640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f0a539350 0x564f0a53b810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f13687f5640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f135800f070 0x7f1358019830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.036+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f135ffff640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f135800f070 0x7f1358019830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f135ffff640 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f135800f070 0x7f1358019830 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.037+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.038+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.039+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.039+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.039+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.039+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.040+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.041+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.042+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.043+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.044+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.045+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a539350 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a534750 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x564f0a530050 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53bee0 con 0x7f135800f070 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a537d50 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.046+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538650 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 zone default found 2024-05-08T09:21:51.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 4 Realm: () 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 zonegroup default 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.047+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53c360 con 0x564f0a534750 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53e590 con 0x564f0a539350 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53e930 con 0x564f0a539350 2024-05-08T09:21:51.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 started sync module instance, tier type = 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.048+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d9d0 con 0x7f135800f070 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.049+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.049+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897475673536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d9d0 con 0x7f135800f070 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.049+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53f200 con 0x564f0a530050 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.050+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897475673536] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.050+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.050+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897475677392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d9d0 con 0x564f0a530050 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.050+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53fc70 con 0x564f0a539350 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.051+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897475677392] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.052+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.052+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897475671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d940 con 0x564f0a539350 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.052+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a540b30 con 0x7f135800f070 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897475684448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5413d0 con 0x7f135800f070 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a541ec0 con 0x564f0a530050 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897475671328] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.053+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897475688848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a541e80 con 0x564f0a530050 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.054+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.054+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897475684448] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.054+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897475688848] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.055+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.055+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897475682400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a540f20 con 0x564f0a534750 2024-05-08T09:21:51.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.055+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a543170 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.056+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.056+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897475693680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5435c0 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.056+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5440e0 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.056+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897475682400] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897475693680] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897475694736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5440a0 con 0x564f0a534750 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=0 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=1 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=2 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=3 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=4 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=5 2024-05-08T09:21:51.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.057+0000 7f136cb33800 20 add_watcher() i=6 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897475694736] v27'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f136cb33800 20 add_watcher() i=7 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f136cb33800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f0a542420 con 0x564f0a530050 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.058+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897475697584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a542420 con 0x564f0a530050 2024-05-08T09:21:51.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.059+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897475697584] v27'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f121e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 5 note: GC not initialized 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f121d7e2640 20 reqs_thread_entry: start 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 20 Filter name: none 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f118effd640 20 reqs_thread_entry: start 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.060+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a579cc0 con 0x564f0a539350 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(62 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a579cc0 con 0x564f0a539350 2024-05-08T09:21:51.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(63 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a579cc0 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(64 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 [pgnls start_epoch 27 out=49b] v27'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.061+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x7f135800f070 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a539350 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(67 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a539350 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(69 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.062+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x7f135800f070 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a539350 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(71 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(72 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.063+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a539350 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(75 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(76 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.064+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(78 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a539350 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(79 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x7f135800f070 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(80 [pgnls start_epoch 27 out=70b] v27'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.065+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a530050 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(81 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a530050 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(82 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a539350 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(83 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x7f135800f070 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(84 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.066+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(85 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a530050 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(86 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(87 [pgnls start_epoch 27 out=49b] v27'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a539350 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(88 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.067+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x7f135800f070 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(89 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a534750 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(90 [pgnls start_epoch 27 out=49b] v27'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a530050 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(91 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x564f0a539350 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(92 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.068+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f0a5428d0 con 0x7f135800f070 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.069+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(93 [pgnls start_epoch 27 out=127b] v27'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.069+0000 7f136cb33800 20 RGWRados::pool_iterate: got myfoo 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.069+0000 7f136cb33800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.069+0000 7f121e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.069+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897475697584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.070+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94897475697584] v27'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.070+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897475673536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x7f135800f070 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.071+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94897475673536] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.071+0000 7f136cb33800 20 remove_watcher() i=0 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.071+0000 7f136cb33800 2 removed watcher, disabling cache 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.071+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897475677392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a530050 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.073+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94897475677392] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.073+0000 7f136cb33800 20 remove_watcher() i=1 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.073+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897475671328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a538170 con 0x564f0a539350 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.074+0000 7f13687f5640 1 -- 172.21.15.161:0/294382945 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94897475671328] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135802e070 con 0x564f0a539350 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.074+0000 7f136cb33800 20 remove_watcher() i=2 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.074+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897475684448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53ddc0 con 0x7f135800f070 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.075+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94897475684448] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x7f135800f070 2024-05-08T09:21:51.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.075+0000 7f136cb33800 20 remove_watcher() i=3 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.075+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897475688848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d520 con 0x564f0a530050 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.076+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94897475688848] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f135005a040 con 0x564f0a530050 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.076+0000 7f136cb33800 20 remove_watcher() i=4 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.076+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897475682400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a540860 con 0x564f0a534750 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.077+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94897475682400] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.077+0000 7f136cb33800 20 remove_watcher() i=5 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.077+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897475693680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53ddc0 con 0x564f0a534750 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.078+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94897475693680] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.078+0000 7f136cb33800 20 remove_watcher() i=6 2024-05-08T09:21:51.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.078+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897475694736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f0a53d520 con 0x564f0a534750 2024-05-08T09:21:51.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f1368ff6640 1 -- 172.21.15.161:0/294382945 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94897475694736] v27'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1360056040 con 0x564f0a534750 2024-05-08T09:21:51.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 20 remove_watcher() i=7 2024-05-08T09:21:51.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a534750 msgr2=0x564f0a536b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a534750 0x564f0a536b40 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a530050 msgr2=0x564f0a532510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a530050 0x564f0a532510 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f135800f070 msgr2=0x7f1358019830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f135800f070 0x7f1358019830 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f0a539350 msgr2=0x564f0a53b810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f0a539350 0x564f0a53b810 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1238036900 msgr2=0x7f1238038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1238036900 0x7f1238038dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x564f0a4febf0 tx=0x7f1358044000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 msgr2=0x564f0a3f9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f135ffff640 1 -- 172.21.15.161:0/294382945 reap_dead start 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1360011fd0 tx=0x7f136004c830 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 shutdown_connections 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/294382945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a51ac90 0x564f0a3f9c60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 >> 172.21.15.161:0/294382945 conn(0x564f0a516f60 msgr2=0x564f0a5145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 shutdown_connections 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/294382945 wait complete. 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 msgr2=0x7f1240038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 0x7f1240038dc0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x564f0a4f9e80 tx=0x7f135801c450 comp rx=0 tx=0).stop 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 msgr2=0x564f0a50dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.079+0000 7f136cb33800 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x564f0a4f9e10 tx=0x7f1360018830 comp rx=0 tx=0).stop 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 shutdown_connections 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1240036900 0x7f1240038dc0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/3646135049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a50d920 0x564f0a50dd40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 >> 172.21.15.161:0/3646135049 conn(0x564f0a5019c0 msgr2=0x564f0a501dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 shutdown_connections 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/3646135049 wait complete. 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 msgr2=0x564f0a4fe150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 0x564f0a4fe150 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 msgr2=0x564f0a4f9480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 0x564f0a4f9480 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 msgr2=0x7f1250038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 0x7f1250038dc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1350054000 tx=0x7f135004e000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 msgr2=0x564f0a4f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1358000f60 tx=0x7f1358000bc0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 shutdown_connections 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f0a4fbd60 0x564f0a4fe150 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f0a3fd610 0x564f0a4f9480 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1250036900 0x7f1250038dc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 --2- 172.21.15.161:0/1345033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f0a3f73a0 0x564f0a4f2240 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 >> 172.21.15.161:0/1345033745 conn(0x564f0a3f2d20 msgr2=0x564f0a4e47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 shutdown_connections 2024-05-08T09:21:51.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.080+0000 7f136cb33800 1 -- 172.21.15.161:0/1345033745 wait complete. 2024-05-08T09:21:51.092 INFO:teuthology.orchestra.run.smithi161.stdout:["myfoo"] 2024-05-08T09:21:51.092 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-05-08T09:21:51.103 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.115 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.127 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.171 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-05-08T09:21:51.200 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.230 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.257 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:51.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:51.258 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T09:21:51.303 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.303 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.304+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.304+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.304+0000 7f8303610800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55aa6f282b60 0x55aa6f284f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.304+0000 7f8303610800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa6f288fa0 con 0x55aa6f285490 2024-05-08T09:21:51.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.304+0000 7f8303610800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55aa6f113050 con 0x55aa6f282b60 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82fec7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55aa6f282b60 0x55aa6f284f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82fec7d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55aa6f282b60 0x55aa6f284f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53118/0 (socket says 172.21.15.161:53118) 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82f647c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55aa6f285490 0x55aa6f287880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42936/0 (socket says 172.21.15.161:42936) 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82fec7d640 1 -- 172.21.15.161:0/770691796 learned_addr learned my addr 172.21.15.161:0/770691796 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82fec7d640 1 -- 172.21.15.161:0/770691796 >> v1:172.21.15.45:6789/0 conn(0x55aa6f285490 legacy=0x55aa6f287880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.305+0000 7f82fec7d640 1 -- 172.21.15.161:0/770691796 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f28a180 con 0x55aa6f282b60 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.307+0000 7f82fec7d640 1 --2- 172.21.15.161:0/770691796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f284f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f82f000a520 tx=0x7f82f001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5699d78941c509ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.307+0000 7f82fe47c640 1 -- 172.21.15.161:0/770691796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0057070 con 0x55aa6f282b60 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.307+0000 7f82fe47c640 1 -- 172.21.15.161:0/770691796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0052570 con 0x55aa6f282b60 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.307+0000 7f82fe47c640 1 -- 172.21.15.161:0/770691796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f004ae60 con 0x55aa6f282b60 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 -- 172.21.15.161:0/770691796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 msgr2=0x55aa6f284f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 --2- 172.21.15.161:0/770691796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f284f50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f82f000a520 tx=0x7f82f001d010 comp rx=0 tx=0).stop 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 -- 172.21.15.161:0/770691796 shutdown_connections 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 --2- 172.21.15.161:0/770691796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f284f50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 -- 172.21.15.161:0/770691796 >> 172.21.15.161:0/770691796 conn(0x55aa6f27c5b0 msgr2=0x55aa6f27e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 -- 172.21.15.161:0/770691796 shutdown_connections 2024-05-08T09:21:51.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.308+0000 7f8303610800 1 -- 172.21.15.161:0/770691796 wait complete. 2024-05-08T09:21:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.321+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.321+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.321+0000 7f8303610800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.321+0000 7f8303610800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa6f1cd1d0 con 0x55aa6f282b60 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f82fec7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f82fec7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53124/0 (socket says 172.21.15.161:53124) 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f82fec7d640 1 -- 172.21.15.161:0/159007202 learned_addr learned my addr 172.21.15.161:0/159007202 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f82fec7d640 1 -- 172.21.15.161:0/159007202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f373cb0 con 0x55aa6f282b60 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f82fec7d640 1 --2- 172.21.15.161:0/159007202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82f0055040 tx=0x7f82f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf87a579c718581 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f81ece09640 1 -- 172.21.15.161:0/159007202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0057040 con 0x55aa6f282b60 2024-05-08T09:21:51.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f81ece09640 1 -- 172.21.15.161:0/159007202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f0052720 con 0x55aa6f282b60 2024-05-08T09:21:51.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.322+0000 7f81ece09640 1 -- 172.21.15.161:0/159007202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0052a20 con 0x55aa6f282b60 2024-05-08T09:21:51.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 -- 172.21.15.161:0/159007202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 msgr2=0x55aa6f3736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 --2- 172.21.15.161:0/159007202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82f0055040 tx=0x7f82f004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 -- 172.21.15.161:0/159007202 shutdown_connections 2024-05-08T09:21:51.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 --2- 172.21.15.161:0/159007202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f3736e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 -- 172.21.15.161:0/159007202 >> 172.21.15.161:0/159007202 conn(0x55aa6f27c5b0 msgr2=0x55aa6f36f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 -- 172.21.15.161:0/159007202 shutdown_connections 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 -- 172.21.15.161:0/159007202 wait complete. 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.323+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f8303610800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f8303610800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa6f289410 con 0x55aa6f282b60 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f82fec7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f82fec7d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53126/0 (socket says 172.21.15.161:53126) 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f82fec7d640 1 -- 172.21.15.161:0/441117874 learned_addr learned my addr 172.21.15.161:0/441117874 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f82fec7d640 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f37b710 con 0x55aa6f282b60 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.324+0000 7f82fec7d640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82f0052540 tx=0x7f82f0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f81eb606640 1 -- 172.21.15.161:0/441117874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0073070 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f81eb606640 1 -- 172.21.15.161:0/441117874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f005d440 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa6f37b9a0 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f81eb606640 1 -- 172.21.15.161:0/441117874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f0057070 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6f37e5b0 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.325+0000 7f81eb606640 1 -- 172.21.15.161:0/441117874 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82f0076070 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f81eb606640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 0x7f81e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f81eb606640 1 -- 172.21.15.161:0/441117874 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82f008dbd0 con 0x55aa6f282b60 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f82f647c640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 0x7f81e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 0x55aa6f382370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3828f0 con 0x55aa6f285490 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f82ff47e640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 0x55aa6f382370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f82f647c640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 0x7f81e4038dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82e8000f60 tx=0x7f82e8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f82ff47e640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 0x55aa6f382370 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.326+0000 7f82ff47e640 1 -- 172.21.15.161:0/441117874 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82f800a4a0 con 0x55aa6f285490 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f37f940 con 0x55aa6f285490 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f82ff47e640 1 -- 172.21.15.161:0/441117874 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82f800a4a0 con 0x55aa6f285490 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 0x55aa6f387040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3876e0 con 0x55aa6f384c50 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f82fec7d640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 0x55aa6f387040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.327+0000 7f82fec7d640 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 0x55aa6f387040 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.328+0000 7f82fec7d640 1 -- 172.21.15.161:0/441117874 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f82f0075030 con 0x55aa6f384c50 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.328+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f383c00 con 0x55aa6f285490 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.328+0000 7f82ff47e640 1 -- 172.21.15.161:0/441117874 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82f800a4a0 con 0x55aa6f285490 2024-05-08T09:21:51.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.328+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3840e0 con 0x55aa6f285490 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.328+0000 7f82ff47e640 1 -- 172.21.15.161:0/441117874 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f82f800a4a0 con 0x55aa6f285490 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f8303610800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f8303610800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa6f173cf0 con 0x55aa6f282720 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53136/0 (socket says 172.21.15.161:53136) 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f82ff47e640 1 -- 172.21.15.161:0/1045585926 learned_addr learned my addr 172.21.15.161:0/1045585926 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f82ff47e640 1 -- 172.21.15.161:0/1045585926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f2810d0 con 0x55aa6f282720 2024-05-08T09:21:51.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.329+0000 7f82ff47e640 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55aa6f382cb0 tx=0x7f82f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f81e8e01640 1 -- 172.21.15.161:0/1045585926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f8014450 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f81e8e01640 1 -- 172.21.15.161:0/1045585926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f80145f0 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa6f281360 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f81e8e01640 1 -- 172.21.15.161:0/1045585926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f80148d0 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6f281860 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.330+0000 7f81e8e01640 1 -- 172.21.15.161:0/1045585926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82f8011040 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f81e8e01640 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 0x7f81d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f81e8e01640 1 -- 172.21.15.161:0/1045585926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82f801e070 con 0x55aa6f282720 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 0x7f81d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 0x7f81d8038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55aa6f382d70 tx=0x7f82f0052f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f8303610800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f8303610800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa6f373f70 con 0x55aa6f3a5d60 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53150/0 (socket says 172.21.15.161:53150) 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.331+0000 7f82ff47e640 1 -- 172.21.15.161:0/4121767718 learned_addr learned my addr 172.21.15.161:0/4121767718 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f82ff47e640 1 -- 172.21.15.161:0/4121767718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f3a6750 con 0x55aa6f3a5d60 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f82ff47e640 1 --2- 172.21.15.161:0/4121767718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82f804ca00 tx=0x7f82f8011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d1e6e27fd666f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f81e27fc640 1 -- 172.21.15.161:0/4121767718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f8013cb0 con 0x55aa6f3a5d60 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f81e27fc640 1 -- 172.21.15.161:0/4121767718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f8013e50 con 0x55aa6f3a5d60 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f81e27fc640 1 -- 172.21.15.161:0/4121767718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f804e0d0 con 0x55aa6f3a5d60 2024-05-08T09:21:51.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 -- 172.21.15.161:0/4121767718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 msgr2=0x55aa6f3a6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 --2- 172.21.15.161:0/4121767718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f82f804ca00 tx=0x7f82f8011700 comp rx=0 tx=0).stop 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 -- 172.21.15.161:0/4121767718 shutdown_connections 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 --2- 172.21.15.161:0/4121767718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3a6180 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 -- 172.21.15.161:0/4121767718 >> 172.21.15.161:0/4121767718 conn(0x55aa6f3a20c0 msgr2=0x55aa6f3a0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 -- 172.21.15.161:0/4121767718 shutdown_connections 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.332+0000 7f8303610800 1 -- 172.21.15.161:0/4121767718 wait complete. 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.333+0000 7f8303610800 1 Processor -- start 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.333+0000 7f8303610800 1 -- start start 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.333+0000 7f8303610800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.333+0000 7f8303610800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa6f3a6e60 con 0x55aa6f3a5d60 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.334+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.334+0000 7f82ff47e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53158/0 (socket says 172.21.15.161:53158) 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.334+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 learned_addr learned my addr 172.21.15.161:0/1133085990 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.335+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa6f3ad7f0 con 0x55aa6f3a5d60 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f82ff47e640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f82f8011be0 tx=0x7f82f804c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f81e0ff9640 1 -- 172.21.15.161:0/1133085990 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f8013cb0 con 0x55aa6f3a5d60 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f81e0ff9640 1 -- 172.21.15.161:0/1133085990 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82f8022a80 con 0x55aa6f3a5d60 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f81e0ff9640 1 -- 172.21.15.161:0/1133085990 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82f8022d60 con 0x55aa6f3a5d60 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa6f3ada80 con 0x55aa6f3a5d60 2024-05-08T09:21:51.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.336+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa6f3ada80 con 0x55aa6f3a5d60 2024-05-08T09:21:51.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f81e0ff9640 1 -- 172.21.15.161:0/1133085990 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82f80133b0 con 0x55aa6f3a5d60 2024-05-08T09:21:51.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f81e0ff9640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81c8036950 0x7f81c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f81e0ff9640 1 -- 172.21.15.161:0/1133085990 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82f8045050 con 0x55aa6f3a5d60 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81c8036950 0x7f81c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f3b8bd0 0x55aa6f3bb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.337+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3bb7e0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f82f647c640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f3b8bd0 0x55aa6f3bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81c8036950 0x7f81c8038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55aa6f387ae0 tx=0x7f82f008e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f82f647c640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f3b8bd0 0x55aa6f3bb090 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82e800f610 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 20 realm 2024-05-08T09:21:51.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3b80a0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82e800f610 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.338+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3bc2e0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82e800f610 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3bcbb0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82e800f610 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f3bd460 0x55aa6f3bf850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3bff90 con 0x55aa6f3bd460 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.339+0000 7f82ff47e640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f3bd460 0x55aa6f3bf850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f82ff47e640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f3bd460 0x55aa6f3bf850 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f8303610800 20 searching for the correct realm 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa6f3c2040 0x55aa6f3c4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.340+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa6f3c2040 0x55aa6f3c4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.341+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa6f3c2040 0x55aa6f3c4500 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.341+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.341+0000 7f82fec7d640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82f0078060 0x7f82f00766f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.341+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.341+0000 7f82f647c640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82f0078060 0x7f82f00766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82f647c640 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82f0078060 0x7f82f00766f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e800f610 con 0x7f82f0078060 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e800f610 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.342+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.343+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x7f82f0078060 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.344+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f82e802b040 con 0x7f82f0078060 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.345+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.346+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x7f82f0078060 2024-05-08T09:21:51.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.347+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.348+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.348+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.349+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.349+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.349+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.349+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x7f82f0078060 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3c2040 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.350+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c4bd0 con 0x7f82f0078060 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82e802b040 con 0x7f82f0078060 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c0a40 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82e802b040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.351+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c0e60 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c1340 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 zone default found 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 4 Realm: () 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 zonegroup default 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c5050 con 0x55aa6f3bd460 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.352+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c7280 con 0x55aa6f3c2040 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c7620 con 0x55aa6f3c2040 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 20 started sync module instance, tier type = 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.353+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c66c0 con 0x7f82f0078060 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.354+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.354+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94190499031728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c66c0 con 0x7f82f0078060 2024-05-08T09:21:51.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.354+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c7ef0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.355+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94190499031728] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.355+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.355+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94190499035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c66c0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.355+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c8980 con 0x55aa6f3c2040 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.356+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.356+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94190499038288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c9220 con 0x55aa6f3c2040 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.356+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c9cc0 con 0x7f82f0078060 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.356+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94190499035584] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.357+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.357+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94190499038288] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.357+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94190499043216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3ca0b0 con 0x7f82f0078060 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.357+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c8d70 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.358+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94190499043216] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.358+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.358+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94190499029520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3c8d70 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.358+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3caf20 con 0x55aa6f3bd460 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.360+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94190499029520] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.360+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.360+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94190499046848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cb310 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.360+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cbcd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.361+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94190499046848] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.361+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.361+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94190499047904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cbcd0 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.361+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cc720 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94190499054128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3ccb60 con 0x55aa6f3bd460 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=0 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=1 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=2 2024-05-08T09:21:51.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=3 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=4 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=5 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94190499047904] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.362+0000 7f8303610800 20 add_watcher() i=6 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94190499054128] v27'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f8303610800 20 add_watcher() i=7 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f8303610800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cb820 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.363+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94190499055184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3cb820 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94190499055184] v27'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f81b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f8303610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f8303610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f8303610800 5 note: GC not initialized 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.364+0000 7f812ffff640 20 reqs_thread_entry: start 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 20 Filter name: none 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f812dffb640 20 reqs_thread_entry: start 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f403180 con 0x7f82f0078060 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.365+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f403a10 con 0x7f82f0078060 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f402520 con 0x7f82f0078060 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f405020 con 0x7f82f0078060 2024-05-08T09:21:51.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.366+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(65 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 4.7 4:e36019c5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f406a50 con 0x55aa6f3bd460 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 4.17 4:eba780b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f409590 con 0x55aa6f3bd460 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 4.d 4:b0be4d53:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f40bef0 con 0x55aa6f3c2040 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 4.32 4:4ceb3478:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f40e760 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 4.2f 4:f5a2285c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f411370 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 4.1f 4:f85c6e14:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f4141b0 con 0x55aa6f3c2040 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f416a60 con 0x55aa6f3bd460 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 4.20 4:077f40c6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f419600 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 4.13 4:ca8f0f6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f41c030 con 0x7f82f0078060 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 4.c 4:339bb1ce:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f41ea60 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 4.24 4:27768d85:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f421920 con 0x55aa6f3bd460 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(67 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(66 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(69 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(70 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(76 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(73 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(75 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.367+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(71 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.368+0000 7f81b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.368+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94190499055184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f41ea60 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.369+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94190499055184] v27'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.369+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94190499031728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x7f82f0078060 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.370+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94190499031728] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.370+0000 7f8303610800 20 remove_watcher() i=0 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.370+0000 7f8303610800 2 removed watcher, disabling cache 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.370+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94190499035584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.371+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94190499035584] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.371+0000 7f8303610800 20 remove_watcher() i=1 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.371+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94190499038288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3c2040 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.372+0000 7f82fec7d640 1 -- 172.21.15.161:0/1133085990 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94190499038288] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f0086040 con 0x55aa6f3c2040 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.372+0000 7f8303610800 20 remove_watcher() i=2 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.372+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94190499043216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x7f82f0078060 2024-05-08T09:21:51.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.373+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94190499043216] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x7f82f0078060 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.373+0000 7f8303610800 20 remove_watcher() i=3 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.373+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94190499029520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.374+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94190499029520] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82e803d040 con 0x55aa6f3b8bd0 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.374+0000 7f8303610800 20 remove_watcher() i=4 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.374+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94190499046848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3bd460 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.376+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94190499046848] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.376+0000 7f8303610800 20 remove_watcher() i=5 2024-05-08T09:21:51.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.376+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94190499047904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3bd460 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.377+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94190499047904] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.377+0000 7f8303610800 20 remove_watcher() i=6 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.377+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94190499054128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa6f3eb6e0 con 0x55aa6f3bd460 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f82ff47e640 1 -- 172.21.15.161:0/1133085990 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94190499054128] v27'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82f802a070 con 0x55aa6f3bd460 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 20 remove_watcher() i=7 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f3bd460 msgr2=0x55aa6f3bf850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f3bd460 0x55aa6f3bf850 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f3b8bd0 msgr2=0x55aa6f3bb090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f3b8bd0 0x55aa6f3bb090 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82f0078060 msgr2=0x7f82f00766f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82f0078060 0x7f82f00766f0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa6f3c2040 msgr2=0x55aa6f3c4500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.378+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa6f3c2040 0x55aa6f3c4500 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81c8036950 msgr2=0x7f81c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81c8036950 0x7f81c8038e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55aa6f387ae0 tx=0x7f82f008e000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 msgr2=0x55aa6f3ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f82f647c640 1 -- 172.21.15.161:0/1133085990 reap_dead start 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f82f8011be0 tx=0x7f82f804c960 comp rx=0 tx=0).stop 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 shutdown_connections 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1133085990 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f3a5d60 0x55aa6f3ad2b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 >> 172.21.15.161:0/1133085990 conn(0x55aa6f3a20c0 msgr2=0x55aa6f39f720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 shutdown_connections 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1133085990 wait complete. 2024-05-08T09:21:51.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 msgr2=0x7f81d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 0x7f81d8038dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55aa6f382d70 tx=0x7f82f0052f40 comp rx=0 tx=0).stop 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 msgr2=0x55aa6f280b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x55aa6f382cb0 tx=0x7f82f8018830 comp rx=0 tx=0).stop 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 shutdown_connections 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81d8036900 0x7f81d8038dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 --2- 172.21.15.161:0/1045585926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282720 0x55aa6f280b90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 >> 172.21.15.161:0/1045585926 conn(0x55aa6f38a930 msgr2=0x55aa6f38ad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 shutdown_connections 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.379+0000 7f8303610800 1 -- 172.21.15.161:0/1045585926 wait complete. 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 msgr2=0x55aa6f387040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 0x55aa6f387040 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 msgr2=0x55aa6f382370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 0x55aa6f382370 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 msgr2=0x7f81e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 0x7f81e4038dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f82e8000f60 tx=0x7f82e8001370 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 msgr2=0x55aa6f37b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f82f0052540 tx=0x7f82f0003020 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 shutdown_connections 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa6f384c50 0x55aa6f387040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa6f285490 0x55aa6f382370 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81e4036900 0x7f81e4038dc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 --2- 172.21.15.161:0/441117874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa6f282b60 0x55aa6f37b1d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 >> 172.21.15.161:0/441117874 conn(0x55aa6f27c5b0 msgr2=0x55aa6f36d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 shutdown_connections 2024-05-08T09:21:51.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.380+0000 7f8303610800 1 -- 172.21.15.161:0/441117874 wait complete. 2024-05-08T09:21:51.392 INFO:teuthology.orchestra.run.smithi161.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"05c85a99-f6a8-405d-b310-d83661265ff5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T09:21:50.822820Z","creation_time":"2024-05-08T09:21:50.820361Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T09:21:51.392 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:21:50.822820Z', 'creation_time': '2024-05-08T09:21:50.820361Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:21:51.392 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-05-08T09:21:51.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-05-08T09:21:51.393 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-05-08T09:21:51.437 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.438 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.438+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.438+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d5e62800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55acd68bdfd0 0x55acd68be3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d5e62800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55acd68bea70 con 0x55acd68bf230 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d5e62800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55acd6750050 con 0x55acd68bdfd0 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d3961640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55acd68bdfd0 0x55acd68be3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d3961640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55acd68bdfd0 0x55acd68be3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53168/0 (socket says 172.21.15.161:53168) 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d3160640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55acd68bf230 0x55acd68bf6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42950/0 (socket says 172.21.15.161:42950) 2024-05-08T09:21:51.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.439+0000 7f82d3961640 1 -- 172.21.15.161:0/3402572372 learned_addr learned my addr 172.21.15.161:0/3402572372 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.441+0000 7f82d3961640 1 -- 172.21.15.161:0/3402572372 >> v1:172.21.15.45:6789/0 conn(0x55acd68bf230 legacy=0x55acd68bf6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.441+0000 7f82d3961640 1 -- 172.21.15.161:0/3402572372 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd68bfdf0 con 0x55acd68bdfd0 2024-05-08T09:21:51.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.445+0000 7f82d3961640 1 --2- 172.21.15.161:0/3402572372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd68be3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82c4005fd0 tx=0x7f82c401cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf8fa8cd43256eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d295f640 1 -- 172.21.15.161:0/3402572372 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4052540 con 0x55acd68bdfd0 2024-05-08T09:21:51.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d295f640 1 -- 172.21.15.161:0/3402572372 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c404e070 con 0x55acd68bdfd0 2024-05-08T09:21:51.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d295f640 1 -- 172.21.15.161:0/3402572372 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4052890 con 0x55acd68bdfd0 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 -- 172.21.15.161:0/3402572372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 msgr2=0x55acd68be3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3402572372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd68be3f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f82c4005fd0 tx=0x7f82c401cd80 comp rx=0 tx=0).stop 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 -- 172.21.15.161:0/3402572372 shutdown_connections 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3402572372 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd68be3f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 -- 172.21.15.161:0/3402572372 >> 172.21.15.161:0/3402572372 conn(0x55acd68b95b0 msgr2=0x55acd68bb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 -- 172.21.15.161:0/3402572372 shutdown_connections 2024-05-08T09:21:51.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.446+0000 7f82d5e62800 1 -- 172.21.15.161:0/3402572372 wait complete. 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d5e62800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d5e62800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55acd680a1d0 con 0x55acd68bdfd0 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d3961640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d3961640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53178/0 (socket says 172.21.15.161:53178) 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d3961640 1 -- 172.21.15.161:0/2368456765 learned_addr learned my addr 172.21.15.161:0/2368456765 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.460+0000 7f82d3961640 1 -- 172.21.15.161:0/2368456765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd69b0d90 con 0x55acd68bdfd0 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.461+0000 7f82d3961640 1 --2- 172.21.15.161:0/2368456765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82c401ba70 tx=0x7f82c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c68f8834dbde6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.461+0000 7f81c1e0b640 1 -- 172.21.15.161:0/2368456765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4052820 con 0x55acd68bdfd0 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.461+0000 7f81c1e0b640 1 -- 172.21.15.161:0/2368456765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c4062070 con 0x55acd68bdfd0 2024-05-08T09:21:51.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.461+0000 7f81c1e0b640 1 -- 172.21.15.161:0/2368456765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4052b10 con 0x55acd68bdfd0 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- 172.21.15.161:0/2368456765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 msgr2=0x55acd69b07c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 --2- 172.21.15.161:0/2368456765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f82c401ba70 tx=0x7f82c404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- 172.21.15.161:0/2368456765 shutdown_connections 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 --2- 172.21.15.161:0/2368456765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b07c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- 172.21.15.161:0/2368456765 >> 172.21.15.161:0/2368456765 conn(0x55acd68b95b0 msgr2=0x55acd69aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- 172.21.15.161:0/2368456765 shutdown_connections 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- 172.21.15.161:0/2368456765 wait complete. 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d5e62800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55acd68c7700 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d3961640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d3961640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53184/0 (socket says 172.21.15.161:53184) 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.462+0000 7f82d3961640 1 -- 172.21.15.161:0/1527231437 learned_addr learned my addr 172.21.15.161:0/1527231437 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f82d3961640 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd69b8720 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f82d3961640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f82c400a190 tx=0x7f82c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f81bbfff640 1 -- 172.21.15.161:0/1527231437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4071570 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f81bbfff640 1 -- 172.21.15.161:0/1527231437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82c4058040 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd69b89b0 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f81bbfff640 1 -- 172.21.15.161:0/1527231437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82c4071840 con 0x55acd68bdfd0 2024-05-08T09:21:51.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.463+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd69bb660 con 0x55acd68bdfd0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f81bbfff640 1 -- 172.21.15.161:0/1527231437 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82c4050070 con 0x55acd68bdfd0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f81bbfff640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 0x7f81bc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f81bbfff640 1 -- 172.21.15.161:0/1527231437 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82c408e6d0 con 0x55acd68bdfd0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f82d3160640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 0x7f81bc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 0x55acd69bf420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69bf960 con 0x55acd68bf230 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.464+0000 7f82d4162640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 0x55acd69bf420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d3160640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 0x7f81bc038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f60 tx=0x7f82c8001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d4162640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 0x55acd69bf420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d4162640 1 -- 172.21.15.161:0/1527231437 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82cc0083e0 con 0x55acd68bf230 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69bc9d0 con 0x55acd68bf230 2024-05-08T09:21:51.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d4162640 1 -- 172.21.15.161:0/1527231437 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82cc0083e0 con 0x55acd68bf230 2024-05-08T09:21:51.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 0x55acd69c4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69c4730 con 0x55acd69c1c50 2024-05-08T09:21:51.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.465+0000 7f82d3961640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 0x55acd69c4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.466+0000 7f82d3961640 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 0x55acd69c4040 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.466+0000 7f82d3961640 1 -- 172.21.15.161:0/1527231437 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69c1c50 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.466+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69c0bd0 con 0x55acd68bf230 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.466+0000 7f82d4162640 1 -- 172.21.15.161:0/1527231437 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82cc0083e0 con 0x55acd68bf230 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.466+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69c1090 con 0x55acd68bf230 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d4162640 1 -- 172.21.15.161:0/1527231437 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f82cc0083e0 con 0x55acd68bf230 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d5e62800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d5e62800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55acd67b0cf0 con 0x55acd69d38b0 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53196/0 (socket says 172.21.15.161:53196) 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.467+0000 7f82d4162640 1 -- 172.21.15.161:0/3670285886 learned_addr learned my addr 172.21.15.161:0/3670285886 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f82d4162640 1 -- 172.21.15.161:0/3670285886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd69d4210 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f82d4162640 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x55acd69b9000 tx=0x7f82cc00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f81b97fa640 1 -- 172.21.15.161:0/3670285886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc007d00 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f81b97fa640 1 -- 172.21.15.161:0/3670285886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc01e020 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f81b97fa640 1 -- 172.21.15.161:0/3670285886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc019420 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd69d4c80 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.468+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd69d5180 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f81b97fa640 1 -- 172.21.15.161:0/3670285886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82cc016040 con 0x55acd69d38b0 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f81b97fa640 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 0x7f81ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f81b97fa640 1 -- 172.21.15.161:0/3670285886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82cc01f030 con 0x55acd69d38b0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f82d3961640 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 0x7f81ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.469+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d3961640 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 0x7f81ac038dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82c408cac0 tx=0x7f82c4066460 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d5e62800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d5e62800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55acd69b1050 con 0x55acd69e0bf0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53212/0 (socket says 172.21.15.161:53212) 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d4162640 1 -- 172.21.15.161:0/798110425 learned_addr learned my addr 172.21.15.161:0/798110425 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d4162640 1 -- 172.21.15.161:0/798110425 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd69e15e0 con 0x55acd69e0bf0 2024-05-08T09:21:51.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f82d4162640 1 --2- 172.21.15.161:0/798110425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f82cc017020 tx=0x7f82cc014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f508612a205edc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f81b2ffd640 1 -- 172.21.15.161:0/798110425 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc01d070 con 0x55acd69e0bf0 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f81b2ffd640 1 -- 172.21.15.161:0/798110425 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc04e0d0 con 0x55acd69e0bf0 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.470+0000 7f81b2ffd640 1 -- 172.21.15.161:0/798110425 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc017ca0 con 0x55acd69e0bf0 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- 172.21.15.161:0/798110425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 msgr2=0x55acd69e1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 --2- 172.21.15.161:0/798110425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f82cc017020 tx=0x7f82cc014640 comp rx=0 tx=0).stop 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- 172.21.15.161:0/798110425 shutdown_connections 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 --2- 172.21.15.161:0/798110425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e1010 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- 172.21.15.161:0/798110425 >> 172.21.15.161:0/798110425 conn(0x55acd69dcf00 msgr2=0x55acd69dafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- 172.21.15.161:0/798110425 shutdown_connections 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- 172.21.15.161:0/798110425 wait complete. 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 Processor -- start 2024-05-08T09:21:51.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- start start 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.471+0000 7f82d5e62800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55acd69e1db0 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.472+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.472+0000 7f82d4162640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53218/0 (socket says 172.21.15.161:53218) 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.472+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 learned_addr learned my addr 172.21.15.161:0/1208010958 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acd69e8650 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f82d4162640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e8110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82cc017020 tx=0x7f82cc04c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f81b17fa640 1 -- 172.21.15.161:0/1208010958 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc031030 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f81b17fa640 1 -- 172.21.15.161:0/1208010958 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82cc04e280 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55acd69e88e0 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f81b17fa640 1 -- 172.21.15.161:0/1208010958 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f82cc017860 con 0x55acd69e0bf0 2024-05-08T09:21:51.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.473+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acd69eb590 con 0x55acd69e0bf0 2024-05-08T09:21:51.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.474+0000 7f81b17fa640 1 -- 172.21.15.161:0/1208010958 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f82cc034070 con 0x55acd69e0bf0 2024-05-08T09:21:51.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f81b17fa640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f819c036900 0x7f819c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f81b17fa640 1 -- 172.21.15.161:0/1208010958 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f82cc032070 con 0x55acd69e0bf0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d3961640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f819c036900 0x7f819c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd69f3bc0 0x55acd69f6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69f67a0 con 0x55acd69f3bc0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d3160640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd69f3bc0 0x55acd69f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d3160640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd69f3bc0 0x55acd69f6050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.475+0000 7f82d3961640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f819c036900 0x7f819c038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82c40843f0 tx=0x7f82c4091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82c800f610 con 0x55acd69f3bc0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 realm 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69f30d0 con 0x55acd69f3bc0 2024-05-08T09:21:51.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82c800f610 con 0x55acd69f3bc0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69f7280 con 0x55acd69f3bc0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82c800f610 con 0x55acd69f3bc0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69f7b50 con 0x55acd69f3bc0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f82c800f610 con 0x55acd69f3bc0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69f8450 0x55acd69fa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.476+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69fafa0 con 0x55acd69f8450 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d4162640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69f8450 0x55acd69fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d4162640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69f8450 0x55acd69fa840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d5e62800 20 searching for the correct realm 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55acd69fd050 0x55acd69ff510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.477+0000 7f82d3961640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55acd69fd050 0x55acd69ff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.478+0000 7f82d3961640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55acd69fd050 0x55acd69ff510 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.478+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.478+0000 7f82d3961640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82c4052030 0x7f82c408b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.478+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d3160640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82c4052030 0x7f82c408b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d3160640 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82c4052030 0x7f82c408b1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c800f610 con 0x7f82c4052030 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.479+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c800f610 con 0x55acd69f3bc0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.480+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x7f82c4052030 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.481+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f82c802b040 con 0x7f82c4052030 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.482+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.483+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.484+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x7f82c4052030 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.485+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.486+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x7f82c4052030 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69fd050 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x55acd69f3bc0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55acd69ffbe0 con 0x7f82c4052030 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f82c802b040 con 0x7f82c4052030 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d5e62800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d5e62800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.487+0000 7f82d5e62800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69fba50 con 0x55acd69f3bc0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f82c802b040 con 0x55acd69f3bc0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69fbed0 con 0x55acd69f3bc0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd69fc3b0 con 0x55acd69f3bc0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 zone default found 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 4 Realm: () 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 zonegroup default 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.488+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a00060 con 0x55acd69f8450 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a02290 con 0x55acd69fd050 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a02630 con 0x55acd69fd050 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 started sync module instance, tier type = 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.489+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a016d0 con 0x7f82c4052030 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.490+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.490+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94200823552704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a016d0 con 0x7f82c4052030 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.490+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a02f00 con 0x55acd69f3bc0 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.491+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94200823552704] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.491+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.491+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94200823556560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a016d0 con 0x55acd69f3bc0 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.491+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a03970 con 0x55acd69fd050 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.492+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94200823556560] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.493+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.493+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94200823550496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a01640 con 0x55acd69fd050 2024-05-08T09:21:51.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.493+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a04860 con 0x7f82c4052030 2024-05-08T09:21:51.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.494+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94200823550496] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.495+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.495+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94200823563184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a04c80 con 0x7f82c4052030 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.495+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a05640 con 0x55acd69f3bc0 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.496+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94200823563184] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.496+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.496+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94200823567216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a04c80 con 0x55acd69f3bc0 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.496+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a06050 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.497+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94200823567216] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.497+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.497+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94200823564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a06050 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.497+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a06a10 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.498+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94200823564752] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.498+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.498+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94200823572352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a06050 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.498+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a07460 con 0x55acd69f8450 2024-05-08T09:21:51.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.499+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94200823572352] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94200823569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a07620 con 0x55acd69f8450 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=0 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=1 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=2 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=3 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=4 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=5 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.500+0000 7f82d5e62800 20 add_watcher() i=6 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.501+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94200823569312] v27'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.501+0000 7f82d5e62800 20 add_watcher() i=7 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.501+0000 7f82d5e62800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.501+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a0a830 con 0x55acd69f3bc0 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.502+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.502+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94200823587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a075b0 con 0x55acd69f3bc0 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94200823587232] v27'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f8189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 5 note: GC not initialized 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f8188fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 20 Filter name: none 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f81027fc640 20 reqs_thread_entry: start 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.503+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3d970 con 0x55acd69f3bc0 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:51.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3dd50 con 0x55acd69f3bc0 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3ed60 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.504+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3c790 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3ecf0 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 4.7 4:e36019c5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a3e6e0 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:68 4.17 4:eba780b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a43830 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 4.d 4:b0be4d53:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a43830 con 0x55acd69fd050 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 4.32 4:4ceb3478:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a48570 con 0x55acd69f3bc0 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 4.2f 4:f5a2285c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a4b2b0 con 0x55acd69f3bc0 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:72 4.1f 4:f85c6e14:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a4e0e0 con 0x55acd69fd050 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a50a90 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 4.20 4:077f40c6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a53480 con 0x55acd69f3bc0 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(68 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(67 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.505+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:75 4.13 4:ca8f0f6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a53480 con 0x7f82c4052030 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(71 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(72 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(74 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 4.c 4:339bb1ce:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a4acc0 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 4.24 4:27768d85:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a4e5a0 con 0x55acd69f8450 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(75 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(76 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.506+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(77 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.507+0000 7f8189fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.507+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94200823587232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a4acc0 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.508+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94200823587232] v27'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.508+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94200823552704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x7f82c4052030 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.509+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94200823552704] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.509+0000 7f82d5e62800 20 remove_watcher() i=0 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.509+0000 7f82d5e62800 2 removed watcher, disabling cache 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.509+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94200823556560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69f3bc0 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.510+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94200823556560] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.510+0000 7f82d5e62800 20 remove_watcher() i=1 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.510+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94200823550496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69fd050 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.511+0000 7f82d3961640 1 -- 172.21.15.161:0/1208010958 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94200823550496] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c4077020 con 0x55acd69fd050 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.511+0000 7f82d5e62800 20 remove_watcher() i=2 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.511+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94200823563184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x7f82c4052030 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.512+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94200823563184] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x7f82c4052030 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.512+0000 7f82d5e62800 20 remove_watcher() i=3 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.512+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94200823567216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69f3bc0 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.513+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94200823567216] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82c803d040 con 0x55acd69f3bc0 2024-05-08T09:21:51.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.513+0000 7f82d5e62800 20 remove_watcher() i=4 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.513+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94200823564752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.514+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94200823564752] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.514+0000 7f82d5e62800 20 remove_watcher() i=5 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.514+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94200823572352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.516+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94200823572352] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.516+0000 7f82d5e62800 20 remove_watcher() i=6 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.516+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94200823569312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55acd6a26420 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d4162640 1 -- 172.21.15.161:0/1208010958 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94200823569312] v27'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f82cc057040 con 0x55acd69f8450 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 20 remove_watcher() i=7 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69f8450 msgr2=0x55acd69fa840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69f8450 0x55acd69fa840 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd69f3bc0 msgr2=0x55acd69f6050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd69f3bc0 0x55acd69f6050 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82c4052030 msgr2=0x7f82c408b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f82c4052030 0x7f82c408b1d0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55acd69fd050 msgr2=0x55acd69ff510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55acd69fd050 0x55acd69ff510 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f819c036900 msgr2=0x7f819c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f819c036900 0x7f819c038dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f82c40843f0 tx=0x7f82c4091000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 msgr2=0x55acd69e8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1208010958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69e0bf0 0x55acd69e8110 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f82cc017020 tx=0x7f82cc04c810 comp rx=0 tx=0).stop 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 reap_dead start 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d3160640 1 -- 172.21.15.161:0/1208010958 reap_dead start 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 shutdown_connections 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 >> 172.21.15.161:0/1208010958 conn(0x55acd69dcf00 msgr2=0x55acd69da5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 shutdown_connections 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/1208010958 wait complete. 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 msgr2=0x7f81ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 0x7f81ac038dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f82c408cac0 tx=0x7f82c4066460 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 msgr2=0x55acd69d3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x55acd69b9000 tx=0x7f82cc00aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 shutdown_connections 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81ac036900 0x7f81ac038dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 --2- 172.21.15.161:0/3670285886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd69d38b0 0x55acd69d3cd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 >> 172.21.15.161:0/3670285886 conn(0x55acd69c7950 msgr2=0x55acd69c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 shutdown_connections 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.517+0000 7f82d5e62800 1 -- 172.21.15.161:0/3670285886 wait complete. 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 msgr2=0x55acd69c4040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 0x55acd69c4040 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 msgr2=0x55acd69bf420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 0x55acd69bf420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 msgr2=0x7f81bc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 0x7f81bc038dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f82c8000f60 tx=0x7f82c8001370 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 msgr2=0x55acd69b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f82c400a190 tx=0x7f82c4003330 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 shutdown_connections 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55acd69c1c50 0x55acd69c4040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55acd68bf230 0x55acd69bf420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f81bc036900 0x7f81bc038dc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 --2- 172.21.15.161:0/1527231437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55acd68bdfd0 0x55acd69b81e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 >> 172.21.15.161:0/1527231437 conn(0x55acd68b95b0 msgr2=0x55acd69aa070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 shutdown_connections 2024-05-08T09:21:51.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.518+0000 7f82d5e62800 1 -- 172.21.15.161:0/1527231437 wait complete. 2024-05-08T09:21:51.531 INFO:teuthology.orchestra.run.smithi161.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"05c85a99-f6a8-405d-b310-d83661265ff5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T09:21:50.822820Z","creation_time":"2024-05-08T09:21:50.820361Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}}] 2024-05-08T09:21:51.531 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:21:50.822820Z', 'creation_time': '2024-05-08T09:21:50.820361Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T09:21:51.537 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T09:21:51.537 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:51.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:51.538 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T09:21:51.582 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.582 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.583+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.583+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.583+0000 7f2932d46800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f8bd42c950 0x55f8bd42cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.583+0000 7f2932d46800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8bd42de70 con 0x55f8bd42d2b0 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.583+0000 7f2932d46800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55f8bd2bf050 con 0x55f8bd42c950 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f2930845640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f8bd42c950 0x55f8bd42cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f292bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55f8bd42d2b0 0x55f8bd42d760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42958/0 (socket says 172.21.15.161:42958) 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f292bfff640 1 -- 172.21.15.161:0/116696388 learned_addr learned my addr 172.21.15.161:0/116696388 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f292b7fe640 1 -- 172.21.15.161:0/116696388 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2660130002 0 0) 0x55f8bd42de70 con 0x55f8bd42d2b0 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f292b7fe640 1 -- 172.21.15.161:0/116696388 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2920001e10 con 0x55f8bd42d2b0 2024-05-08T09:21:51.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f2930845640 1 -- 172.21.15.161:0/116696388 >> v1:172.21.15.45:6789/0 conn(0x55f8bd42d2b0 legacy=0x55f8bd42d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.584+0000 7f2930845640 1 -- 172.21.15.161:0/116696388 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd42e040 con 0x55f8bd42c950 2024-05-08T09:21:51.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.588+0000 7f2930845640 1 --2- 172.21.15.161:0/116696388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd42cd70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f292400a470 tx=0x7f292401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e902822b23596293 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.588+0000 7f292b7fe640 1 -- 172.21.15.161:0/116696388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2924057070 con 0x55f8bd42c950 2024-05-08T09:21:51.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.588+0000 7f292b7fe640 1 -- 172.21.15.161:0/116696388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292404ad60 con 0x55f8bd42c950 2024-05-08T09:21:51.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f292b7fe640 1 -- 172.21.15.161:0/116696388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2924052570 con 0x55f8bd42c950 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 -- 172.21.15.161:0/116696388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 msgr2=0x55f8bd42cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 --2- 172.21.15.161:0/116696388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd42cd70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f292400a470 tx=0x7f292401cdb0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 -- 172.21.15.161:0/116696388 shutdown_connections 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 --2- 172.21.15.161:0/116696388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd42cd70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 -- 172.21.15.161:0/116696388 >> 172.21.15.161:0/116696388 conn(0x55f8bd4285b0 msgr2=0x55f8bd42a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 -- 172.21.15.161:0/116696388 shutdown_connections 2024-05-08T09:21:51.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.589+0000 7f2932d46800 1 -- 172.21.15.161:0/116696388 wait complete. 2024-05-08T09:21:51.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.603+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.603+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2932d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2932d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8bd3791d0 con 0x55f8bd42c950 2024-05-08T09:21:51.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2930845640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2930845640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53238/0 (socket says 172.21.15.161:53238) 2024-05-08T09:21:51.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2930845640 1 -- 172.21.15.161:0/114436634 learned_addr learned my addr 172.21.15.161:0/114436634 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2930845640 1 -- 172.21.15.161:0/114436634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd521cb0 con 0x55f8bd42c950 2024-05-08T09:21:51.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.604+0000 7f2930845640 1 --2- 172.21.15.161:0/114436634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2924055040 tx=0x7f292404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fafb09ba028ed158 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f281ee05640 1 -- 172.21.15.161:0/114436634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2924057040 con 0x55f8bd42c950 2024-05-08T09:21:51.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f281ee05640 1 -- 172.21.15.161:0/114436634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2924063070 con 0x55f8bd42c950 2024-05-08T09:21:51.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f281ee05640 1 -- 172.21.15.161:0/114436634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29240527e0 con 0x55f8bd42c950 2024-05-08T09:21:51.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 -- 172.21.15.161:0/114436634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 msgr2=0x55f8bd5216e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 --2- 172.21.15.161:0/114436634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2924055040 tx=0x7f292404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 -- 172.21.15.161:0/114436634 shutdown_connections 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 --2- 172.21.15.161:0/114436634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd5216e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 -- 172.21.15.161:0/114436634 >> 172.21.15.161:0/114436634 conn(0x55f8bd4285b0 msgr2=0x55f8bd51d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 -- 172.21.15.161:0/114436634 shutdown_connections 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.605+0000 7f2932d46800 1 -- 172.21.15.161:0/114436634 wait complete. 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2932d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2932d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8bd42e510 con 0x55f8bd42c950 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2930845640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2930845640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53246/0 (socket says 172.21.15.161:53246) 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2930845640 1 -- 172.21.15.161:0/415053730 learned_addr learned my addr 172.21.15.161:0/415053730 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2930845640 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd529650 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.606+0000 7f2930845640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f292404ad30 tx=0x7f2924002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f281d602640 1 -- 172.21.15.161:0/415053730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292406d070 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f281d602640 1 -- 172.21.15.161:0/415053730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2924052dd0 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8bd5298e0 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f281d602640 1 -- 172.21.15.161:0/415053730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2924057050 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8bd52c4f0 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.607+0000 7f281d602640 1 -- 172.21.15.161:0/415053730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f292405d6b0 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f281d602640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f281d602640 1 -- 172.21.15.161:0/415053730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f292408da10 con 0x55f8bd42c950 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f292bfff640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 0x55f8bd5302b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd530880 con 0x55f8bd42d2b0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2931046640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 0x55f8bd5302b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f292bfff640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f291c000f60 tx=0x7f291c0010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2931046640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 0x55f8bd5302b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2931046640 1 -- 172.21.15.161:0/415053730 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f292c00a4a0 con 0x55f8bd42d2b0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.608+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd52d860 con 0x55f8bd42d2b0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.609+0000 7f2931046640 1 -- 172.21.15.161:0/415053730 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f292c00a4a0 con 0x55f8bd42d2b0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.609+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 0x55f8bd534fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.609+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd535670 con 0x55f8bd532be0 2024-05-08T09:21:51.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.609+0000 7f2930845640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 0x55f8bd534fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.609+0000 7f2930845640 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 0x55f8bd534fd0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.610+0000 7f2930845640 1 -- 172.21.15.161:0/415053730 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f292405a040 con 0x55f8bd532be0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.610+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd531b90 con 0x55f8bd42d2b0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.610+0000 7f2931046640 1 -- 172.21.15.161:0/415053730 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f292c00a4a0 con 0x55f8bd42d2b0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.610+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd532070 con 0x55f8bd42d2b0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.610+0000 7f2931046640 1 -- 172.21.15.161:0/415053730 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f292c00a4a0 con 0x55f8bd42d2b0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2932d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2932d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8bd31fcf0 con 0x55f8bd544820 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53254/0 (socket says 172.21.15.161:53254) 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2931046640 1 -- 172.21.15.161:0/1779935622 learned_addr learned my addr 172.21.15.161:0/1779935622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2931046640 1 -- 172.21.15.161:0/1779935622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd545180 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.611+0000 7f2931046640 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f8bd530c60 tx=0x7f292c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f28167fc640 1 -- 172.21.15.161:0/1779935622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c014450 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f28167fc640 1 -- 172.21.15.161:0/1779935622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c0145f0 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8bd545bf0 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f28167fc640 1 -- 172.21.15.161:0/1779935622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c0148d0 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8bd5460f0 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.612+0000 7f28167fc640 1 -- 172.21.15.161:0/1779935622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f292c011040 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f28167fc640 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 0x7f2808038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f28167fc640 1 -- 172.21.15.161:0/1779935622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f292c01e070 con 0x55f8bd544820 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2930845640 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 0x7f2808038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2930845640 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 0x7f2808038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55f8bd530d20 tx=0x7f292408bd10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2932d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2932d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8bd521f70 con 0x55f8bd551ad0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53260/0 (socket says 172.21.15.161:53260) 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.613+0000 7f2931046640 1 -- 172.21.15.161:0/2390025892 learned_addr learned my addr 172.21.15.161:0/2390025892 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2931046640 1 -- 172.21.15.161:0/2390025892 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd5524c0 con 0x55f8bd551ad0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2931046640 1 --2- 172.21.15.161:0/2390025892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f292c013010 tx=0x7f292c04cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb277a1b4ce86d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2807fff640 1 -- 172.21.15.161:0/2390025892 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c0167c0 con 0x55f8bd551ad0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2807fff640 1 -- 172.21.15.161:0/2390025892 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c04e0d0 con 0x55f8bd551ad0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2807fff640 1 -- 172.21.15.161:0/2390025892 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c016960 con 0x55f8bd551ad0 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 -- 172.21.15.161:0/2390025892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 msgr2=0x55f8bd551ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 --2- 172.21.15.161:0/2390025892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f292c013010 tx=0x7f292c04cc60 comp rx=0 tx=0).stop 2024-05-08T09:21:51.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 -- 172.21.15.161:0/2390025892 shutdown_connections 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 --2- 172.21.15.161:0/2390025892 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd551ef0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 -- 172.21.15.161:0/2390025892 >> 172.21.15.161:0/2390025892 conn(0x55f8bd54dd90 msgr2=0x55f8bd54be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 -- 172.21.15.161:0/2390025892 shutdown_connections 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.614+0000 7f2932d46800 1 -- 172.21.15.161:0/2390025892 wait complete. 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2932d46800 1 Processor -- start 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2932d46800 1 -- start start 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2932d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd5590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2932d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8bd552c40 con 0x55f8bd551ad0 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd5590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2931046640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd5590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53274/0 (socket says 172.21.15.161:53274) 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 learned_addr learned my addr 172.21.15.161:0/1911033745 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8bd559630 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.615+0000 7f2931046640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd5590f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f292c013010 tx=0x7f292c04c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f28067fc640 1 -- 172.21.15.161:0/1911033745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c016440 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f28067fc640 1 -- 172.21.15.161:0/1911033745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f292c022c90 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8bd5598c0 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f28067fc640 1 -- 172.21.15.161:0/1911033745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f292c04b200 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8bd55c570 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f28067fc640 1 -- 172.21.15.161:0/1911033745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f292c04b3a0 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.616+0000 7f28067fc640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f27fc036900 0x7f27fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f28067fc640 1 -- 172.21.15.161:0/1911033745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f292c00e040 con 0x55f8bd551ad0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f2930845640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f27fc036900 0x7f27fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd564ac0 0x55f8bd566f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5676d0 con 0x55f8bd564ac0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f292bfff640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd564ac0 0x55f8bd566f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f2930845640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f27fc036900 0x7f27fc038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f292408c0a0 tx=0x7f2924087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.617+0000 7f292bfff640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd564ac0 0x55f8bd566f80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291c009050 con 0x55f8bd564ac0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 realm 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd563f10 con 0x55f8bd564ac0 2024-05-08T09:21:51.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291c009050 con 0x55f8bd564ac0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5681b0 con 0x55f8bd564ac0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291c009050 con 0x55f8bd564ac0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd568a80 con 0x55f8bd564ac0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f291c009050 con 0x55f8bd564ac0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd569380 0x55f8bd56b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd56bed0 con 0x55f8bd569380 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.618+0000 7f2931046640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd569380 0x55f8bd56b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.619+0000 7f2931046640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd569380 0x55f8bd56b770 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2932d46800 20 searching for the correct realm 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8bd56df80 0x55f8bd570440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.620+0000 7f2930845640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8bd56df80 0x55f8bd570440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f2930845640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8bd56df80 0x55f8bd570440 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f2930845640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f292409b040 0x7f2924066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f292bfff640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f292409b040 0x7f2924066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.621+0000 7f292bfff640 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f292409b040 0x7f2924066380 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.622+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c009050 con 0x7f292409b040 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.622+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c009050 con 0x55f8bd564ac0 2024-05-08T09:21:51.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.623+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.624+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.624+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.625+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.626+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.627+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.628+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.629+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.630+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.630+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.630+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.630+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd56df80 2024-05-08T09:21:51.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd569380 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.631+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x55f8bd564ac0 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570b10 con 0x7f292409b040 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd56c980 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd56ce00 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.632+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd56d2e0 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 zone default found 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 4 Realm: () 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 zonegroup default 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd570f90 con 0x55f8bd569380 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5731c0 con 0x55f8bd56df80 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.633+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd573560 con 0x55f8bd56df80 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.634+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.634+0000 7f2932d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.634+0000 7f2932d46800 20 started sync module instance, tier type = 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.634+0000 7f2932d46800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.634+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd572600 con 0x7f292409b040 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.635+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.635+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526816856560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd572600 con 0x7f292409b040 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.635+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd573db0 con 0x55f8bd564ac0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.636+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526816856560] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.636+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.636+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526816860896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd572600 con 0x55f8bd564ac0 2024-05-08T09:21:51.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.636+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd574820 con 0x55f8bd56df80 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.637+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526816860896] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.637+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.637+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526816854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd572570 con 0x55f8bd56df80 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.637+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5756e0 con 0x7f292409b040 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.638+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.638+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526816867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd575ea0 con 0x7f292409b040 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.638+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5769c0 con 0x55f8bd564ac0 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.638+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526816854352] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.639+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526816867344] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.639+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.639+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526816871568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd576980 con 0x55f8bd564ac0 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.639+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd577260 con 0x55f8bd569380 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.640+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526816871568] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.640+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.640+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526816873904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd576980 con 0x55f8bd569380 2024-05-08T09:21:51.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.640+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd577c20 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.642+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.642+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526816873904] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.642+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526816876400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd578080 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.642+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd574c50 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526816876400] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526816865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd578670 con 0x55f8bd569380 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=0 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=1 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=2 2024-05-08T09:21:51.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=3 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=4 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=5 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.643+0000 7f2932d46800 20 add_watcher() i=6 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526816865360] v27'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f2932d46800 20 add_watcher() i=7 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f2932d46800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd57ba70 con 0x55f8bd564ac0 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.644+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526816877456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd578f90 con 0x55f8bd564ac0 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526816877456] v27'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f291c029040 con 0x55f8bd564ac0 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f27e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f2932d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f2932d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f2932d46800 5 note: GC not initialized 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.645+0000 7f27e5fe3640 20 reqs_thread_entry: start 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 20 Filter name: none 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f27577fe640 20 reqs_thread_entry: start 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5af010 con 0x7f292409b040 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.646+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5af8a0 con 0x7f292409b040 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5ae3f0 con 0x7f292409b040 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5b0ed0 con 0x7f292409b040 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(65 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f291c029040 con 0x7f292409b040 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 4.7 4:e36019c5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5b28d0 con 0x55f8bd569380 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 4.17 4:eba780b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5b5490 con 0x55f8bd569380 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 4.d 4:b0be4d53:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5b5490 con 0x55f8bd56df80 2024-05-08T09:21:51.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 4.32 4:4ceb3478:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5ba4e0 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 4.2f 4:f5a2285c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5bd280 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 4.1f 4:f85c6e14:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5c0040 con 0x55f8bd56df80 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5c2990 con 0x55f8bd569380 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.647+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 4.20 4:077f40c6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5c5200 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 4.13 4:ca8f0f6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5c7fe0 con 0x7f292409b040 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 4.c 4:339bb1ce:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5caea0 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 4.24 4:27768d85:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5cdd60 con 0x55f8bd569380 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(71 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(69 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(67 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(66 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(76 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f291c048060 con 0x7f292409b040 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.648+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(73 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.649+0000 7f27e6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.649+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526816877456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5caea0 con 0x55f8bd564ac0 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.650+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94526816877456] v27'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.650+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526816856560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x7f292409b040 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.651+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94526816856560] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c048060 con 0x7f292409b040 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.651+0000 7f2932d46800 20 remove_watcher() i=0 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.651+0000 7f2932d46800 2 removed watcher, disabling cache 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.651+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526816860896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd564ac0 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.652+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94526816860896] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.652+0000 7f2932d46800 20 remove_watcher() i=1 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.652+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526816854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd56df80 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.653+0000 7f2930845640 1 -- 172.21.15.161:0/1911033745 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94526816854352] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2924087070 con 0x55f8bd56df80 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.653+0000 7f2932d46800 20 remove_watcher() i=2 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.653+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526816867344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x7f292409b040 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.654+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94526816867344] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c048060 con 0x7f292409b040 2024-05-08T09:21:51.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.654+0000 7f2932d46800 20 remove_watcher() i=3 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.654+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526816871568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd564ac0 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.655+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94526816871568] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f291c048060 con 0x55f8bd564ac0 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.655+0000 7f2932d46800 20 remove_watcher() i=4 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.655+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526816873904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.657+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94526816873904] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.657+0000 7f2932d46800 20 remove_watcher() i=5 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.657+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526816876400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.658+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94526816876400] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.658+0000 7f2932d46800 20 remove_watcher() i=6 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.658+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526816865360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8bd5975b0 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2931046640 1 -- 172.21.15.161:0/1911033745 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94526816865360] v27'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f292c02a070 con 0x55f8bd569380 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 20 remove_watcher() i=7 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd569380 msgr2=0x55f8bd56b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd569380 0x55f8bd56b770 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd564ac0 msgr2=0x55f8bd566f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd564ac0 0x55f8bd566f80 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f292409b040 msgr2=0x7f2924066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f292409b040 0x7f2924066380 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8bd56df80 msgr2=0x55f8bd570440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8bd56df80 0x55f8bd570440 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f27fc036900 msgr2=0x7f27fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f27fc036900 0x7f27fc038dc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f292408c0a0 tx=0x7f2924087000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 msgr2=0x55f8bd5590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 --2- 172.21.15.161:0/1911033745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd551ad0 0x55f8bd5590f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f292c013010 tx=0x7f292c04c940 comp rx=0 tx=0).stop 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 reap_dead start 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f292bfff640 1 -- 172.21.15.161:0/1911033745 reap_dead start 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 shutdown_connections 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 >> 172.21.15.161:0/1911033745 conn(0x55f8bd54dd90 msgr2=0x55f8bd54b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 shutdown_connections 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.659+0000 7f2932d46800 1 -- 172.21.15.161:0/1911033745 wait complete. 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 msgr2=0x7f2808038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 0x7f2808038e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55f8bd530d20 tx=0x7f292408bd10 comp rx=0 tx=0).stop 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 msgr2=0x55f8bd544c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55f8bd530c60 tx=0x7f292c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 shutdown_connections 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2808036950 0x7f2808038e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/1779935622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd544820 0x55f8bd544c40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 >> 172.21.15.161:0/1779935622 conn(0x55f8bd5388c0 msgr2=0x55f8bd538cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 shutdown_connections 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/1779935622 wait complete. 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 msgr2=0x55f8bd534fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 0x55f8bd534fd0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 msgr2=0x55f8bd5302b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 0x55f8bd5302b0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 msgr2=0x7f2818038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f291c000f60 tx=0x7f291c0010a0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 msgr2=0x55f8bd529110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f292404ad30 tx=0x7f2924002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 shutdown_connections 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8bd532be0 0x55f8bd534fd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8bd42d2b0 0x55f8bd5302b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 --2- 172.21.15.161:0/415053730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8bd42c950 0x55f8bd529110 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 >> 172.21.15.161:0/415053730 conn(0x55f8bd4285b0 msgr2=0x55f8bd51b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 shutdown_connections 2024-05-08T09:21:51.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.660+0000 7f2932d46800 1 -- 172.21.15.161:0/415053730 wait complete. 2024-05-08T09:21:51.672 INFO:teuthology.orchestra.run.smithi161.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"05c85a99-f6a8-405d-b310-d83661265ff5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T09:21:50.822820Z","creation_time":"2024-05-08T09:21:50.820361Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T09:21:51.673 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:21:50.822820Z', 'creation_time': '2024-05-08T09:21:50.820361Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:21:51.673 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T09:21:51.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-05-08T09:21:51.673 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-05-08T09:21:51.759 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.759 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.760+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.760+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.760+0000 7f4d98121800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55aa822e3fe0 0x55aa822e4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.760+0000 7f4d98121800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55aa822e4a80 con 0x55aa822e5240 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.760+0000 7f4d98121800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55aa82176050 con 0x55aa822e3fe0 2024-05-08T09:21:51.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.761+0000 7f4d93e59640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55aa822e3fe0 0x55aa822e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.761+0000 7f4d93658640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55aa822e5240 0x55aa822e56c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42974/0 (socket says 172.21.15.161:42974) 2024-05-08T09:21:51.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.761+0000 7f4d93658640 1 -- 172.21.15.161:0/2344476887 learned_addr learned my addr 172.21.15.161:0/2344476887 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:51.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.761+0000 7f4d93e59640 1 -- 172.21.15.161:0/2344476887 >> v1:172.21.15.45:6789/0 conn(0x55aa822e5240 legacy=0x55aa822e56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.761+0000 7f4d93e59640 1 -- 172.21.15.161:0/2344476887 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa822e5e00 con 0x55aa822e3fe0 2024-05-08T09:21:51.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.763+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2344476887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa822e4400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d84005fd0 tx=0x7f4d8401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd459a41f428d48 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.763+0000 7f4d92e57640 1 -- 172.21.15.161:0/2344476887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d84052560 con 0x55aa822e3fe0 2024-05-08T09:21:51.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.763+0000 7f4d92e57640 1 -- 172.21.15.161:0/2344476887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84052700 con 0x55aa822e3fe0 2024-05-08T09:21:51.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.763+0000 7f4d92e57640 1 -- 172.21.15.161:0/2344476887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d84052a60 con 0x55aa822e3fe0 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 -- 172.21.15.161:0/2344476887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 msgr2=0x55aa822e4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 --2- 172.21.15.161:0/2344476887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa822e4400 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d84005fd0 tx=0x7f4d8401ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 -- 172.21.15.161:0/2344476887 shutdown_connections 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 --2- 172.21.15.161:0/2344476887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa822e4400 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 -- 172.21.15.161:0/2344476887 >> 172.21.15.161:0/2344476887 conn(0x55aa822df5c0 msgr2=0x55aa822e19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 -- 172.21.15.161:0/2344476887 shutdown_connections 2024-05-08T09:21:51.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.764+0000 7f4d98121800 1 -- 172.21.15.161:0/2344476887 wait complete. 2024-05-08T09:21:51.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.777+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.777+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d98121800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d98121800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa822301c0 con 0x55aa822e3fe0 2024-05-08T09:21:51.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d93e59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d93e59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53284/0 (socket says 172.21.15.161:53284) 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d93e59640 1 -- 172.21.15.161:0/2199861389 learned_addr learned my addr 172.21.15.161:0/2199861389 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d93e59640 1 -- 172.21.15.161:0/2199861389 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa823d5ca0 con 0x55aa822e3fe0 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.778+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2199861389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007000 tx=0x7f4d8404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca9b655a15d15ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4c81e0b640 1 -- 172.21.15.161:0/2199861389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d840529e0 con 0x55aa822e3fe0 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4c81e0b640 1 -- 172.21.15.161:0/2199861389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84052b80 con 0x55aa822e3fe0 2024-05-08T09:21:51.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4c81e0b640 1 -- 172.21.15.161:0/2199861389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8405c430 con 0x55aa822e3fe0 2024-05-08T09:21:51.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 -- 172.21.15.161:0/2199861389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 msgr2=0x55aa823d56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 --2- 172.21.15.161:0/2199861389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4d84007000 tx=0x7f4d8404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 -- 172.21.15.161:0/2199861389 shutdown_connections 2024-05-08T09:21:51.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 --2- 172.21.15.161:0/2199861389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823d56d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 -- 172.21.15.161:0/2199861389 >> 172.21.15.161:0/2199861389 conn(0x55aa822df5c0 msgr2=0x55aa823d0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 -- 172.21.15.161:0/2199861389 shutdown_connections 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.779+0000 7f4d98121800 1 -- 172.21.15.161:0/2199861389 wait complete. 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d98121800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d98121800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa822ed710 con 0x55aa822e3fe0 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d93e59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d93e59640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53300/0 (socket says 172.21.15.161:53300) 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.780+0000 7f4d93e59640 1 -- 172.21.15.161:0/2905421602 learned_addr learned my addr 172.21.15.161:0/2905421602 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4d93e59640 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa823dd700 con 0x55aa822e3fe0 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4d840526d0 tx=0x7f4d84003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4c7bfff640 1 -- 172.21.15.161:0/2905421602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d84075070 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4c7bfff640 1 -- 172.21.15.161:0/2905421602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84070410 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa823dd990 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4c7bfff640 1 -- 172.21.15.161:0/2905421602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d840529e0 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.781+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa823e0640 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4c7bfff640 1 -- 172.21.15.161:0/2905421602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4d84078070 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4c7bfff640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 0x7f4c7c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4c7bfff640 1 -- 172.21.15.161:0/2905421602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4d8406d070 con 0x55aa822e3fe0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4d93658640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 0x7f4c7c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 0x55aa823e4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa823e49d0 con 0x55aa822e5240 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.782+0000 7f4d9465a640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 0x55aa823e4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d93658640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 0x7f4c7c038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d880012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d9465a640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 0x55aa823e4400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d9465a640 1 -- 172.21.15.161:0/2905421602 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa823e19b0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d9465a640 1 -- 172.21.15.161:0/2905421602 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 0x55aa823e9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa823e9810 con 0x55aa823e6d30 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.783+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 0x55aa823e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 0x55aa823e9120 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d93e59640 1 -- 172.21.15.161:0/2905421602 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d84077030 con 0x55aa823e6d30 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa823e5ce0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d9465a640 1 -- 172.21.15.161:0/2905421602 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa823e6180 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.784+0000 7f4d9465a640 1 -- 172.21.15.161:0/2905421602 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa822e5240 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d98121800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d98121800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa821d6cf0 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53312/0 (socket says 172.21.15.161:53312) 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d9465a640 1 -- 172.21.15.161:0/2390460876 learned_addr learned my addr 172.21.15.161:0/2390460876 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.785+0000 7f4d9465a640 1 -- 172.21.15.161:0/2390460876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa82258110 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4d9465a640 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55aa823de090 tx=0x7f4d8c00aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4c797fa640 1 -- 172.21.15.161:0/2390460876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c007d00 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4c797fa640 1 -- 172.21.15.161:0/2390460876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c01e020 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4c797fa640 1 -- 172.21.15.161:0/2390460876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c019420 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa823fcf80 con 0x55aa823fa650 2024-05-08T09:21:51.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.786+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa823fd480 con 0x55aa823fa650 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4c797fa640 1 -- 172.21.15.161:0/2390460876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4d8c016040 con 0x55aa823fa650 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4c797fa640 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 0x7f4c6c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4c797fa640 1 -- 172.21.15.161:0/2390460876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4d8c01f030 con 0x55aa823fa650 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 0x7f4c6c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d93e59640 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 0x7f4c6c038dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55aa823e4ea0 tx=0x7f4d84066d70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d98121800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.787+0000 7f4d98121800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa823d5fc0 con 0x55aa823f9c40 2024-05-08T09:21:51.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53316/0 (socket says 172.21.15.161:53316) 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4d9465a640 1 -- 172.21.15.161:0/1822243285 learned_addr learned my addr 172.21.15.161:0/1822243285 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4d9465a640 1 -- 172.21.15.161:0/1822243285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa823f8440 con 0x55aa823f9c40 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4d9465a640 1 --2- 172.21.15.161:0/1822243285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c008a40 tx=0x7f4d8c015970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffd5e41067a3ce8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4c72ffd640 1 -- 172.21.15.161:0/1822243285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c01d070 con 0x55aa823f9c40 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4c72ffd640 1 -- 172.21.15.161:0/1822243285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c03de50 con 0x55aa823f9c40 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.788+0000 7f4c72ffd640 1 -- 172.21.15.161:0/1822243285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c04e240 con 0x55aa823f9c40 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- 172.21.15.161:0/1822243285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 msgr2=0x55aa823fa060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 --2- 172.21.15.161:0/1822243285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c008a40 tx=0x7f4d8c015970 comp rx=0 tx=0).stop 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- 172.21.15.161:0/1822243285 shutdown_connections 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 --2- 172.21.15.161:0/1822243285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa823fa060 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- 172.21.15.161:0/1822243285 >> 172.21.15.161:0/1822243285 conn(0x55aa82403170 msgr2=0x55aa824011d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- 172.21.15.161:0/1822243285 shutdown_connections 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- 172.21.15.161:0/1822243285 wait complete. 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 Processor -- start 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- start start 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa82410580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d98121800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55aa823f8910 con 0x55aa823f9c40 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa82410580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d9465a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa82410580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53324/0 (socket says 172.21.15.161:53324) 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.789+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 learned_addr learned my addr 172.21.15.161:0/361855756 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa82410ac0 con 0x55aa823f9c40 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4d9465a640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa82410580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c014830 tx=0x7f4d8c04c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4c717fa640 1 -- 172.21.15.161:0/361855756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c032070 con 0x55aa823f9c40 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4c717fa640 1 -- 172.21.15.161:0/361855756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d8c014480 con 0x55aa823f9c40 2024-05-08T09:21:51.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55aa82410d50 con 0x55aa823f9c40 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4c717fa640 1 -- 172.21.15.161:0/361855756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d8c03bbd0 con 0x55aa823f9c40 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.790+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa82413a00 con 0x55aa823f9c40 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4c717fa640 1 -- 172.21.15.161:0/361855756 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4d8c015ac0 con 0x55aa823f9c40 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4c717fa640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c5c036900 0x7f4c5c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4c717fa640 1 -- 172.21.15.161:0/361855756 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4d8c02dc90 con 0x55aa823f9c40 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4d93e59640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c5c036900 0x7f4c5c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa8241c010 0x55aa8241e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8241ec20 con 0x55aa8241c010 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.791+0000 7f4d93658640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa8241c010 0x55aa8241e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d93e59640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c5c036900 0x7f4c5c038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55aa823e9c10 tx=0x7f4d8408e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d93658640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa8241c010 0x55aa8241e4d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d88009050 con 0x55aa8241c010 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 realm 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8241b460 con 0x55aa8241c010 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d88009050 con 0x55aa8241c010 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8241f700 con 0x55aa8241c010 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d88009050 con 0x55aa8241c010 2024-05-08T09:21:51.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.792+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8241ffd0 con 0x55aa8241c010 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d88009050 con 0x55aa8241c010 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa82420880 0x55aa82422c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa824233b0 con 0x55aa82420880 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d9465a640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa82420880 0x55aa82422c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.793+0000 7f4d9465a640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa82420880 0x55aa82422c70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d98121800 20 searching for the correct realm 2024-05-08T09:21:51.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa82425460 0x55aa82427920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d93e59640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa82425460 0x55aa82427920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.794+0000 7f4d93e59640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa82425460 0x55aa82427920 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93e59640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4d8407a060 0x7f4d8408e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93658640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4d8407a060 0x7f4d8408e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93658640 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4d8407a060 0x7f4d8408e070 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88009050 con 0x7f4d8407a060 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.795+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88009050 con 0x55aa8241c010 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.796+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.797+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.798+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.799+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.800+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.801+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82425460 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa82420880 2024-05-08T09:21:51.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.802+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x55aa8241c010 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55aa82427ff0 con 0x7f4d8407a060 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82423e60 con 0x55aa8241c010 2024-05-08T09:21:51.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa824242e0 con 0x55aa8241c010 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.803+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa824247c0 con 0x55aa8241c010 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 zone default found 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 4 Realm: () 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 zonegroup default 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82428470 con 0x55aa82420880 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242a6a0 con 0x55aa82425460 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.804+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242aa40 con 0x55aa82425460 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.805+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.805+0000 7f4d98121800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.805+0000 7f4d98121800 20 started sync module instance, tier type = 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.805+0000 7f4d98121800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.805+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa82429ae0 con 0x7f4d8407a060 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.806+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.806+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94190818205696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa82429ae0 con 0x7f4d8407a060 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.806+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242b400 con 0x55aa8241c010 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.807+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94190818205696] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.807+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.807+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94190818203456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242b400 con 0x55aa8241c010 2024-05-08T09:21:51.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.807+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242bdc0 con 0x55aa82425460 2024-05-08T09:21:51.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.808+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.808+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94190818212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242c660 con 0x55aa82425460 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.808+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242d120 con 0x7f4d8407a060 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.808+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94190818203456] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.809+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.809+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94190818216944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242d510 con 0x7f4d8407a060 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.809+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242ded0 con 0x55aa8241c010 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.809+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94190818212112] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.811+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94190818216944] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.811+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.811+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94190818209616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242da20 con 0x55aa8241c010 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.811+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242e7a0 con 0x55aa82420880 2024-05-08T09:21:51.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.812+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94190818209616] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.812+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.812+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94190818214320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242da20 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.812+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242edc0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.814+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94190818214320] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.814+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.814+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94190818222832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242edc0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.814+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242f810 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94190818222832] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94190818226944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242fc80 con 0x55aa82420880 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=0 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=1 2024-05-08T09:21:51.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=2 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=3 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=4 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=5 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.816+0000 7f4d98121800 20 add_watcher() i=6 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94190818226944] v27'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d98121800 20 add_watcher() i=7 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d98121800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8242fc80 con 0x55aa8241c010 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.817+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94190818228176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa82430550 con 0x55aa8241c010 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94190818228176] v27'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4d98121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4d98121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4d98121800 5 note: GC not initialized 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4c48fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.818+0000 7f4d98121800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 20 Filter name: none 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4bc27fc640 20 reqs_thread_entry: start 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82465e30 con 0x55aa8241c010 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82467220 con 0x7f4d8407a060 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.819+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82467220 con 0x7f4d8407a060 2024-05-08T09:21:51.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 4.7 4:e36019c5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82468b80 con 0x55aa82420880 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 4.17 4:eba780b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8246b830 con 0x55aa82420880 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 4.d 4:b0be4d53:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8246b830 con 0x55aa82425460 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 4.32 4:4ceb3478:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82470970 con 0x55aa8241c010 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 4.2f 4:f5a2285c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82473630 con 0x55aa8241c010 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 4.1f 4:f85c6e14:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82476310 con 0x55aa82425460 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82478b80 con 0x55aa82420880 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 4.20 4:077f40c6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82476310 con 0x55aa8241c010 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 4.13 4:ca8f0f6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247b4b0 con 0x7f4d8407a060 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(68 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 4.c 4:339bb1ce:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247de10 con 0x55aa8241c010 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 4.24 4:27768d85:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa82480b80 con 0x55aa82420880 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(65 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(66 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(69 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.820+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(70 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.821+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(72 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.821+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(73 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.821+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.821+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(74 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.821+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247b4b0 con 0x7f4d8407a060 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.822+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(76 foo.buckets [call] v27'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.822+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247b4b0 con 0x7f4d8407a060 2024-05-08T09:21:51.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(77 foo.buckets [call] v27'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d98121800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247b4b0 con 0x55aa8241c010 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d98121800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55aa8247b4b0 con 0x7f4d8407a060 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.823+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.824+0000 7f4c49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.824+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94190818228176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa8241c010 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.825+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94190818228176] v27'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.825+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94190818205696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x7f4d8407a060 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.826+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94190818205696] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.826+0000 7f4d98121800 20 remove_watcher() i=0 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.826+0000 7f4d98121800 2 removed watcher, disabling cache 2024-05-08T09:21:51.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.826+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94190818203456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa8241c010 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.827+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94190818203456] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.827+0000 7f4d98121800 20 remove_watcher() i=1 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.827+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94190818212112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa82425460 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.828+0000 7f4d93e59640 1 -- 172.21.15.161:0/361855756 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94190818212112] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d84077030 con 0x55aa82425460 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.828+0000 7f4d98121800 20 remove_watcher() i=2 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.828+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94190818216944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x7f4d8407a060 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.829+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94190818216944] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x7f4d8407a060 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.829+0000 7f4d98121800 20 remove_watcher() i=3 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.829+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94190818209616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa8241c010 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.830+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94190818209616] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d88029040 con 0x55aa8241c010 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.830+0000 7f4d98121800 20 remove_watcher() i=4 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.830+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94190818214320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa82420880 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.831+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94190818214320] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.831+0000 7f4d98121800 20 remove_watcher() i=5 2024-05-08T09:21:51.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.831+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94190818222832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa82420880 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.832+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94190818222832] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.832+0000 7f4d98121800 20 remove_watcher() i=6 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.832+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94190818226944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55aa8244e900 con 0x55aa82420880 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d9465a640 1 -- 172.21.15.161:0/361855756 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94190818226944] v27'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d8c0083e0 con 0x55aa82420880 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 20 remove_watcher() i=7 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa82420880 msgr2=0x55aa82422c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa82420880 0x55aa82422c70 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa8241c010 msgr2=0x55aa8241e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa8241c010 0x55aa8241e4d0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4d8407a060 msgr2=0x7f4d8408e070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4d8407a060 0x7f4d8408e070 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa82425460 msgr2=0x55aa82427920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55aa82425460 0x55aa82427920 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c5c036900 msgr2=0x7f4c5c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c5c036900 0x7f4c5c038dc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55aa823e9c10 tx=0x7f4d8408e000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 msgr2=0x55aa82410580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 --2- 172.21.15.161:0/361855756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823f9c40 0x55aa82410580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c014830 tx=0x7f4d8c04c7e0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 reap_dead start 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d93658640 1 -- 172.21.15.161:0/361855756 reap_dead start 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 shutdown_connections 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 >> 172.21.15.161:0/361855756 conn(0x55aa82403170 msgr2=0x55aa824007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 shutdown_connections 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.833+0000 7f4d98121800 1 -- 172.21.15.161:0/361855756 wait complete. 2024-05-08T09:21:51.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 msgr2=0x7f4c6c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 0x7f4c6c038dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55aa823e4ea0 tx=0x7f4d84066d70 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 msgr2=0x55aa823fca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x55aa823de090 tx=0x7f4d8c00aea0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 shutdown_connections 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c6c036900 0x7f4c6c038dc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2390460876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa823fa650 0x55aa823fca40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 >> 172.21.15.161:0/2390460876 conn(0x55aa823eca50 msgr2=0x55aa823ece50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 shutdown_connections 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2390460876 wait complete. 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 msgr2=0x55aa823e9120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 0x55aa823e9120 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 msgr2=0x55aa823e4400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 0x55aa823e4400 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 msgr2=0x7f4c7c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 0x7f4c7c038dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4d88000f60 tx=0x7f4d880012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 msgr2=0x55aa823dd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4d840526d0 tx=0x7f4d84003330 comp rx=0 tx=0).stop 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 shutdown_connections 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55aa823e6d30 0x55aa823e9120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55aa822e5240 0x55aa823e4400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c7c036900 0x7f4c7c038dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 --2- 172.21.15.161:0/2905421602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55aa822e3fe0 0x55aa823dd1c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 >> 172.21.15.161:0/2905421602 conn(0x55aa822df5c0 msgr2=0x55aa823cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 shutdown_connections 2024-05-08T09:21:51.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.834+0000 7f4d98121800 1 -- 172.21.15.161:0/2905421602 wait complete. 2024-05-08T09:21:51.846 INFO:teuthology.orchestra.run.smithi161.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-05-08T09:21:51.823171Z","last_stats_update":"2024-05-08T09:21:51.822156Z"} 2024-05-08T09:21:51.846 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-05-08T09:21:51.823171Z', 'last_stats_update': '2024-05-08T09:21:51.822156Z'} 2024-05-08T09:21:51.851 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:51.852 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T09:21:51.852 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-05-08T09:21:51.852 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-05-08T09:21:51.897 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:51.897 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bc152e800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558be17e2be0 0x558be17e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bc152e800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558be17e9020 con 0x558be17e5510 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bc152e800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x558be1673050 con 0x558be17e2be0 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbd26e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558be17e2be0 0x558be17e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbca6d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x558be17e5510 0x558be17e7900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42978/0 (socket says 172.21.15.161:42978) 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbd26e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558be17e2be0 0x558be17e4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53338/0 (socket says 172.21.15.161:53338) 2024-05-08T09:21:51.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbca6d640 1 -- 172.21.15.161:0/2162215661 learned_addr learned my addr 172.21.15.161:0/2162215661 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:51.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbd26e640 1 -- 172.21.15.161:0/2162215661 >> v1:172.21.15.45:6789/0 conn(0x558be17e5510 legacy=0x558be17e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bb7fff640 1 -- 172.21.15.161:0/2162215661 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522339027 0 0) 0x558be17e9020 con 0x558be17e5510 2024-05-08T09:21:51.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.899+0000 7f0bbd26e640 1 -- 172.21.15.161:0/2162215661 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be17ea200 con 0x558be17e2be0 2024-05-08T09:21:51.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.901+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2162215661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be17e4fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005fd0 tx=0x7f0bb001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df984e479218eea8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bb7fff640 1 -- 172.21.15.161:0/2162215661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb0052560 con 0x558be17e2be0 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bb7fff640 1 -- 172.21.15.161:0/2162215661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0052700 con 0x558be17e2be0 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bb7fff640 1 -- 172.21.15.161:0/2162215661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb0052a20 con 0x558be17e2be0 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 -- 172.21.15.161:0/2162215661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 msgr2=0x558be17e4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2162215661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be17e4fd0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0005fd0 tx=0x7f0bb001ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 -- 172.21.15.161:0/2162215661 shutdown_connections 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2162215661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be17e4fd0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 -- 172.21.15.161:0/2162215661 >> 172.21.15.161:0/2162215661 conn(0x558be17dc5b0 msgr2=0x558be17de9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 -- 172.21.15.161:0/2162215661 shutdown_connections 2024-05-08T09:21:51.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.902+0000 7f0bc152e800 1 -- 172.21.15.161:0/2162215661 wait complete. 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.916+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bc152e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bc152e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558be172d1c0 con 0x558be17e2be0 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bbd26e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bbd26e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53352/0 (socket says 172.21.15.161:53352) 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bbd26e640 1 -- 172.21.15.161:0/3546397045 learned_addr learned my addr 172.21.15.161:0/3546397045 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bbd26e640 1 -- 172.21.15.161:0/3546397045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be18d3a70 con 0x558be17e2be0 2024-05-08T09:21:51.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/3546397045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0007000 tx=0x7f0bb004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546e0896b6351dda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.917+0000 7f0aab606640 1 -- 172.21.15.161:0/3546397045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb00529e0 con 0x558be17e2be0 2024-05-08T09:21:51.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0aab606640 1 -- 172.21.15.161:0/3546397045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0052b80 con 0x558be17e2be0 2024-05-08T09:21:51.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0aab606640 1 -- 172.21.15.161:0/3546397045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb005c430 con 0x558be17e2be0 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 -- 172.21.15.161:0/3546397045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 msgr2=0x558be18d34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 --2- 172.21.15.161:0/3546397045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0007000 tx=0x7f0bb004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 -- 172.21.15.161:0/3546397045 shutdown_connections 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 --2- 172.21.15.161:0/3546397045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18d34a0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 -- 172.21.15.161:0/3546397045 >> 172.21.15.161:0/3546397045 conn(0x558be17dc5b0 msgr2=0x558be18cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 -- 172.21.15.161:0/3546397045 shutdown_connections 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.918+0000 7f0bc152e800 1 -- 172.21.15.161:0/3546397045 wait complete. 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bc152e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bc152e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558be17e94f0 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bbd26e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bbd26e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53362/0 (socket says 172.21.15.161:53362) 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bbd26e640 1 -- 172.21.15.161:0/2621097080 learned_addr learned my addr 172.21.15.161:0/2621097080 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.919+0000 7f0bbd26e640 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be18db4a0 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00526d0 tx=0x7f0bb0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0aa9e03640 1 -- 172.21.15.161:0/2621097080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb0075070 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0aa9e03640 1 -- 172.21.15.161:0/2621097080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb0070410 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0aa9e03640 1 -- 172.21.15.161:0/2621097080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb00529e0 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558be18db730 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be18de3e0 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.920+0000 7f0aa9e03640 1 -- 172.21.15.161:0/2621097080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0bb0078070 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0aa9e03640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 0x7f0aa4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0aa9e03640 1 -- 172.21.15.161:0/2621097080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0bb006d070 con 0x558be17e2be0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 0x7f0aa4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 0x558be18e21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be18e2720 con 0x558be17e5510 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 0x558be18e21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 0x7f0aa4038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.921+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 0x558be18e21a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2621097080 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be17e5510 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be18df730 con 0x558be17e5510 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2621097080 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be17e5510 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 0x558be18e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be18e7520 con 0x558be18e4a60 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.922+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 0x558be18e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 0x558be18e6e50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bbd26e640 1 -- 172.21.15.161:0/2621097080 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0bb0077030 con 0x558be18e4a60 2024-05-08T09:21:51.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be18e3a10 con 0x558be17e5510 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2621097080 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be17e5510 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be18e3ed0 con 0x558be17e5510 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.923+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2621097080 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be17e5510 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bc152e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bc152e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558be16d3cf0 con 0x558be17e2780 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53368/0 (socket says 172.21.15.161:53368) 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2419462762 learned_addr learned my addr 172.21.15.161:0/2419462762 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.924+0000 7f0bbda6f640 1 -- 172.21.15.161:0/2419462762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be17e1130 con 0x558be17e2780 2024-05-08T09:21:51.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x558be18dc360 tx=0x7f0bb800aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0aa2ffd640 1 -- 172.21.15.161:0/2419462762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb8007d00 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0aa2ffd640 1 -- 172.21.15.161:0/2419462762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb801e020 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0aa2ffd640 1 -- 172.21.15.161:0/2419462762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb8019590 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558be17e13c0 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be17e18c0 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.925+0000 7f0aa2ffd640 1 -- 172.21.15.161:0/2419462762 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0bb8016040 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0aa2ffd640 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 0x7f0a98038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0aa2ffd640 1 -- 172.21.15.161:0/2419462762 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0bb801f030 con 0x558be17e2780 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 0x7f0a98038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 0x7f0a98038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558be18e2b90 tx=0x7f0bb008e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bc152e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bc152e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558be18d3d90 con 0x558be1905cd0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53374/0 (socket says 172.21.15.161:53374) 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.926+0000 7f0bbda6f640 1 -- 172.21.15.161:0/811451061 learned_addr learned my addr 172.21.15.161:0/811451061 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bbda6f640 1 -- 172.21.15.161:0/811451061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be19066c0 con 0x558be1905cd0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/811451061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0bb804c810 tx=0x7f0bb804ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173e36550dc98d10 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0aa0ff9640 1 -- 172.21.15.161:0/811451061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb804a070 con 0x558be1905cd0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0aa0ff9640 1 -- 172.21.15.161:0/811451061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb80184e0 con 0x558be1905cd0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0aa0ff9640 1 -- 172.21.15.161:0/811451061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb801d070 con 0x558be1905cd0 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 -- 172.21.15.161:0/811451061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 msgr2=0x558be19060f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 --2- 172.21.15.161:0/811451061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0bb804c810 tx=0x7f0bb804ca90 comp rx=0 tx=0).stop 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 -- 172.21.15.161:0/811451061 shutdown_connections 2024-05-08T09:21:51.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 --2- 172.21.15.161:0/811451061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be19060f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 -- 172.21.15.161:0/811451061 >> 172.21.15.161:0/811451061 conn(0x558be1901fa0 msgr2=0x558be1900000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 -- 172.21.15.161:0/811451061 shutdown_connections 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.927+0000 7f0bc152e800 1 -- 172.21.15.161:0/811451061 wait complete. 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bc152e800 1 Processor -- start 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bc152e800 1 -- start start 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bc152e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bc152e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558be1906e80 con 0x558be1905cd0 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bbda6f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53384/0 (socket says 172.21.15.161:53384) 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 learned_addr learned my addr 172.21.15.161:0/1319370903 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558be190d6f0 con 0x558be1905cd0 2024-05-08T09:21:51.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.928+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0bb804e420 tx=0x7f0bb804c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0a8effd640 1 -- 172.21.15.161:0/1319370903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb80153e0 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0a8effd640 1 -- 172.21.15.161:0/1319370903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb8031070 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558be190d980 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0a8effd640 1 -- 172.21.15.161:0/1319370903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0bb80156b0 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558be1910630 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.929+0000 7f0a8effd640 1 -- 172.21.15.161:0/1319370903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0bb8019730 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0a8effd640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a88036950 0x7f0a88038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0a8effd640 1 -- 172.21.15.161:0/1319370903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0bb8037cd0 con 0x558be1905cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a88036950 0x7f0a88038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a88036950 0x7f0a88038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bb008e010 tx=0x7f0bb0089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be1918cd0 0x558be191b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be191b8e0 con 0x558be1918cd0 2024-05-08T09:21:51.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.930+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be1918cd0 0x558be191b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be1918cd0 0x558be191b190 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ba800f5f0 con 0x558be1918cd0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 realm 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1918120 con 0x558be1918cd0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ba800f5f0 con 0x558be1918cd0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be191c3d0 con 0x558be1918cd0 2024-05-08T09:21:51.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ba800f5f0 con 0x558be1918cd0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.931+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be191cca0 con 0x558be1918cd0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0ba800f5f0 con 0x558be1918cd0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be191d6c0 0x558be191fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be191d6c0 0x558be191fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bbda6f640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be191d6c0 0x558be191fab0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:51.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 20 searching for the correct realm 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558be19221d0 0x558be1924690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.932+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1924d60 con 0x558be19221d0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558be19221d0 0x558be1924690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558be19221d0 0x558be1924690 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbd26e640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0bb009b040 0x7f0bb008c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1924d60 con 0x7f0bb009b040 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.933+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0bb009b040 0x7f0bb008c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbca6d640 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0bb009b040 0x7f0bb008c460 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba800f5f0 con 0x7f0bb009b040 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1924d60 con 0x558be191d6c0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba800f5f0 con 0x558be1918cd0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.934+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x7f0bb009b040 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x7f0bb009b040 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.935+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.936+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x7f0bb009b040 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0ba802b040 con 0x7f0bb009b040 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.937+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.938+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x7f0bb009b040 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x7f0bb009b040 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.939+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.940+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x7f0bb009b040 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x7f0bb009b040 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be19221d0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be191d6c0 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x558be1918cd0 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.941+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558be1920220 con 0x7f0bb009b040 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0ba802b040 con 0x7f0bb009b040 2024-05-08T09:21:51.964 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1920ae0 con 0x558be1918cd0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0ba802b040 con 0x558be1918cd0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1920ed0 con 0x558be1918cd0 2024-05-08T09:21:51.965 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be19212f0 con 0x558be1918cd0 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 zone default found 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 4 Realm: () 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 zonegroup default 2024-05-08T09:21:51.966 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.942+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be19251e0 con 0x558be191d6c0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1926f90 con 0x558be19221d0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1927420 con 0x558be19221d0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 started sync module instance, tier type = 2024-05-08T09:21:51.967 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.943+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1926400 con 0x7f0bb009b040 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.944+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.945+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94059273283872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1926400 con 0x7f0bb009b040 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.945+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1927f20 con 0x558be1918cd0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.945+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94059273283872] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.946+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.946+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94059273288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1926400 con 0x558be1918cd0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.946+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be19289b0 con 0x558be19221d0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.947+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94059273288192] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.947+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.947+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94059273281360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1926370 con 0x558be19221d0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.947+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1929870 con 0x7f0bb009b040 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.948+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94059273281360] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.968 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.948+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.948+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94059273294784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be19297e0 con 0x7f0bb009b040 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.948+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192a730 con 0x558be1918cd0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.949+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.949+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94059273298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192ab50 con 0x558be1918cd0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.949+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192b580 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.950+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94059273294784] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.950+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94059273298560] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.950+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.951+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94059273302160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192a6a0 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.951+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192be50 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.953+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94059273302160] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.954+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.954+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94059273296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192a6a0 con 0x558be191d6c0 2024-05-08T09:21:51.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.954+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192c4d0 con 0x558be191d6c0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94059273306016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192c940 con 0x558be191d6c0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=1 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=2 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=3 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=4 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=5 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94059273296992] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=6 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94059273306016] v27'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 20 add_watcher() i=7 2024-05-08T09:21:51.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.955+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be192b950 con 0x558be1918cd0 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.956+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.956+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94059273307280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192b950 con 0x558be1918cd0 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94059273307280] v27'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0a737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0bc152e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0bc152e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0bc152e800 5 note: GC not initialized 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0a727e4640 20 reqs_thread_entry: start 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.957+0000 7f0bc152e800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 Filter name: none 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f09e3fff640 20 reqs_thread_entry: start 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:51.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1962e20 con 0x558be1918cd0 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1962970 con 0x7f0bb009b040 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:51.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.958+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be19667b0 con 0x7f0bb009b040 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:51.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.959+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1969f30 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 foo.buckets [call] v27'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be1969070 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.960+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1969a90 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bc152e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T09:21:51.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bc152e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bc152e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94059273557280 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558be196b3e0 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== watch-notify(notify (1) cookie 94059273296992 notify 115964116999 ret 0) ==== 380+0+0 (crc 0 0 0) 0x558be190d980 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0aa0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 94059273296992 notifier 4473 bl.length()=338 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0aa0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(68 notify.6 [notify cookie 94059273557280 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0aa0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.962+0000 7f0aa0ff9640 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f0a80003ea0 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.963+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.963+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== watch-notify(notify_complete (2) cookie 94059273557280 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558be190d6f0 con 0x558be191d6c0 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.963+0000 7f0a737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:51.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.964+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94059273307280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be19699d0 con 0x558be1918cd0 2024-05-08T09:21:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94059273307280] v27'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94059273283872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192c490 con 0x7f0bb009b040 2024-05-08T09:21:51.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94059273283872] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bc152e800 20 remove_watcher() i=0 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bc152e800 2 removed watcher, disabling cache 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.965+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94059273288192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192c490 con 0x558be1918cd0 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.967+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94059273288192] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.967+0000 7f0bc152e800 20 remove_watcher() i=1 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.967+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94059273281360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192c490 con 0x558be19221d0 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.968+0000 7f0bbd26e640 1 -- 172.21.15.161:0/1319370903 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94059273281360] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb0098070 con 0x558be19221d0 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.968+0000 7f0bc152e800 20 remove_watcher() i=2 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.968+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94059273294784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1925f50 con 0x7f0bb009b040 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94059273294784] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x7f0bb009b040 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bc152e800 20 remove_watcher() i=3 2024-05-08T09:21:51.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94059273298560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1925f50 con 0x558be1918cd0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94059273298560] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0ba803d040 con 0x558be1918cd0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bc152e800 20 remove_watcher() i=4 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.969+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94059273302160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192a280 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.971+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94059273302160] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.971+0000 7f0bc152e800 20 remove_watcher() i=5 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.971+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94059273296992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be1925f50 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.972+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94059273296992] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.972+0000 7f0bc152e800 20 remove_watcher() i=6 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.972+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94059273306016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558be192a280 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bbda6f640 1 -- 172.21.15.161:0/1319370903 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94059273306016] v27'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0bb80083e0 con 0x558be191d6c0 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 20 remove_watcher() i=7 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be191d6c0 msgr2=0x558be191fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be191d6c0 0x558be191fab0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be1918cd0 msgr2=0x558be191b190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be1918cd0 0x558be191b190 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0bb009b040 msgr2=0x7f0bb008c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0bb009b040 0x7f0bb008c460 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558be19221d0 msgr2=0x558be1924690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558be19221d0 0x558be1924690 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a88036950 msgr2=0x7f0a88038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a88036950 0x7f0a88038e10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0bb008e010 tx=0x7f0bb0089000 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 msgr2=0x558be190d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f0bb804e420 tx=0x7f0bb804c770 comp rx=0 tx=0).stop 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bbca6d640 1 -- 172.21.15.161:0/1319370903 reap_dead start 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 shutdown_connections 2024-05-08T09:21:51.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/1319370903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be1905cd0 0x558be190d1b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 >> 172.21.15.161:0/1319370903 conn(0x558be1901fa0 msgr2=0x558be18ff600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 shutdown_connections 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/1319370903 wait complete. 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 msgr2=0x7f0a98038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 0x7f0a98038dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558be18e2b90 tx=0x7f0bb008e040 comp rx=0 tx=0).stop 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 msgr2=0x558be17e0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x558be18dc360 tx=0x7f0bb800aea0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 shutdown_connections 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0a98036900 0x7f0a98038dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2419462762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2780 0x558be17e0bf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 >> 172.21.15.161:0/2419462762 conn(0x558be18ea770 msgr2=0x558be18eab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 shutdown_connections 2024-05-08T09:21:51.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.973+0000 7f0bc152e800 1 -- 172.21.15.161:0/2419462762 wait complete. 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 msgr2=0x558be18e6e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 0x558be18e6e50 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 msgr2=0x558be18e21a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 0x558be18e21a0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 msgr2=0x7f0aa4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 0x7f0aa4038e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8000c00 tx=0x7f0ba80013b0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 msgr2=0x558be18daf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00526d0 tx=0x7f0bb0003330 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 shutdown_connections 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558be18e4a60 0x558be18e6e50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558be17e5510 0x558be18e21a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0aa4036950 0x7f0aa4038e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 --2- 172.21.15.161:0/2621097080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558be17e2be0 0x558be18daf60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:51.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 >> 172.21.15.161:0/2621097080 conn(0x558be17dc5b0 msgr2=0x558be18cd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:51.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 shutdown_connections 2024-05-08T09:21:51.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:51.974+0000 7f0bc152e800 1 -- 172.21.15.161:0/2621097080 wait complete. 2024-05-08T09:21:51.987 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T09:21:51.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T09:21:51.987 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T09:21:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.039 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb09812800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55bdeee39010 0x55bdeee39430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb09812800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55bdeee39ab0 con 0x55bdeee3a270 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb09812800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55bdeeccb050 con 0x55bdeee39010 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb04dee640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55bdeee39010 0x55bdeee39430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb045ed640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55bdeee3a270 0x55bdeee3a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:42990/0 (socket says 172.21.15.161:42990) 2024-05-08T09:21:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.041+0000 7fbb045ed640 1 -- 172.21.15.161:0/2913861819 learned_addr learned my addr 172.21.15.161:0/2913861819 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.042+0000 7fbb04dee640 1 -- 172.21.15.161:0/2913861819 >> v1:172.21.15.45:6789/0 conn(0x55bdeee3a270 legacy=0x55bdeee3a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.042+0000 7fbb04dee640 1 -- 172.21.15.161:0/2913861819 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeee3ae30 con 0x55bdeee39010 2024-05-08T09:21:52.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.042+0000 7fbb03dec640 1 -- 172.21.15.161:0/2913861819 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3083137086 0 0) 0x55bdeee39ab0 con 0x55bdeee3a270 2024-05-08T09:21:52.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb04dee640 1 --2- 172.21.15.161:0/2913861819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeee39430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400a470 tx=0x7fbaf401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7e4dfb886b9349 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb03dec640 1 -- 172.21.15.161:0/2913861819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf4057070 con 0x55bdeee39010 2024-05-08T09:21:52.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb03dec640 1 -- 172.21.15.161:0/2913861819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf404adc0 con 0x55bdeee39010 2024-05-08T09:21:52.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb03dec640 1 -- 172.21.15.161:0/2913861819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf4052590 con 0x55bdeee39010 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 -- 172.21.15.161:0/2913861819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 msgr2=0x55bdeee39430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 --2- 172.21.15.161:0/2913861819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeee39430 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbaf400a470 tx=0x7fbaf401ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 -- 172.21.15.161:0/2913861819 shutdown_connections 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 --2- 172.21.15.161:0/2913861819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeee39430 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 -- 172.21.15.161:0/2913861819 >> 172.21.15.161:0/2913861819 conn(0x55bdeee345f0 msgr2=0x55bdeee36a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 -- 172.21.15.161:0/2913861819 shutdown_connections 2024-05-08T09:21:52.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.044+0000 7fbb09812800 1 -- 172.21.15.161:0/2913861819 wait complete. 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.058+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.058+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb09812800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb09812800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bdeed851f0 con 0x55bdeee39010 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb04dee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb04dee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53404/0 (socket says 172.21.15.161:53404) 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb04dee640 1 -- 172.21.15.161:0/3541176156 learned_addr learned my addr 172.21.15.161:0/3541176156 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb04dee640 1 -- 172.21.15.161:0/3541176156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeef2bd10 con 0x55bdeee39010 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fbb04dee640 1 --2- 172.21.15.161:0/3541176156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4055040 tx=0x7fbaf404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ff9477f8dc1605 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.059+0000 7fb9f2e0d640 1 -- 172.21.15.161:0/3541176156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf4057040 con 0x55bdeee39010 2024-05-08T09:21:52.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fb9f2e0d640 1 -- 172.21.15.161:0/3541176156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf4063070 con 0x55bdeee39010 2024-05-08T09:21:52.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fb9f2e0d640 1 -- 172.21.15.161:0/3541176156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf405d790 con 0x55bdeee39010 2024-05-08T09:21:52.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 -- 172.21.15.161:0/3541176156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 msgr2=0x55bdeef2b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 --2- 172.21.15.161:0/3541176156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4055040 tx=0x7fbaf404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 -- 172.21.15.161:0/3541176156 shutdown_connections 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 --2- 172.21.15.161:0/3541176156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee39010 0x55bdeef2b740 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 -- 172.21.15.161:0/3541176156 >> 172.21.15.161:0/3541176156 conn(0x55bdeee345f0 msgr2=0x55bdeef29af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 -- 172.21.15.161:0/3541176156 shutdown_connections 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.060+0000 7fbb09812800 1 -- 172.21.15.161:0/3541176156 wait complete. 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb09812800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb09812800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bdeee42740 con 0x55bdeee3a270 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb04dee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb04dee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53408/0 (socket says 172.21.15.161:53408) 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb04dee640 1 -- 172.21.15.161:0/604147202 learned_addr learned my addr 172.21.15.161:0/604147202 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.061+0000 7fbb04dee640 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeef25b10 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fbb04dee640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4060040 tx=0x7fbaf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fb9f160a640 1 -- 172.21.15.161:0/604147202 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf4057050 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fb9f160a640 1 -- 172.21.15.161:0/604147202 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaf405dc80 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fb9f160a640 1 -- 172.21.15.161:0/604147202 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbaf4052440 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdeef25da0 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.062+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdeef26320 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fb9f160a640 1 -- 172.21.15.161:0/604147202 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbaf40525e0 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fb9f160a640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 0x7fb9ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fb9f160a640 1 -- 172.21.15.161:0/604147202 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbaf408db40 con 0x55bdeee3a270 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb045ed640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 0x7fb9ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 0x55bdeef3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef3d250 con 0x55bdeef3a920 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb055ef640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 0x55bdeef3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb045ed640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 0x7fb9ec038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8000c00 tx=0x7fbaf80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.063+0000 7fbb055ef640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 0x55bdeef3cd10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb055ef640 1 -- 172.21.15.161:0/604147202 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbafc00a4a0 con 0x55bdeef3a920 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef3daa0 con 0x55bdeef3a920 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb055ef640 1 -- 172.21.15.161:0/604147202 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbafc00a4a0 con 0x55bdeef3a920 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 0x55bdeef41860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef41ff0 con 0x55bdeef3f3f0 2024-05-08T09:21:52.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.064+0000 7fbb04dee640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 0x55bdeef41860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.065+0000 7fbb04dee640 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 0x55bdeef41860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.065+0000 7fbb04dee640 1 -- 172.21.15.161:0/604147202 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef3f3f0 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.065+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef3e320 con 0x55bdeef3a920 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.065+0000 7fbb055ef640 1 -- 172.21.15.161:0/604147202 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbafc00a4a0 con 0x55bdeef3a920 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.065+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef3e800 con 0x55bdeef3a920 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb055ef640 1 -- 172.21.15.161:0/604147202 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbafc00a4a0 con 0x55bdeef3a920 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb09812800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb09812800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bdeef27960 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53418/0 (socket says 172.21.15.161:53418) 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.066+0000 7fbb055ef640 1 -- 172.21.15.161:0/1903439294 learned_addr learned my addr 172.21.15.161:0/1903439294 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fbb055ef640 1 -- 172.21.15.161:0/1903439294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeef51b10 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fbb055ef640 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55bdeef26f80 tx=0x7fbafc012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fb9ea7fc640 1 -- 172.21.15.161:0/1903439294 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc014450 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdeef52580 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fb9ea7fc640 1 -- 172.21.15.161:0/1903439294 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc014610 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fb9ea7fc640 1 -- 172.21.15.161:0/1903439294 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc014930 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.067+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdeef52a80 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fb9ea7fc640 1 -- 172.21.15.161:0/1903439294 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbafc011040 con 0x55bdeef511b0 2024-05-08T09:21:52.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fb9ea7fc640 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 0x7fb9dc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fb9ea7fc640 1 -- 172.21.15.161:0/1903439294 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbafc01e070 con 0x55bdeef511b0 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 0x7fb9dc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 0x7fb9dc038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55bdeef26800 tx=0x7fbaf40799e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.069+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb09812800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb09812800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bdeed2bcf0 con 0x55bdeef5e540 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53426/0 (socket says 172.21.15.161:53426) 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb055ef640 1 -- 172.21.15.161:0/3195293854 learned_addr learned my addr 172.21.15.161:0/3195293854 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb055ef640 1 -- 172.21.15.161:0/3195293854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeef5ef30 con 0x55bdeef5e540 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fbb055ef640 1 --2- 172.21.15.161:0/3195293854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbafc04ca50 tx=0x7fbafc011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5023cbb37bcebaf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fb9dbfff640 1 -- 172.21.15.161:0/3195293854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc011c50 con 0x55bdeef5e540 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fb9dbfff640 1 -- 172.21.15.161:0/3195293854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc011df0 con 0x55bdeef5e540 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.070+0000 7fb9dbfff640 1 -- 172.21.15.161:0/3195293854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc04cb90 con 0x55bdeef5e540 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- 172.21.15.161:0/3195293854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 msgr2=0x55bdeef5e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 --2- 172.21.15.161:0/3195293854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbafc04ca50 tx=0x7fbafc011700 comp rx=0 tx=0).stop 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- 172.21.15.161:0/3195293854 shutdown_connections 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 --2- 172.21.15.161:0/3195293854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef5e960 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- 172.21.15.161:0/3195293854 >> 172.21.15.161:0/3195293854 conn(0x55bdeef5a810 msgr2=0x55bdeef58870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- 172.21.15.161:0/3195293854 shutdown_connections 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- 172.21.15.161:0/3195293854 wait complete. 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 Processor -- start 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- start start 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.071+0000 7fbb09812800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55bdeef5f500 con 0x55bdeef5e540 2024-05-08T09:21:52.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb055ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53438/0 (socket says 172.21.15.161:53438) 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 learned_addr learned my addr 172.21.15.161:0/1557783851 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bdeef65e50 con 0x55bdeef5e540 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb055ef640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbafc04b920 tx=0x7fbafc0033e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fb9da7fc640 1 -- 172.21.15.161:0/1557783851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc031070 con 0x55bdeef5e540 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fb9da7fc640 1 -- 172.21.15.161:0/1557783851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbafc022c90 con 0x55bdeef5e540 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fb9da7fc640 1 -- 172.21.15.161:0/1557783851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbafc011c50 con 0x55bdeef5e540 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55bdeef660e0 con 0x55bdeef5e540 2024-05-08T09:21:52.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.072+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bdeef68d90 con 0x55bdeef5e540 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.073+0000 7fb9da7fc640 1 -- 172.21.15.161:0/1557783851 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbafc034070 con 0x55bdeef5e540 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fb9da7fc640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9d0036900 0x7fb9d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fb9da7fc640 1 -- 172.21.15.161:0/1557783851 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fbafc00e040 con 0x55bdeef5e540 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9d0036900 0x7fb9d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9d0036900 0x7fb9d0038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40798d0 tx=0x7fbaf4087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef71630 0x55bdeef73af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef74240 con 0x55bdeef71630 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.074+0000 7fbb045ed640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef71630 0x55bdeef73af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb045ed640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef71630 0x55bdeef73af0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbaf800f5f0 con 0x55bdeef71630 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 realm 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef70a80 con 0x55bdeef71630 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbaf800f5f0 con 0x55bdeef71630 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef74d30 con 0x55bdeef71630 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbaf800f5f0 con 0x55bdeef71630 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef75600 con 0x55bdeef71630 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbaf800f5f0 con 0x55bdeef71630 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.075+0000 7fbb09812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef76020 0x55bdeef78410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef78b80 con 0x55bdeef76020 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb055ef640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef76020 0x55bdeef78410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb055ef640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef76020 0x55bdeef78410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 20 searching for the correct realm 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55bdeef7ab10 0x55bdeef7cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.076+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55bdeef7ab10 0x55bdeef7cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55bdeef7ab10 0x55bdeef7cfd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb04dee640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbaf409b040 0x7fbaf405e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.077+0000 7fbb045ed640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbaf409b040 0x7fbaf405e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.078+0000 7fbb045ed640 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbaf409b040 0x7fbaf405e790 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.078+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf800f5f0 con 0x7fbaf409b040 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.078+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.078+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.078+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf800f5f0 con 0x55bdeef71630 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.079+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x7fbaf409b040 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.080+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbaf802b040 con 0x7fbaf409b040 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.081+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.082+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.082+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.082+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.082+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.083+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x7fbaf409b040 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.084+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x7fbaf409b040 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef7ab10 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.085+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef76020 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x55bdeef71630 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7d6a0 con 0x7fbaf409b040 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbaf802b040 con 0x7fbaf409b040 2024-05-08T09:21:52.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef79540 con 0x55bdeef71630 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbaf802b040 con 0x55bdeef71630 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.086+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef79150 con 0x55bdeef71630 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef79e70 con 0x55bdeef71630 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 zone default found 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 4 Realm: () 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 zonegroup default 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7db20 con 0x55bdeef76020 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.087+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7fdd0 con 0x55bdeef7ab10 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef80170 con 0x55bdeef7ab10 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 20 started sync module instance, tier type = 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.088+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f260 con 0x7fbaf409b040 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.089+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.089+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94274246408080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f260 con 0x7fbaf409b040 2024-05-08T09:21:52.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.089+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef80bb0 con 0x55bdeef71630 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.090+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94274246408080] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.090+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.090+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94274246411904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f260 con 0x55bdeef71630 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.090+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef81630 con 0x55bdeef7ab10 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.091+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94274246411904] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.091+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.092+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94274246405552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f1d0 con 0x55bdeef7ab10 2024-05-08T09:21:52.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.092+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef82410 con 0x7fbaf409b040 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.092+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94274246405552] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.093+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.093+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94274246416976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef82800 con 0x7fbaf409b040 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.093+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef831c0 con 0x55bdeef71630 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.094+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.094+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94274246416976] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.094+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94274246421776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef83130 con 0x55bdeef71630 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.094+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef83c10 con 0x55bdeef76020 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.095+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94274246421776] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.095+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.095+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94274246418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef84030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.095+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef84a30 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.096+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.096+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94274246427968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef84eb0 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.096+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef859d0 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94274246418032] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94274246427968] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94274246429024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef83720 con 0x55bdeef76020 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=0 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=1 2024-05-08T09:21:52.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=2 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=3 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=4 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=5 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.097+0000 7fbb09812800 20 add_watcher() i=6 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.098+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94274246429024] v27'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.098+0000 7fbb09812800 20 add_watcher() i=7 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.098+0000 7fbb09812800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.098+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef889c0 con 0x55bdeef71630 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.099+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.099+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94274246431904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef85e40 con 0x55bdeef71630 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94274246431904] v27'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fb9bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 5 note: GC not initialized 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fb9b9fe3640 20 reqs_thread_entry: start 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 20 Filter name: none 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fb92b7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.100+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefbbe70 con 0x55bdeef76020 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T09:21:52.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefba610 con 0x55bdeef76020 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.101+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefbaee0 con 0x55bdeef76020 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v27'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb09812800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb09812800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb09812800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94274246650416 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefbf300 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== watch-notify(notify (1) cookie 94274246418032 notify 115964117000 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55bdeefba6f0 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fb9dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 94274246418032 notifier 4480 bl.length()=556 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fb9dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fb9dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(65 notify.5 [notify cookie 94274246650416 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.102+0000 7fb9dbfff640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb9c8003ea0 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.103+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.103+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== watch-notify(notify_complete (2) cookie 94274246650416 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bdeef660e0 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.103+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefbae90 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.104+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v27'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb09812800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:52.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb09812800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb09812800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94274246650336 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55bdeefbae00 con 0x55bdeef7ab10 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94274246405552 notify 115964116995 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fbaf40a2040 con 0x55bdeef7ab10 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fb9dbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116995 cookie 94274246405552 notifier 4480 bl.length()=177 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fb9dbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fb9dbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fb9dbfff640 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fb9c8003ea0 con 0x55bdeef7ab10 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 notify.2 [notify cookie 94274246650336 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.105+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94274246650336 notify 115964116995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55bdeef26320 con 0x55bdeef7ab10 2024-05-08T09:21:52.117 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T09:21:52.102341Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:52.102325Z","tags":[],"group_ids":[]} 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.106+0000 7fb9bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.106+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94274246431904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef6c6e0 con 0x55bdeef71630 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.107+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94274246431904] v27'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.107+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94274246408080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef854a0 con 0x7fbaf409b040 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.108+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94274246408080] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.108+0000 7fbb09812800 20 remove_watcher() i=0 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.108+0000 7fbb09812800 2 removed watcher, disabling cache 2024-05-08T09:21:52.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.108+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94274246411904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f790 con 0x55bdeef71630 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.109+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94274246411904] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.109+0000 7fbb09812800 20 remove_watcher() i=1 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.109+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94274246405552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7f790 con 0x55bdeef7ab10 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.110+0000 7fbb04dee640 1 -- 172.21.15.161:0/1557783851 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94274246405552] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf4078070 con 0x55bdeef7ab10 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.110+0000 7fbb09812800 20 remove_watcher() i=2 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.110+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94274246416976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7edb0 con 0x7fbaf409b040 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.111+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94274246416976] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x7fbaf409b040 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.111+0000 7fbb09812800 20 remove_watcher() i=3 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.111+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94274246421776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef81a50 con 0x55bdeef71630 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.112+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94274246421776] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbaf803d040 con 0x55bdeef71630 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.112+0000 7fbb09812800 20 remove_watcher() i=4 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.112+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94274246418032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7edb0 con 0x55bdeef76020 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.113+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94274246418032] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.113+0000 7fbb09812800 20 remove_watcher() i=5 2024-05-08T09:21:52.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.113+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94274246427968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef82d10 con 0x55bdeef76020 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.115+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94274246427968] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.115+0000 7fbb09812800 20 remove_watcher() i=6 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.115+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94274246429024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55bdeef7edb0 con 0x55bdeef76020 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb055ef640 1 -- 172.21.15.161:0/1557783851 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94274246429024] v27'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbafc033030 con 0x55bdeef76020 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 20 remove_watcher() i=7 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef76020 msgr2=0x55bdeef78410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef76020 0x55bdeef78410 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef71630 msgr2=0x55bdeef73af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef71630 0x55bdeef73af0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbaf409b040 msgr2=0x7fbaf405e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbaf409b040 0x7fbaf405e790 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55bdeef7ab10 msgr2=0x55bdeef7cfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55bdeef7ab10 0x55bdeef7cfd0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9d0036900 msgr2=0x7fb9d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9d0036900 0x7fb9d0038dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40798d0 tx=0x7fbaf4087000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 msgr2=0x55bdeef65910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb045ed640 1 -- 172.21.15.161:0/1557783851 reap_dead start 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbafc04b920 tx=0x7fbafc0033e0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 shutdown_connections 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 --2- 172.21.15.161:0/1557783851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef5e540 0x55bdeef65910 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 >> 172.21.15.161:0/1557783851 conn(0x55bdeef5a810 msgr2=0x55bdeef57e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 shutdown_connections 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.117+0000 7fbb09812800 1 -- 172.21.15.161:0/1557783851 wait complete. 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 msgr2=0x7fb9dc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 0x7fb9dc038e10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x55bdeef26800 tx=0x7fbaf40799e0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 msgr2=0x55bdeef515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x55bdeef26f80 tx=0x7fbafc012fd0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 shutdown_connections 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9dc036950 0x7fb9dc038e10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/1903439294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeef511b0 0x55bdeef515d0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 >> 172.21.15.161:0/1903439294 conn(0x55bdeef45250 msgr2=0x55bdeef45650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 shutdown_connections 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/1903439294 wait complete. 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 msgr2=0x55bdeef41860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 0x55bdeef41860 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 msgr2=0x55bdeef3cd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 0x55bdeef3cd10 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 msgr2=0x7fb9ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 0x7fb9ec038e10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8000c00 tx=0x7fbaf80013b0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 msgr2=0x55bdeef27420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4060040 tx=0x7fbaf4002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 shutdown_connections 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55bdeef3f3f0 0x55bdeef41860 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55bdeef3a920 0x55bdeef3cd10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb9ec036950 0x7fb9ec038e10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 --2- 172.21.15.161:0/604147202 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bdeee3a270 0x55bdeef27420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 >> 172.21.15.161:0/604147202 conn(0x55bdeee345f0 msgr2=0x55bdeef24ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 shutdown_connections 2024-05-08T09:21:52.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.118+0000 7fbb09812800 1 -- 172.21.15.161:0/604147202 wait complete. 2024-05-08T09:21:52.128 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T09:21:52.102341Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:52.102325Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:52.134 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T09:21:52.139 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:52.139 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-05-08T09:21:52.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-05-08T09:21:52.139 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-05-08T09:21:52.182 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.182 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f4960f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cdf360b580 0x55cdf360d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f4960f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cdf360df40 con 0x55cdf3607140 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f4960f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55cdf3498050 con 0x55cdf360b580 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f44413640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cdf360b580 0x55cdf360d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f44c14640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55cdf3607140 0x55cdf3607560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43006/0 (socket says 172.21.15.161:43006) 2024-05-08T09:21:52.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f44c14640 1 -- 172.21.15.161:0/1895425816 learned_addr learned my addr 172.21.15.161:0/1895425816 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f44413640 1 -- 172.21.15.161:0/1895425816 >> v1:172.21.15.45:6789/0 conn(0x55cdf3607140 legacy=0x55cdf3607560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.185+0000 7f7f44413640 1 -- 172.21.15.161:0/1895425816 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf360f170 con 0x55cdf360b580 2024-05-08T09:21:52.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.184+0000 7f7f43c12640 1 -- 172.21.15.161:0/1895425816 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511879357 0 0) 0x55cdf360df40 con 0x55cdf3607140 2024-05-08T09:21:52.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.186+0000 7f7f44413640 1 --2- 172.21.15.161:0/1895425816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf360b580 0x55cdf360d970 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800a470 tx=0x7f7f3801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb87119c33160ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f43c12640 1 -- 172.21.15.161:0/1895425816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f38057070 con 0x55cdf360b580 2024-05-08T09:21:52.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f43c12640 1 -- 172.21.15.161:0/1895425816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f38052570 con 0x55cdf360b580 2024-05-08T09:21:52.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f43c12640 1 -- 172.21.15.161:0/1895425816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f38052870 con 0x55cdf360b580 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 -- 172.21.15.161:0/1895425816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf360b580 msgr2=0x55cdf360d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 --2- 172.21.15.161:0/1895425816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf360b580 0x55cdf360d970 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f3800a470 tx=0x7f7f3801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 -- 172.21.15.161:0/1895425816 shutdown_connections 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 --2- 172.21.15.161:0/1895425816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf360b580 0x55cdf360d970 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 -- 172.21.15.161:0/1895425816 >> 172.21.15.161:0/1895425816 conn(0x55cdf3602780 msgr2=0x55cdf3604ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 -- 172.21.15.161:0/1895425816 shutdown_connections 2024-05-08T09:21:52.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.187+0000 7f7f4960f800 1 -- 172.21.15.161:0/1895425816 wait complete. 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f4960f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f4960f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cdf35521d0 con 0x55cdf3607140 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f44c14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f44c14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53458/0 (socket says 172.21.15.161:53458) 2024-05-08T09:21:52.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.201+0000 7f7f44c14640 1 -- 172.21.15.161:0/1898919125 learned_addr learned my addr 172.21.15.161:0/1898919125 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.202+0000 7f7f44c14640 1 -- 172.21.15.161:0/1898919125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf357adb0 con 0x55cdf3607140 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.202+0000 7f7f44c14640 1 --2- 172.21.15.161:0/1898919125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001660 tx=0x7f7f34001b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6272cc733643a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.202+0000 7f7e32e0d640 1 -- 172.21.15.161:0/1898919125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f34003450 con 0x55cdf3607140 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.202+0000 7f7e32e0d640 1 -- 172.21.15.161:0/1898919125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f34003610 con 0x55cdf3607140 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.202+0000 7f7e32e0d640 1 -- 172.21.15.161:0/1898919125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f340039b0 con 0x55cdf3607140 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- 172.21.15.161:0/1898919125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 msgr2=0x55cdf357c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 --2- 172.21.15.161:0/1898919125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f34001660 tx=0x7f7f34001b20 comp rx=0 tx=0).stop 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- 172.21.15.161:0/1898919125 shutdown_connections 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 --2- 172.21.15.161:0/1898919125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf357c7f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- 172.21.15.161:0/1898919125 >> 172.21.15.161:0/1898919125 conn(0x55cdf3602780 msgr2=0x55cdf36f3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- 172.21.15.161:0/1898919125 shutdown_connections 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- 172.21.15.161:0/1898919125 wait complete. 2024-05-08T09:21:52.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.203+0000 7f7f4960f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cdf360e410 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f44c14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f44c14640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53466/0 (socket says 172.21.15.161:53466) 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f44c14640 1 -- 172.21.15.161:0/3362987275 learned_addr learned my addr 172.21.15.161:0/3362987275 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f44c14640 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf3702770 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f44c14640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55cdf357be20 tx=0x7f7f34001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7e3160a640 1 -- 172.21.15.161:0/3362987275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f34025070 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7e3160a640 1 -- 172.21.15.161:0/3362987275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f34019040 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7e3160a640 1 -- 172.21.15.161:0/3362987275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f34013950 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdf3702a00 con 0x55cdf3607140 2024-05-08T09:21:52.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.204+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf37056b0 con 0x55cdf3607140 2024-05-08T09:21:52.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7e3160a640 1 -- 172.21.15.161:0/3362987275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7f34010070 con 0x55cdf3607140 2024-05-08T09:21:52.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7e3160a640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 0x7f7e2c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7e3160a640 1 -- 172.21.15.161:0/3362987275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7f3404be20 con 0x55cdf3607140 2024-05-08T09:21:52.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7f44413640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 0x7f7e2c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 0x55cdf3709470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.205+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3709a40 con 0x55cdf360b580 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f45415640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 0x55cdf3709470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f44413640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 0x7f7e2c038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f38054000 tx=0x7f7f3804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f45415640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 0x55cdf3709470 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f45415640 1 -- 172.21.15.161:0/3362987275 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f3c0083e0 con 0x55cdf360b580 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3706a00 con 0x55cdf360b580 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f45415640 1 -- 172.21.15.161:0/3362987275 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f3c0083e0 con 0x55cdf360b580 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 0x55cdf370e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.206+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf370e810 con 0x55cdf370bd50 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.207+0000 7f7f44c14640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 0x55cdf370e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.207+0000 7f7f44c14640 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 0x55cdf370e140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.207+0000 7f7f44c14640 1 -- 172.21.15.161:0/3362987275 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf370bd50 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.207+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf370ad00 con 0x55cdf360b580 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f45415640 1 -- 172.21.15.161:0/3362987275 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f3c0083e0 con 0x55cdf360b580 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf370b1b0 con 0x55cdf360b580 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f45415640 1 -- 172.21.15.161:0/3362987275 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7f3c0083e0 con 0x55cdf360b580 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f4960f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.208+0000 7f7f4960f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cdf34f8cf0 con 0x55cdf371d9c0 2024-05-08T09:21:52.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53478/0 (socket says 172.21.15.161:53478) 2024-05-08T09:21:52.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f45415640 1 -- 172.21.15.161:0/2999836971 learned_addr learned my addr 172.21.15.161:0/2999836971 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f45415640 1 -- 172.21.15.161:0/2999836971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf371e320 con 0x55cdf371d9c0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f45415640 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55cdf3709e20 tx=0x7f7f3c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7e2a7fc640 1 -- 172.21.15.161:0/2999836971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c007d30 con 0x55cdf371d9c0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.209+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdf371ed90 con 0x55cdf371d9c0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7e2a7fc640 1 -- 172.21.15.161:0/2999836971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c01e020 con 0x55cdf371d9c0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf371f290 con 0x55cdf371d9c0 2024-05-08T09:21:52.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7e2a7fc640 1 -- 172.21.15.161:0/2999836971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c019420 con 0x55cdf371d9c0 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7e2a7fc640 1 -- 172.21.15.161:0/2999836971 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7f3c016040 con 0x55cdf371d9c0 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7e2a7fc640 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 0x7f7e1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7e2a7fc640 1 -- 172.21.15.161:0/2999836971 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7f3c01f030 con 0x55cdf371d9c0 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.210+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 0x7f7e1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.211+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.211+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 0x7f7e1c038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55cdf3709e80 tx=0x7f7f34003450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.211+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.211+0000 7f7f4960f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.211+0000 7f7f4960f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cdf357b0d0 con 0x55cdf372aca0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.212+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.212+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53488/0 (socket says 172.21.15.161:53488) 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.212+0000 7f7f45415640 1 -- 172.21.15.161:0/3732780948 learned_addr learned my addr 172.21.15.161:0/3732780948 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.214+0000 7f7f45415640 1 -- 172.21.15.161:0/3732780948 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf372b690 con 0x55cdf372aca0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.214+0000 7f7f45415640 1 --2- 172.21.15.161:0/3732780948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c017640 tx=0x7f7f3c014340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c63ab071559f7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7e1bfff640 1 -- 172.21.15.161:0/3732780948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c04a070 con 0x55cdf372aca0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7e1bfff640 1 -- 172.21.15.161:0/3732780948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c04b270 con 0x55cdf372aca0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7e1bfff640 1 -- 172.21.15.161:0/3732780948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c01d070 con 0x55cdf372aca0 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- 172.21.15.161:0/3732780948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 msgr2=0x55cdf372b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3732780948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c017640 tx=0x7f7f3c014340 comp rx=0 tx=0).stop 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- 172.21.15.161:0/3732780948 shutdown_connections 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3732780948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf372b0c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- 172.21.15.161:0/3732780948 >> 172.21.15.161:0/3732780948 conn(0x55cdf3727000 msgr2=0x55cdf3725060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- 172.21.15.161:0/3732780948 shutdown_connections 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- 172.21.15.161:0/3732780948 wait complete. 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 Processor -- start 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.215+0000 7f7f4960f800 1 -- start start 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f4960f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf3732300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f4960f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cdf372bdb0 con 0x55cdf372aca0 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf3732300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f45415640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf3732300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53498/0 (socket says 172.21.15.161:53498) 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 learned_addr learned my addr 172.21.15.161:0/2002391887 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf3732840 con 0x55cdf372aca0 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f45415640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf3732300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c04b7f0 tx=0x7f7f3c04c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7e1a7fc640 1 -- 172.21.15.161:0/2002391887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c045040 con 0x55cdf372aca0 2024-05-08T09:21:52.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7e1a7fc640 1 -- 172.21.15.161:0/2002391887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c017b00 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cdf3732ad0 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7e1a7fc640 1 -- 172.21.15.161:0/2002391887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c017e60 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.216+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf3735780 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.217+0000 7f7e1a7fc640 1 -- 172.21.15.161:0/2002391887 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7f3c0195c0 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.217+0000 7f7e1a7fc640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e10036900 0x7f7e10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.217+0000 7f7e1a7fc640 1 -- 172.21.15.161:0/2002391887 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7f3c036c90 con 0x55cdf372aca0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.217+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e10036900 0x7f7e10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e10036900 0x7f7e10038dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400d010 tx=0x7f7f34020000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf373dd80 0x55cdf3740240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3740990 con 0x55cdf373dd80 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f44413640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf373dd80 0x55cdf3740240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f44413640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf373dd80 0x55cdf3740240 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 20 realm 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.218+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3740d60 con 0x55cdf373dd80 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3741630 con 0x55cdf373dd80 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf37419d0 con 0x55cdf373dd80 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf3742480 0x55cdf3744890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3744ff0 con 0x55cdf3742480 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.219+0000 7f7f45415640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf3742480 0x55cdf3744890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f45415640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf3742480 0x55cdf3744890 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f4960f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f4960f800 20 searching for the correct realm 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cdf37470a0 0x55cdf3749560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf37470a0 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cdf37470a0 0x55cdf3749560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.220+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cdf37470a0 0x55cdf3749560 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.221+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.221+0000 7f7f44c14640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7f3403f660 0x7f7f3403fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.221+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x7f7f3403f660 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.221+0000 7f7f44413640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7f3403f660 0x7f7f3403fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.221+0000 7f7f44413640 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7f3403f660 0x7f7f3403fa80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf3742480 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf373dd80 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf373dd80 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.222+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf3742480 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf3742480 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x7f7f3403f660 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.223+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf37470a0 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf373dd80 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf3742480 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf373dd80 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.224+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x7f7f3403f660 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3749c30 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf3742480 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.225+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf373dd80 2024-05-08T09:21:52.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf373dd80 2024-05-08T09:21:52.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.226+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf3742480 2024-05-08T09:21:52.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x7f7f3403f660 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf373dd80 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.227+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf3742480 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf3742480 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x7f7f3403f660 2024-05-08T09:21:52.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.228+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf37470a0 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.229+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.229+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf3742480 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.229+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.229+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x55cdf373dd80 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.229+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7f34058040 con 0x7f7f3403f660 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3745aa0 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3745f20 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.230+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3746400 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 zone default found 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 4 Realm: () 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 zonegroup default 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374a0b0 con 0x55cdf3742480 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3745700 con 0x55cdf37470a0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374c460 con 0x55cdf37470a0 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 started sync module instance, tier type = 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.231+0000 7f7f4960f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.232+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374b770 con 0x7f7f3403f660 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.232+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.232+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94343041170544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374b770 con 0x7f7f3403f660 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.232+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374cf20 con 0x55cdf373dd80 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.234+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94343041170544] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.234+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.234+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94343041168064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374cee0 con 0x55cdf373dd80 2024-05-08T09:21:52.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.234+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374d9c0 con 0x55cdf37470a0 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.235+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94343041168064] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.235+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.235+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94343041174064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374ce50 con 0x55cdf37470a0 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.235+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374e8b0 con 0x7f7f3403f660 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.236+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.236+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94343041180672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374e860 con 0x7f7f3403f660 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.236+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374f850 con 0x55cdf373dd80 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.237+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94343041174064] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.237+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.237+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94343041184544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374f810 con 0x55cdf373dd80 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.237+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94343041180672] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.237+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374eca0 con 0x55cdf3742480 2024-05-08T09:21:52.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.238+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.238+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94343041184544] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.238+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94343041182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3750260 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.238+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374de20 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.239+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94343041182880] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.239+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.239+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94343041187248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf37501d0 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.239+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3751240 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94343041191312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3751660 con 0x55cdf3742480 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=0 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=1 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=2 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=3 2024-05-08T09:21:52.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=4 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=5 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94343041187248] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.241+0000 7f7f4960f800 20 add_watcher() i=6 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94343041191312] v27'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f4960f800 20 add_watcher() i=7 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f4960f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3751660 con 0x55cdf373dd80 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.242+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94343041192368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf37515d0 con 0x55cdf373dd80 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94343041192368] v27'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7dfafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7f4960f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7f4960f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7f4960f800 5 note: GC not initialized 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.243+0000 7f7df9fe3640 20 reqs_thread_entry: start 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f4960f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f4960f800 20 Filter name: none 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7d6b7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f4960f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55cdf37874e0 con 0x7f7f3403f660 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.244+0000 7f7f4960f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.245+0000 7f7dfafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.245+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94343041192368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3785420 con 0x55cdf373dd80 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.246+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94343041192368] v27'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.246+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94343041170544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3785420 con 0x7f7f3403f660 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.247+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94343041170544] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.247+0000 7f7f4960f800 20 remove_watcher() i=0 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.247+0000 7f7f4960f800 2 removed watcher, disabling cache 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.247+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94343041168064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374bc70 con 0x55cdf373dd80 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.248+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94343041168064] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.248+0000 7f7f4960f800 20 remove_watcher() i=1 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.248+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94343041174064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3785420 con 0x55cdf37470a0 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.249+0000 7f7f44c14640 1 -- 172.21.15.161:0/2002391887 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94343041174064] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3400f030 con 0x55cdf37470a0 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.249+0000 7f7f4960f800 20 remove_watcher() i=2 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.249+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94343041180672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374b2c0 con 0x7f7f3403f660 2024-05-08T09:21:52.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.250+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94343041180672] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x7f7f3403f660 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.250+0000 7f7f4960f800 20 remove_watcher() i=3 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.250+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94343041184544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374bc70 con 0x55cdf373dd80 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.251+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94343041184544] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3805a040 con 0x55cdf373dd80 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.251+0000 7f7f4960f800 20 remove_watcher() i=4 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.251+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94343041182880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374ca30 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.252+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94343041182880] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.252+0000 7f7f4960f800 20 remove_watcher() i=5 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.252+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94343041187248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf3785420 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.253+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94343041187248] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.253+0000 7f7f4960f800 20 remove_watcher() i=6 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.253+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94343041191312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55cdf374b2c0 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f45415640 1 -- 172.21.15.161:0/2002391887 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94343041191312] v27'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7f3c03b020 con 0x55cdf3742480 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 20 remove_watcher() i=7 2024-05-08T09:21:52.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf3742480 msgr2=0x55cdf3744890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf3742480 0x55cdf3744890 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf373dd80 msgr2=0x55cdf3740240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf373dd80 0x55cdf3740240 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7f3403f660 msgr2=0x7f7f3403fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7f3403f660 0x7f7f3403fa80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cdf37470a0 msgr2=0x55cdf3749560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cdf37470a0 0x55cdf3749560 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e10036900 msgr2=0x7f7e10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e10036900 0x7f7e10038dc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400d010 tx=0x7f7f34020000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 msgr2=0x55cdf3732300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2002391887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf372aca0 0x55cdf3732300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c04b7f0 tx=0x7f7f3c04c810 comp rx=0 tx=0).stop 2024-05-08T09:21:52.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f44413640 1 -- 172.21.15.161:0/2002391887 reap_dead start 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 shutdown_connections 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.254+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 >> 172.21.15.161:0/2002391887 conn(0x55cdf3727000 msgr2=0x55cdf3724660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 shutdown_connections 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2002391887 wait complete. 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 msgr2=0x7f7e1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 0x7f7e1c038e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55cdf3709e80 tx=0x7f7f34003450 comp rx=0 tx=0).stop 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 msgr2=0x55cdf371dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55cdf3709e20 tx=0x7f7f3c00aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 shutdown_connections 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e1c036950 0x7f7e1c038e10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/2999836971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf371d9c0 0x55cdf371dde0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 >> 172.21.15.161:0/2999836971 conn(0x55cdf3711a60 msgr2=0x55cdf3711e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 shutdown_connections 2024-05-08T09:21:52.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/2999836971 wait complete. 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 msgr2=0x55cdf370e140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 0x55cdf370e140 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 msgr2=0x55cdf3709470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 0x55cdf3709470 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 msgr2=0x7f7e2c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 0x7f7e2c038e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7f38054000 tx=0x7f7f3804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 msgr2=0x55cdf3702230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55cdf357be20 tx=0x7f7f34001250 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 shutdown_connections 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cdf370bd50 0x55cdf370e140 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cdf360b580 0x55cdf3709470 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7e2c036950 0x7f7e2c038e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 --2- 172.21.15.161:0/3362987275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cdf3607140 0x55cdf3702230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 >> 172.21.15.161:0/3362987275 conn(0x55cdf3602780 msgr2=0x55cdf357b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 shutdown_connections 2024-05-08T09:21:52.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.255+0000 7f7f4960f800 1 -- 172.21.15.161:0/3362987275 wait complete. 2024-05-08T09:21:52.265 INFO:teuthology.orchestra.run.smithi161.stdout:{"key":"bucket:myfoo","ver":{"tag":"_5aXwLqEIp--dEM6f53db3dL","ver":2},"mtime":"2024-05-08T09:21:51.961712Z","data":{"bucket":{"name":"myfoo","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","bucket_id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-05-08T09:21:50.820361Z","linked":false,"has_bucket_info":false}} 2024-05-08T09:21:52.266 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_5aXwLqEIp--dEM6f53db3dL', 'ver': 2}, 'mtime': '2024-05-08T09:21:51.961712Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'bucket_id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-05-08T09:21:50.820361Z', 'linked': False, 'has_bucket_info': False}} 2024-05-08T09:21:52.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1'] 2024-05-08T09:21:52.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1'] 2024-05-08T09:21:52.266 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:52.354 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.354 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.356+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.356+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.356+0000 7fc624533800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5646451b0610 0x564645244fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.356+0000 7fc624533800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5646451b0b50 con 0x5646451b19f0 2024-05-08T09:21:52.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.356+0000 7fc624533800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5646450cd050 con 0x5646451b0610 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.357+0000 7fc617fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5646451b0610 0x564645244fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.357+0000 7fc6201f5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5646451b19f0 0x5646451aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43016/0 (socket says 172.21.15.161:43016) 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.357+0000 7fc6201f5640 1 -- 172.21.15.161:0/3883017441 learned_addr learned my addr 172.21.15.161:0/3883017441 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.357+0000 7fc617fff640 1 -- 172.21.15.161:0/3883017441 >> v1:172.21.15.45:6789/0 conn(0x5646451b19f0 legacy=0x5646451aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.357+0000 7fc61f9f4640 1 -- 172.21.15.161:0/3883017441 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2381665996 0 0) 0x5646451b0b50 con 0x5646451b19f0 2024-05-08T09:21:52.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.358+0000 7fc617fff640 1 -- 172.21.15.161:0/3883017441 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645246530 con 0x5646451b0610 2024-05-08T09:21:52.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.359+0000 7fc617fff640 1 --2- 172.21.15.161:0/3883017441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645244fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc60800a470 tx=0x7fc60801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702b5cbf1d004783 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc61f9f4640 1 -- 172.21.15.161:0/3883017441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc608057070 con 0x5646451b0610 2024-05-08T09:21:52.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc61f9f4640 1 -- 172.21.15.161:0/3883017441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc608052570 con 0x5646451b0610 2024-05-08T09:21:52.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc61f9f4640 1 -- 172.21.15.161:0/3883017441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc608052870 con 0x5646451b0610 2024-05-08T09:21:52.360 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 -- 172.21.15.161:0/3883017441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 msgr2=0x564645244fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 --2- 172.21.15.161:0/3883017441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645244fe0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fc60800a470 tx=0x7fc60801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 -- 172.21.15.161:0/3883017441 shutdown_connections 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 --2- 172.21.15.161:0/3883017441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645244fe0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 -- 172.21.15.161:0/3883017441 >> 172.21.15.161:0/3883017441 conn(0x5646452377a0 msgr2=0x564645239bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 -- 172.21.15.161:0/3883017441 shutdown_connections 2024-05-08T09:21:52.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.360+0000 7fc624533800 1 -- 172.21.15.161:0/3883017441 wait complete. 2024-05-08T09:21:52.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc624533800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc624533800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5646451871f0 con 0x5646451b0610 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc6201f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc6201f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53522/0 (socket says 172.21.15.161:53522) 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc6201f5640 1 -- 172.21.15.161:0/1231189176 learned_addr learned my addr 172.21.15.161:0/1231189176 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.374+0000 7fc6201f5640 1 -- 172.21.15.161:0/1231189176 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56464532fd60 con 0x5646451b0610 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.375+0000 7fc6201f5640 1 --2- 172.21.15.161:0/1231189176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc610001e00 tx=0x7fc61000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755d4e83ac27feca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.375+0000 7fc50e60c640 1 -- 172.21.15.161:0/1231189176 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610012020 con 0x5646451b0610 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.375+0000 7fc50e60c640 1 -- 172.21.15.161:0/1231189176 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61000e5c0 con 0x5646451b0610 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.375+0000 7fc50e60c640 1 -- 172.21.15.161:0/1231189176 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61000e8e0 con 0x5646451b0610 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.375+0000 7fc624533800 1 -- 172.21.15.161:0/1231189176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 msgr2=0x56464532f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 --2- 172.21.15.161:0/1231189176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc610001e00 tx=0x7fc61000b780 comp rx=0 tx=0).stop 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- 172.21.15.161:0/1231189176 shutdown_connections 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 --2- 172.21.15.161:0/1231189176 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x56464532f790 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- 172.21.15.161:0/1231189176 >> 172.21.15.161:0/1231189176 conn(0x5646452377a0 msgr2=0x56464532b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- 172.21.15.161:0/1231189176 shutdown_connections 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- 172.21.15.161:0/1231189176 wait complete. 2024-05-08T09:21:52.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc624533800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564645245760 con 0x5646451b0610 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc6201f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc6201f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53532/0 (socket says 172.21.15.161:53532) 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.376+0000 7fc6201f5640 1 -- 172.21.15.161:0/1080843183 learned_addr learned my addr 172.21.15.161:0/1080843183 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc6201f5640 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645337840 con 0x5646451b0610 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc6201f5640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x564645330520 tx=0x7fc610000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc50ce09640 1 -- 172.21.15.161:0/1080843183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610012030 con 0x5646451b0610 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc50ce09640 1 -- 172.21.15.161:0/1080843183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61001a700 con 0x5646451b0610 2024-05-08T09:21:52.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564645337ad0 con 0x5646451b0610 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc50ce09640 1 -- 172.21.15.161:0/1080843183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61001a9e0 con 0x5646451b0610 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.377+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464533a780 con 0x5646451b0610 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc50ce09640 1 -- 172.21.15.161:0/1080843183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc610015020 con 0x5646451b0610 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc50ce09640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 0x7fc508038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc50ce09640 1 -- 172.21.15.161:0/1080843183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc610020030 con 0x5646451b0610 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc617fff640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 0x7fc508038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 0x56464533e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464533ea80 con 0x5646451b19f0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc6209f6640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 0x56464533e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc617fff640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 0x7fc508038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc608054000 tx=0x7fc60804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.378+0000 7fc6209f6640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 0x56464533e540 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc6209f6640 1 -- 172.21.15.161:0/1080843183 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4a0 con 0x5646451b19f0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464533bb10 con 0x5646451b19f0 2024-05-08T09:21:52.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc6209f6640 1 -- 172.21.15.161:0/1080843183 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc61800a4a0 con 0x5646451b19f0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 0x564645343180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645343870 con 0x564645340d90 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.379+0000 7fc6201f5640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 0x564645343180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.380+0000 7fc6201f5640 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 0x564645343180 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.380+0000 7fc6201f5640 1 -- 172.21.15.161:0/1080843183 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc61000dcd0 con 0x564645340d90 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.380+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464533fd40 con 0x5646451b19f0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.380+0000 7fc6209f6640 1 -- 172.21.15.161:0/1080843183 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc61800a4a0 con 0x5646451b19f0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.380+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645340220 con 0x5646451b19f0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc6209f6640 1 -- 172.21.15.161:0/1080843183 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc61800a4a0 con 0x5646451b19f0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc624533800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc624533800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56464512dcf0 con 0x5646453529e0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53542/0 (socket says 172.21.15.161:53542) 2024-05-08T09:21:52.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.381+0000 7fc6209f6640 1 -- 172.21.15.161:0/40478951 learned_addr learned my addr 172.21.15.161:0/40478951 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc6209f6640 1 -- 172.21.15.161:0/40478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645353340 con 0x5646453529e0 2024-05-08T09:21:52.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc6209f6640 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x56464533ee40 tx=0x7fc618018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc505ffb640 1 -- 172.21.15.161:0/40478951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc618014450 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc505ffb640 1 -- 172.21.15.161:0/40478951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc618014610 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc505ffb640 1 -- 172.21.15.161:0/40478951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc618014930 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564645353db0 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.382+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646453542b0 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc505ffb640 1 -- 172.21.15.161:0/40478951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc618011040 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc505ffb640 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 0x7fc4f8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc505ffb640 1 -- 172.21.15.161:0/40478951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc61801e070 con 0x5646453529e0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc6201f5640 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 0x7fc4f8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.383+0000 7fc6201f5640 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 0x7fc4f8038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x56464533eee0 tx=0x7fc61000df60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc624533800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc624533800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5646453300e0 con 0x56464535fc30 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53556/0 (socket says 172.21.15.161:53556) 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc6209f6640 1 -- 172.21.15.161:0/2173305136 learned_addr learned my addr 172.21.15.161:0/2173305136 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc6209f6640 1 -- 172.21.15.161:0/2173305136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645360620 con 0x56464535fc30 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc6209f6640 1 --2- 172.21.15.161:0/2173305136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc61804c890 tx=0x7fc618011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f015d4d495b76e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc4f77fe640 1 -- 172.21.15.161:0/2173305136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61804e200 con 0x56464535fc30 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc4f77fe640 1 -- 172.21.15.161:0/2173305136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc618014ad0 con 0x56464535fc30 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.384+0000 7fc4f77fe640 1 -- 172.21.15.161:0/2173305136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61804b200 con 0x56464535fc30 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- 172.21.15.161:0/2173305136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 msgr2=0x564645360050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 --2- 172.21.15.161:0/2173305136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc61804c890 tx=0x7fc618011f20 comp rx=0 tx=0).stop 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- 172.21.15.161:0/2173305136 shutdown_connections 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 --2- 172.21.15.161:0/2173305136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645360050 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- 172.21.15.161:0/2173305136 >> 172.21.15.161:0/2173305136 conn(0x56464535bfe0 msgr2=0x56464535a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- 172.21.15.161:0/2173305136 shutdown_connections 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- 172.21.15.161:0/2173305136 wait complete. 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 Processor -- start 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- start start 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645367200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc624533800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564645360d80 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645367200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc6209f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645367200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53568/0 (socket says 172.21.15.161:53568) 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.385+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 learned_addr learned my addr 172.21.15.161:0/437532538 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.386+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564645367740 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.386+0000 7fc6209f6640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645367200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc618011f60 tx=0x7fc61804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.387+0000 7fc4f5ffb640 1 -- 172.21.15.161:0/437532538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc618031020 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.387+0000 7fc4f5ffb640 1 -- 172.21.15.161:0/437532538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61804cbe0 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.387+0000 7fc4f5ffb640 1 -- 172.21.15.161:0/437532538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6180133b0 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.387+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5646453679d0 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.387+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56464536a680 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc4f5ffb640 1 -- 172.21.15.161:0/437532538 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc618034020 con 0x56464535fc30 2024-05-08T09:21:52.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc4f5ffb640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4e8036950 0x7fc4e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc4f5ffb640 1 -- 172.21.15.161:0/437532538 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc61800e040 con 0x56464535fc30 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc6201f5640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4e8036950 0x7fc4e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564645372d30 0x5646453751c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645375910 con 0x564645372d30 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc617fff640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564645372d30 0x5646453751c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.389+0000 7fc6201f5640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4e8036950 0x7fc4e8038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc61000dfd0 tx=0x7fc610036000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc617fff640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564645372d30 0x5646453751c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 realm 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645375ce0 con 0x564645372d30 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645376580 con 0x564645372d30 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645376920 con 0x564645372d30 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.390+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.391+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645377680 0x564645379a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.391+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464537a0c0 con 0x564645377680 2024-05-08T09:21:52.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.391+0000 7fc6209f6640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645377680 0x564645379a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.392+0000 7fc6209f6640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645377680 0x564645379a70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc624533800 20 searching for the correct realm 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56464537c070 0x56464537e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc6201f5640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56464537c070 0x56464537e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc6201f5640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56464537c070 0x56464537e530 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.393+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc6201f5640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc610017050 0x7fc61000c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc617fff640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc610017050 0x7fc61000c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc617fff640 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc610017050 0x7fc61000c570 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.394+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.395+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.396+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.396+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.396+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.396+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.397+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.398+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.399+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.400+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.401+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x56464537c070 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.402+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645377680 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x564645372d30 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56464537ec00 con 0x7fc610017050 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.403+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464537aa80 con 0x564645372d30 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464537a6c0 con 0x564645372d30 2024-05-08T09:21:52.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464537b4a0 con 0x564645372d30 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 zone default found 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 4 Realm: () 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 zonegroup default 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.404+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56464537af20 con 0x564645377680 2024-05-08T09:21:52.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645381410 con 0x56464537c070 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453817b0 con 0x56464537c070 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 started sync module instance, tier type = 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.405+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645380850 con 0x7fc610017050 2024-05-08T09:21:52.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.406+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.406+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94859809000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645380850 con 0x7fc610017050 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.406+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453821d0 con 0x564645372d30 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.407+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94859809000752] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.408+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.408+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94859809004736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645380850 con 0x564645372d30 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.408+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645382c40 con 0x56464537c070 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.409+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.409+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94859809007408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645383510 con 0x56464537c070 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.409+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645384000 con 0x7fc610017050 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.409+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94859809004736] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.410+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94859809007408] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.410+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.410+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94859809009760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453803a0 con 0x7fc610017050 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.410+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453848e0 con 0x564645372d30 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.411+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94859809009760] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.411+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.411+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94859809012432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645384850 con 0x564645372d30 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.411+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453852f0 con 0x564645377680 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.412+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.412+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94859809017408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645385b90 con 0x564645377680 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.412+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94859809012432] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.412+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645386410 con 0x564645377680 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.413+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94859809017408] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.413+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.413+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94859809019536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645385ab0 con 0x564645377680 2024-05-08T09:21:52.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.413+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645386a90 con 0x564645377680 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94859809019536] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94859809023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645386f00 con 0x564645377680 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=0 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=1 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=2 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=3 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=4 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=5 2024-05-08T09:21:52.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.414+0000 7fc624533800 20 add_watcher() i=6 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94859809023360] v27'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc624533800 20 add_watcher() i=7 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc624533800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564645386f00 con 0x564645372d30 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.415+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94859809024592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645386ee0 con 0x564645372d30 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.416+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94859809024592] v27'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.416+0000 7fc4d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.416+0000 7fc624533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.416+0000 7fc624533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.416+0000 7fc624533800 5 note: GC not initialized 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc4d5fdb640 20 reqs_thread_entry: start 2024-05-08T09:21:52.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc624533800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc624533800 20 Filter name: none 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc4477fe640 20 reqs_thread_entry: start 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc624533800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.417+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453bd3f0 con 0x564645377680 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453bf370 con 0x7fc610017050 2024-05-08T09:21:52.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0bc0 con 0x7fc610017050 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.418+0000 7fc624533800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.419+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c51c0 con 0x7fc610017050 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.420+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 foo.buckets [call] v27'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.420+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453cb0e0 con 0x7fc610017050 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94859809260656 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453c55f0 con 0x56464537c070 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94859809007408 notify 115964116996 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fc610054040 con 0x56464537c070 2024-05-08T09:21:52.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc4f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116996 cookie 94859809007408 notifier 4494 bl.length()=752 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc4f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94859809260656 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc4f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc4f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc4f77fe640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc4ec003ea0 con 0x56464537c070 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94859809260656 notify 115964116996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56464533a780 con 0x56464537c070 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:52.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.421+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0470 con 0x564645377680 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.422+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 fud.buckets [call] v27'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.423+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0470 con 0x7fc610017050 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc624533800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc624533800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc624533800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94859809260656 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5646453c9d90 con 0x564645377680 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== watch-notify(notify (1) cookie 94859809019536 notify 115964117001 ret 0) ==== 356+0+0 (crc 0 0 0) 0x564645367740 con 0x564645377680 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc4f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94859809019536 notifier 4494 bl.length()=314 2024-05-08T09:21:52.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(71 notify.6 [notify cookie 94859809260656 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc4f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc4f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc4f77fe640 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc4ec004240 con 0x564645377680 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.424+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.425+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== watch-notify(notify_complete (2) cookie 94859809260656 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564645360620 con 0x564645377680 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.425+0000 7fc4d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.425+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94859809024592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0470 con 0x564645372d30 2024-05-08T09:21:52.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.426+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94859809024592] v27'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.426+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94859809000752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0470 con 0x7fc610017050 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.427+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94859809000752] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.427+0000 7fc624533800 20 remove_watcher() i=0 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.427+0000 7fc624533800 2 removed watcher, disabling cache 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.427+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94859809004736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5646453c0470 con 0x564645372d30 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.428+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94859809004736] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.428+0000 7fc624533800 20 remove_watcher() i=1 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.428+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94859809007408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645381cc0 con 0x56464537c070 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.429+0000 7fc6201f5640 1 -- 172.21.15.161:0/437532538 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94859809007408] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61000dcd0 con 0x56464537c070 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.429+0000 7fc624533800 20 remove_watcher() i=2 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.429+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94859809009760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645381cc0 con 0x7fc610017050 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.430+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94859809009760] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x7fc610017050 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.430+0000 7fc624533800 20 remove_watcher() i=3 2024-05-08T09:21:52.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.430+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94859809012432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645383060 con 0x564645372d30 2024-05-08T09:21:52.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.431+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94859809012432] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc60805a040 con 0x564645372d30 2024-05-08T09:21:52.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.431+0000 7fc624533800 20 remove_watcher() i=4 2024-05-08T09:21:52.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.431+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94859809017408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645381cc0 con 0x564645377680 2024-05-08T09:21:52.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.433+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94859809017408] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.433+0000 7fc624533800 20 remove_watcher() i=5 2024-05-08T09:21:52.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.433+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94859809019536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645383060 con 0x564645377680 2024-05-08T09:21:52.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.434+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94859809019536] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.434+0000 7fc624533800 20 remove_watcher() i=6 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.434+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94859809023360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564645381cc0 con 0x564645377680 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc6209f6640 1 -- 172.21.15.161:0/437532538 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94859809023360] v27'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc618057040 con 0x564645377680 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 20 remove_watcher() i=7 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645377680 msgr2=0x564645379a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645377680 0x564645379a70 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564645372d30 msgr2=0x5646453751c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564645372d30 0x5646453751c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc610017050 msgr2=0x7fc61000c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc610017050 0x7fc61000c570 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56464537c070 msgr2=0x56464537e530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56464537c070 0x56464537e530 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4e8036950 msgr2=0x7fc4e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4e8036950 0x7fc4e8038e10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc61000dfd0 tx=0x7fc610036000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 msgr2=0x564645367200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc624533800 1 --2- 172.21.15.161:0/437532538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56464535fc30 0x564645367200 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc618011f60 tx=0x7fc61804c820 comp rx=0 tx=0).stop 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 reap_dead start 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.436+0000 7fc617fff640 1 -- 172.21.15.161:0/437532538 reap_dead start 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 shutdown_connections 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 >> 172.21.15.161:0/437532538 conn(0x56464535bfe0 msgr2=0x5646453614a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 shutdown_connections 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/437532538 wait complete. 2024-05-08T09:21:52.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 msgr2=0x7fc4f8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 0x7fc4f8038e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x56464533eee0 tx=0x7fc61000df60 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 msgr2=0x564645352e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x56464533ee40 tx=0x7fc618018830 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 shutdown_connections 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc4f8036950 0x7fc4f8038e10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/40478951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646453529e0 0x564645352e00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 >> 172.21.15.161:0/40478951 conn(0x564645346a80 msgr2=0x564645346e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 shutdown_connections 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/40478951 wait complete. 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 msgr2=0x564645343180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 0x564645343180 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 msgr2=0x56464533e540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 0x56464533e540 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 msgr2=0x7fc508038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 0x7fc508038e10 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc608054000 tx=0x7fc60804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 msgr2=0x564645337300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.437+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x564645330520 tx=0x7fc610000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 shutdown_connections 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564645340d90 0x564645343180 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5646451b19f0 0x56464533e540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fc508036950 0x7fc508038e10 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 --2- 172.21.15.161:0/1080843183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5646451b0610 0x564645337300 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 >> 172.21.15.161:0/1080843183 conn(0x5646452377a0 msgr2=0x5646453298f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 shutdown_connections 2024-05-08T09:21:52.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.438+0000 7fc624533800 1 -- 172.21.15.161:0/1080843183 wait complete. 2024-05-08T09:21:52.449 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:52.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:52.450 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T09:21:52.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.495+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.495+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.495+0000 7f20b740f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556b2947d6e0 0x556b2947fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.495+0000 7f20b740f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556b29480010 con 0x556b29479bd0 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.495+0000 7f20b740f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x556b2930a050 con 0x556b2947d6e0 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.496+0000 7f20abfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556b2947d6e0 0x556b2947fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.496+0000 7f20abfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556b2947d6e0 0x556b2947fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53578/0 (socket says 172.21.15.161:53578) 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.496+0000 7f20abfff640 1 -- 172.21.15.161:0/1701605818 learned_addr learned my addr 172.21.15.161:0/1701605818 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.496+0000 7f20abfff640 1 -- 172.21.15.161:0/1701605818 >> v1:172.21.15.45:6789/0 conn(0x556b29479bd0 legacy=0x556b2947bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:52.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.496+0000 7f20abfff640 1 -- 172.21.15.161:0/1701605818 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b294811f0 con 0x556b2947d6e0 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20abfff640 1 --2- 172.21.15.161:0/1701605818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2947d6e0 0x556b2947fad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a520 tx=0x7f209c01cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3ad7f68388f5cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b235b640 1 -- 172.21.15.161:0/1701605818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c057070 con 0x556b2947d6e0 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b235b640 1 -- 172.21.15.161:0/1701605818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c052570 con 0x556b2947d6e0 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b235b640 1 -- 172.21.15.161:0/1701605818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f209c052870 con 0x556b2947d6e0 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b740f800 1 -- 172.21.15.161:0/1701605818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2947d6e0 msgr2=0x556b2947fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b740f800 1 --2- 172.21.15.161:0/1701605818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2947d6e0 0x556b2947fad0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f209c00a520 tx=0x7f209c01cf70 comp rx=0 tx=0).stop 2024-05-08T09:21:52.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b740f800 1 -- 172.21.15.161:0/1701605818 shutdown_connections 2024-05-08T09:21:52.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b740f800 1 --2- 172.21.15.161:0/1701605818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2947d6e0 0x556b2947fad0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.498+0000 7f20b740f800 1 -- 172.21.15.161:0/1701605818 >> 172.21.15.161:0/1701605818 conn(0x556b294735a0 msgr2=0x556b294759c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.499+0000 7f20b740f800 1 -- 172.21.15.161:0/1701605818 shutdown_connections 2024-05-08T09:21:52.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.499+0000 7f20b740f800 1 -- 172.21.15.161:0/1701605818 wait complete. 2024-05-08T09:21:52.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.512+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.512+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b740f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b740f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b293c41d0 con 0x556b29479bd0 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b2b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b2b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53590/0 (socket says 172.21.15.161:53590) 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b2b5c640 1 -- 172.21.15.161:0/2248790180 learned_addr learned my addr 172.21.15.161:0/2248790180 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b2b5c640 1 -- 172.21.15.161:0/2248790180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2956ad10 con 0x556b29479bd0 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.513+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/2248790180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20a400a480 tx=0x7f20a400a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145969002293b086 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f1fa0e09640 1 -- 172.21.15.161:0/2248790180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a4008860 con 0x556b29479bd0 2024-05-08T09:21:52.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f1fa0e09640 1 -- 172.21.15.161:0/2248790180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4008a00 con 0x556b29479bd0 2024-05-08T09:21:52.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f1fa0e09640 1 -- 172.21.15.161:0/2248790180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a4008d00 con 0x556b29479bd0 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 -- 172.21.15.161:0/2248790180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 msgr2=0x556b2956a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 --2- 172.21.15.161:0/2248790180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20a400a480 tx=0x7f20a400a940 comp rx=0 tx=0).stop 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 -- 172.21.15.161:0/2248790180 shutdown_connections 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 --2- 172.21.15.161:0/2248790180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b2956a740 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 -- 172.21.15.161:0/2248790180 >> 172.21.15.161:0/2248790180 conn(0x556b294735a0 msgr2=0x556b29566060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 -- 172.21.15.161:0/2248790180 shutdown_connections 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.514+0000 7f20b740f800 1 -- 172.21.15.161:0/2248790180 wait complete. 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b740f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b740f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b294804e0 con 0x556b29479bd0 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b2b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b2b5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53596/0 (socket says 172.21.15.161:53596) 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b2b5c640 1 -- 172.21.15.161:0/2986167040 learned_addr learned my addr 172.21.15.161:0/2986167040 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.515+0000 7f20b2b5c640 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b29572850 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20a400a420 tx=0x7f20a4002fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f1f9f606640 1 -- 172.21.15.161:0/2986167040 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a4022020 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f1f9f606640 1 -- 172.21.15.161:0/2986167040 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20a4019040 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f1f9f606640 1 -- 172.21.15.161:0/2986167040 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20a4013a20 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b29572ae0 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.516+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b29575790 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f1f9f606640 1 -- 172.21.15.161:0/2986167040 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20a4025020 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f1f9f606640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 0x7f1f98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f1f9f606640 1 -- 172.21.15.161:0/2986167040 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f20a404c2c0 con 0x556b29479bd0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20abfff640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 0x7f1f98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 0x556b29579550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b29579ae0 con 0x556b2947d6e0 2024-05-08T09:21:52.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20b335d640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 0x556b29579550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20abfff640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 0x7f1f98038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f209c054000 tx=0x7f209c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.517+0000 7f20b335d640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 0x556b29579550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b335d640 1 -- 172.21.15.161:0/2986167040 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f20ac00a4a0 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b29576b20 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b335d640 1 -- 172.21.15.161:0/2986167040 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f20ac00a4a0 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 0x556b2957e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b2957e8c0 con 0x556b2957be30 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.518+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 0x556b2957e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.519+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 0x556b2957e220 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.519+0000 7f20b2b5c640 1 -- 172.21.15.161:0/2986167040 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f20a40491a0 con 0x556b2957be30 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.519+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b2957ade0 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.519+0000 7f20b335d640 1 -- 172.21.15.161:0/2986167040 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f20ac00a4a0 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.519+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b2957b270 con 0x556b2947d6e0 2024-05-08T09:21:52.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b335d640 1 -- 172.21.15.161:0/2986167040 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f20ac00a4a0 con 0x556b2947d6e0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b740f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b740f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b2936acf0 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53608/0 (socket says 172.21.15.161:53608) 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.520+0000 7f20b335d640 1 -- 172.21.15.161:0/114479875 learned_addr learned my addr 172.21.15.161:0/114479875 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f20b335d640 1 -- 172.21.15.161:0/114479875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2958e400 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f20b335d640 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x556b29579ee0 tx=0x7f20ac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f1f9ce01640 1 -- 172.21.15.161:0/114479875 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac014450 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f1f9ce01640 1 -- 172.21.15.161:0/114479875 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac014610 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b2958ee70 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f1f9ce01640 1 -- 172.21.15.161:0/114479875 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac014930 con 0x556b2958daa0 2024-05-08T09:21:52.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.521+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b2958f370 con 0x556b2958daa0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f1f9ce01640 1 -- 172.21.15.161:0/114479875 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20ac011040 con 0x556b2958daa0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f1f9ce01640 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 0x7f1f8c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f1f9ce01640 1 -- 172.21.15.161:0/114479875 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f20ac01e070 con 0x556b2958daa0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 0x7f1f8c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 0x7f1f8c038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x556b29579f50 tx=0x7f20a404c050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b740f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.522+0000 7f20b740f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b2956b090 con 0x556b2959ad20 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53618/0 (socket says 172.21.15.161:53618) 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f20b335d640 1 -- 172.21.15.161:0/2220013268 learned_addr learned my addr 172.21.15.161:0/2220013268 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f20b335d640 1 -- 172.21.15.161:0/2220013268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b2959b710 con 0x556b2959ad20 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f20b335d640 1 --2- 172.21.15.161:0/2220013268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f20ac04c890 tx=0x7f20ac011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97521472be332901 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f1f967fc640 1 -- 172.21.15.161:0/2220013268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac014ad0 con 0x556b2959ad20 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f1f967fc640 1 -- 172.21.15.161:0/2220013268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac014c70 con 0x556b2959ad20 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.523+0000 7f1f967fc640 1 -- 172.21.15.161:0/2220013268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac04e0d0 con 0x556b2959ad20 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- 172.21.15.161:0/2220013268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 msgr2=0x556b2959b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 --2- 172.21.15.161:0/2220013268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f20ac04c890 tx=0x7f20ac011f20 comp rx=0 tx=0).stop 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- 172.21.15.161:0/2220013268 shutdown_connections 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 --2- 172.21.15.161:0/2220013268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b2959b140 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- 172.21.15.161:0/2220013268 >> 172.21.15.161:0/2220013268 conn(0x556b29597080 msgr2=0x556b295950e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- 172.21.15.161:0/2220013268 shutdown_connections 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- 172.21.15.161:0/2220013268 wait complete. 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 Processor -- start 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- start start 2024-05-08T09:21:52.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b740f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556b2959be80 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b335d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53626/0 (socket says 172.21.15.161:53626) 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 learned_addr learned my addr 172.21.15.161:0/3906730371 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.524+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b295a2860 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f20b335d640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f20ac011680 tx=0x7f20ac04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f1f94ff9640 1 -- 172.21.15.161:0/3906730371 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac031020 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f1f94ff9640 1 -- 172.21.15.161:0/3906730371 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20ac04ca90 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f1f94ff9640 1 -- 172.21.15.161:0/3906730371 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20ac0133b0 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556b295a2af0 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b295a57a0 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.525+0000 7f1f94ff9640 1 -- 172.21.15.161:0/3906730371 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f20ac034020 con 0x556b2959ad20 2024-05-08T09:21:52.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f1f94ff9640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f7c036950 0x7f1f7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f1f94ff9640 1 -- 172.21.15.161:0/3906730371 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f20ac00e040 con 0x556b2959ad20 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f7c036950 0x7f1f7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f7c036950 0x7f1f7c038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20a4049490 tx=0x7f20a4035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b295ade70 0x556b295b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.526+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b0a80 con 0x556b295ade70 2024-05-08T09:21:52.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20abfff640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b295ade70 0x556b295b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20abfff640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b295ade70 0x556b295b0330 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 20 realm 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b0e50 con 0x556b295ade70 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.527+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b1720 con 0x556b295ade70 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b1ac0 con 0x556b295ade70 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b295b2820 0x556b295b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b51d0 con 0x556b295b2820 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.528+0000 7f20b335d640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b295b2820 0x556b295b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b335d640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b295b2820 0x556b295b4c10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b740f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b740f800 20 searching for the correct realm 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556b295b7180 0x556b295b9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556b295b7180 0x556b295b9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.529+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556b295b7180 0x556b295b9640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20b2b5c640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20a403d070 0x7f20a404a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20abfff640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20a403d070 0x7f20a404a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20abfff640 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20a403d070 0x7f20a404a7f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.530+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.531+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.532+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.533+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.534+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.535+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.536+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.537+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b7180 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.538+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x556b295ade70 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556b295b9d10 con 0x7f20a403d070 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b5b90 con 0x556b295ade70 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b57d0 con 0x556b295ade70 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.539+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295b6570 con 0x556b295ade70 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 zone default found 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 4 Realm: () 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 zonegroup default 2024-05-08T09:21:52.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295ba220 con 0x556b295b2820 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295bc4f0 con 0x556b295b7180 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.540+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295bc890 con 0x556b295b7180 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.541+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.541+0000 7f20b740f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.541+0000 7f20b740f800 20 started sync module instance, tier type = 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.541+0000 7f20b740f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.541+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bb980 con 0x7f20a403d070 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.542+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.542+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93918743740080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bb980 con 0x7f20a403d070 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.542+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bd2a0 con 0x556b295ade70 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.543+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93918743740080] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.543+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.543+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93918743744464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bb980 con 0x556b295ade70 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.543+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bdcf0 con 0x556b295b7180 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.544+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.544+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93918743746560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295be590 con 0x556b295b7180 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.544+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bf040 con 0x7f20a403d070 2024-05-08T09:21:52.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.544+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93918743744464] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.545+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.545+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93918743746560] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.545+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93918743737552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bf430 con 0x7f20a403d070 2024-05-08T09:21:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.545+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295be0e0 con 0x556b295ade70 2024-05-08T09:21:52.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.546+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.546+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93918743755072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295be0e0 con 0x556b295ade70 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.546+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c0830 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.546+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93918743737552] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.547+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93918743755072] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.548+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.548+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93918743756128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295beb20 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.548+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c1100 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.549+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93918743756128] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.549+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.549+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93918743757696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c10b0 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.549+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c1af0 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93918743757696] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93918743762368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c1cf0 con 0x556b295b2820 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=0 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=1 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=2 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=3 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=4 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=5 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.551+0000 7f20b740f800 20 add_watcher() i=6 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93918743762368] v27'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20b740f800 20 add_watcher() i=7 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20b740f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295c50d0 con 0x556b295ade70 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.552+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93918743763952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c24f0 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.553+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93918743763952] v27'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.553+0000 7f1f69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.553+0000 7f20b740f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.553+0000 7f20b740f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.553+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cd950 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.555+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.555+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295ce020 con 0x556b295b2820 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.557+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.557+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295ce020 con 0x556b295b7180 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.558+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.558+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295ceac0 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.559+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'113 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.559+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cb780 con 0x7f20a403d070 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.560+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.560+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cb780 con 0x556b295b7180 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.561+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.561+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cf6b0 con 0x556b295ade70 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.562+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.562+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cf6b0 con 0x556b295b2820 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.563+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.563+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.564+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.564 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.564+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.565+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'20 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.565+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.566+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.566+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b2820 2024-05-08T09:21:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.568+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.568+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.569+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.569+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b2820 2024-05-08T09:21:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.570+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'27 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.570+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295ade70 2024-05-08T09:21:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.571+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.571+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.572+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'26 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.572+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.573+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.573+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.574+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.574+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295ade70 2024-05-08T09:21:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.575+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.575+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295ade70 2024-05-08T09:21:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.576+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.576+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.577+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'27 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.577+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.578+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.578+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.579+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.579+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.580+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.580+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.581+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.581+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.582+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.582+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b2820 2024-05-08T09:21:52.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.583+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.583+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.584+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.584+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b2820 2024-05-08T09:21:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.586+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.586+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b7180 2024-05-08T09:21:52.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.587+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.587+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x556b295b2820 2024-05-08T09:21:52.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.588+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'28 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.588+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cfb60 con 0x7f20a403d070 2024-05-08T09:21:52.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f1f68fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20b740f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20b740f800 20 Filter name: none 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20b740f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f1f61ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20b740f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.590+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295fac00 con 0x556b295b2820 2024-05-08T09:21:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b740f800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:21:52.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b740f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b740f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b740f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556b295fd180 con 0x556b295b2820 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.591+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.592+0000 7f1f69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.592+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93918743763952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cc790 con 0x556b295ade70 2024-05-08T09:21:52.592 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.593+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93918743763952] v27'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.593+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93918743740080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295cc790 con 0x7f20a403d070 2024-05-08T09:21:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.594+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93918743740080] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.594+0000 7f20b740f800 20 remove_watcher() i=0 2024-05-08T09:21:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.594+0000 7f20b740f800 2 removed watcher, disabling cache 2024-05-08T09:21:52.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.594+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93918743744464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bbeb0 con 0x556b295ade70 2024-05-08T09:21:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.596+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93918743744464] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.596+0000 7f20b740f800 20 remove_watcher() i=1 2024-05-08T09:21:52.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.596+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93918743746560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bcfd0 con 0x556b295b7180 2024-05-08T09:21:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.597+0000 7f20b2b5c640 1 -- 172.21.15.161:0/3906730371 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93918743746560] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20a40491a0 con 0x556b295b7180 2024-05-08T09:21:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.597+0000 7f20b740f800 20 remove_watcher() i=2 2024-05-08T09:21:52.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.597+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93918743737552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bcfd0 con 0x7f20a403d070 2024-05-08T09:21:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.598+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93918743737552] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x7f20a403d070 2024-05-08T09:21:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.598+0000 7f20b740f800 20 remove_watcher() i=3 2024-05-08T09:21:52.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.598+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93918743755072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bb4d0 con 0x556b295ade70 2024-05-08T09:21:52.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.599+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93918743755072] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f209c05a040 con 0x556b295ade70 2024-05-08T09:21:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.599+0000 7f20b740f800 20 remove_watcher() i=4 2024-05-08T09:21:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.599+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93918743756128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bcfd0 con 0x556b295b2820 2024-05-08T09:21:52.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.600+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93918743756128] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.600+0000 7f20b740f800 20 remove_watcher() i=5 2024-05-08T09:21:52.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.600+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93918743757696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295bcfd0 con 0x556b295b2820 2024-05-08T09:21:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.601+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93918743757696] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.601+0000 7f20b740f800 20 remove_watcher() i=6 2024-05-08T09:21:52.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.601+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93918743762368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556b295c0380 con 0x556b295b2820 2024-05-08T09:21:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b335d640 1 -- 172.21.15.161:0/3906730371 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93918743762368] v27'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f20ac057040 con 0x556b295b2820 2024-05-08T09:21:52.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 20 remove_watcher() i=7 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b295b2820 msgr2=0x556b295b4c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b295b2820 0x556b295b4c10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b295ade70 msgr2=0x556b295b0330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b295ade70 0x556b295b0330 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20a403d070 msgr2=0x7f20a404a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f20a403d070 0x7f20a404a7f0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556b295b7180 msgr2=0x556b295b9640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556b295b7180 0x556b295b9640 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f7c036950 msgr2=0x7f1f7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f7c036950 0x7f1f7c038e10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f20a4049490 tx=0x7f20a4035000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 msgr2=0x556b295a2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20abfff640 1 -- 172.21.15.161:0/3906730371 reap_dead start 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.602+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f20ac011680 tx=0x7f20ac04c820 comp rx=0 tx=0).stop 2024-05-08T09:21:52.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 shutdown_connections 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/3906730371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2959ad20 0x556b295a2320 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 >> 172.21.15.161:0/3906730371 conn(0x556b29597080 msgr2=0x556b295946e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 shutdown_connections 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/3906730371 wait complete. 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 msgr2=0x7f1f8c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 0x7f1f8c038e10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x556b29579f50 tx=0x7f20a404c050 comp rx=0 tx=0).stop 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 msgr2=0x556b2958dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x556b29579ee0 tx=0x7f20ac018830 comp rx=0 tx=0).stop 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 shutdown_connections 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f8c036950 0x7f1f8c038e10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/114479875 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b2958daa0 0x556b2958dec0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 >> 172.21.15.161:0/114479875 conn(0x556b29581b40 msgr2=0x556b29581f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 shutdown_connections 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/114479875 wait complete. 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 msgr2=0x556b2957e220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 0x556b2957e220 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 msgr2=0x556b29579550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.603+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 0x556b29579550 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 msgr2=0x7f1f98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 0x7f1f98038e10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f209c054000 tx=0x7f209c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 msgr2=0x556b29572310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f20a400a420 tx=0x7f20a4002fd0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 shutdown_connections 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556b2957be30 0x556b2957e220 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556b2947d6e0 0x556b29579550 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f1f98036950 0x7f1f98038e10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 --2- 172.21.15.161:0/2986167040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556b29479bd0 0x556b29572310 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 >> 172.21.15.161:0/2986167040 conn(0x556b294735a0 msgr2=0x556b29564860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 shutdown_connections 2024-05-08T09:21:52.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.604+0000 7f20b740f800 1 -- 172.21.15.161:0/2986167040 wait complete. 2024-05-08T09:21:52.612 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T09:21:52.612 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T09:21:52.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-05-08T09:21:52.613 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-05-08T09:21:52.699 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.699 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.700+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.700+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.700+0000 7fd30f60e800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x563275139400 0x56327513b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.700+0000 7fd30f60e800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56327513bf20 con 0x5632750a8040 2024-05-08T09:21:52.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.700+0000 7fd30f60e800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x563274fc6050 con 0x563275139400 2024-05-08T09:21:52.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd30d114640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5632750a8040 0x563275137c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43032/0 (socket says 172.21.15.161:43032) 2024-05-08T09:21:52.701 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd30d114640 1 -- 172.21.15.161:0/3598301192 learned_addr learned my addr 172.21.15.161:0/3598301192 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577527861 0 0) 0x56327513bf20 con 0x5632750a8040 2024-05-08T09:21:52.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f8001e10 con 0x5632750a8040 2024-05-08T09:21:52.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2053113935 0 0) 0x7fd2f8001e10 con 0x5632750a8040 2024-05-08T09:21:52.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 >> v2:172.21.15.45:3300/0 conn(0x563275139400 msgr2=0x56327513b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:52.702 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 --2- 172.21.15.161:0/3598301192 >> v2:172.21.15.45:3300/0 conn(0x563275139400 0x56327513b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327513d150 con 0x5632750a8040 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 1106978320 0 0) 0x7fd3000015a0 con 0x5632750a8040 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 >> v1:172.21.15.45:6789/0 conn(0x5632750a8040 legacy=0x563275137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 --2- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 0x7fd2f80026a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.701+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563274fc6050 con 0x7fd2f80022a0 2024-05-08T09:21:52.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.703+0000 7fd30d114640 1 --2- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 0x7fd2f80026a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.704+0000 7fd30d114640 1 -- 172.21.15.161:0/3598301192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f8001e10 con 0x7fd2f80022a0 2024-05-08T09:21:52.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.707+0000 7fd30d114640 1 --2- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 0x7fd2f80026a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd3000099e0 tx=0x7fd30001d800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b489ffa8cddd8bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.707+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3000096b0 con 0x7fd2f80022a0 2024-05-08T09:21:52.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.707+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30004f070 con 0x7fd2f80022a0 2024-05-08T09:21:52.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.707+0000 7fd2fffff640 1 -- 172.21.15.161:0/3598301192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30004bc50 con 0x7fd2f80022a0 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 -- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 msgr2=0x7fd2f80026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 --2- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 0x7fd2f80026a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fd3000099e0 tx=0x7fd30001d800 comp rx=0 tx=0).stop 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 -- 172.21.15.161:0/3598301192 shutdown_connections 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 --2- 172.21.15.161:0/3598301192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2f80022a0 0x7fd2f80026a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 --2- 172.21.15.161:0/3598301192 >> v2:172.21.15.45:3300/0 conn(0x563275139400 0x56327513b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 -- 172.21.15.161:0/3598301192 >> 172.21.15.161:0/3598301192 conn(0x56327512f5c0 msgr2=0x5632751319e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 -- 172.21.15.161:0/3598301192 shutdown_connections 2024-05-08T09:21:52.708 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.708+0000 7fd30f60e800 1 -- 172.21.15.161:0/3598301192 wait complete. 2024-05-08T09:21:52.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.722+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.722+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.722+0000 7fd30f60e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.722+0000 7fd30f60e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5632750801c0 con 0x5632750a8040 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd30d114640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd30d114640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53652/0 (socket says 172.21.15.161:53652) 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd30d114640 1 -- 172.21.15.161:0/529773196 learned_addr learned my addr 172.21.15.161:0/529773196 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd30d114640 1 -- 172.21.15.161:0/529773196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632752268c0 con 0x5632750a8040 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd30d114640 1 --2- 172.21.15.161:0/529773196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd300045400 tx=0x7fd30004d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ef7e3b06d616e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd1fb606640 1 -- 172.21.15.161:0/529773196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd300001560 con 0x5632750a8040 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd1fb606640 1 -- 172.21.15.161:0/529773196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30004b9b0 con 0x5632750a8040 2024-05-08T09:21:52.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.723+0000 7fd1fb606640 1 -- 172.21.15.161:0/529773196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30004bcd0 con 0x5632750a8040 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- 172.21.15.161:0/529773196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 msgr2=0x5632752262f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 --2- 172.21.15.161:0/529773196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd300045400 tx=0x7fd30004d070 comp rx=0 tx=0).stop 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- 172.21.15.161:0/529773196 shutdown_connections 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 --2- 172.21.15.161:0/529773196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x5632752262f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- 172.21.15.161:0/529773196 >> 172.21.15.161:0/529773196 conn(0x56327512f5c0 msgr2=0x563275221c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- 172.21.15.161:0/529773196 shutdown_connections 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- 172.21.15.161:0/529773196 wait complete. 2024-05-08T09:21:52.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.724+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30f60e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30f60e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56327513c3f0 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30d114640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30d114640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53660/0 (socket says 172.21.15.161:53660) 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30d114640 1 -- 172.21.15.161:0/1355069277 learned_addr learned my addr 172.21.15.161:0/1355069277 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30d114640 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327522e2d0 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30d114640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3000454d0 tx=0x7fd2f8004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd1f9e03640 1 -- 172.21.15.161:0/1355069277 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30004bd50 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd1f9e03640 1 -- 172.21.15.161:0/1355069277 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd30006e030 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd1f9e03640 1 -- 172.21.15.161:0/1355069277 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd30005f5b0 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.725+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327522e560 con 0x5632750a8040 2024-05-08T09:21:52.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.726+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563275231210 con 0x5632750a8040 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.726+0000 7fd1f9e03640 1 -- 172.21.15.161:0/1355069277 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd300051030 con 0x5632750a8040 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.726+0000 7fd1f9e03640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 0x7fd1f4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd1f9e03640 1 -- 172.21.15.161:0/1355069277 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd300064070 con 0x5632750a8040 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30c913640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 0x7fd1f4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 0x563275234fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275235510 con 0x563275139400 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30d915640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 0x563275234fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30c913640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 0x7fd1f4038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd304008530 tx=0x7fd304005600 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30d915640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 0x563275234fd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30d915640 1 -- 172.21.15.161:0/1355069277 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd30800a4a0 con 0x563275139400 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.727+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275232560 con 0x563275139400 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.728+0000 7fd30d915640 1 -- 172.21.15.161:0/1355069277 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd30800a4a0 con 0x563275139400 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.728+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 0x563275239860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.728+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275239f00 con 0x7fd2f80022a0 2024-05-08T09:21:52.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.728+0000 7fd30d114640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 0x563275239860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.728+0000 7fd30d114640 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 0x563275239860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30d114640 1 -- 172.21.15.161:0/1355069277 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd30007a070 con 0x7fd2f80022a0 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752367d0 con 0x563275139400 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30d915640 1 -- 172.21.15.161:0/1355069277 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd30800a4a0 con 0x563275139400 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275236c70 con 0x563275139400 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30d915640 1 -- 172.21.15.161:0/1355069277 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd30800a4a0 con 0x563275139400 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.729+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30f60e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30f60e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563275026cf0 con 0x563275249080 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53668/0 (socket says 172.21.15.161:53668) 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30d915640 1 -- 172.21.15.161:0/2336725295 learned_addr learned my addr 172.21.15.161:0/2336725295 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30d915640 1 -- 172.21.15.161:0/2336725295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632752499e0 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd30d915640 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5632752358d0 tx=0x7fd308018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd1f2ffd640 1 -- 172.21.15.161:0/2336725295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308014450 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd1f2ffd640 1 -- 172.21.15.161:0/2336725295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308014610 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.730+0000 7fd1f2ffd640 1 -- 172.21.15.161:0/2336725295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308014930 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.731+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327524a450 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.731+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56327524a950 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.731+0000 7fd1f2ffd640 1 -- 172.21.15.161:0/2336725295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd308011040 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.731+0000 7fd1f2ffd640 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 0x7fd1e8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.731+0000 7fd1f2ffd640 1 -- 172.21.15.161:0/2336725295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd30801e070 con 0x563275249080 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30d114640 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 0x7fd1e8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30d114640 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 0x7fd1e8038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd300069fd0 tx=0x7fd30008cc00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30f60e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30f60e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x563275226be0 con 0x563275256300 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53676/0 (socket says 172.21.15.161:53676) 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.732+0000 7fd30d915640 1 -- 172.21.15.161:0/598966481 learned_addr learned my addr 172.21.15.161:0/598966481 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30d915640 1 -- 172.21.15.161:0/598966481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563275256cf0 con 0x563275256300 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30d915640 1 --2- 172.21.15.161:0/598966481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd30804c9e0 tx=0x7fd308011330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c1a7287a85c823 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd1f0ff9640 1 -- 172.21.15.161:0/598966481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308013c90 con 0x563275256300 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd1f0ff9640 1 -- 172.21.15.161:0/598966481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308013e30 con 0x563275256300 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd1f0ff9640 1 -- 172.21.15.161:0/598966481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308014c00 con 0x563275256300 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 -- 172.21.15.161:0/598966481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 msgr2=0x563275256720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 --2- 172.21.15.161:0/598966481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd30804c9e0 tx=0x7fd308011330 comp rx=0 tx=0).stop 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 -- 172.21.15.161:0/598966481 shutdown_connections 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 --2- 172.21.15.161:0/598966481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x563275256720 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 -- 172.21.15.161:0/598966481 >> 172.21.15.161:0/598966481 conn(0x563275252610 msgr2=0x5632752506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 -- 172.21.15.161:0/598966481 shutdown_connections 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.733+0000 7fd30f60e800 1 -- 172.21.15.161:0/598966481 wait complete. 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30f60e800 1 Processor -- start 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30f60e800 1 -- start start 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30f60e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30f60e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5632752574c0 con 0x563275256300 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30d915640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53690/0 (socket says 172.21.15.161:53690) 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 learned_addr learned my addr 172.21.15.161:0/79802776 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56327525de40 con 0x563275256300 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.734+0000 7fd30d915640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd308011b80 tx=0x7fd30804c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 -- 172.21.15.161:0/79802776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd308013c90 con 0x563275256300 2024-05-08T09:21:52.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 -- 172.21.15.161:0/79802776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308031030 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56327525e0d0 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 -- 172.21.15.161:0/79802776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd3080119c0 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563275260d80 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 -- 172.21.15.161:0/79802776 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fd3080133b0 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1d8036900 0x7fd1d8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.735+0000 7fd1deffd640 1 -- 172.21.15.161:0/79802776 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fd30800e040 con 0x563275256300 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30d114640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1d8036900 0x7fd1d8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30d114640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1d8036900 0x7fd1d8038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3000097f0 tx=0x7fd30007e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275269600 0x56327526bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56327526c210 con 0x563275269600 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.736+0000 7fd30c913640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275269600 0x56327526bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30c913640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275269600 0x56327526bac0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 realm 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275268a50 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56327526cd00 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.737+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56327526d5d0 con 0x563275269600 2024-05-08T09:21:52.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56327526dff0 0x5632752703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275270b70 con 0x56327526dff0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30d915640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56327526dff0 0x5632752703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.738+0000 7fd30d915640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56327526dff0 0x5632752703e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30f60e800 20 searching for the correct realm 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x563275272b40 0x563275275000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x563275272b40 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30d114640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x563275272b40 0x563275275000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.739+0000 7fd30d114640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x563275272b40 0x563275275000 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30d114640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fd30008e0b0 0x7fd300061090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x7fd30008e0b0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30c913640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fd30008e0b0 0x7fd300061090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30c913640 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fd30008e0b0 0x7fd300061090 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x7fd30008e0b0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.740+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x56327526dff0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x563275269600 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x563275269600 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x56327526dff0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.741+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x56327526dff0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5632752756d0 con 0x7fd30008e0b0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x7fd30008e0b0 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.742+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x7fd30008e0b0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd304014140 con 0x7fd30008e0b0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.743+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.744+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd304014140 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.745+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x7fd30008e0b0 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304014140 con 0x7fd30008e0b0 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.746+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.747+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.747+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.747+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.747+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x7fd30008e0b0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275272b40 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.748+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x563275269600 2024-05-08T09:21:52.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7fd30402c040 con 0x7fd30008e0b0 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.749+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275271530 con 0x563275269600 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275271920 con 0x563275269600 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275271920 con 0x563275269600 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 zone default found 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 4 Realm: () 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 zonegroup default 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.750+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275271d40 con 0x56327526dff0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275277530 con 0x563275272b40 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x563275277960 con 0x563275272b40 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 started sync module instance, tier type = 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.751+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752769d0 con 0x7fd30008e0b0 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.752+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.752+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94774713872112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752769d0 con 0x7fd30008e0b0 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.752+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563275278460 con 0x563275269600 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.753+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94774713872112] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.754+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.754+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94774713876272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752769d0 con 0x563275269600 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.754+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563275278ef0 con 0x563275272b40 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.755+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.755+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94774713878976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563275279790 con 0x563275272b40 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.755+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527a250 con 0x7fd30008e0b0 2024-05-08T09:21:52.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.755+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94774713876272] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.756+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94774713878976] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.756+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.756+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94774713881312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563275276520 con 0x7fd30008e0b0 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.756+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527aaf0 con 0x563275269600 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.757+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.757+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94774713886144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527aee0 con 0x563275269600 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.757+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527b9e0 con 0x56327526dff0 2024-05-08T09:21:52.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.757+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94774713881312] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.758+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94774713886144] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.758+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.758+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94774713887200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x563275279d20 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.758+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527c280 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.760+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94774713887200] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.760+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.760+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94774713890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527c280 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.760+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527cc80 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94774713890000] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94774713894800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527d0c0 con 0x56327526dff0 2024-05-08T09:21:52.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=0 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=1 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=2 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=3 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=4 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=5 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=6 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94774713894800] v27'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.762+0000 7fd30f60e800 20 add_watcher() i=7 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.763+0000 7fd30f60e800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.763+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56327527be30 con 0x563275269600 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.763+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.763+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94774713895856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527be30 con 0x563275269600 2024-05-08T09:21:52.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94774713895856] v27'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30f60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30f60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30f60e800 5 note: GC not initialized 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd1c27e4640 20 reqs_thread_entry: start 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30f60e800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd30f60e800 20 Filter name: none 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.764+0000 7fd133fff640 20 reqs_thread_entry: start 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752b3600 con 0x56327526dff0 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:21:52.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752b5580 con 0x7fd30008e0b0 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.765+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752b6e30 con 0x7fd30008e0b0 2024-05-08T09:21:52.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.766+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752b8350 con 0x56327526dff0 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.767+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(65 fud.buckets [call] v27'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.767+0000 7fd30f60e800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.767+0000 7fd30f60e800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.767+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752b8750 con 0x7fd30008e0b0 2024-05-08T09:21:52.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30f60e800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30f60e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30f60e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30f60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.768+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752be340 con 0x7fd30008e0b0 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v27'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30f60e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30f60e800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30f60e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94774714146384 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5632752bb730 con 0x56327526dff0 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== watch-notify(notify (1) cookie 94774713890000 notify 115964117002 ret 0) ==== 380+0+0 (crc 0 0 0) 0x563275260d80 con 0x56327526dff0 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd1f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 94774713890000 notifier 4506 bl.length()=338 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd1f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-05-08T09:21:52.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd1f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd1f0ff9640 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fd1d0003ea0 con 0x56327526dff0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(68 notify.6 [notify cookie 94774714146384 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.769+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify_complete (2) cookie 94774714146384 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56327525e0d0 con 0x56327526dff0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.770+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.770+0000 7fd1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.770+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94774713895856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752b3ec0 con 0x563275269600 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.771+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94774713895856] v27'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.771+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94774713872112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527cbb0 con 0x7fd30008e0b0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.772+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94774713872112] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.772+0000 7fd30f60e800 20 remove_watcher() i=0 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.772+0000 7fd30f60e800 2 removed watcher, disabling cache 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.772+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94774713876272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527cbb0 con 0x563275269600 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.773+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94774713876272] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.773+0000 7fd30f60e800 20 remove_watcher() i=1 2024-05-08T09:21:52.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.773+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94774713878976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56327527cbb0 con 0x563275272b40 2024-05-08T09:21:52.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.774+0000 7fd30d114640 1 -- 172.21.15.161:0/79802776 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94774713878976] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30007a070 con 0x563275272b40 2024-05-08T09:21:52.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.774+0000 7fd30f60e800 20 remove_watcher() i=2 2024-05-08T09:21:52.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.774+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94774713881312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752789c0 con 0x7fd30008e0b0 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.775+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94774713881312] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x7fd30008e0b0 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.775+0000 7fd30f60e800 20 remove_watcher() i=3 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.775+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94774713886144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752789c0 con 0x563275269600 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.776+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94774713886144] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd304036040 con 0x563275269600 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.776+0000 7fd30f60e800 20 remove_watcher() i=4 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.776+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94774713887200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752789c0 con 0x56327526dff0 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.777+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94774713887200] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.777+0000 7fd30f60e800 20 remove_watcher() i=5 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.777+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94774713890000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752789c0 con 0x56327526dff0 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.778+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94774713890000] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.778+0000 7fd30f60e800 20 remove_watcher() i=6 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.778+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94774713894800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5632752789c0 con 0x56327526dff0 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30d915640 1 -- 172.21.15.161:0/79802776 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94774713894800] v27'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd30802a070 con 0x56327526dff0 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 20 remove_watcher() i=7 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56327526dff0 msgr2=0x5632752703e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56327526dff0 0x5632752703e0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275269600 msgr2=0x56327526bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275269600 0x56327526bac0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fd30008e0b0 msgr2=0x7fd300061090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fd30008e0b0 0x7fd300061090 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x563275272b40 msgr2=0x563275275000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x563275272b40 0x563275275000 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1d8036900 msgr2=0x7fd1d8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1d8036900 0x7fd1d8038dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd3000097f0 tx=0x7fd30007e000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 msgr2=0x56327525d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30c913640 1 -- 172.21.15.161:0/79802776 reap_dead start 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd308011b80 tx=0x7fd30804c970 comp rx=0 tx=0).stop 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 shutdown_connections 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 --2- 172.21.15.161:0/79802776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275256300 0x56327525d900 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 >> 172.21.15.161:0/79802776 conn(0x563275252610 msgr2=0x56327524fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 shutdown_connections 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.779+0000 7fd30f60e800 1 -- 172.21.15.161:0/79802776 wait complete. 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 msgr2=0x7fd1e8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 0x7fd1e8038e10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd300069fd0 tx=0x7fd30008cc00 comp rx=0 tx=0).stop 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 msgr2=0x5632752494a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x5632752358d0 tx=0x7fd308018830 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 shutdown_connections 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1e8036950 0x7fd1e8038e10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/2336725295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563275249080 0x5632752494a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 >> 172.21.15.161:0/2336725295 conn(0x56327523d120 msgr2=0x56327523d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 shutdown_connections 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/2336725295 wait complete. 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 msgr2=0x563275239860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 0x563275239860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 msgr2=0x563275234fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 0x563275234fd0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 msgr2=0x7fd1f4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 0x7fd1f4038dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd304008530 tx=0x7fd304005600 comp rx=0 tx=0).stop 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 msgr2=0x56327522dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fd3000454d0 tx=0x7fd2f8004120 comp rx=0 tx=0).stop 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 shutdown_connections 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7fd2f80022a0 0x563275239860 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x563275139400 0x563275234fd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fd1f4036900 0x7fd1f4038dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 --2- 172.21.15.161:0/1355069277 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5632750a8040 0x56327522dd90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 >> 172.21.15.161:0/1355069277 conn(0x56327512f5c0 msgr2=0x563275220410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 shutdown_connections 2024-05-08T09:21:52.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.780+0000 7fd30f60e800 1 -- 172.21.15.161:0/1355069277 wait complete. 2024-05-08T09:21:52.790 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1'] 2024-05-08T09:21:52.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1'] 2024-05-08T09:21:52.790 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:52.839 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.839 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.840+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.840+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.840+0000 7fcb87936800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5640a6b18690 0x5640a6b1aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.840+0000 7fcb87936800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5640a6b1afc0 con 0x5640a6b14b80 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.840+0000 7fcb87936800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5640a69a5050 con 0x5640a6b18690 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.841+0000 7fcb7bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5640a6b18690 0x5640a6b1aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.841+0000 7fcb836cc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5640a6b14b80 0x5640a6b16f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43038/0 (socket says 172.21.15.161:43038) 2024-05-08T09:21:52.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.841+0000 7fcb836cc640 1 -- 172.21.15.161:0/1485456842 learned_addr learned my addr 172.21.15.161:0/1485456842 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.841+0000 7fcb7bfff640 1 -- 172.21.15.161:0/1485456842 >> v1:172.21.15.45:6789/0 conn(0x5640a6b14b80 legacy=0x5640a6b16f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.841+0000 7fcb7bfff640 1 -- 172.21.15.161:0/1485456842 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6b1c1a0 con 0x5640a6b18690 2024-05-08T09:21:52.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.843+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/1485456842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b18690 0x5640a6b1aa80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00a470 tx=0x7fcb6c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c204de3293459f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.843+0000 7fcb82ecb640 1 -- 172.21.15.161:0/1485456842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c057070 con 0x5640a6b18690 2024-05-08T09:21:52.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.843+0000 7fcb82ecb640 1 -- 172.21.15.161:0/1485456842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c052570 con 0x5640a6b18690 2024-05-08T09:21:52.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.843+0000 7fcb82ecb640 1 -- 172.21.15.161:0/1485456842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb6c052870 con 0x5640a6b18690 2024-05-08T09:21:52.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 -- 172.21.15.161:0/1485456842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b18690 msgr2=0x5640a6b1aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 --2- 172.21.15.161:0/1485456842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b18690 0x5640a6b1aa80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c00a470 tx=0x7fcb6c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 -- 172.21.15.161:0/1485456842 shutdown_connections 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 --2- 172.21.15.161:0/1485456842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b18690 0x5640a6b1aa80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 -- 172.21.15.161:0/1485456842 >> 172.21.15.161:0/1485456842 conn(0x5640a6b0e5d0 msgr2=0x5640a6b109f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 -- 172.21.15.161:0/1485456842 shutdown_connections 2024-05-08T09:21:52.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.844+0000 7fcb87936800 1 -- 172.21.15.161:0/1485456842 wait complete. 2024-05-08T09:21:52.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.857+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.857+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.857+0000 7fcb87936800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.857+0000 7fcb87936800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5640a6a5f1f0 con 0x5640a6b14b80 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fcb836cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fcb836cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53718/0 (socket says 172.21.15.161:53718) 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fcb836cc640 1 -- 172.21.15.161:0/2994812025 learned_addr learned my addr 172.21.15.161:0/2994812025 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fcb836cc640 1 -- 172.21.15.161:0/2994812025 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6c05dc0 con 0x5640a6b14b80 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2994812025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcb74001de0 tx=0x7fcb7400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416d1d0b3f684fe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.858+0000 7fca7160a640 1 -- 172.21.15.161:0/2994812025 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74012020 con 0x5640a6b14b80 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fca7160a640 1 -- 172.21.15.161:0/2994812025 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7400e5a0 con 0x5640a6b14b80 2024-05-08T09:21:52.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fca7160a640 1 -- 172.21.15.161:0/2994812025 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7400e8c0 con 0x5640a6b14b80 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 -- 172.21.15.161:0/2994812025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 msgr2=0x5640a6c057f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 --2- 172.21.15.161:0/2994812025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcb74001de0 tx=0x7fcb7400b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 -- 172.21.15.161:0/2994812025 shutdown_connections 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 --2- 172.21.15.161:0/2994812025 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c057f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 -- 172.21.15.161:0/2994812025 >> 172.21.15.161:0/2994812025 conn(0x5640a6b0e5d0 msgr2=0x5640a6c01110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 -- 172.21.15.161:0/2994812025 shutdown_connections 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.859+0000 7fcb87936800 1 -- 172.21.15.161:0/2994812025 wait complete. 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb87936800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb87936800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5640a6b1b490 con 0x5640a6b14b80 2024-05-08T09:21:52.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb836cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb836cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53726/0 (socket says 172.21.15.161:53726) 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb836cc640 1 -- 172.21.15.161:0/88612945 learned_addr learned my addr 172.21.15.161:0/88612945 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.860+0000 7fcb836cc640 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6c0d850 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fcb836cc640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c010 tx=0x7fcb74000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fca6fe07640 1 -- 172.21.15.161:0/88612945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb74012070 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fca6fe07640 1 -- 172.21.15.161:0/88612945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7401a7a0 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640a6c0dae0 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fca6fe07640 1 -- 172.21.15.161:0/88612945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7401aa80 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.861+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640a6c10790 con 0x5640a6b14b80 2024-05-08T09:21:52.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fca6fe07640 1 -- 172.21.15.161:0/88612945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb74015020 con 0x5640a6b14b80 2024-05-08T09:21:52.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fca6fe07640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fca6fe07640 1 -- 172.21.15.161:0/88612945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb74020070 con 0x5640a6b14b80 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 0x5640a6c14550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c14a90 con 0x5640a6b18690 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 0x5640a6c14550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c054000 tx=0x7fcb6c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.862+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 0x5640a6c14550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb83ecd640 1 -- 172.21.15.161:0/88612945 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x5640a6b18690 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c11b20 con 0x5640a6b18690 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb83ecd640 1 -- 172.21.15.161:0/88612945 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x5640a6b18690 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 0x5640a6c19220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c198c0 con 0x5640a6c16e30 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.863+0000 7fcb836cc640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 0x5640a6c19220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb836cc640 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 0x5640a6c19220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb836cc640 1 -- 172.21.15.161:0/88612945 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c16e30 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c15de0 con 0x5640a6b18690 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb83ecd640 1 -- 172.21.15.161:0/88612945 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x5640a6b18690 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c162c0 con 0x5640a6b18690 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.864+0000 7fcb83ecd640 1 -- 172.21.15.161:0/88612945 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb7c00a4a0 con 0x5640a6b18690 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb87936800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb87936800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5640a6a05cf0 con 0x5640a6c28ab0 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53736/0 (socket says 172.21.15.161:53736) 2024-05-08T09:21:52.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb83ecd640 1 -- 172.21.15.161:0/695234572 learned_addr learned my addr 172.21.15.161:0/695234572 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.865+0000 7fcb83ecd640 1 -- 172.21.15.161:0/695234572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6c29410 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x5640a6c14e90 tx=0x7fcb7c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fca6d602640 1 -- 172.21.15.161:0/695234572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c014450 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fca6d602640 1 -- 172.21.15.161:0/695234572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c0145f0 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640a6c29e80 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fca6d602640 1 -- 172.21.15.161:0/695234572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c0148d0 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.866+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640a6c2a380 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fca6d602640 1 -- 172.21.15.161:0/695234572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb7c011040 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fca6d602640 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fca6d602640 1 -- 172.21.15.161:0/695234572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb7c01e070 con 0x5640a6c28ab0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb836cc640 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb836cc640 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 0x7fca5c038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5640a6c14f50 tx=0x7fcb7400b6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb87936800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb87936800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5640a6c06140 con 0x5640a6c35ce0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.867+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53738/0 (socket says 172.21.15.161:53738) 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb83ecd640 1 -- 172.21.15.161:0/46344211 learned_addr learned my addr 172.21.15.161:0/46344211 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb83ecd640 1 -- 172.21.15.161:0/46344211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6c366d0 con 0x5640a6c35ce0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/46344211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c04c980 tx=0x7fcb7c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e062e44f789134 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fca66ffd640 1 -- 172.21.15.161:0/46344211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c013de0 con 0x5640a6c35ce0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fca66ffd640 1 -- 172.21.15.161:0/46344211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c040e50 con 0x5640a6c35ce0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fca66ffd640 1 -- 172.21.15.161:0/46344211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c04e220 con 0x5640a6c35ce0 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb87936800 1 -- 172.21.15.161:0/46344211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 msgr2=0x5640a6c36100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb87936800 1 --2- 172.21.15.161:0/46344211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c04c980 tx=0x7fcb7c011700 comp rx=0 tx=0).stop 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb87936800 1 -- 172.21.15.161:0/46344211 shutdown_connections 2024-05-08T09:21:52.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb87936800 1 --2- 172.21.15.161:0/46344211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c36100 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.868+0000 7fcb87936800 1 -- 172.21.15.161:0/46344211 >> 172.21.15.161:0/46344211 conn(0x5640a6c32040 msgr2=0x5640a6c300a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 -- 172.21.15.161:0/46344211 shutdown_connections 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 -- 172.21.15.161:0/46344211 wait complete. 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 Processor -- start 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 -- start start 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb87936800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5640a6c36de0 con 0x5640a6c35ce0 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb83ecd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53740/0 (socket says 172.21.15.161:53740) 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 learned_addr learned my addr 172.21.15.161:0/2574794651 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.869+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640a6c3d7c0 con 0x5640a6c35ce0 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c040040 tx=0x7fcb7c04c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fca657fa640 1 -- 172.21.15.161:0/2574794651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c04b410 con 0x5640a6c35ce0 2024-05-08T09:21:52.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fca657fa640 1 -- 172.21.15.161:0/2574794651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb7c04b5b0 con 0x5640a6c35ce0 2024-05-08T09:21:52.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fca657fa640 1 -- 172.21.15.161:0/2574794651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb7c04cbc0 con 0x5640a6c35ce0 2024-05-08T09:21:52.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5640a6c3da50 con 0x5640a6c35ce0 2024-05-08T09:21:52.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640a6c40700 con 0x5640a6c35ce0 2024-05-08T09:21:52.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.870+0000 7fca657fa640 1 -- 172.21.15.161:0/2574794651 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb7c02ba60 con 0x5640a6c35ce0 2024-05-08T09:21:52.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fca657fa640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca4c036950 0x7fca4c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fca657fa640 1 -- 172.21.15.161:0/2574794651 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb7c00e040 con 0x5640a6c35ce0 2024-05-08T09:21:52.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca4c036950 0x7fca4c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca4c036950 0x7fca4c038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400bc10 tx=0x7fcb74031040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6c48d70 0x5640a6c4b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c4b980 con 0x5640a6c48d70 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.871+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6c48d70 0x5640a6c4b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6c48d70 0x5640a6c4b230 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 20 realm 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c4bd50 con 0x5640a6c48d70 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:52.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.872+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c4c620 con 0x5640a6c48d70 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c4c9c0 con 0x5640a6c48d70 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c4d720 0x5640a6c4fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c500d0 con 0x5640a6c4d720 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.873+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c4d720 0x5640a6c4fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb83ecd640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c4d720 0x5640a6c4fb10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb87936800 20 searching for the correct realm 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5640a6c520a0 0x5640a6c54560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5640a6c520a0 0x5640a6c54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.874+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5640a6c520a0 0x5640a6c54560 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb836cc640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb74017050 0x7fcb740163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb74017050 0x7fcb740163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb7bfff640 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb74017050 0x7fcb740163b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.875+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.876+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.877+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.878+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.879+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.880+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.881+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.882+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c520a0 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x5640a6c48d70 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.883+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c54c30 con 0x7fcb74017050 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c50a90 con 0x5640a6c48d70 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c506d0 con 0x5640a6c48d70 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c51430 con 0x5640a6c48d70 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 zone default found 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 4 Realm: () 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 zonegroup default 2024-05-08T09:21:52.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.884+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c55110 con 0x5640a6c4d720 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c573e0 con 0x5640a6c520a0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c57780 con 0x5640a6c520a0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:52.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 started sync module instance, tier type = 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.885+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56820 con 0x7fcb74017050 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.886+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.887+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94835675852064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56820 con 0x7fcb74017050 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.887+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c58140 con 0x5640a6c48d70 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.887+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94835675852064] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.888+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.888+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94835675856496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56820 con 0x5640a6c48d70 2024-05-08T09:21:52.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.888+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c58bc0 con 0x5640a6c520a0 2024-05-08T09:21:52.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.889+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.889+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94835675858640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c59460 con 0x5640a6c520a0 2024-05-08T09:21:52.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.889+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c59f20 con 0x7fcb74017050 2024-05-08T09:21:52.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.890+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94835675856496] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.890+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94835675858640] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.890+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.890+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94835675860912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56370 con 0x7fcb74017050 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.890+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5a7c0 con 0x5640a6c48d70 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.891+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.891+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94835675865744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5abb0 con 0x5640a6c48d70 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.891+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5b690 con 0x5640a6c4d720 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.892+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94835675860912] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.892+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94835675865744] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.892+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.892+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94835675866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5b1a0 con 0x5640a6c4d720 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.892+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5bf60 con 0x5640a6c4d720 2024-05-08T09:21:52.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.893+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94835675866800] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.894+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.894+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94835675863536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5bee0 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.894+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5c980 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94835675863536] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94835675874384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5cb60 con 0x5640a6c4d720 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=0 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=1 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=2 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=3 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=4 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=5 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.895+0000 7fcb87936800 20 add_watcher() i=6 2024-05-08T09:21:52.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94835675874384] v27'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb87936800 20 add_watcher() i=7 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb87936800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5ff30 con 0x5640a6c48d70 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.896+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94835675875920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c5d320 con 0x5640a6c48d70 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.897+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94835675875920] v27'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.897+0000 7fca39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.897+0000 7fcb87936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.897+0000 7fcb87936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.897+0000 7fcb87936800 5 note: GC not initialized 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fca38fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:52.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 20 Filter name: none 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fc9b27fc640 20 reqs_thread_entry: start 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c932e0 con 0x5640a6c48d70 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.898+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c95260 con 0x7fcb74017050 2024-05-08T09:21:52.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 20 rados->read ofs=0 len=0 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c968f0 con 0x7fcb74017050 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:52.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.899+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c9b140 con 0x5640a6c4d720 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.901+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(65 fud.buckets [call] v27'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.901+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6ca1040 con 0x7fcb74017050 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb87936800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb87936800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb87936800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb87936800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.902+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94835676114864 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c9b570 con 0x5640a6c520a0 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94835675858640 notify 115964116997 ret 0) ==== 794+0+0 (crc 0 0 0) 0x5640a6c10790 con 0x5640a6c520a0 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94835676114864 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fca667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116997 cookie 94835675858640 notifier 4513 bl.length()=752 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fca667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fca667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fca667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fca667fc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc9b8003530 con 0x5640a6c520a0 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94835676114864 notify 115964116997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640a6c0dae0 con 0x5640a6c520a0 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb87936800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb87936800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb87936800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb87936800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.903+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c9f860 con 0x7fcb74017050 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.904+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(69 foo.buckets [call] v27'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.904+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6ca0870 con 0x7fcb74017050 2024-05-08T09:21:52.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.905+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.905+0000 7fcb87936800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.905+0000 7fcb87936800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.905+0000 7fcb87936800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.905+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94835676114832 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c9fd10 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== watch-notify(notify (1) cookie 94835675863536 notify 115964117003 ret 0) ==== 356+0+0 (crc 0 0 0) 0x5640a6c3d7c0 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fca667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94835675863536 notifier 4513 bl.length()=314 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fca667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.6 [notify cookie 94835676114832 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fca667fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fca667fc640 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fc9b8003560 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.906+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify_complete (2) cookie 94835676114832 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5640a6c366d0 con 0x5640a6c4d720 2024-05-08T09:21:52.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.907+0000 7fca39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.907+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94835675875920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c97b40 con 0x5640a6c48d70 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.908+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94835675875920] v27'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.908+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94835675852064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c97b40 con 0x7fcb74017050 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.909+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94835675852064] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.909+0000 7fcb87936800 20 remove_watcher() i=0 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.909+0000 7fcb87936800 2 removed watcher, disabling cache 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.909+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94835675856496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56d20 con 0x5640a6c48d70 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.910+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94835675856496] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.910+0000 7fcb87936800 20 remove_watcher() i=1 2024-05-08T09:21:52.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.910+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94835675858640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56d20 con 0x5640a6c520a0 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.911+0000 7fcb836cc640 1 -- 172.21.15.161:0/2574794651 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94835675858640] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7402b070 con 0x5640a6c520a0 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.911+0000 7fcb87936800 20 remove_watcher() i=2 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.911+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94835675860912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56d20 con 0x7fcb74017050 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.912+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94835675860912] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x7fcb74017050 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.912+0000 7fcb87936800 20 remove_watcher() i=3 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.912+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94835675865744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c58fb0 con 0x5640a6c48d70 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.913+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94835675865744] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb6c05a040 con 0x5640a6c48d70 2024-05-08T09:21:52.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.913+0000 7fcb87936800 20 remove_watcher() i=4 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.913+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94835675866800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56d20 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.914+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94835675866800] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.914+0000 7fcb87936800 20 remove_watcher() i=5 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.914+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94835675863536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c58fb0 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.915+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94835675863536] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.915+0000 7fcb87936800 20 remove_watcher() i=6 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.915+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94835675874384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5640a6c56d20 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb83ecd640 1 -- 172.21.15.161:0/2574794651 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94835675874384] v27'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb7c02a070 con 0x5640a6c4d720 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 20 remove_watcher() i=7 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c4d720 msgr2=0x5640a6c4fb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c4d720 0x5640a6c4fb10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6c48d70 msgr2=0x5640a6c4b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6c48d70 0x5640a6c4b230 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb74017050 msgr2=0x7fcb740163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb74017050 0x7fcb740163b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5640a6c520a0 msgr2=0x5640a6c54560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5640a6c520a0 0x5640a6c54560 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca4c036950 msgr2=0x7fca4c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca4c036950 0x7fca4c038e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400bc10 tx=0x7fcb74031040 comp rx=0 tx=0).stop 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 msgr2=0x5640a6c3d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb7bfff640 1 -- 172.21.15.161:0/2574794651 reap_dead start 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c040040 tx=0x7fcb7c04c8e0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 shutdown_connections 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/2574794651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c35ce0 0x5640a6c3d280 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 >> 172.21.15.161:0/2574794651 conn(0x5640a6c32040 msgr2=0x5640a6c2f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 shutdown_connections 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/2574794651 wait complete. 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 msgr2=0x7fca5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 0x7fca5c038e10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5640a6c14f50 tx=0x7fcb7400b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 msgr2=0x5640a6c28ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x5640a6c14e90 tx=0x7fcb7c018830 comp rx=0 tx=0).stop 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 shutdown_connections 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca5c036950 0x7fca5c038e10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 --2- 172.21.15.161:0/695234572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6c28ab0 0x5640a6c28ed0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 >> 172.21.15.161:0/695234572 conn(0x5640a6c1cb50 msgr2=0x5640a6c1cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 shutdown_connections 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.916+0000 7fcb87936800 1 -- 172.21.15.161:0/695234572 wait complete. 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 msgr2=0x5640a6c19220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 0x5640a6c19220 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 msgr2=0x5640a6c14550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 0x5640a6c14550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 msgr2=0x7fca68038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 0x7fca68038e10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c054000 tx=0x7fcb6c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 msgr2=0x5640a6c0d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400c010 tx=0x7fcb74000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 shutdown_connections 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5640a6c16e30 0x5640a6c19220 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5640a6b18690 0x5640a6c14550 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca68036950 0x7fca68038e10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 --2- 172.21.15.161:0/88612945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640a6b14b80 0x5640a6c0d310 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 >> 172.21.15.161:0/88612945 conn(0x5640a6b0e5d0 msgr2=0x5640a6bff910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 shutdown_connections 2024-05-08T09:21:52.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.917+0000 7fcb87936800 1 -- 172.21.15.161:0/88612945 wait complete. 2024-05-08T09:21:52.927 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:52.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-05-08T09:21:52.928 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-05-08T09:21:52.977 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:52.977 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.978+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f0427c10800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5623244b23c0 0x5623244b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f0427c10800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5623244b2e10 con 0x5623244b53b0 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f0427c10800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x562324345050 con 0x5623244b23c0 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f04233b9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5623244b23c0 0x5623244b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f041bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5623244b53b0 0x5623244b5860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43048/0 (socket says 172.21.15.161:43048) 2024-05-08T09:21:52.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f041bfff640 1 -- 172.21.15.161:0/2931845079 learned_addr learned my addr 172.21.15.161:0/2931845079 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:52.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f04233b9640 1 -- 172.21.15.161:0/2931845079 >> v1:172.21.15.45:6789/0 conn(0x5623244b53b0 legacy=0x5623244b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f0422bb8640 1 -- 172.21.15.161:0/2931845079 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193377699 0 0) 0x5623244b2e10 con 0x5623244b53b0 2024-05-08T09:21:52.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.979+0000 7f04233b9640 1 -- 172.21.15.161:0/2931845079 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623244b5f70 con 0x5623244b23c0 2024-05-08T09:21:52.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.981+0000 7f04233b9640 1 --2- 172.21.15.161:0/2931845079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623244b27e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0414005fd0 tx=0x7f041401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408c55867855938a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0422bb8640 1 -- 172.21.15.161:0/2931845079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414052560 con 0x5623244b23c0 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0422bb8640 1 -- 172.21.15.161:0/2931845079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414052700 con 0x5623244b23c0 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0422bb8640 1 -- 172.21.15.161:0/2931845079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414052a20 con 0x5623244b23c0 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 -- 172.21.15.161:0/2931845079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 msgr2=0x5623244b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 --2- 172.21.15.161:0/2931845079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623244b27e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0414005fd0 tx=0x7f041401ccc0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 -- 172.21.15.161:0/2931845079 shutdown_connections 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 --2- 172.21.15.161:0/2931845079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623244b27e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 -- 172.21.15.161:0/2931845079 >> 172.21.15.161:0/2931845079 conn(0x5623244add30 msgr2=0x5623244b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 -- 172.21.15.161:0/2931845079 shutdown_connections 2024-05-08T09:21:52.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.982+0000 7f0427c10800 1 -- 172.21.15.161:0/2931845079 wait complete. 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f0427c10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f0427c10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5623243ff1d0 con 0x5623244b23c0 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f04233b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f04233b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53758/0 (socket says 172.21.15.161:53758) 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.996+0000 7f04233b9640 1 -- 172.21.15.161:0/1071326051 learned_addr learned my addr 172.21.15.161:0/1071326051 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:52.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.997+0000 7f04233b9640 1 -- 172.21.15.161:0/1071326051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623245a5b10 con 0x5623244b23c0 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.997+0000 7f04233b9640 1 --2- 172.21.15.161:0/1071326051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0414007000 tx=0x7f041404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b86e7c05dcd2a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.997+0000 7f031160a640 1 -- 172.21.15.161:0/1071326051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04140528b0 con 0x5623244b23c0 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.997+0000 7f031160a640 1 -- 172.21.15.161:0/1071326051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0414052c10 con 0x5623244b23c0 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.997+0000 7f031160a640 1 -- 172.21.15.161:0/1071326051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041405c430 con 0x5623244b23c0 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- 172.21.15.161:0/1071326051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 msgr2=0x5623245a5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 --2- 172.21.15.161:0/1071326051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0414007000 tx=0x7f041404c000 comp rx=0 tx=0).stop 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- 172.21.15.161:0/1071326051 shutdown_connections 2024-05-08T09:21:52.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 --2- 172.21.15.161:0/1071326051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245a5540 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- 172.21.15.161:0/1071326051 >> 172.21.15.161:0/1071326051 conn(0x5623244add30 msgr2=0x5623245a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- 172.21.15.161:0/1071326051 shutdown_connections 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- 172.21.15.161:0/1071326051 wait complete. 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.998+0000 7f0427c10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5623244bd880 con 0x5623244b23c0 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f04233b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f04233b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53760/0 (socket says 172.21.15.161:53760) 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f04233b9640 1 -- 172.21.15.161:0/399823409 learned_addr learned my addr 172.21.15.161:0/399823409 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f04233b9640 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623245ad630 con 0x5623244b23c0 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f04233b9640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0414000f80 tx=0x7f0414003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f030fe07640 1 -- 172.21.15.161:0/399823409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0414073020 con 0x5623244b23c0 2024-05-08T09:21:53.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f030fe07640 1 -- 172.21.15.161:0/399823409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04140529e0 con 0x5623244b23c0 2024-05-08T09:21:53.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f030fe07640 1 -- 172.21.15.161:0/399823409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041406f520 con 0x5623244b23c0 2024-05-08T09:21:53.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:52.999+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623245ad8c0 con 0x5623244b23c0 2024-05-08T09:21:53.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.000+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623245b0570 con 0x5623244b23c0 2024-05-08T09:21:53.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.000+0000 7f030fe07640 1 -- 172.21.15.161:0/399823409 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f041406f6c0 con 0x5623244b23c0 2024-05-08T09:21:53.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.000+0000 7f030fe07640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 0x7f0308038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.000+0000 7f030fe07640 1 -- 172.21.15.161:0/399823409 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f041406c050 con 0x5623244b23c0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f041bfff640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 0x7f0308038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 0x5623245b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245b48b0 con 0x5623244b53b0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0423bba640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 0x5623245b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f041bfff640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 0x7f0308038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c0013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0423bba640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 0x5623245b4330 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0423bba640 1 -- 172.21.15.161:0/399823409 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f041c0083e0 con 0x5623244b53b0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.001+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245b18c0 con 0x5623244b53b0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.002+0000 7f0423bba640 1 -- 172.21.15.161:0/399823409 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f041c0083e0 con 0x5623244b53b0 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.002+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 0x5623245b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.005 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.002+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245b96a0 con 0x5623245b6be0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.002+0000 7f04233b9640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 0x5623245b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.002+0000 7f04233b9640 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 0x5623245b8fd0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.003+0000 7f04233b9640 1 -- 172.21.15.161:0/399823409 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0414075020 con 0x5623245b6be0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.003+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245b5b90 con 0x5623244b53b0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.003+0000 7f0423bba640 1 -- 172.21.15.161:0/399823409 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f041c0083e0 con 0x5623244b53b0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.003+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245b6070 con 0x5623244b53b0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0423bba640 1 -- 172.21.15.161:0/399823409 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f041c0083e0 con 0x5623244b53b0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0427c10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0427c10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5623243a5cf0 con 0x5623245c8770 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.006 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53766/0 (socket says 172.21.15.161:53766) 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.004+0000 7f0423bba640 1 -- 172.21.15.161:0/2577167299 learned_addr learned my addr 172.21.15.161:0/2577167299 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f0423bba640 1 -- 172.21.15.161:0/2577167299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623245c90d0 con 0x5623245c8770 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f0423bba640 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5623245ae310 tx=0x7f041c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f030d602640 1 -- 172.21.15.161:0/2577167299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c007d00 con 0x5623245c8770 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f030d602640 1 -- 172.21.15.161:0/2577167299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c01e020 con 0x5623245c8770 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f030d602640 1 -- 172.21.15.161:0/2577167299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c019420 con 0x5623245c8770 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623245c9b40 con 0x5623245c8770 2024-05-08T09:21:53.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.005+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623245ca040 con 0x5623245c8770 2024-05-08T09:21:53.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f030d602640 1 -- 172.21.15.161:0/2577167299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f041c016040 con 0x5623245c8770 2024-05-08T09:21:53.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f030d602640 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 0x7f02fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f030d602640 1 -- 172.21.15.161:0/2577167299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f041c01f030 con 0x5623245c8770 2024-05-08T09:21:53.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f04233b9640 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 0x7f02fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.006+0000 7f04233b9640 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 0x7f02fc038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5623245b4d10 tx=0x7f0414077a10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0427c10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0427c10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5623245a5e30 con 0x5623245d5ad0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53776/0 (socket says 172.21.15.161:53776) 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0423bba640 1 -- 172.21.15.161:0/1812487047 learned_addr learned my addr 172.21.15.161:0/1812487047 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0423bba640 1 -- 172.21.15.161:0/1812487047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623245d64c0 con 0x5623245d5ad0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0423bba640 1 --2- 172.21.15.161:0/1812487047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f041c04cb80 tx=0x7f041c017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fc8a5cdfcef5b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0306ffd640 1 -- 172.21.15.161:0/1812487047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c044070 con 0x5623245d5ad0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0306ffd640 1 -- 172.21.15.161:0/1812487047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c03f030 con 0x5623245d5ad0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.007+0000 7f0306ffd640 1 -- 172.21.15.161:0/1812487047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c01d040 con 0x5623245d5ad0 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- 172.21.15.161:0/1812487047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 msgr2=0x5623245d5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 --2- 172.21.15.161:0/1812487047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f041c04cb80 tx=0x7f041c017fa0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- 172.21.15.161:0/1812487047 shutdown_connections 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 --2- 172.21.15.161:0/1812487047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245d5ef0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- 172.21.15.161:0/1812487047 >> 172.21.15.161:0/1812487047 conn(0x5623245d1d50 msgr2=0x5623245cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- 172.21.15.161:0/1812487047 shutdown_connections 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- 172.21.15.161:0/1812487047 wait complete. 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 Processor -- start 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- start start 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.008+0000 7f0427c10800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5623245d6bf0 con 0x5623245d5ad0 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0423bba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53792/0 (socket says 172.21.15.161:53792) 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 learned_addr learned my addr 172.21.15.161:0/3460774455 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.018 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623245dd570 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0423bba640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f041c017930 tx=0x7f041c04cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f03057fa640 1 -- 172.21.15.161:0/3460774455 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c044030 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f03057fa640 1 -- 172.21.15.161:0/3460774455 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f041c04e110 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.009+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5623245dd800 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f03057fa640 1 -- 172.21.15.161:0/3460774455 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f041c01d040 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623245e04b0 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f03057fa640 1 -- 172.21.15.161:0/3460774455 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f041c04e3f0 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f03057fa640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02ec036950 0x7f02ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f03057fa640 1 -- 172.21.15.161:0/3460774455 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f041c045070 con 0x5623245d5ad0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.010+0000 7f04233b9640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02ec036950 0x7f02ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.011+0000 7f04233b9640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02ec036950 0x7f02ec038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0414051fd0 tx=0x7f041408f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.011+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.011+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623245e8ad0 0x5623245eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.011+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245eb6e0 con 0x5623245e8ad0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.011+0000 7f041bfff640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623245e8ad0 0x5623245eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f041bfff640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623245e8ad0 0x5623245eaf90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c00f5f0 con 0x5623245e8ad0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 realm 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245e7f20 con 0x5623245e8ad0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c00f5f0 con 0x5623245e8ad0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245ec1d0 con 0x5623245e8ad0 2024-05-08T09:21:53.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c00f5f0 con 0x5623245e8ad0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.012+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245ecaa0 con 0x5623245e8ad0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f040c00f5f0 con 0x5623245e8ad0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0427c10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245ed4c0 0x5623245ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f0020 con 0x5623245ed4c0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0423bba640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245ed4c0 0x5623245ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.013+0000 7f0423bba640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245ed4c0 0x5623245ef8b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f0427c10800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f0427c10800 20 searching for the correct realm 2024-05-08T09:21:53.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5623245f1fd0 0x5623245f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f04233b9640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5623245f1fd0 0x5623245f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.014+0000 7f04233b9640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5623245f1fd0 0x5623245f4490 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f04233b9640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0414078060 0x7f041408c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f041bfff640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0414078060 0x7f041408c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f041bfff640 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0414078060 0x7f041408c2d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c00f5f0 con 0x7f0414078060 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.015+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c00f5f0 con 0x5623245e8ad0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.016+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x7f0414078060 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.017+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f040c02b040 con 0x7f0414078060 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.018+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.019+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.020+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x7f0414078060 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.021+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x7f0414078060 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245f1fd0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.022+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245ed4c0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x5623245e8ad0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4b60 con 0x7f0414078060 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f040c02b040 con 0x7f0414078060 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f09e0 con 0x5623245e8ad0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f040c02b040 con 0x5623245e8ad0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.023+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f05f0 con 0x5623245e8ad0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f1310 con 0x5623245e8ad0 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 zone default found 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 4 Realm: () 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 zonegroup default 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f4fe0 con 0x5623245ed4c0 2024-05-08T09:21:53.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.024+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f7260 con 0x5623245f1fd0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245f7600 con 0x5623245f1fd0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 20 started sync module instance, tier type = 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.025+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f66f0 con 0x7f0414078060 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.026+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.026+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94708934077424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f66f0 con 0x7f0414078060 2024-05-08T09:21:53.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.026+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f7fc0 con 0x5623245e8ad0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.027+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94708934077424] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.027+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.027+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94708934081776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f66f0 con 0x5623245e8ad0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.027+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f8a50 con 0x5623245f1fd0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.028+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.028+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94708934083872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f92f0 con 0x5623245f1fd0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.028+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f9db0 con 0x7f0414078060 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.028+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94708934081776] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.029+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94708934083872] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.029+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.029+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94708934086208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f6240 con 0x7f0414078060 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.029+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fa650 con 0x5623245e8ad0 2024-05-08T09:21:53.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.030+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.030+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94708934091008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245faa80 con 0x5623245e8ad0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.030+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94708934086208] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.030+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f9880 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.031+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94708934091008] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.031+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.031+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94708934092064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f9880 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.031+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fbb10 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.032+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.032+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94708934096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fbf30 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.032+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fca30 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.032+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94708934092064] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94708934096480] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94708934100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fbac0 con 0x5623245ed4c0 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=0 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=1 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=2 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=3 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=4 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=5 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.033+0000 7f0427c10800 20 add_watcher() i=6 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.034+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94708934100256] v27'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.034+0000 7f0427c10800 20 add_watcher() i=7 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.034+0000 7f0427c10800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.034+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5623245ffb30 con 0x5623245e8ad0 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.035+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.035+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94708934094912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245fcfb0 con 0x5623245e8ad0 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.036+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94708934094912] v27'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.036+0000 7f02d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.036+0000 7f0427c10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.036+0000 7f0427c10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.036+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623246082a0 con 0x5623245e8ad0 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.037+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.037+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324608970 con 0x5623245ed4c0 2024-05-08T09:21:53.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.038+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.038+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324608970 con 0x5623245f1fd0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.039+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.039+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324609410 con 0x5623245e8ad0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.040+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'122 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.040+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623246060e0 con 0x7f0414078060 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.041+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.041+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623246060e0 con 0x5623245f1fd0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.042+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.042+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a250 con 0x5623245e8ad0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.043+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.043+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a230 con 0x5623245ed4c0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.044+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.044+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a230 con 0x7f0414078060 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.046+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.046+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a230 con 0x5623245f1fd0 2024-05-08T09:21:53.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.047+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.047+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a230 con 0x7f0414078060 2024-05-08T09:21:53.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.047+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.047+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a230 con 0x5623245ed4c0 2024-05-08T09:21:53.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.049+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.049+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x7f0414078060 2024-05-08T09:21:53.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.050+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.050+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245ed4c0 2024-05-08T09:21:53.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.051+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'29 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.051+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245e8ad0 2024-05-08T09:21:53.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.052+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.052+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.053+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'29 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.053+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x7f0414078060 2024-05-08T09:21:53.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.054+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.054+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.055+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.055+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245e8ad0 2024-05-08T09:21:53.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.056+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.056+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245e8ad0 2024-05-08T09:21:53.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.057+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.057+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.058+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'30 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.058+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x7f0414078060 2024-05-08T09:21:53.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.059+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.059+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.060+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.060+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.061+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.061+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.062+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.062+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.063+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.063+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245ed4c0 2024-05-08T09:21:53.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.064+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.064+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.065+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.065+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245ed4c0 2024-05-08T09:21:53.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.066+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.066+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245f1fd0 2024-05-08T09:21:53.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.067+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.067+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x5623245ed4c0 2024-05-08T09:21:53.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.068+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'30 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.068+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56232460a300 con 0x7f0414078060 2024-05-08T09:21:53.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.069+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f02d8fe1640 20 reqs_thread_entry: start 2024-05-08T09:21:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 20 Filter name: none 2024-05-08T09:21:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f02527fc640 20 reqs_thread_entry: start 2024-05-08T09:21:53.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562324635580 con 0x5623245ed4c0 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.070+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562324637e40 con 0x5623245ed4c0 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.071+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.071+0000 7f0427c10800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T09:21:53.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.071+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324635e20 con 0x5623245ed4c0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f0427c10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94708934338784 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562324638480 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== watch-notify(notify (1) cookie 94708934083872 notify 115964116998 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562324608260 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f0306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116998 cookie 94708934083872 notifier 4520 bl.length()=170 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(97 notify.2 [notify cookie 94708934338784 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f0306ffd640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f02e8003d60 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.072+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.073+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== watch-notify(notify_complete (2) cookie 94708934338784 notify 115964116998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5623245dd800 con 0x5623245f1fd0 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.073+0000 7f0427c10800 10 removing email index: 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.073+0000 7f0427c10800 10 removing user buckets index 2024-05-08T09:21:53.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.073+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245ed4c0 2024-05-08T09:21:53.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(99 fud.buckets [delete] v27'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f0427c10800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94708934344368 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== watch-notify(notify (1) cookie 94708934096480 notify 115964117004 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562324606480 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f03067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94708934096480 notifier 4520 bl.length()=160 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f03067fc640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f02580032c0 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.074+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(100 notify.6 [notify cookie 94708934344368 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.075+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.075+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== watch-notify(notify_complete (2) cookie 94708934344368 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5623245dd570 con 0x5623245ed4c0 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.075+0000 7f0427c10800 10 removing user index: fud 2024-05-08T09:21:53.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.075+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245ed4c0 2024-05-08T09:21:53.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(102 fud [call,call,delete] v27'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0427c10800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T09:21:53.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0427c10800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94708934344368 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== watch-notify(notify (1) cookie 94708934092064 notify 115964117005 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5623245dd570 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94708934092064 notifier 4520 bl.length()=152 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.076+0000 7f0306ffd640 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f02e8003d60 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.077+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(103 notify.5 [notify cookie 94708934344368 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.077+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.077+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== watch-notify(notify_complete (2) cookie 94708934344368 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5623245d64c0 con 0x5623245ed4c0 2024-05-08T09:21:53.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.078+0000 7f02d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.078+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94708934094912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245e8ad0 2024-05-08T09:21:53.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.079+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94708934094912] v27'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.079+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94708934077424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x7f0414078060 2024-05-08T09:21:53.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.080+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94708934077424] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.080+0000 7f0427c10800 20 remove_watcher() i=0 2024-05-08T09:21:53.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.080+0000 7f0427c10800 2 removed watcher, disabling cache 2024-05-08T09:21:53.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.080+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94708934081776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245e8ad0 2024-05-08T09:21:53.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.081+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94708934081776] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.081+0000 7f0427c10800 20 remove_watcher() i=1 2024-05-08T09:21:53.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.081+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94708934083872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x562324638400 con 0x5623245f1fd0 2024-05-08T09:21:53.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.082+0000 7f04233b9640 1 -- 172.21.15.161:0/3460774455 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94708934083872] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0414075020 con 0x5623245f1fd0 2024-05-08T09:21:53.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.082+0000 7f0427c10800 20 remove_watcher() i=2 2024-05-08T09:21:53.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.082+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94708934086208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f6bf0 con 0x7f0414078060 2024-05-08T09:21:53.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.083+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94708934086208] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x7f0414078060 2024-05-08T09:21:53.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.083+0000 7f0427c10800 20 remove_watcher() i=3 2024-05-08T09:21:53.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.083+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94708934091008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f7cf0 con 0x5623245e8ad0 2024-05-08T09:21:53.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.084+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94708934091008] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f040c03d040 con 0x5623245e8ad0 2024-05-08T09:21:53.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.084+0000 7f0427c10800 20 remove_watcher() i=4 2024-05-08T09:21:53.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.084+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94708934092064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f8520 con 0x5623245ed4c0 2024-05-08T09:21:53.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.085+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94708934092064] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.085+0000 7f0427c10800 20 remove_watcher() i=5 2024-05-08T09:21:53.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.085+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94708934096480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f6bf0 con 0x5623245ed4c0 2024-05-08T09:21:53.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.086+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94708934096480] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.086+0000 7f0427c10800 20 remove_watcher() i=6 2024-05-08T09:21:53.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.086+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94708934100256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5623245f7cf0 con 0x5623245ed4c0 2024-05-08T09:21:53.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0423bba640 1 -- 172.21.15.161:0/3460774455 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94708934100256] v27'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f041c02a070 con 0x5623245ed4c0 2024-05-08T09:21:53.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 20 remove_watcher() i=7 2024-05-08T09:21:53.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245ed4c0 msgr2=0x5623245ef8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245ed4c0 0x5623245ef8b0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623245e8ad0 msgr2=0x5623245eaf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623245e8ad0 0x5623245eaf90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0414078060 msgr2=0x7f041408c2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0414078060 0x7f041408c2d0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5623245f1fd0 msgr2=0x5623245f4490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5623245f1fd0 0x5623245f4490 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02ec036950 msgr2=0x7f02ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02ec036950 0x7f02ec038e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0414051fd0 tx=0x7f041408f000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f041bfff640 1 -- 172.21.15.161:0/3460774455 reap_dead start 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 msgr2=0x5623245dd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f041c017930 tx=0x7f041c04cb10 comp rx=0 tx=0).stop 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 shutdown_connections 2024-05-08T09:21:53.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/3460774455 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245d5ad0 0x5623245dd030 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 >> 172.21.15.161:0/3460774455 conn(0x5623245d1d50 msgr2=0x5623245cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 shutdown_connections 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/3460774455 wait complete. 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 msgr2=0x7f02fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 0x7f02fc038e10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x5623245b4d10 tx=0x7f0414077a10 comp rx=0 tx=0).stop 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 msgr2=0x5623245c8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x5623245ae310 tx=0x7f041c00aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 shutdown_connections 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f02fc036950 0x7f02fc038e10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 --2- 172.21.15.161:0/2577167299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623245c8770 0x5623245c8b90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 >> 172.21.15.161:0/2577167299 conn(0x5623245bc880 msgr2=0x5623245bcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 shutdown_connections 2024-05-08T09:21:53.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.087+0000 7f0427c10800 1 -- 172.21.15.161:0/2577167299 wait complete. 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 msgr2=0x5623245b8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 0x5623245b8fd0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 msgr2=0x5623245b4330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 0x5623245b4330 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 msgr2=0x7f0308038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 0x7f0308038e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f040c000c00 tx=0x7f040c0013b0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 msgr2=0x5623245ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0414000f80 tx=0x7f0414003330 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 shutdown_connections 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5623245b6be0 0x5623245b8fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5623244b53b0 0x5623245b4330 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0308036950 0x7f0308038e10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 --2- 172.21.15.161:0/399823409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5623244b23c0 0x5623245ad0f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 >> 172.21.15.161:0/399823409 conn(0x5623244add30 msgr2=0x56232459f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 shutdown_connections 2024-05-08T09:21:53.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.088+0000 7f0427c10800 1 -- 172.21.15.161:0/399823409 wait complete. 2024-05-08T09:21:53.096 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T09:21:53.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-05-08T09:21:53.096 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-05-08T09:21:53.150 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.150 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa64123f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5577a2098b00 0x5577a209aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa64123f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5577a209ef40 con 0x5577a209b430 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa64123f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5577a1f29050 con 0x5577a2098b00 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa63ed3e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5577a2098b00 0x5577a209aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa63ed3e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5577a2098b00 0x5577a209aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53808/0 (socket says 172.21.15.161:53808) 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.152+0000 7fa63ed3e640 1 -- 172.21.15.161:0/2315826803 learned_addr learned my addr 172.21.15.161:0/2315826803 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.153+0000 7fa63ed3e640 1 -- 172.21.15.161:0/2315826803 >> v1:172.21.15.45:6789/0 conn(0x5577a209b430 legacy=0x5577a209d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T09:21:53.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.153+0000 7fa63ed3e640 1 -- 172.21.15.161:0/2315826803 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a20a0120 con 0x5577a2098b00 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/2315826803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a209aef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa63000a520 tx=0x7fa63001cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1057498f652b57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa63e53d640 1 -- 172.21.15.161:0/2315826803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630057070 con 0x5577a2098b00 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa63e53d640 1 -- 172.21.15.161:0/2315826803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa630052570 con 0x5577a2098b00 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa63e53d640 1 -- 172.21.15.161:0/2315826803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630052870 con 0x5577a2098b00 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 -- 172.21.15.161:0/2315826803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 msgr2=0x5577a209aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 --2- 172.21.15.161:0/2315826803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a209aef0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa63000a520 tx=0x7fa63001cf70 comp rx=0 tx=0).stop 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 -- 172.21.15.161:0/2315826803 shutdown_connections 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 --2- 172.21.15.161:0/2315826803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a209aef0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 -- 172.21.15.161:0/2315826803 >> 172.21.15.161:0/2315826803 conn(0x5577a2092550 msgr2=0x5577a2094970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 -- 172.21.15.161:0/2315826803 shutdown_connections 2024-05-08T09:21:53.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.155+0000 7fa64123f800 1 -- 172.21.15.161:0/2315826803 wait complete. 2024-05-08T09:21:53.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.169+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.169+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.169+0000 7fa64123f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa64123f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5577a1fe3170 con 0x5577a2098b00 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa63ed3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa63ed3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53820/0 (socket says 172.21.15.161:53820) 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa63ed3e640 1 -- 172.21.15.161:0/641939196 learned_addr learned my addr 172.21.15.161:0/641939196 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa63ed3e640 1 -- 172.21.15.161:0/641939196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a2189d90 con 0x5577a2098b00 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/641939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa630055040 tx=0x7fa63004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c71022d4cf58b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa52ce09640 1 -- 172.21.15.161:0/641939196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630057040 con 0x5577a2098b00 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa52ce09640 1 -- 172.21.15.161:0/641939196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa630052850 con 0x5577a2098b00 2024-05-08T09:21:53.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.170+0000 7fa52ce09640 1 -- 172.21.15.161:0/641939196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630052b50 con 0x5577a2098b00 2024-05-08T09:21:53.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 -- 172.21.15.161:0/641939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 msgr2=0x5577a21897c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 --2- 172.21.15.161:0/641939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa630055040 tx=0x7fa63004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 -- 172.21.15.161:0/641939196 shutdown_connections 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 --2- 172.21.15.161:0/641939196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a21897c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 -- 172.21.15.161:0/641939196 >> 172.21.15.161:0/641939196 conn(0x5577a2092550 msgr2=0x5577a21850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 -- 172.21.15.161:0/641939196 shutdown_connections 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.171+0000 7fa64123f800 1 -- 172.21.15.161:0/641939196 wait complete. 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa64123f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa64123f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5577a209f410 con 0x5577a2098b00 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa63ed3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa63ed3e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53822/0 (socket says 172.21.15.161:53822) 2024-05-08T09:21:53.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa63ed3e640 1 -- 172.21.15.161:0/3150674984 learned_addr learned my addr 172.21.15.161:0/3150674984 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.172+0000 7fa63ed3e640 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a2096b30 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa630052540 tx=0x7fa630003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa52b606640 1 -- 172.21.15.161:0/3150674984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630073070 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa52b606640 1 -- 172.21.15.161:0/3150674984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63005d570 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa52b606640 1 -- 172.21.15.161:0/3150674984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa630057070 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577a2096dc0 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a20972e0 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.173+0000 7fa52b606640 1 -- 172.21.15.161:0/3150674984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa630076070 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa52b606640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 0x7fa524038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa52b606640 1 -- 172.21.15.161:0/3150674984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa63008de40 con 0x5577a2098b00 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa637fff640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 0x7fa524038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 0x5577a219a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a219ac10 con 0x5577a209b430 2024-05-08T09:21:53.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa63f53f640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 0x5577a219a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa637fff640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 0x7fa524038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa62800a430 tx=0x7fa628005540 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.174+0000 7fa63f53f640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 0x5577a219a640 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa63f53f640 1 -- 172.21.15.161:0/3150674984 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa63800a4a0 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a219b500 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa63f53f640 1 -- 172.21.15.161:0/3150674984 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa63800a4a0 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 0x5577a219f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a219fb50 con 0x5577a219cf30 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 0x5577a219f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.175+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 0x5577a219f3c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.176+0000 7fa63ed3e640 1 -- 172.21.15.161:0/3150674984 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa630075030 con 0x5577a219cf30 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.176+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a219bd80 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.176+0000 7fa63f53f640 1 -- 172.21.15.161:0/3150674984 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa63800a4a0 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.176+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a219c260 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.176+0000 7fa63f53f640 1 -- 172.21.15.161:0/3150674984 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa63800a4a0 con 0x5577a209b430 2024-05-08T09:21:53.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa64123f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa64123f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5577a2098980 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53836/0 (socket says 172.21.15.161:53836) 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa63f53f640 1 -- 172.21.15.161:0/1801044399 learned_addr learned my addr 172.21.15.161:0/1801044399 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa63f53f640 1 -- 172.21.15.161:0/1801044399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a21af660 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.177+0000 7fa63f53f640 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5577a219afd0 tx=0x7fa638018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa528e01640 1 -- 172.21.15.161:0/1801044399 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa638014450 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa528e01640 1 -- 172.21.15.161:0/1801044399 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6380145f0 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa528e01640 1 -- 172.21.15.161:0/1801044399 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6380148d0 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577a21b00d0 con 0x5577a21aed00 2024-05-08T09:21:53.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a21b05d0 con 0x5577a21aed00 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.178+0000 7fa528e01640 1 -- 172.21.15.161:0/1801044399 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa638011040 con 0x5577a21aed00 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa528e01640 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 0x7fa518038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa528e01640 1 -- 172.21.15.161:0/1801044399 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa63801e070 con 0x5577a21aed00 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 0x7fa518038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 0x7fa518038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5577a20978a0 tx=0x7fa6300069f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa64123f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa64123f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5577a1f89cf0 con 0x5577a21bbfb0 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53838/0 (socket says 172.21.15.161:53838) 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.179+0000 7fa63f53f640 1 -- 172.21.15.161:0/1751230977 learned_addr learned my addr 172.21.15.161:0/1751230977 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa63f53f640 1 -- 172.21.15.161:0/1751230977 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a21bc9a0 con 0x5577a21bbfb0 2024-05-08T09:21:53.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa63f53f640 1 --2- 172.21.15.161:0/1751230977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa638011b60 tx=0x7fa63804cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66da99eb97f5b252 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa5227fc640 1 -- 172.21.15.161:0/1751230977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6380168f0 con 0x5577a21bbfb0 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa5227fc640 1 -- 172.21.15.161:0/1751230977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa638013c50 con 0x5577a21bbfb0 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa5227fc640 1 -- 172.21.15.161:0/1751230977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63803bbe0 con 0x5577a21bbfb0 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 -- 172.21.15.161:0/1751230977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 msgr2=0x5577a21bc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 --2- 172.21.15.161:0/1751230977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa638011b60 tx=0x7fa63804cc40 comp rx=0 tx=0).stop 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 -- 172.21.15.161:0/1751230977 shutdown_connections 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 --2- 172.21.15.161:0/1751230977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21bc3d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 -- 172.21.15.161:0/1751230977 >> 172.21.15.161:0/1751230977 conn(0x5577a21b8310 msgr2=0x5577a21b6370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 -- 172.21.15.161:0/1751230977 shutdown_connections 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.180+0000 7fa64123f800 1 -- 172.21.15.161:0/1751230977 wait complete. 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa64123f800 1 Processor -- start 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa64123f800 1 -- start start 2024-05-08T09:21:53.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa64123f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa64123f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5577a21bcf30 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa63f53f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53846/0 (socket says 172.21.15.161:53846) 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 learned_addr learned my addr 172.21.15.161:0/172605923 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577a21c38b0 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.181+0000 7fa63f53f640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21c3370 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa63804b860 tx=0x7fa63804c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa520ff9640 1 -- 172.21.15.161:0/172605923 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63804e0c0 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa520ff9640 1 -- 172.21.15.161:0/172605923 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa63804e260 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5577a21c3b40 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa520ff9640 1 -- 172.21.15.161:0/172605923 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa63804b1f0 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577a21c67f0 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.182+0000 7fa520ff9640 1 -- 172.21.15.161:0/172605923 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa63804b390 con 0x5577a21bbfb0 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa520ff9640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa508036950 0x7fa508038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa520ff9640 1 -- 172.21.15.161:0/172605923 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa638046040 con 0x5577a21bbfb0 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa508036950 0x7fa508038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa508036950 0x7fa508038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa63008c230 tx=0x7fa630091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a21cf010 0x5577a21d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d1c20 con 0x5577a21cf010 2024-05-08T09:21:53.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.183+0000 7fa637fff640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a21cf010 0x5577a21d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa637fff640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a21cf010 0x5577a21d14d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa62800b8f0 con 0x5577a21cf010 2024-05-08T09:21:53.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 realm 2024-05-08T09:21:53.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21ce440 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa62800b8f0 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d26f0 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa62800b8f0 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.184+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d2fc0 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa62800b8f0 con 0x5577a21cf010 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a21d39e0 0x5577a21d5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d6510 con 0x5577a21d39e0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa63f53f640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a21d39e0 0x5577a21d5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa63f53f640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a21d39e0 0x5577a21d5dd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 20 searching for the correct realm 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5577a21d84a0 0x5577a21da960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.185+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5577a21d84a0 0x5577a21da960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5577a21d84a0 0x5577a21da960 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa63ed3e640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa6300a4040 0x7fa630077a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.186+0000 7fa637fff640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa6300a4040 0x7fa630077a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.187+0000 7fa637fff640 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa6300a4040 0x7fa630077a70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.187+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa62800b8f0 con 0x7fa6300a4040 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.187+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.187+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.187+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.188+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x7fa6300a4040 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.189+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa628024040 con 0x7fa6300a4040 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.190+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.191+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x7fa6300a4040 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.192+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.193+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x7fa6300a4040 2024-05-08T09:21:53.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d84a0 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21d39e0 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.194+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x5577a21cf010 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dafe0 con 0x7fa6300a4040 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa628024040 con 0x7fa6300a4040 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d79f0 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.195+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d7260 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa628024040 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d69a0 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 zone default found 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 4 Realm: () 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 zonegroup default 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21d6e80 con 0x5577a21d39e0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.196+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dd820 con 0x5577a21d84a0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21ddbc0 con 0x5577a21d84a0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 20 started sync module instance, tier type = 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.197+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dccb0 con 0x7fa6300a4040 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.198+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x7fa6300a4040 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.198+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93972309332432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dccb0 con 0x7fa6300a4040 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.198+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21de5d0 con 0x5577a21cf010 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.199+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93972309332432] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x7fa6300a4040 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.199+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.199+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93972309336832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dccb0 con 0x5577a21cf010 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.199+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21df020 con 0x5577a21d84a0 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.200+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.200+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93972309338928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21df8f0 con 0x5577a21d84a0 2024-05-08T09:21:53.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.200+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e0390 con 0x7fa6300a4040 2024-05-08T09:21:53.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.201+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93972309336832] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.201+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x7fa6300a4040 2024-05-08T09:21:53.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.201+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93972309343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e0780 con 0x7fa6300a4040 2024-05-08T09:21:53.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.201+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e1180 con 0x5577a21cf010 2024-05-08T09:21:53.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.201+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93972309338928] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.202+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.202+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93972309341248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e1140 con 0x5577a21cf010 2024-05-08T09:21:53.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.202+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e1b90 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.202+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93972309343840] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x7fa6300a4040 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.203+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93972309341248] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.204+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.204+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93972309329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e1140 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.204+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e2430 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.206+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.206+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93972309329920] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.206+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93972309352240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e2350 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.206+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e2e40 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93972309352240] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93972309347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e2e40 con 0x5577a21d39e0 2024-05-08T09:21:53.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=0 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=1 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=2 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=3 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=4 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=5 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.207+0000 7fa64123f800 20 add_watcher() i=6 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.210+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93972309347472] v27'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.210+0000 7fa64123f800 20 add_watcher() i=7 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.210+0000 7fa64123f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.210+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e6230 con 0x5577a21cf010 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.211+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.211+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93972309367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e2fb0 con 0x5577a21cf010 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93972309367712] v27'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa628038040 con 0x5577a21cf010 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa4f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 5 note: GC not initialized 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa46ffff640 20 reqs_thread_entry: start 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 20 Filter name: none 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa46dffb640 20 reqs_thread_entry: start 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.212+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a22199d0 con 0x5577a21d39e0 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T09:21:53.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a22180c0 con 0x5577a21d39e0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.213+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a221c4b0 con 0x5577a21d39e0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.214+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v27'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.214+0000 7fa64123f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.214+0000 7fa64123f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T09:21:53.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.214+0000 7fa64123f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.214+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93972309585392 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a221cf80 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== watch-notify(notify (1) cookie 93972309343840 notify 115964117004 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fa62802abf0 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.3 [notify cookie 93972309585392 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa628005020 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa5227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 93972309343840 notifier 4526 bl.length()=610 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa5227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa5227fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa5227fc640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa504003ea0 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628005020 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== watch-notify(notify_complete (2) cookie 93972309585392 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa628018430 con 0x7fa6300a4040 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.215+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a221c490 con 0x5577a21d39e0 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v27'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa64123f800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa64123f800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa64123f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:53.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93972309585344 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5577a221c490 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 93972309338928 notify 115964116999 ret 0) ==== 234+0+0 (crc 0 0 0) 0x7fa630091070 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa5227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964116999 cookie 93972309338928 notifier 4526 bl.length()=192 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa5227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa5227fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa5227fc640 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fa504003ea0 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.216+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 notify.2 [notify cookie 93972309585344 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.217+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.217+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 93972309585344 notify 115964116999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5577a20972e0 con 0x5577a21d84a0 2024-05-08T09:21:53.224 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T09:21:53.214424Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:53.214409Z","tags":[],"group_ids":[]} 2024-05-08T09:21:53.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.218+0000 7fa4f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.218+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93972309367712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21cc430 con 0x5577a21cf010 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.219+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93972309367712] v27'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa628005020 con 0x5577a21cf010 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.219+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93972309332432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a2218b80 con 0x7fa6300a4040 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.219+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93972309332432] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628005020 con 0x7fa6300a4040 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.219+0000 7fa64123f800 20 remove_watcher() i=0 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.219+0000 7fa64123f800 2 removed watcher, disabling cache 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.220+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93972309336832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dd1b0 con 0x5577a21cf010 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.220+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93972309336832] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628005020 con 0x5577a21cf010 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.221+0000 7fa64123f800 20 remove_watcher() i=1 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.221+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93972309338928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21de300 con 0x5577a21d84a0 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.221+0000 7fa63ed3e640 1 -- 172.21.15.161:0/172605923 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93972309338928] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa630075030 con 0x5577a21d84a0 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.221+0000 7fa64123f800 20 remove_watcher() i=2 2024-05-08T09:21:53.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.221+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93972309343840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21de300 con 0x7fa6300a4040 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.222+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93972309343840] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628005020 con 0x7fa6300a4040 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.222+0000 7fa64123f800 20 remove_watcher() i=3 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.222+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93972309341248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21de300 con 0x5577a21cf010 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.223+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93972309341248] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa628005020 con 0x5577a21cf010 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.223+0000 7fa64123f800 20 remove_watcher() i=4 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.223+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93972309329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21df440 con 0x5577a21d39e0 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.224+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93972309329920] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.224+0000 7fa64123f800 20 remove_watcher() i=5 2024-05-08T09:21:53.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.224+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93972309352240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21dc800 con 0x5577a21d39e0 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.226+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93972309352240] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.226+0000 7fa64123f800 20 remove_watcher() i=6 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.226+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93972309347472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5577a21e1f30 con 0x5577a21d39e0 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa63f53f640 1 -- 172.21.15.161:0/172605923 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93972309347472] v27'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa638056040 con 0x5577a21d39e0 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 20 remove_watcher() i=7 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a21d39e0 msgr2=0x5577a21d5dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a21d39e0 0x5577a21d5dd0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a21cf010 msgr2=0x5577a21d14d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a21cf010 0x5577a21d14d0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa6300a4040 msgr2=0x7fa630077a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa6300a4040 0x7fa630077a70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5577a21d84a0 msgr2=0x5577a21da960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.227+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5577a21d84a0 0x5577a21da960 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa508036950 msgr2=0x7fa508038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa508036950 0x7fa508038e10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa63008c230 tx=0x7fa630091000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 msgr2=0x5577a21c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/172605923 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21bbfb0 0x5577a21c3370 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa63804b860 tx=0x7fa63804c920 comp rx=0 tx=0).stop 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 reap_dead start 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa637fff640 1 -- 172.21.15.161:0/172605923 reap_dead start 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 shutdown_connections 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 >> 172.21.15.161:0/172605923 conn(0x5577a21b8310 msgr2=0x5577a21b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 shutdown_connections 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/172605923 wait complete. 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 msgr2=0x7fa518038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 0x7fa518038dc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x5577a20978a0 tx=0x7fa6300069f0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 msgr2=0x5577a21af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x5577a219afd0 tx=0x7fa638018830 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 shutdown_connections 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa518036900 0x7fa518038dc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/1801044399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a21aed00 0x5577a21af120 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 >> 172.21.15.161:0/1801044399 conn(0x5577a21a2da0 msgr2=0x5577a21a31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 shutdown_connections 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/1801044399 wait complete. 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 msgr2=0x5577a219f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 0x5577a219f3c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 msgr2=0x5577a219a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.228+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 0x5577a219a640 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 msgr2=0x7fa524038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 0x7fa524038dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa62800a430 tx=0x7fa628005540 comp rx=0 tx=0).stop 2024-05-08T09:21:53.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 msgr2=0x5577a2098440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa630052540 tx=0x7fa630003020 comp rx=0 tx=0).stop 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 shutdown_connections 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5577a219cf30 0x5577a219f3c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5577a209b430 0x5577a219a640 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa524036900 0x7fa524038dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 --2- 172.21.15.161:0/3150674984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5577a2098b00 0x5577a2098440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 >> 172.21.15.161:0/3150674984 conn(0x5577a2092550 msgr2=0x5577a21838e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 shutdown_connections 2024-05-08T09:21:53.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.229+0000 7fa64123f800 1 -- 172.21.15.161:0/3150674984 wait complete. 2024-05-08T09:21:53.237 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T09:21:53.214424Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:53.214409Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:53.237 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T09:21:53.237 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T09:21:53.237 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-05-08T09:21:53.285 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.286 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34dea12800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dac83b770 0x556dac83db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34dea12800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556dac83e0a0 con 0x556dac837c60 2024-05-08T09:21:53.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34dea12800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x556dac6c8050 con 0x556dac83b770 2024-05-08T09:21:53.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34d97ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dac83b770 0x556dac83db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34d9fee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x556dac837c60 0x556dac83a050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43058/0 (socket says 172.21.15.161:43058) 2024-05-08T09:21:53.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34d97ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x556dac83b770 0x556dac83db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53862/0 (socket says 172.21.15.161:53862) 2024-05-08T09:21:53.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.287+0000 7f34d9fee640 1 -- 172.21.15.161:0/1353712024 learned_addr learned my addr 172.21.15.161:0/1353712024 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:53.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.288+0000 7f34d97ed640 1 -- 172.21.15.161:0/1353712024 >> v1:172.21.15.45:6789/0 conn(0x556dac837c60 legacy=0x556dac83a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.288+0000 7f34d97ed640 1 -- 172.21.15.161:0/1353712024 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac83f280 con 0x556dac83b770 2024-05-08T09:21:53.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34d97ed640 1 --2- 172.21.15.161:0/1353712024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac83b770 0x556dac83db60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d000a470 tx=0x7f34d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfafede30f995224 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34d8fec640 1 -- 172.21.15.161:0/1353712024 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d0057070 con 0x556dac83b770 2024-05-08T09:21:53.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34d8fec640 1 -- 172.21.15.161:0/1353712024 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d0052570 con 0x556dac83b770 2024-05-08T09:21:53.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34d8fec640 1 -- 172.21.15.161:0/1353712024 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d0052870 con 0x556dac83b770 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 -- 172.21.15.161:0/1353712024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac83b770 msgr2=0x556dac83db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 --2- 172.21.15.161:0/1353712024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac83b770 0x556dac83db60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d000a470 tx=0x7f34d001ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 -- 172.21.15.161:0/1353712024 shutdown_connections 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 --2- 172.21.15.161:0/1353712024 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac83b770 0x556dac83db60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 -- 172.21.15.161:0/1353712024 >> 172.21.15.161:0/1353712024 conn(0x556dac8315d0 msgr2=0x556dac8339f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 -- 172.21.15.161:0/1353712024 shutdown_connections 2024-05-08T09:21:53.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.290+0000 7f34dea12800 1 -- 172.21.15.161:0/1353712024 wait complete. 2024-05-08T09:21:53.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.304+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.304+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.305+0000 7f34dea12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.304 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.305+0000 7f34dea12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dac7821f0 con 0x556dac837c60 2024-05-08T09:21:53.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.305+0000 7f34d9fee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.305+0000 7f34d9fee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53872/0 (socket says 172.21.15.161:53872) 2024-05-08T09:21:53.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.305+0000 7f34d9fee640 1 -- 172.21.15.161:0/1020776383 learned_addr learned my addr 172.21.15.161:0/1020776383 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.306+0000 7f34d9fee640 1 -- 172.21.15.161:0/1020776383 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac928d00 con 0x556dac837c60 2024-05-08T09:21:53.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.306+0000 7f34d9fee640 1 --2- 172.21.15.161:0/1020776383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34cc001de0 tx=0x7f34cc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492d5ead5e917850 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f33c7e07640 1 -- 172.21.15.161:0/1020776383 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34cc012020 con 0x556dac837c60 2024-05-08T09:21:53.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f33c7e07640 1 -- 172.21.15.161:0/1020776383 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc00e5a0 con 0x556dac837c60 2024-05-08T09:21:53.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f33c7e07640 1 -- 172.21.15.161:0/1020776383 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34cc00e8c0 con 0x556dac837c60 2024-05-08T09:21:53.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 -- 172.21.15.161:0/1020776383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 msgr2=0x556dac928730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 --2- 172.21.15.161:0/1020776383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f34cc001de0 tx=0x7f34cc00b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 -- 172.21.15.161:0/1020776383 shutdown_connections 2024-05-08T09:21:53.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 --2- 172.21.15.161:0/1020776383 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac928730 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 -- 172.21.15.161:0/1020776383 >> 172.21.15.161:0/1020776383 conn(0x556dac8315d0 msgr2=0x556dac924050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 -- 172.21.15.161:0/1020776383 shutdown_connections 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.307+0000 7f34dea12800 1 -- 172.21.15.161:0/1020776383 wait complete. 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34dea12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34dea12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dac83e510 con 0x556dac837c60 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34d9fee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34d9fee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53888/0 (socket says 172.21.15.161:53888) 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34d9fee640 1 -- 172.21.15.161:0/2646051413 learned_addr learned my addr 172.21.15.161:0/2646051413 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.308+0000 7f34d9fee640 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac835c90 con 0x556dac837c60 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f34d9fee640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f34cc001de0 tx=0x7f34cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f33c6604640 1 -- 172.21.15.161:0/2646051413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34cc012030 con 0x556dac837c60 2024-05-08T09:21:53.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f33c6604640 1 -- 172.21.15.161:0/2646051413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34cc01a7a0 con 0x556dac837c60 2024-05-08T09:21:53.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dac835f20 con 0x556dac837c60 2024-05-08T09:21:53.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f33c6604640 1 -- 172.21.15.161:0/2646051413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34cc01aac0 con 0x556dac837c60 2024-05-08T09:21:53.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.309+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dac836440 con 0x556dac837c60 2024-05-08T09:21:53.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f33c6604640 1 -- 172.21.15.161:0/2646051413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34cc015020 con 0x556dac837c60 2024-05-08T09:21:53.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f33c6604640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 0x7f33c0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f33c6604640 1 -- 172.21.15.161:0/2646051413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f34cc020070 con 0x556dac837c60 2024-05-08T09:21:53.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f34d97ed640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 0x7f33c0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 0x556dac939640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.310+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac939bc0 con 0x556dac83b770 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34da7ef640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 0x556dac939640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34d97ed640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 0x7f33c0038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34d0054000 tx=0x7f34d004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34da7ef640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 0x556dac939640 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34da7ef640 1 -- 172.21.15.161:0/2646051413 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34d400a4a0 con 0x556dac83b770 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac93a4d0 con 0x556dac83b770 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34da7ef640 1 -- 172.21.15.161:0/2646051413 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34d400a4a0 con 0x556dac83b770 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 0x556dac93e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.311+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac93eba0 con 0x556dac93bf50 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.312+0000 7f34d9fee640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 0x556dac93e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.312+0000 7f34d9fee640 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 0x556dac93e410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.312+0000 7f34d9fee640 1 -- 172.21.15.161:0/2646051413 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34cc024980 con 0x556dac93bf50 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.312+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac93ad50 con 0x556dac83b770 2024-05-08T09:21:53.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.313+0000 7f34da7ef640 1 -- 172.21.15.161:0/2646051413 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34d400a4a0 con 0x556dac83b770 2024-05-08T09:21:53.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.313+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac93b230 con 0x556dac83b770 2024-05-08T09:21:53.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.313+0000 7f34da7ef640 1 -- 172.21.15.161:0/2646051413 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34d400a4a0 con 0x556dac83b770 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.313+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.313+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.314+0000 7f34dea12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.314+0000 7f34dea12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dac837ae0 con 0x556dac94dd10 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.314+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.314+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53904/0 (socket says 172.21.15.161:53904) 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.314+0000 7f34da7ef640 1 -- 172.21.15.161:0/1998998051 learned_addr learned my addr 172.21.15.161:0/1998998051 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.315+0000 7f34da7ef640 1 -- 172.21.15.161:0/1998998051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac94e670 con 0x556dac94dd10 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f34da7ef640 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x556dac939fa0 tx=0x7f34d4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f33bf7fe640 1 -- 172.21.15.161:0/1998998051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4014450 con 0x556dac94dd10 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f33bf7fe640 1 -- 172.21.15.161:0/1998998051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4014610 con 0x556dac94dd10 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f33bf7fe640 1 -- 172.21.15.161:0/1998998051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4014930 con 0x556dac94dd10 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dac94f0e0 con 0x556dac94dd10 2024-05-08T09:21:53.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.316+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dac94f5e0 con 0x556dac94dd10 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.317+0000 7f33bf7fe640 1 -- 172.21.15.161:0/1998998051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34d4011040 con 0x556dac94dd10 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.317+0000 7f33bf7fe640 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.317+0000 7f33bf7fe640 1 -- 172.21.15.161:0/1998998051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f34d401e070 con 0x556dac94dd10 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34d9fee640 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34d9fee640 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 0x7f33b4038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x556dac836a50 tx=0x7f34cc017f60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34dea12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34dea12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dac728cf0 con 0x556dac95aff0 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53906/0 (socket says 172.21.15.161:53906) 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.318+0000 7f34da7ef640 1 -- 172.21.15.161:0/126741549 learned_addr learned my addr 172.21.15.161:0/126741549 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.319+0000 7f34da7ef640 1 -- 172.21.15.161:0/126741549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac95b9e0 con 0x556dac95aff0 2024-05-08T09:21:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.319+0000 7f34da7ef640 1 --2- 172.21.15.161:0/126741549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34d404c9d0 tx=0x7f34d4011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e22e27aaffad988 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.320+0000 7f33bd7fa640 1 -- 172.21.15.161:0/126741549 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4016940 con 0x556dac95aff0 2024-05-08T09:21:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.320+0000 7f33bd7fa640 1 -- 172.21.15.161:0/126741549 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d404e0d0 con 0x556dac95aff0 2024-05-08T09:21:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.320+0000 7f33bd7fa640 1 -- 172.21.15.161:0/126741549 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d404e3d0 con 0x556dac95aff0 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- 172.21.15.161:0/126741549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 msgr2=0x556dac95b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 --2- 172.21.15.161:0/126741549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f34d404c9d0 tx=0x7f34d4011700 comp rx=0 tx=0).stop 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- 172.21.15.161:0/126741549 shutdown_connections 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 --2- 172.21.15.161:0/126741549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac95b410 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- 172.21.15.161:0/126741549 >> 172.21.15.161:0/126741549 conn(0x556dac957350 msgr2=0x556dac9553b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- 172.21.15.161:0/126741549 shutdown_connections 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- 172.21.15.161:0/126741549 wait complete. 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 Processor -- start 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- start start 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34dea12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x556dac95bf70 con 0x556dac95aff0 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34da7ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53910/0 (socket says 172.21.15.161:53910) 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.321+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 learned_addr learned my addr 172.21.15.161:0/3079514441 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556dac962990 con 0x556dac95aff0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f34da7ef640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34d40119b0 tx=0x7f34d404c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f33ab7fe640 1 -- 172.21.15.161:0/3079514441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4031070 con 0x556dac95aff0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f33ab7fe640 1 -- 172.21.15.161:0/3079514441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d4022a80 con 0x556dac95aff0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556dac962c20 con 0x556dac95aff0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f33ab7fe640 1 -- 172.21.15.161:0/3079514441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34d4022da0 con 0x556dac95aff0 2024-05-08T09:21:53.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.322+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556dac9658d0 con 0x556dac95aff0 2024-05-08T09:21:53.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f33ab7fe640 1 -- 172.21.15.161:0/3079514441 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f34d4034070 con 0x556dac95aff0 2024-05-08T09:21:53.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f33ab7fe640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33a4036900 0x7f33a4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f33ab7fe640 1 -- 172.21.15.161:0/3079514441 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f34d4045050 con 0x556dac95aff0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f34d9fee640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33a4036900 0x7f33a4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f34d9fee640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33a4036900 0x7f33a4038dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34cc024c90 tx=0x7f34cc030000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac96df80 0x556dac970440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.323+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac970b90 con 0x556dac96df80 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34d97ed640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac96df80 0x556dac970440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34d97ed640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac96df80 0x556dac970440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 realm 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac970f60 con 0x556dac96df80 2024-05-08T09:21:53.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac971830 con 0x556dac96df80 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.324+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac971bd0 con 0x556dac96df80 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac972930 0x556dac974d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac975330 con 0x556dac972930 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.325+0000 7f34da7ef640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac972930 0x556dac974d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34da7ef640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac972930 0x556dac974d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34dea12800 20 searching for the correct realm 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dac9772c0 0x556dac979780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.326+0000 7f34d9fee640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dac9772c0 0x556dac979780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.327+0000 7f34d9fee640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dac9772c0 0x556dac979780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.327+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.327+0000 7f34d9fee640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f34cc017050 0x7f34cc02d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.327+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x7f34cc017050 2024-05-08T09:21:53.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.327+0000 7f34d97ed640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f34cc017050 0x7f34cc02d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34d97ed640 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f34cc017050 0x7f34cc02d3f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac972930 2024-05-08T09:21:53.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac96df80 2024-05-08T09:21:53.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.328+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac96df80 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac972930 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac972930 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.329+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x7f34cc017050 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac96df80 2024-05-08T09:21:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac972930 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.330+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac96df80 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x7f34cc017050 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.331+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac972930 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x556dac979e50 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac96df80 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.332+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac96df80 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac972930 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x7f34cc017050 2024-05-08T09:21:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.333+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac96df80 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac972930 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac9772c0 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.334+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac972930 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x7f34cc017050 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac9772c0 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.335+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac972930 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x556dac96df80 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f34cc065040 con 0x7f34cc017050 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac976810 con 0x556dac96df80 2024-05-08T09:21:53.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.336+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac976080 con 0x556dac96df80 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9757c0 con 0x556dac96df80 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 zone default found 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 4 Realm: () 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 zonegroup default 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac97a780 con 0x556dac972930 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.337+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac97c9b0 con 0x556dac9772c0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac97cd50 con 0x556dac9772c0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 20 started sync module instance, tier type = 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.338+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97be40 con 0x7f34cc017050 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.339+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.339+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93929535423344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97be40 con 0x7f34cc017050 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.339+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97d710 con 0x556dac96df80 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.340+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.340+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93929535423344] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.340+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93929535427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97d6c0 con 0x556dac96df80 2024-05-08T09:21:53.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.340+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97b990 con 0x556dac9772c0 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.341+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93929535427168] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.341+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.341+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93929535429376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97e630 con 0x556dac9772c0 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.341+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97eff0 con 0x7f34cc017050 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.342+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93929535429376] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.342+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.342+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93929535433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97f410 con 0x7f34cc017050 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.342+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97fdd0 con 0x556dac96df80 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.343+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93929535433536] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.343+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.343+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93929535435072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97fdd0 con 0x556dac96df80 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.343+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac980790 con 0x556dac972930 2024-05-08T09:21:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.344+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93929535435072] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.345+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.345+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93929535437088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97fd40 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.345+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac981600 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.345+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93929535437088] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.346+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.346+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93929535441712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac981600 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.346+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac981fc0 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93929535445776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9823e0 con 0x556dac972930 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=0 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=1 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=2 2024-05-08T09:21:53.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=3 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=4 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=5 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93929535441712] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.347+0000 7f34dea12800 20 add_watcher() i=6 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93929535445776] v27'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34dea12800 20 add_watcher() i=7 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34dea12800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9823e0 con 0x556dac96df80 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.348+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93929535446832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac982350 con 0x556dac96df80 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.349+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93929535446832] v27'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.349+0000 7f338b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.349+0000 7f34dea12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.349+0000 7f34dea12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.349+0000 7f34dea12800 5 note: GC not initialized 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f338a7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f34dea12800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f34dea12800 20 Filter name: none 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f32fbfff640 20 reqs_thread_entry: start 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f34dea12800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.350+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9b8a10 con 0x556dac972930 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T09:21:53.356 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9b8460 con 0x7f34cc017050 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.351+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bbf20 con 0x7f34cc017050 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:53.357 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.352+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9c0640 con 0x7f34cc017050 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.353+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 foo.buckets [call] v27'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.358 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.353+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 8.6 8:609c8fc6:root::.bucket.meta.testx%3amyfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [create,call version.inc in=38b,writefull 0~412 in=412b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9c3f30 con 0x556dac972930 2024-05-08T09:21:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [create,call,writefull 0~412,setxattr (203)] v27'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34dea12800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x7 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34dea12800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34dea12800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34dea12800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [notify cookie 93929535708080 in=859b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9c3810 con 0x556dac96df80 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 93929535427168 notify 115964117003 ret 0) ==== 889+0+0 (crc 0 0 0) 0x556dac9bc310 con 0x556dac96df80 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f33bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 93929535427168 notifier 4533 bl.length()=847 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f33bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x7 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f33bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f33bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(67 notify.1 [notify cookie 93929535708080 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.355+0000 7f33bd7fa640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f339c003ea0 con 0x556dac96df80 2024-05-08T09:21:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 notify.1 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 93929535708080 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dac9bb4f0 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34dea12800 20 handle_bi_update(): bucket=testx:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34dea12800 20 handle_bi_update(): bucket=testx:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34dea12800 20 handle_bi_update(): bucket=testx:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34dea12800 20 handle_bi_update(): bucket=testx:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.356+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bf870 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.357+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v27'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.357+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9c4090 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v27'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34dea12800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34dea12800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34dea12800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 93929535697856 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bfc90 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== watch-notify(notify (1) cookie 93929535435072 notify 115964117004 ret 0) ==== 390+0+0 (crc 0 0 0) 0x556dac9c2e20 con 0x556dac96df80 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f33bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 93929535435072 notifier 4533 bl.length()=348 2024-05-08T09:21:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f33bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f33bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f33bd7fa640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f339c003ea0 con 0x556dac96df80 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(71 notify.4 [notify cookie 93929535697856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== watch-notify(notify_complete (2) cookie 93929535697856 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dac9c2bc0 con 0x556dac96df80 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.358+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bf870 con 0x7f34cc017050 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.359+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(73 myfoo [call,delete] v27'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.359+0000 7f34dea12800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.359+0000 7f34dea12800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.359+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93929535697856 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bfc90 con 0x556dac972930 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== watch-notify(notify (1) cookie 93929535441712 notify 115964117006 ret 0) ==== 191+0+0 (crc 0 0 0) 0x556dac9c0490 con 0x556dac972930 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.6 [notify cookie 93929535697856 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f33bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 93929535441712 notifier 4533 bl.length()=149 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f33bcff9640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f33040032c0 con 0x556dac972930 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify_complete (2) cookie 93929535697856 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dac962990 con 0x556dac972930 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.360+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:76 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bf870 con 0x7f34cc017050 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.361+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(76 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call,delete] v27'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.361+0000 7f34dea12800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 from cache 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.361+0000 7f34dea12800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.361+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify cookie 93929535686048 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bf870 con 0x556dac9772c0 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 93929535429376 notify 115964117000 ret 0) ==== 248+0+0 (crc 0 0 0) 0x7f34cc060040 con 0x556dac9772c0 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f33bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117000 cookie 93929535429376 notifier 4533 bl.length()=206 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f33bcff9640 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:78 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f33040032c0 con 0x556dac9772c0 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(77 notify.2 [notify cookie 93929535686048 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(78 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.362+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 93929535686048 notify 115964117000 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556dac836440 con 0x556dac9772c0 2024-05-08T09:21:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.363+0000 7f338b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.363+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93929535446832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac9bfca0 con 0x556dac96df80 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.364+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93929535446832] v27'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.364+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93929535423344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac981f30 con 0x7f34cc017050 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.365+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93929535423344] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.365+0000 7f34dea12800 20 remove_watcher() i=0 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.365+0000 7f34dea12800 2 removed watcher, disabling cache 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.365+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93929535427168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac981f30 con 0x556dac96df80 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.366+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93929535427168] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.366+0000 7f34dea12800 20 remove_watcher() i=1 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.366+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93929535429376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97d260 con 0x556dac9772c0 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.367+0000 7f34d9fee640 1 -- 172.21.15.161:0/3079514441 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93929535429376] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34cc024980 con 0x556dac9772c0 2024-05-08T09:21:53.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.367+0000 7f34dea12800 20 remove_watcher() i=2 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.367+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93929535433536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97db00 con 0x7f34cc017050 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.368+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93929535433536] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x7f34cc017050 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.368+0000 7f34dea12800 20 remove_watcher() i=3 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.368+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93929535435072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97eb40 con 0x556dac96df80 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.369+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93929535435072] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d005a040 con 0x556dac96df80 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.369+0000 7f34dea12800 20 remove_watcher() i=4 2024-05-08T09:21:53.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.369+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93929535437088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97db00 con 0x556dac972930 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.370+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93929535437088] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.370+0000 7f34dea12800 20 remove_watcher() i=5 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.370+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93929535441712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97eb40 con 0x556dac972930 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.371+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93929535441712] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.371+0000 7f34dea12800 20 remove_watcher() i=6 2024-05-08T09:21:53.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.371+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93929535445776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x556dac97f920 con 0x556dac972930 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34da7ef640 1 -- 172.21.15.161:0/3079514441 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93929535445776] v27'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34d4033030 con 0x556dac972930 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 20 remove_watcher() i=7 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac972930 msgr2=0x556dac974d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac972930 0x556dac974d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac96df80 msgr2=0x556dac970440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac96df80 0x556dac970440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f34cc017050 msgr2=0x7f34cc02d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f34cc017050 0x7f34cc02d3f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dac9772c0 msgr2=0x556dac979780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x556dac9772c0 0x556dac979780 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33a4036900 msgr2=0x7f33a4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.372+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33a4036900 0x7f33a4038dc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f34cc024c90 tx=0x7f34cc030000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34d97ed640 1 -- 172.21.15.161:0/3079514441 reap_dead start 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 msgr2=0x556dac962450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f34d40119b0 tx=0x7f34d404c960 comp rx=0 tx=0).stop 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 shutdown_connections 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/3079514441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac95aff0 0x556dac962450 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 >> 172.21.15.161:0/3079514441 conn(0x556dac957350 msgr2=0x556dac9549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 shutdown_connections 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/3079514441 wait complete. 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 msgr2=0x7f33b4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 0x7f33b4038dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x556dac836a50 tx=0x7f34cc017f60 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 msgr2=0x556dac94e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x556dac939fa0 tx=0x7f34d4018830 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 shutdown_connections 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33b4036900 0x7f33b4038dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/1998998051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac94dd10 0x556dac94e130 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 >> 172.21.15.161:0/1998998051 conn(0x556dac941db0 msgr2=0x556dac9421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 shutdown_connections 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/1998998051 wait complete. 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 msgr2=0x556dac93e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 0x556dac93e410 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 msgr2=0x556dac939640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 0x556dac939640 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.373+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 msgr2=0x7f33c0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 0x7f33c0038e10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f34d0054000 tx=0x7f34d004e000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 msgr2=0x556dac8375a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f34cc001de0 tx=0x7f34cc000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 shutdown_connections 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x556dac93bf50 0x556dac93e410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x556dac83b770 0x556dac939640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f33c0036950 0x7f33c0038e10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 --2- 172.21.15.161:0/2646051413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556dac837c60 0x556dac8375a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 >> 172.21.15.161:0/2646051413 conn(0x556dac8315d0 msgr2=0x556dac922850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 shutdown_connections 2024-05-08T09:21:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.374+0000 7f34dea12800 1 -- 172.21.15.161:0/2646051413 wait complete. 2024-05-08T09:21:53.382 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T09:21:53.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-05-08T09:21:53.382 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-05-08T09:21:53.425 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.425 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3f094800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55dabe4ce520 0x55dabe4d7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3f094800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dabe441920 con 0x55dabe4cc9e0 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3f094800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55dabe35f050 con 0x55dabe4ce520 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55dabe4ce520 0x55dabe4d7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e37fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55dabe4ce520 0x55dabe4d7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53918/0 (socket says 172.21.15.161:53918) 2024-05-08T09:21:53.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e3cb93640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55dabe4cc9e0 0x55dabe4cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43070/0 (socket says 172.21.15.161:43070) 2024-05-08T09:21:53.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.427+0000 7f7e37fff640 1 -- 172.21.15.161:0/2652975647 learned_addr learned my addr 172.21.15.161:0/2652975647 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.428+0000 7f7e37fff640 1 -- 172.21.15.161:0/2652975647 >> v1:172.21.15.45:6789/0 conn(0x55dabe4cc9e0 legacy=0x55dabe4cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.428 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.428+0000 7f7e37fff640 1 -- 172.21.15.161:0/2652975647 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe4d8570 con 0x55dabe4ce520 2024-05-08T09:21:53.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e37fff640 1 --2- 172.21.15.161:0/2652975647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4ce520 0x55dabe4d7020 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800a520 tx=0x7f7e2801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cfaf7028d0a8b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e377fe640 1 -- 172.21.15.161:0/2652975647 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28057070 con 0x55dabe4ce520 2024-05-08T09:21:53.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e377fe640 1 -- 172.21.15.161:0/2652975647 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e28052570 con 0x55dabe4ce520 2024-05-08T09:21:53.429 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e377fe640 1 -- 172.21.15.161:0/2652975647 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e28052870 con 0x55dabe4ce520 2024-05-08T09:21:53.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 -- 172.21.15.161:0/2652975647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4ce520 msgr2=0x55dabe4d7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 --2- 172.21.15.161:0/2652975647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4ce520 0x55dabe4d7020 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7e2800a520 tx=0x7f7e2801d010 comp rx=0 tx=0).stop 2024-05-08T09:21:53.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 -- 172.21.15.161:0/2652975647 shutdown_connections 2024-05-08T09:21:53.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 --2- 172.21.15.161:0/2652975647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4ce520 0x55dabe4d7020 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.430 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 -- 172.21.15.161:0/2652975647 >> 172.21.15.161:0/2652975647 conn(0x55dabe4c85a0 msgr2=0x55dabe4ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 -- 172.21.15.161:0/2652975647 shutdown_connections 2024-05-08T09:21:53.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.430+0000 7f7e3f094800 1 -- 172.21.15.161:0/2652975647 wait complete. 2024-05-08T09:21:53.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3f094800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3f094800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dabe4191d0 con 0x55dabe4cc9e0 2024-05-08T09:21:53.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3cb93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3cb93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53924/0 (socket says 172.21.15.161:53924) 2024-05-08T09:21:53.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3cb93640 1 -- 172.21.15.161:0/510616822 learned_addr learned my addr 172.21.15.161:0/510616822 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.444+0000 7f7e3cb93640 1 -- 172.21.15.161:0/510616822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe5c2040 con 0x55dabe4cc9e0 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.445+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/510616822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e90 tx=0x7f7e3000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eced7135fd9520c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.445+0000 7f7d2ae05640 1 -- 172.21.15.161:0/510616822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3000e5c0 con 0x55dabe4cc9e0 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.445+0000 7f7d2ae05640 1 -- 172.21.15.161:0/510616822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e30006070 con 0x55dabe4cc9e0 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.445+0000 7f7d2ae05640 1 -- 172.21.15.161:0/510616822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3000e890 con 0x55dabe4cc9e0 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- 172.21.15.161:0/510616822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 msgr2=0x55dabe5c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 --2- 172.21.15.161:0/510616822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001e90 tx=0x7f7e3000b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- 172.21.15.161:0/510616822 shutdown_connections 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 --2- 172.21.15.161:0/510616822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c1a70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- 172.21.15.161:0/510616822 >> 172.21.15.161:0/510616822 conn(0x55dabe4c85a0 msgr2=0x55dabe5bd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- 172.21.15.161:0/510616822 shutdown_connections 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- 172.21.15.161:0/510616822 wait complete. 2024-05-08T09:21:53.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3f094800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dabe4d7830 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3cb93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3cb93640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53938/0 (socket says 172.21.15.161:53938) 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.446+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3666070842 learned_addr learned my addr 172.21.15.161:0/3666070842 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe5c9b50 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001ed0 tx=0x7f7e30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7d29602640 1 -- 172.21.15.161:0/3666070842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3001a880 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7d29602640 1 -- 172.21.15.161:0/3666070842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3001aa20 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dabe5c9de0 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7d29602640 1 -- 172.21.15.161:0/3666070842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3001ad40 con 0x55dabe4cc9e0 2024-05-08T09:21:53.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.447+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dabe5cca90 con 0x55dabe4cc9e0 2024-05-08T09:21:53.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7d29602640 1 -- 172.21.15.161:0/3666070842 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e30017070 con 0x55dabe4cc9e0 2024-05-08T09:21:53.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7d29602640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 0x7f7d24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7d29602640 1 -- 172.21.15.161:0/3666070842 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e30015020 con 0x55dabe4cc9e0 2024-05-08T09:21:53.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 0x7f7d24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 0x55dabe5d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe5d0dd0 con 0x55dabe4ce520 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.448+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 0x55dabe5d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 0x7f7d24038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7e28054000 tx=0x7f7e2804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 0x55dabe5d0850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3d394640 1 -- 172.21.15.161:0/3666070842 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e3800a4a0 con 0x55dabe4ce520 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe5cde20 con 0x55dabe4ce520 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3d394640 1 -- 172.21.15.161:0/3666070842 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e3800a4a0 con 0x55dabe4ce520 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 0x55dabe5d5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.449+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe5d5c00 con 0x55dabe5d3120 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.450+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 0x55dabe5d5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.451+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 0x55dabe5d5510 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.451+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3666070842 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe5d3120 2024-05-08T09:21:53.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.451+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe5d20a0 con 0x55dabe4ce520 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.451+0000 7f7e3d394640 1 -- 172.21.15.161:0/3666070842 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e3800a4a0 con 0x55dabe4ce520 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.451+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe5d2580 con 0x55dabe4ce520 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3d394640 1 -- 172.21.15.161:0/3666070842 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e3800a4a0 con 0x55dabe4ce520 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3f094800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3f094800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dabe3bfcf0 con 0x55dabe5e4d30 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53942/0 (socket says 172.21.15.161:53942) 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.452+0000 7f7e3d394640 1 -- 172.21.15.161:0/3156778416 learned_addr learned my addr 172.21.15.161:0/3156778416 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7e3d394640 1 -- 172.21.15.161:0/3156778416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe5e5690 con 0x55dabe5e4d30 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55dabe5d11d0 tx=0x7f7e38018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7d227fc640 1 -- 172.21.15.161:0/3156778416 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e38014450 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7d227fc640 1 -- 172.21.15.161:0/3156778416 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e38014610 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7d227fc640 1 -- 172.21.15.161:0/3156778416 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e38014930 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dabe5e6100 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.453+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dabe5e6600 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.454+0000 7f7d227fc640 1 -- 172.21.15.161:0/3156778416 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e38011040 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.454+0000 7f7d227fc640 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 0x7f7d14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.454+0000 7f7d227fc640 1 -- 172.21.15.161:0/3156778416 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e3801e070 con 0x55dabe5e4d30 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.454+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 0x7f7d14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 0x7f7d14038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e30000fd0 tx=0x7f7e3004b320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3f094800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3f094800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dabe5c23c0 con 0x55dabe5f2010 2024-05-08T09:21:53.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53950/0 (socket says 172.21.15.161:53950) 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3d394640 1 -- 172.21.15.161:0/2260747889 learned_addr learned my addr 172.21.15.161:0/2260747889 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3d394640 1 -- 172.21.15.161:0/2260747889 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe5f2a00 con 0x55dabe5f2010 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.455+0000 7f7e3d394640 1 --2- 172.21.15.161:0/2260747889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7e3804c910 tx=0x7f7e3800df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9862025237110a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7d13fff640 1 -- 172.21.15.161:0/2260747889 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3802bc50 con 0x55dabe5f2010 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7d13fff640 1 -- 172.21.15.161:0/2260747889 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3802bdf0 con 0x55dabe5f2010 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7d13fff640 1 -- 172.21.15.161:0/2260747889 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3804e0d0 con 0x55dabe5f2010 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- 172.21.15.161:0/2260747889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 msgr2=0x55dabe5f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 --2- 172.21.15.161:0/2260747889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f7e3804c910 tx=0x7f7e3800df90 comp rx=0 tx=0).stop 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- 172.21.15.161:0/2260747889 shutdown_connections 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 --2- 172.21.15.161:0/2260747889 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f2430 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- 172.21.15.161:0/2260747889 >> 172.21.15.161:0/2260747889 conn(0x55dabe5ee320 msgr2=0x55dabe5ec3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- 172.21.15.161:0/2260747889 shutdown_connections 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- 172.21.15.161:0/2260747889 wait complete. 2024-05-08T09:21:53.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 Processor -- start 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- start start 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.456+0000 7f7e3f094800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55dabe5f3170 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3d394640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:53962/0 (socket says 172.21.15.161:53962) 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 learned_addr learned my addr 172.21.15.161:0/3775120931 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dabe5f99e0 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55dabe5eea40 tx=0x7f7e3804c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7d127fc640 1 -- 172.21.15.161:0/3775120931 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e38031030 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7d127fc640 1 -- 172.21.15.161:0/3775120931 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e3803be10 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dabe5f9c70 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7d127fc640 1 -- 172.21.15.161:0/3775120931 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e3802bc50 con 0x55dabe5f2010 2024-05-08T09:21:53.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.457+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dabe5fc920 con 0x55dabe5f2010 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.458+0000 7f7d127fc640 1 -- 172.21.15.161:0/3775120931 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e38034030 con 0x55dabe5f2010 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.458+0000 7f7d127fc640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d08036950 0x7f7d08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.458+0000 7f7d127fc640 1 -- 172.21.15.161:0/3775120931 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f7e38032070 con 0x55dabe5f2010 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.458+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d08036950 0x7f7d08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe604fe0 0x55dabe6074a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe607bf0 con 0x55dabe604fe0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d08036950 0x7f7d08038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e3001dfd0 tx=0x7f7e30035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe604fe0 0x55dabe6074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe604fe0 0x55dabe6074a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 20 realm 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.459+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe607fc0 con 0x55dabe604fe0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe608890 con 0x55dabe604fe0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe608c30 con 0x55dabe604fe0 2024-05-08T09:21:53.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe6096e0 0x55dabe60baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe60c250 con 0x55dabe6096e0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.460+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe6096e0 0x55dabe60baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3d394640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe6096e0 0x55dabe60baf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3f094800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3f094800 20 searching for the correct realm 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55dabe60e300 0x55dabe6107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.461+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55dabe60e300 0x55dabe6107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.462+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55dabe60e300 0x55dabe6107c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.462+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.462+0000 7f7e3cb93640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e3000f070 0x7f7e30019840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.462+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x7f7e3000f070 2024-05-08T09:21:53.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.462+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e3000f070 0x7f7e30019840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.463+0000 7f7e37fff640 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e3000f070 0x7f7e30019840 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.463+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.463+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe6096e0 2024-05-08T09:21:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.463+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.463+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe604fe0 2024-05-08T09:21:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe604fe0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe6096e0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.464+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe6096e0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x7f7e3000f070 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe604fe0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.465+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe6096e0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe604fe0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x7f7e3000f070 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.466+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe6096e0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55dabe610e90 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.467+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe604fe0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.468+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.468+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe604fe0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.468+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.468+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe6096e0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x7f7e3000f070 2024-05-08T09:21:53.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.469+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe604fe0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe6096e0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe60e300 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.470+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe6096e0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x7f7e3000f070 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe60e300 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.471+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe6096e0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x55dabe604fe0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f7e30064040 con 0x7f7e3000f070 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.472+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe60cd00 con 0x55dabe604fe0 2024-05-08T09:21:53.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe60d180 con 0x55dabe604fe0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe60d660 con 0x55dabe604fe0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 zone default found 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 4 Realm: () 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 zonegroup default 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.473+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe611310 con 0x55dabe6096e0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe613540 con 0x55dabe60e300 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6138e0 con 0x55dabe60e300 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 started sync module instance, tier type = 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.474+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe612980 con 0x7f7e3000f070 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.475+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.475+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94397985271504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe612980 con 0x7f7e3000f070 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.475+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6142a0 con 0x55dabe604fe0 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.476+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94397985271504] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.476+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.476+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94397985269424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6142a0 con 0x55dabe604fe0 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.476+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe614c60 con 0x55dabe60e300 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.477+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94397985269424] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.477+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.477+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94397985275376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe614210 con 0x55dabe60e300 2024-05-08T09:21:53.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.477+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe615b50 con 0x7f7e3000f070 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.478+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.478+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94397985275376] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.478+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94397985282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6162f0 con 0x7f7e3000f070 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.479+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe615080 con 0x55dabe604fe0 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.480+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.480+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94397985286368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe615080 con 0x55dabe604fe0 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.480+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6177d0 con 0x55dabe6096e0 2024-05-08T09:21:53.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.480+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94397985282176] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.481+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94397985286368] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.481+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.481+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94397985287424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe615d40 con 0x55dabe6096e0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.481+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618210 con 0x55dabe6096e0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.482+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94397985287424] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.482+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.482+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94397985288992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618210 con 0x55dabe6096e0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.482+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618ac0 con 0x55dabe6096e0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94397985288992] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94397985291616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618ca0 con 0x55dabe6096e0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=0 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=1 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=2 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=3 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=4 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=5 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.483+0000 7f7e3f094800 20 add_watcher() i=6 2024-05-08T09:21:53.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94397985291616] v27'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e3f094800 20 add_watcher() i=7 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e3f094800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe61c070 con 0x55dabe604fe0 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.484+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94397985295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe619460 con 0x55dabe604fe0 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.485+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94397985295248] v27'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.485+0000 7f7cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.485+0000 7f7e3f094800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.485+0000 7f7e3f094800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.485+0000 7f7e3f094800 5 note: GC not initialized 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7cf1fe3640 20 reqs_thread_entry: start 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e3f094800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e3f094800 20 Filter name: none 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7c637fe640 20 reqs_thread_entry: start 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e3f094800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55dabe64ef40 con 0x55dabe604fe0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.486+0000 7f7e3f094800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.487+0000 7f7cf2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.487+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94397985295248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe625220 con 0x55dabe604fe0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.488+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94397985295248] v27'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.488+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94397985271504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618b90 con 0x7f7e3000f070 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.489+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94397985271504] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.489+0000 7f7e3f094800 20 remove_watcher() i=0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.489+0000 7f7e3f094800 2 removed watcher, disabling cache 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.489+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94397985269424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618b90 con 0x55dabe604fe0 2024-05-08T09:21:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.490+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94397985269424] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.491+0000 7f7e3f094800 20 remove_watcher() i=1 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.491+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94397985275376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe6126b0 con 0x55dabe60e300 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.491+0000 7f7e3cb93640 1 -- 172.21.15.161:0/3775120931 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94397985275376] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3002e070 con 0x55dabe60e300 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.491+0000 7f7e3f094800 20 remove_watcher() i=2 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.491+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94397985282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618b90 con 0x7f7e3000f070 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.492+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94397985282176] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x7f7e3000f070 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.492+0000 7f7e3f094800 20 remove_watcher() i=3 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.492+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94397985286368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe613df0 con 0x55dabe604fe0 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.493+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94397985286368] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e2805a040 con 0x55dabe604fe0 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.493+0000 7f7e3f094800 20 remove_watcher() i=4 2024-05-08T09:21:53.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.493+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94397985287424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe615880 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.495+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94397985287424] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.495+0000 7f7e3f094800 20 remove_watcher() i=5 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.495+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94397985288992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe618b90 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.496+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94397985288992] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.496+0000 7f7e3f094800 20 remove_watcher() i=6 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.496+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94397985291616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55dabe613df0 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3d394640 1 -- 172.21.15.161:0/3775120931 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94397985291616] v27'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e3802a070 con 0x55dabe6096e0 2024-05-08T09:21:53.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 20 remove_watcher() i=7 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe6096e0 msgr2=0x55dabe60baf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe6096e0 0x55dabe60baf0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe604fe0 msgr2=0x55dabe6074a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe604fe0 0x55dabe6074a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e3000f070 msgr2=0x7f7e30019840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e3000f070 0x7f7e30019840 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55dabe60e300 msgr2=0x55dabe6107c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55dabe60e300 0x55dabe6107c0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d08036950 msgr2=0x7f7d08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d08036950 0x7f7d08038e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e3001dfd0 tx=0x7f7e30035000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 msgr2=0x55dabe5f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e37fff640 1 -- 172.21.15.161:0/3775120931 reap_dead start 2024-05-08T09:21:53.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x55dabe5eea40 tx=0x7f7e3804c870 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 shutdown_connections 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3775120931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5f2010 0x55dabe5f94a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.497+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 >> 172.21.15.161:0/3775120931 conn(0x55dabe5ee320 msgr2=0x55dabe5eb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 shutdown_connections 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3775120931 wait complete. 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 msgr2=0x7f7d14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 0x7f7d14038e10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7e30000fd0 tx=0x7f7e3004b320 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 msgr2=0x55dabe5e5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x55dabe5d11d0 tx=0x7f7e38018830 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 shutdown_connections 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d14036950 0x7f7d14038e10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3156778416 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe5e4d30 0x55dabe5e5150 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 >> 172.21.15.161:0/3156778416 conn(0x55dabe5d8dd0 msgr2=0x55dabe5d91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 shutdown_connections 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3156778416 wait complete. 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 msgr2=0x55dabe5d5510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 0x55dabe5d5510 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 msgr2=0x55dabe5d0850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 0x55dabe5d0850 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 msgr2=0x7f7d24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 0x7f7d24038e10 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7e28054000 tx=0x7f7e2804e000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 msgr2=0x55dabe5c9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f7e30001ed0 tx=0x7f7e30000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 shutdown_connections 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55dabe5d3120 0x55dabe5d5510 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55dabe4ce520 0x55dabe5d0850 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d24036950 0x7f7d24038e10 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 --2- 172.21.15.161:0/3666070842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55dabe4cc9e0 0x55dabe5c9610 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 >> 172.21.15.161:0/3666070842 conn(0x55dabe4c85a0 msgr2=0x55dabe5bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.498+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 shutdown_connections 2024-05-08T09:21:53.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.499+0000 7f7e3f094800 1 -- 172.21.15.161:0/3666070842 wait complete. 2024-05-08T09:21:53.507 INFO:teuthology.orchestra.run.smithi161.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"WJJG8G54Jp6vY3wBI+igG3RH","ver":2},"mtime":"2024-05-08T09:21:53.358021Z","data":{"bucket":{"name":"myfoo","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","bucket_id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-05-08T09:21:50.820361Z","linked":true,"has_bucket_info":false}} 2024-05-08T09:21:53.507 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'WJJG8G54Jp6vY3wBI+igG3RH', 'ver': 2}, 'mtime': '2024-05-08T09:21:53.358021Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'bucket_id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-05-08T09:21:50.820361Z', 'linked': True, 'has_bucket_info': False}} 2024-05-08T09:21:53.507 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T09:21:53.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-05-08T09:21:53.508 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-05-08T09:21:53.593 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.593 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.594+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.594+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.594+0000 7f30c2e13800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d1db5f83f0 0x55d1db5fa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.594+0000 7f30c2e13800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d1db5faf60 con 0x55d1db567020 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.594+0000 7f30c2e13800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55d1db485050 con 0x55d1db5f83f0 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30bdd46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d1db5f83f0 0x55d1db5fa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30bdd46640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d1db5f83f0 0x55d1db5fa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32952/0 (socket says 172.21.15.161:32952) 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30be547640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55d1db567020 0x55d1db5f6ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50868/0 (socket says 172.21.15.161:50868) 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30bdd46640 1 -- 172.21.15.161:0/3405876529 learned_addr learned my addr 172.21.15.161:0/3405876529 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30bdd46640 1 -- 172.21.15.161:0/3405876529 >> v1:172.21.15.45:6789/0 conn(0x55d1db567020 legacy=0x55d1db5f6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.595+0000 7f30bdd46640 1 -- 172.21.15.161:0/3405876529 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db5fc190 con 0x55d1db5f83f0 2024-05-08T09:21:53.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.597+0000 7f30bdd46640 1 --2- 172.21.15.161:0/3405876529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f83f0 0x55d1db5fa8b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f30b400a520 tx=0x7f30b401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9285d95fd8ef5797 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.597+0000 7f30bd545640 1 -- 172.21.15.161:0/3405876529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b4057070 con 0x55d1db5f83f0 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.597+0000 7f30bd545640 1 -- 172.21.15.161:0/3405876529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b4052570 con 0x55d1db5f83f0 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.597+0000 7f30bd545640 1 -- 172.21.15.161:0/3405876529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b404ae60 con 0x55d1db5f83f0 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 -- 172.21.15.161:0/3405876529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f83f0 msgr2=0x55d1db5fa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 --2- 172.21.15.161:0/3405876529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f83f0 0x55d1db5fa8b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f30b400a520 tx=0x7f30b401d010 comp rx=0 tx=0).stop 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 -- 172.21.15.161:0/3405876529 shutdown_connections 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 --2- 172.21.15.161:0/3405876529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f83f0 0x55d1db5fa8b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 -- 172.21.15.161:0/3405876529 >> 172.21.15.161:0/3405876529 conn(0x55d1db5ee5c0 msgr2=0x55d1db5f09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 -- 172.21.15.161:0/3405876529 shutdown_connections 2024-05-08T09:21:53.598 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.598+0000 7f30c2e13800 1 -- 172.21.15.161:0/3405876529 wait complete. 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.611+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.611+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.611+0000 7f30c2e13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.611+0000 7f30c2e13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1db53f1c0 con 0x55d1db567020 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.612+0000 7f30be547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.612+0000 7f30be547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32960/0 (socket says 172.21.15.161:32960) 2024-05-08T09:21:53.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.612+0000 7f30be547640 1 -- 172.21.15.161:0/1685195849 learned_addr learned my addr 172.21.15.161:0/1685195849 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.612+0000 7f30be547640 1 -- 172.21.15.161:0/1685195849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db6e5c60 con 0x55d1db567020 2024-05-08T09:21:53.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.613+0000 7f30be547640 1 --2- 172.21.15.161:0/1685195849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001610 tx=0x7f30b0006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7790ad2799b11e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.614+0000 7f2fac608640 1 -- 172.21.15.161:0/1685195849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0013420 con 0x55d1db567020 2024-05-08T09:21:53.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.614+0000 7f2fac608640 1 -- 172.21.15.161:0/1685195849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b00135e0 con 0x55d1db567020 2024-05-08T09:21:53.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.614+0000 7f2fac608640 1 -- 172.21.15.161:0/1685195849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0013940 con 0x55d1db567020 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- 172.21.15.161:0/1685195849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 msgr2=0x55d1db6e5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1685195849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001610 tx=0x7f30b0006f90 comp rx=0 tx=0).stop 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- 172.21.15.161:0/1685195849 shutdown_connections 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1685195849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6e5690 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- 172.21.15.161:0/1685195849 >> 172.21.15.161:0/1685195849 conn(0x55d1db5ee5c0 msgr2=0x55d1db6e0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- 172.21.15.161:0/1685195849 shutdown_connections 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- 172.21.15.161:0/1685195849 wait complete. 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30c2e13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1db5fb430 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30be547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30be547640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32964/0 (socket says 172.21.15.161:32964) 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.615+0000 7f30be547640 1 -- 172.21.15.161:0/1861660131 learned_addr learned my addr 172.21.15.161:0/1861660131 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f30be547640 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db6ed740 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f30be547640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f30b000f000 tx=0x7f30b0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f2faae05640 1 -- 172.21.15.161:0/1861660131 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0022020 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f2faae05640 1 -- 172.21.15.161:0/1861660131 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0019040 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1db6ed9d0 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f2faae05640 1 -- 172.21.15.161:0/1861660131 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b0004a40 con 0x55d1db567020 2024-05-08T09:21:53.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.616+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1db6f0680 con 0x55d1db567020 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f2faae05640 1 -- 172.21.15.161:0/1861660131 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30b0025020 con 0x55d1db567020 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f2faae05640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 0x7f2fa4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f2faae05640 1 -- 172.21.15.161:0/1861660131 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f30b004c580 con 0x55d1db567020 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 0x7f2fa4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 0x55d1db6f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db6f49c0 con 0x55d1db5f83f0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.617+0000 7f30bed48640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 0x55d1db6f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 0x7f2fa4038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30b4054000 tx=0x7f30b404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30bed48640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 0x55d1db6f4440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30bed48640 1 -- 172.21.15.161:0/1861660131 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b80083e0 con 0x55d1db5f83f0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db6f19f0 con 0x55d1db5f83f0 2024-05-08T09:21:53.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30bed48640 1 -- 172.21.15.161:0/1861660131 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30b80083e0 con 0x55d1db5f83f0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 0x55d1db6f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.618+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db6f97b0 con 0x55d1db6f6cd0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.619+0000 7f30be547640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 0x55d1db6f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.619+0000 7f30be547640 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 0x55d1db6f90c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.619+0000 7f30be547640 1 -- 172.21.15.161:0/1861660131 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db6f6cd0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.619+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db6f5c80 con 0x55d1db5f83f0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.619+0000 7f30bed48640 1 -- 172.21.15.161:0/1861660131 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30b80083e0 con 0x55d1db5f83f0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db6f6140 con 0x55d1db5f83f0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30bed48640 1 -- 172.21.15.161:0/1861660131 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f30b80083e0 con 0x55d1db5f83f0 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30c2e13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30c2e13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1db4e5cf0 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32966/0 (socket says 172.21.15.161:32966) 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.620+0000 7f30bed48640 1 -- 172.21.15.161:0/1793335247 learned_addr learned my addr 172.21.15.161:0/1793335247 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f30bed48640 1 -- 172.21.15.161:0/1793335247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db5f31e0 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f30bed48640 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55d1db6ee600 tx=0x7f30b800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f2fa3fff640 1 -- 172.21.15.161:0/1793335247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b8007d00 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f2fa3fff640 1 -- 172.21.15.161:0/1793335247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b801e020 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f2fa3fff640 1 -- 172.21.15.161:0/1793335247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b8019420 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1db5f3470 con 0x55d1db5f4830 2024-05-08T09:21:53.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.621+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1db5f3970 con 0x55d1db5f4830 2024-05-08T09:21:53.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f2fa3fff640 1 -- 172.21.15.161:0/1793335247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30b8016040 con 0x55d1db5f4830 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f2fa3fff640 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 0x7f2f98038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f2fa3fff640 1 -- 172.21.15.161:0/1793335247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f30b801f030 con 0x55d1db5f4830 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f30be547640 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 0x7f2f98038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.622+0000 7f30be547640 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 0x7f2f98038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55d1db6f4e40 tx=0x7f30b00119f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30c2e13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30c2e13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1db6e5fe0 con 0x55d1db717e80 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32974/0 (socket says 172.21.15.161:32974) 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30bed48640 1 -- 172.21.15.161:0/3964960337 learned_addr learned my addr 172.21.15.161:0/3964960337 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30bed48640 1 -- 172.21.15.161:0/3964960337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db718870 con 0x55d1db717e80 2024-05-08T09:21:53.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f30bed48640 1 --2- 172.21.15.161:0/3964960337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f30b8018fd0 tx=0x7f30b80163f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3118053f7ba1b883 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f2fa1ffb640 1 -- 172.21.15.161:0/3964960337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b801d070 con 0x55d1db717e80 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f2fa1ffb640 1 -- 172.21.15.161:0/3964960337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b804b230 con 0x55d1db717e80 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.623+0000 7f2fa1ffb640 1 -- 172.21.15.161:0/3964960337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b8017570 con 0x55d1db717e80 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- 172.21.15.161:0/3964960337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 msgr2=0x55d1db7182a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 --2- 172.21.15.161:0/3964960337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f30b8018fd0 tx=0x7f30b80163f0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- 172.21.15.161:0/3964960337 shutdown_connections 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 --2- 172.21.15.161:0/3964960337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db7182a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- 172.21.15.161:0/3964960337 >> 172.21.15.161:0/3964960337 conn(0x55d1db7141e0 msgr2=0x55d1db712240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- 172.21.15.161:0/3964960337 shutdown_connections 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- 172.21.15.161:0/3964960337 wait complete. 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 Processor -- start 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- start start 2024-05-08T09:21:53.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30c2e13800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d1db718fe0 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30bed48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32976/0 (socket says 172.21.15.161:32976) 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.624+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 learned_addr learned my addr 172.21.15.161:0/1803300796 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1db71fa20 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f30bed48640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30b8018010 tx=0x7f30b804c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f2f8ffff640 1 -- 172.21.15.161:0/1803300796 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b8031030 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f2f8ffff640 1 -- 172.21.15.161:0/1803300796 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b8014950 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d1db71fcb0 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f2f8ffff640 1 -- 172.21.15.161:0/1803300796 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f30b8014c30 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.625+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1db722960 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.626+0000 7f2f8ffff640 1 -- 172.21.15.161:0/1803300796 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f30b8034070 con 0x55d1db717e80 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.626+0000 7f2f8ffff640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f88036950 0x7f2f88038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.626+0000 7f2f8ffff640 1 -- 172.21.15.161:0/1803300796 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f30b8032070 con 0x55d1db717e80 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.626+0000 7f30be547640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f88036950 0x7f2f88038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.626+0000 7f30be547640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f88036950 0x7f2f88038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001fb0 tx=0x7f30b0011bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db72afe0 0x55d1db72d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db72dbf0 con 0x55d1db72afe0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db72afe0 0x55d1db72d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db72afe0 0x55d1db72d4a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 realm 2024-05-08T09:21:53.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db72dfc0 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.627+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db72e890 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db72ec30 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db72f990 0x55d1db731d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db732390 con 0x55d1db72f990 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.628+0000 7f30bed48640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db72f990 0x55d1db731d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30bed48640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db72f990 0x55d1db731d80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30c2e13800 20 searching for the correct realm 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d1db734320 0x55d1db7367e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30be547640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d1db734320 0x55d1db7367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.629+0000 7f30be547640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d1db734320 0x55d1db7367e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30be547640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f30b0027020 0x7f30b0044000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f30b0027020 0x7f30b0044000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30bdd46640 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f30b0027020 0x7f30b0044000 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.630+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.631+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.632+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.633+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.634+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.635+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.636+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.637+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db734320 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72f990 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x55d1db72afe0 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.638+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55d1db736eb0 con 0x7f30b0027020 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db733870 con 0x55d1db72afe0 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7327f0 con 0x55d1db72afe0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.639+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7331b0 con 0x55d1db72afe0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 zone default found 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 4 Realm: () 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 zonegroup default 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7377e0 con 0x55d1db72f990 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db739a10 con 0x55d1db734320 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.640+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db739db0 con 0x55d1db734320 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.641+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.641+0000 7f30c2e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.641+0000 7f30c2e13800 20 started sync module instance, tier type = 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.641+0000 7f30c2e13800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.641+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db738e50 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.642+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.642+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94359818310528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db738e50 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.642+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73a770 con 0x55d1db72afe0 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.643+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94359818310528] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.643+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.643+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94359818308000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73a770 con 0x55d1db72afe0 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.643+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73b1a0 con 0x55d1db734320 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.644+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.644+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94359818316976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ba70 con 0x55d1db734320 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.644+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73c530 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.644+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94359818308000] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.645+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94359818316976] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.645+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.645+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94359818319296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73a2c0 con 0x7f30b0027020 2024-05-08T09:21:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.645+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73cdd0 con 0x55d1db72afe0 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.646+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.646+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94359818324096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73d1c0 con 0x55d1db72afe0 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.646+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73dce0 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.646+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94359818319296] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.647+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94359818324096] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.648+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.648+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94359818325152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73dca0 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.648+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73e580 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.649+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.649+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94359818329248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73e630 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.649+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73f150 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.649+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94359818325152] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94359818329248] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94359818330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73d7b0 con 0x55d1db72f990 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=0 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=1 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=2 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=3 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=4 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=5 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.650+0000 7f30c2e13800 20 add_watcher() i=6 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.651+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94359818330304] v27'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.651+0000 7f30c2e13800 20 add_watcher() i=7 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.651+0000 7f30c2e13800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.651+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db742140 con 0x55d1db72afe0 2024-05-08T09:21:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.652+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.652+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94359818333216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73f5c0 con 0x55d1db72afe0 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94359818333216] v27'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f2f74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 5 note: GC not initialized 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f2eef7fe640 20 reqs_thread_entry: start 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 20 Filter name: none 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f2eed7fa640 20 reqs_thread_entry: start 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.653+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db775500 con 0x55d1db72afe0 2024-05-08T09:21:53.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db775050 con 0x55d1db72afe0 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=193 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.654+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.6 8:609c8fc6:root::.bucket.meta.testx%3amyfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db778f30 con 0x55d1db72f990 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~412 out=412b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+774 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 20 rados_obj.operate() r=0 bl.length=412 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.655+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db77d1c0 con 0x55d1db72afe0 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.656+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v27'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.656+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [create,call version.inc in=38b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db780ad0 con 0x7f30b0027020 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [create,call,writefull 0~379,setxattr (123)] v27'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30c2e13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x7 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30c2e13800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30c2e13800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30c2e13800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94359818594416 in=740b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db780530 con 0x55d1db734320 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94359818316976 notify 115964117001 ret 0) ==== 770+0+0 (crc 0 0 0) 0x7f30b0052040 con 0x55d1db734320 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f2fa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117001 cookie 94359818316976 notifier 4547 bl.length()=728 2024-05-08T09:21:53.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f2fa1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x7 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f2fa1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f2fa1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94359818594416 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.657+0000 7f2fa1ffb640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2f84003ea0 con 0x55d1db734320 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94359818594416 notify 115964117001 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1db6f0680 con 0x55d1db734320 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30c2e13800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30c2e13800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30c2e13800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30c2e13800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.658+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7805d0 con 0x7f30b0027020 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.659+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(69 foo.buckets [call] v27'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.659+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7805d0 con 0x7f30b0027020 2024-05-08T09:21:53.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.660+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v27'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.660+0000 7f30c2e13800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.660+0000 7f30c2e13800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.660+0000 7f30c2e13800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.660+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94359818600736 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db780540 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== watch-notify(notify (1) cookie 94359818329248 notify 115964117007 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55d1db71fa20 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f2fa17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 94359818329248 notifier 4547 bl.length()=314 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f2fa17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f2fa17fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(71 notify.6 [notify cookie 94359818600736 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f2fa17fa640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2ef4003400 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify_complete (2) cookie 94359818600736 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1db718870 con 0x55d1db72f990 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.661+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7805d0 con 0x55d1db72afe0 2024-05-08T09:21:53.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(73 testx/myfoo [call,delete] v27'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30c2e13800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30c2e13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 94359818600736 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db780540 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== watch-notify(notify (1) cookie 94359818324096 notify 115964117005 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55d1db780970 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f2fa1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 94359818324096 notifier 4547 bl.length()=155 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f2fa1ffb640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2f84003ea0 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(74 notify.4 [notify cookie 94359818600736 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.662+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.663+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== watch-notify(notify_complete (2) cookie 94359818600736 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1db77f880 con 0x55d1db72afe0 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.663+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 8.6 8:609c8fc6:root::.bucket.meta.testx%3amyfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7805d0 con 0x55d1db72f990 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call,delete] v27'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30c2e13800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 from cache 2024-05-08T09:21:53.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30c2e13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94359818571424 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7805d0 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== watch-notify(notify (1) cookie 94359818308000 notify 115964117006 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55d1db77f880 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f2fa17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117006 cookie 94359818308000 notifier 4547 bl.length()=212 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f2fa17fa640 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f2ef4003470 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(77 notify.1 [notify cookie 94359818571424 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.664+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.665+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== watch-notify(notify_complete (2) cookie 94359818571424 notify 115964117006 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55d1db780e70 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.665+0000 7f2f74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.665+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94359818333216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db7283e0 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.666+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94359818333216] v27'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.666+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94359818310528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x7f30b0027020 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.667+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94359818310528] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.667+0000 7f30c2e13800 20 remove_watcher() i=0 2024-05-08T09:21:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.667+0000 7f30c2e13800 2 removed watcher, disabling cache 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.667+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94359818308000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x55d1db72afe0 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.669+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94359818308000] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.669+0000 7f30c2e13800 20 remove_watcher() i=1 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.669+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94359818316976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x55d1db734320 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30be547640 1 -- 172.21.15.161:0/1803300796 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94359818316976] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b000f030 con 0x55d1db734320 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30c2e13800 20 remove_watcher() i=2 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94359818319296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x7f30b0027020 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94359818319296] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x7f30b0027020 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30c2e13800 20 remove_watcher() i=3 2024-05-08T09:21:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.670+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94359818324096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73b5c0 con 0x55d1db72afe0 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.672+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94359818324096] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b405a040 con 0x55d1db72afe0 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.672+0000 7f30c2e13800 20 remove_watcher() i=4 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.672+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94359818325152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x55d1db72f990 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.673+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94359818325152] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.673+0000 7f30c2e13800 20 remove_watcher() i=5 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.673+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94359818329248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73b5c0 con 0x55d1db72f990 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.674+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94359818329248] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.674+0000 7f30c2e13800 20 remove_watcher() i=6 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.674+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94359818330304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55d1db73ec20 con 0x55d1db72f990 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30bed48640 1 -- 172.21.15.161:0/1803300796 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94359818330304] v27'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f30b8057040 con 0x55d1db72f990 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 20 remove_watcher() i=7 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db72f990 msgr2=0x55d1db731d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db72f990 0x55d1db731d80 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db72afe0 msgr2=0x55d1db72d4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db72afe0 0x55d1db72d4a0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f30b0027020 msgr2=0x7f30b0044000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f30b0027020 0x7f30b0044000 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d1db734320 msgr2=0x55d1db7367e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d1db734320 0x55d1db7367e0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f88036950 msgr2=0x7f2f88038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f88036950 0x7f2f88038e10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30b0001fb0 tx=0x7f30b0011bc0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 msgr2=0x55d1db71f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f30b8018010 tx=0x7f30b804c7b0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30bdd46640 1 -- 172.21.15.161:0/1803300796 reap_dead start 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 shutdown_connections 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1803300796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db717e80 0x55d1db71f4e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 >> 172.21.15.161:0/1803300796 conn(0x55d1db7141e0 msgr2=0x55d1db711840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 shutdown_connections 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.675+0000 7f30c2e13800 1 -- 172.21.15.161:0/1803300796 wait complete. 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 msgr2=0x7f2f98038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 0x7f2f98038e10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x55d1db6f4e40 tx=0x7f30b00119f0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 msgr2=0x55d1db5f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x55d1db6ee600 tx=0x7f30b800aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 shutdown_connections 2024-05-08T09:21:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2f98036950 0x7f2f98038e10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1793335247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db5f4830 0x55d1db5f2ca0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 >> 172.21.15.161:0/1793335247 conn(0x55d1db6fca00 msgr2=0x55d1db6fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 shutdown_connections 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1793335247 wait complete. 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 msgr2=0x55d1db6f90c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 0x55d1db6f90c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 msgr2=0x55d1db6f4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 0x55d1db6f4440 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 msgr2=0x7f2fa4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 0x7f2fa4038e10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30b4054000 tx=0x7f30b404e000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 msgr2=0x55d1db6ed200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f30b000f000 tx=0x7f30b0000f40 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 shutdown_connections 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d1db6f6cd0 0x55d1db6f90c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d1db5f83f0 0x55d1db6f4440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2fa4036950 0x7f2fa4038e10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 --2- 172.21.15.161:0/1861660131 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d1db567020 0x55d1db6ed200 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 >> 172.21.15.161:0/1861660131 conn(0x55d1db5ee5c0 msgr2=0x55d1db6df7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 shutdown_connections 2024-05-08T09:21:53.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.676+0000 7f30c2e13800 1 -- 172.21.15.161:0/1861660131 wait complete. 2024-05-08T09:21:53.685 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T09:21:53.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-05-08T09:21:53.685 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-05-08T09:21:53.731 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.731 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.732+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4eb3f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x555a8547c400 0x555a8547e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4eb3f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555a8547ef20 con 0x555a853eb040 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4eb3f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x555a85309050 con 0x555a8547c400 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b43fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x555a8547c400 0x555a8547e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4a89b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x555a853eb040 0x555a8547ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50874/0 (socket says 172.21.15.161:50874) 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b4a89b640 1 -- 172.21.15.161:0/835864104 learned_addr learned my addr 172.21.15.161:0/835864104 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b43fff640 1 -- 172.21.15.161:0/835864104 >> v1:172.21.15.45:6789/0 conn(0x555a853eb040 legacy=0x555a8547ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.733+0000 7f4b43fff640 1 -- 172.21.15.161:0/835864104 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a85480150 con 0x555a8547c400 2024-05-08T09:21:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.735+0000 7f4b43fff640 1 --2- 172.21.15.161:0/835864104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8547c400 0x555a8547e8a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400a470 tx=0x7f4b3401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a71dae94809bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.735+0000 7f4b4a09a640 1 -- 172.21.15.161:0/835864104 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b34057070 con 0x555a8547c400 2024-05-08T09:21:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.735+0000 7f4b4a09a640 1 -- 172.21.15.161:0/835864104 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b34052570 con 0x555a8547c400 2024-05-08T09:21:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.735+0000 7f4b4a09a640 1 -- 172.21.15.161:0/835864104 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b34052870 con 0x555a8547c400 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/835864104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8547c400 msgr2=0x555a8547e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/835864104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8547c400 0x555a8547e8a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4b3400a470 tx=0x7f4b3401ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/835864104 shutdown_connections 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/835864104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8547c400 0x555a8547e8a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/835864104 >> 172.21.15.161:0/835864104 conn(0x555a854725c0 msgr2=0x555a854749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/835864104 shutdown_connections 2024-05-08T09:21:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.736+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/835864104 wait complete. 2024-05-08T09:21:53.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.750+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.750+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.750+0000 7f4b4eb3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.750+0000 7f4b4eb3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555a853c31c0 con 0x555a853eb040 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.751+0000 7f4b4a89b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.751+0000 7f4b4a89b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32996/0 (socket says 172.21.15.161:32996) 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.751+0000 7f4b4a89b640 1 -- 172.21.15.161:0/2272315885 learned_addr learned my addr 172.21.15.161:0/2272315885 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.750 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.751+0000 7f4b4a89b640 1 -- 172.21.15.161:0/2272315885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a85476b70 con 0x555a853eb040 2024-05-08T09:21:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.751+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/2272315885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001de0 tx=0x7f4b3c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3f4d09d8b9c923 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4a38e09640 1 -- 172.21.15.161:0/2272315885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c012020 con 0x555a853eb040 2024-05-08T09:21:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4a38e09640 1 -- 172.21.15.161:0/2272315885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c00e5a0 con 0x555a853eb040 2024-05-08T09:21:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4a38e09640 1 -- 172.21.15.161:0/2272315885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c00e8c0 con 0x555a853eb040 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2272315885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 msgr2=0x555a854785b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/2272315885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c001de0 tx=0x7f4b3c00b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2272315885 shutdown_connections 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/2272315885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a854785b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2272315885 >> 172.21.15.161:0/2272315885 conn(0x555a854725c0 msgr2=0x555a85565030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2272315885 shutdown_connections 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.752+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2272315885 wait complete. 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4eb3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4eb3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555a8547f3f0 con 0x555a853eb040 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4a89b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4a89b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33008/0 (socket says 172.21.15.161:33008) 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4a89b640 1 -- 172.21.15.161:0/4086889936 learned_addr learned my addr 172.21.15.161:0/4086889936 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.753+0000 7f4b4a89b640 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a855739b0 con 0x555a853eb040 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c010 tx=0x7f4b3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4a37606640 1 -- 172.21.15.161:0/4086889936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c012070 con 0x555a853eb040 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4a37606640 1 -- 172.21.15.161:0/4086889936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c01a7a0 con 0x555a853eb040 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a85573c40 con 0x555a853eb040 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4a37606640 1 -- 172.21.15.161:0/4086889936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c01aa80 con 0x555a853eb040 2024-05-08T09:21:53.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.754+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a855768f0 con 0x555a853eb040 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4a37606640 1 -- 172.21.15.161:0/4086889936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b3c015020 con 0x555a853eb040 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4a37606640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 0x7f4a30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4a37606640 1 -- 172.21.15.161:0/4086889936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b3c020070 con 0x555a853eb040 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b43fff640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 0x7f4a30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 0x555a8557a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a8557abf0 con 0x555a8547c400 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 0x555a8557a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b43fff640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 0x7f4a30038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b34054000 tx=0x7f4b3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.755+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 0x555a8557a6b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4b09c640 1 -- 172.21.15.161:0/4086889936 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b4400a4a0 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a85577c80 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4b09c640 1 -- 172.21.15.161:0/4086889936 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b4400a4a0 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 0x555a8557f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a8557f9c0 con 0x555a8557cee0 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.756+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 0x555a8557f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.757+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 0x555a8557f2d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.757+0000 7f4b4a89b640 1 -- 172.21.15.161:0/4086889936 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a8557cee0 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.757+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a8557be90 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.757+0000 7f4b4b09c640 1 -- 172.21.15.161:0/4086889936 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b4400a4a0 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.757+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a8557c370 con 0x555a8547c400 2024-05-08T09:21:53.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4b09c640 1 -- 172.21.15.161:0/4086889936 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4b4400a4a0 con 0x555a8547c400 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4eb3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4eb3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555a85369cf0 con 0x555a8558eb30 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33022/0 (socket says 172.21.15.161:33022) 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.758+0000 7f4b4b09c640 1 -- 172.21.15.161:0/1765395087 learned_addr learned my addr 172.21.15.161:0/1765395087 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4b4b09c640 1 -- 172.21.15.161:0/1765395087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a8558f490 con 0x555a8558eb30 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x555a8557af90 tx=0x7f4b44018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4a34e01640 1 -- 172.21.15.161:0/1765395087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44014450 con 0x555a8558eb30 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4a34e01640 1 -- 172.21.15.161:0/1765395087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b44014610 con 0x555a8558eb30 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a8558ff00 con 0x555a8558eb30 2024-05-08T09:21:53.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4a34e01640 1 -- 172.21.15.161:0/1765395087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44014930 con 0x555a8558eb30 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.759+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a85590400 con 0x555a8558eb30 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4a34e01640 1 -- 172.21.15.161:0/1765395087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b44011040 con 0x555a8558eb30 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4a34e01640 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 0x7f4a24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4a34e01640 1 -- 172.21.15.161:0/1765395087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b4401e070 con 0x555a8558eb30 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 0x7f4a24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 0x7f4a24038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x555a8557b030 tx=0x7f4b3c00b6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.760+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4eb3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4eb3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555a85476ef0 con 0x555a8559be10 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33028/0 (socket says 172.21.15.161:33028) 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4b09c640 1 -- 172.21.15.161:0/2678658903 learned_addr learned my addr 172.21.15.161:0/2678658903 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4b09c640 1 -- 172.21.15.161:0/2678658903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a8559c800 con 0x555a8559be10 2024-05-08T09:21:53.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/2678658903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b4404c8b0 tx=0x7f4b44011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716f9717e494b18a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4a2e7fc640 1 -- 172.21.15.161:0/2678658903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44028070 con 0x555a8559be10 2024-05-08T09:21:53.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4a2e7fc640 1 -- 172.21.15.161:0/2678658903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b44022d90 con 0x555a8559be10 2024-05-08T09:21:53.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.761+0000 7f4a2e7fc640 1 -- 172.21.15.161:0/2678658903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44016ab0 con 0x555a8559be10 2024-05-08T09:21:53.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2678658903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 msgr2=0x555a8559c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/2678658903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4b4404c8b0 tx=0x7f4b44011a80 comp rx=0 tx=0).stop 2024-05-08T09:21:53.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2678658903 shutdown_connections 2024-05-08T09:21:53.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/2678658903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a8559c230 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2678658903 >> 172.21.15.161:0/2678658903 conn(0x555a85598170 msgr2=0x555a855961d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2678658903 shutdown_connections 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/2678658903 wait complete. 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 Processor -- start 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- start start 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.762+0000 7f4b4eb3f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555a8559cf70 con 0x555a8559be10 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4b09c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33030/0 (socket says 172.21.15.161:33030) 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 learned_addr learned my addr 172.21.15.161:0/301186124 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a855a3900 con 0x555a8559be10 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b44011f60 tx=0x7f4b4400a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4a2cff9640 1 -- 172.21.15.161:0/301186124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44033070 con 0x555a8559be10 2024-05-08T09:21:53.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4a2cff9640 1 -- 172.21.15.161:0/301186124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b4404b230 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555a855a3b90 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4a2cff9640 1 -- 172.21.15.161:0/301186124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b44028050 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.763+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a855a6840 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.764+0000 7f4a2cff9640 1 -- 172.21.15.161:0/301186124 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4b4403bb00 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.764+0000 7f4a2cff9640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a14036950 0x7f4a14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.764+0000 7f4a2cff9640 1 -- 172.21.15.161:0/301186124 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4b4400e040 con 0x555a8559be10 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.764+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a14036950 0x7f4a14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a14036950 0x7f4a14038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c016e90 tx=0x7f4b3c031040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a855af000 0x555a855b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b1c10 con 0x555a855af000 2024-05-08T09:21:53.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b43fff640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a855af000 0x555a855b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b43fff640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a855af000 0x555a855b14c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.765+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 realm 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b1fe0 con 0x555a855af000 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b28b0 con 0x555a855af000 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b2c50 con 0x555a855af000 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a855b39b0 0x555a855b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.766+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b6360 con 0x555a855b39b0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a855b39b0 0x555a855b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4b09c640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a855b39b0 0x555a855b5da0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4b4402a070 con 0x555a855b39b0 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4eb3f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4eb3f800 20 searching for the correct realm 2024-05-08T09:21:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555a855b8310 0x555a855ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b8310 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.767+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555a855b8310 0x555a855ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.768+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555a855b8310 0x555a855ba7d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.768+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.768+0000 7f4b4a89b640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4b3c017050 0x7f4b3c0163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.768+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x7f4b3c017050 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.768+0000 7f4b43fff640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4b3c017050 0x7f4b3c0163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.769+0000 7f4b43fff640 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4b3c017050 0x7f4b3c0163b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.769+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.769+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b39b0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.769+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b4402a070 con 0x555a855b39b0 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.769+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855af000 2024-05-08T09:21:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855af000 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b39b0 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.770+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b39b0 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x7f4b3c017050 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b8310 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855af000 2024-05-08T09:21:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.771+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b39b0 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855af000 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x7f4b3c017050 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x555a855baea0 con 0x555a855b8310 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.772+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b39b0 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.773+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855af000 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855af000 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b39b0 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.774+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x7f4b3c017050 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855af000 2024-05-08T09:21:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.775+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x7f4b3c017050 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b8310 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.776+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x555a855af000 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f4b3c059040 con 0x7f4b3c017050 2024-05-08T09:21:53.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:53.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:53.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.777+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b6d20 con 0x555a855af000 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b6960 con 0x555a855af000 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855b7700 con 0x555a855af000 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 zone default found 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 4 Realm: () 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 zonegroup default 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855bb3b0 con 0x555a855b39b0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.778+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855bd680 con 0x555a855b8310 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855bda20 con 0x555a855b8310 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 20 started sync module instance, tier type = 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.779+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bcb10 con 0x7f4b3c017050 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.780+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.780+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93847272804416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bcb10 con 0x7f4b3c017050 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.780+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855be430 con 0x555a855af000 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.781+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.781+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93847272808320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855be3e0 con 0x555a855af000 2024-05-08T09:21:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.781+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bf3f0 con 0x555a855b8310 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.782+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93847272808320] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.783+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93847272804416] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.783+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.783+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93847272801888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855be820 con 0x555a855b8310 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.783+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bfc90 con 0x7f4b3c017050 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.784+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93847272801888] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.784+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.784+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93847272812192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bfc90 con 0x7f4b3c017050 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.784+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c06e0 con 0x555a855af000 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.785+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93847272812192] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.785+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.785+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93847272817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bfc90 con 0x555a855af000 2024-05-08T09:21:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.785+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c10f0 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.786+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93847272817136] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.786+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.786+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93847272814560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bfc00 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.786+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c1f60 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.787+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93847272814560] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.788+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.788+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93847272821904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c1f60 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.788+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c2960 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.788+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93847272821904] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93847272825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c2b40 con 0x555a855b39b0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=0 2024-05-08T09:21:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=1 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=2 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=3 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=4 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=5 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4eb3f800 20 add_watcher() i=6 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.789+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93847272825968] v27'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.790+0000 7f4b4eb3f800 20 add_watcher() i=7 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.790+0000 7f4b4eb3f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.790+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855c5f10 con 0x555a855af000 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.790+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.790+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93847272827440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c3300 con 0x555a855af000 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.791+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93847272827440] v27'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.791+0000 7f4a017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.791+0000 7f4b4eb3f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.791+0000 7f4b4eb3f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.791+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855ce650 con 0x555a855af000 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.792+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.792+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855ced20 con 0x555a855b39b0 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.794+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.794+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855ced20 con 0x555a855b8310 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.795+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.795+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cf1d0 con 0x555a855af000 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.795+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'135 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.795+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc5f0 con 0x7f4b3c017050 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.796+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.796+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc5f0 con 0x555a855b8310 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.798+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.798+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc5f0 con 0x555a855af000 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.799+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.799+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x555a855b39b0 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.800+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.800+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x7f4b3c017050 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.801+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.801+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x555a855b8310 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.802+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'22 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.802+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x7f4b3c017050 2024-05-08T09:21:53.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.803+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.803+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x555a855b39b0 2024-05-08T09:21:53.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.804+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.804+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x7f4b3c017050 2024-05-08T09:21:53.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.805+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.805+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x555a855b39b0 2024-05-08T09:21:53.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.807+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'31 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.807+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc680 con 0x555a855af000 2024-05-08T09:21:53.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.808+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.808+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cc5f0 con 0x555a855b8310 2024-05-08T09:21:53.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.809+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'32 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.809+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x7f4b3c017050 2024-05-08T09:21:53.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.810+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.810+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.811+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.811+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855af000 2024-05-08T09:21:53.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.813+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.813+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855af000 2024-05-08T09:21:53.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.814+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.814+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.815+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'33 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.815+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x7f4b3c017050 2024-05-08T09:21:53.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.816+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.816+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.817+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.817+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.818+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.818+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.818+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.818+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.819+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.820+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b39b0 2024-05-08T09:21:53.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.821+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.821+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.822+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.822+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b39b0 2024-05-08T09:21:53.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.823+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.823+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b8310 2024-05-08T09:21:53.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.824+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'34 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.824+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x555a855b39b0 2024-05-08T09:21:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.825+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'32 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.825+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855d0240 con 0x7f4b3c017050 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.826+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.826+0000 7f497bfff640 20 reqs_thread_entry: start 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 20 Filter name: none 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4979ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855fb1f0 con 0x555a855b39b0 2024-05-08T09:21:53.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 20 rados_obj.operate() r=0 bl.length=419 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.827+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855facd0 con 0x555a855af000 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.828+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.828+0000 7f4b4eb3f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T09:21:53.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.828+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855facd0 con 0x555a855b39b0 2024-05-08T09:21:53.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v27'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4eb3f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 93847273064032 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855fdf40 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== watch-notify(notify (1) cookie 93847272801888 notify 115964117002 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555a855a6840 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4a2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117002 cookie 93847272801888 notifier 4554 bl.length()=170 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(97 notify.2 [notify cookie 93847273064032 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4a2e7fc640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4a10003d60 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== watch-notify(notify_complete (2) cookie 93847273064032 notify 115964117002 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4b3c053040 con 0x555a855b8310 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4eb3f800 10 removing email index: 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4eb3f800 10 removing user buckets index 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.829+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855fbb00 con 0x555a855af000 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.830+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v27'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.830+0000 7f4b4eb3f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.830+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 93847273064032 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855fdf40 con 0x555a855af000 2024-05-08T09:21:53.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.830+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== watch-notify(notify (1) cookie 93847272817136 notify 115964117007 ret 0) ==== 217+0+0 (crc 0 0 0) 0x555a855cfd30 con 0x555a855af000 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4a2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117007 cookie 93847272817136 notifier 4554 bl.length()=175 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4a2dffb640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f49800032c0 con 0x555a855af000 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(100 notify.4 [notify cookie 93847273064032 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== watch-notify(notify_complete (2) cookie 93847273064032 notify 115964117007 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a855cbe70 con 0x555a855af000 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4b4eb3f800 10 removing user index: testx$tenanteduser 2024-05-08T09:21:53.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.831+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855ffb40 con 0x555a855b39b0 2024-05-08T09:21:53.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.832+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v27'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.832+0000 7f4b4eb3f800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-05-08T09:21:53.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.832+0000 7f4b4eb3f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-05-08T09:21:53.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.832+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 93847273059776 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x555a855fcea0 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== watch-notify(notify (1) cookie 93847272812192 notify 115964117005 ret 0) ==== 209+0+0 (crc 0 0 0) 0x555a855cbe70 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4a2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117005 cookie 93847272812192 notifier 4554 bl.length()=167 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4a2e7fc640 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f4a10003d60 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(103 notify.3 [notify cookie 93847273059776 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== watch-notify(notify_complete (2) cookie 93847273059776 notify 115964117005 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555a855ce2c0 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.833+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.834+0000 7f4a017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:53.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.834+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93847272827440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cb2c0 con 0x555a855af000 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.835+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 93847272827440] v27'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.835+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93847272804416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855cb2c0 con 0x7f4b3c017050 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.836+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 93847272804416] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.836+0000 7f4b4eb3f800 20 remove_watcher() i=0 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.836+0000 7f4b4eb3f800 2 removed watcher, disabling cache 2024-05-08T09:21:53.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.836+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93847272808320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bd040 con 0x555a855af000 2024-05-08T09:21:53.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.837+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 93847272808320] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.837+0000 7f4b4eb3f800 20 remove_watcher() i=1 2024-05-08T09:21:53.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.837+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93847272801888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bd040 con 0x555a855b8310 2024-05-08T09:21:53.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.838+0000 7f4b4a89b640 1 -- 172.21.15.161:0/301186124 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 93847272801888] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3c02b070 con 0x555a855b8310 2024-05-08T09:21:53.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.838+0000 7f4b4eb3f800 20 remove_watcher() i=2 2024-05-08T09:21:53.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.838+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93847272812192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bd040 con 0x7f4b3c017050 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.839+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 93847272812192] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x7f4b3c017050 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.839+0000 7f4b4eb3f800 20 remove_watcher() i=3 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.839+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93847272817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855beea0 con 0x555a855af000 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.840+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 93847272817136] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b3405a040 con 0x555a855af000 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.840+0000 7f4b4eb3f800 20 remove_watcher() i=4 2024-05-08T09:21:53.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.840+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93847272814560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855c01f0 con 0x555a855b39b0 2024-05-08T09:21:53.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.841+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 93847272814560] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.842+0000 7f4b4eb3f800 20 remove_watcher() i=5 2024-05-08T09:21:53.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.842+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93847272821904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bf7e0 con 0x555a855b39b0 2024-05-08T09:21:53.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.843+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 93847272821904] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.843+0000 7f4b4eb3f800 20 remove_watcher() i=6 2024-05-08T09:21:53.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.843+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93847272825968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x555a855bf7e0 con 0x555a855b39b0 2024-05-08T09:21:53.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4b09c640 1 -- 172.21.15.161:0/301186124 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 93847272825968] v27'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4b44058040 con 0x555a855b39b0 2024-05-08T09:21:53.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 20 remove_watcher() i=7 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a855b39b0 msgr2=0x555a855b5da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a855b39b0 0x555a855b5da0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a855af000 msgr2=0x555a855b14c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a855af000 0x555a855b14c0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4b3c017050 msgr2=0x7f4b3c0163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4b3c017050 0x7f4b3c0163b0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555a855b8310 msgr2=0x555a855ba7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555a855b8310 0x555a855ba7d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a14036950 msgr2=0x7f4a14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a14036950 0x7f4a14038e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c016e90 tx=0x7f4b3c031040 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 msgr2=0x555a855a33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4b44011f60 tx=0x7f4b4400a9b0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b43fff640 1 -- 172.21.15.161:0/301186124 reap_dead start 2024-05-08T09:21:53.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 shutdown_connections 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/301186124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8559be10 0x555a855a33c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 >> 172.21.15.161:0/301186124 conn(0x555a85598170 msgr2=0x555a855957d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 shutdown_connections 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.844+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/301186124 wait complete. 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 msgr2=0x7f4a24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 0x7f4a24038dc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x555a8557b030 tx=0x7f4b3c00b6c0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 msgr2=0x555a8558ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x555a8557af90 tx=0x7f4b44018830 comp rx=0 tx=0).stop 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 shutdown_connections 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a24036900 0x7f4a24038dc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/1765395087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a8558eb30 0x555a8558ef50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 >> 172.21.15.161:0/1765395087 conn(0x555a85582bd0 msgr2=0x555a85582fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 shutdown_connections 2024-05-08T09:21:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/1765395087 wait complete. 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 msgr2=0x555a8557f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 0x555a8557f2d0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 msgr2=0x555a8557a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 0x555a8557a6b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 msgr2=0x7f4a30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 0x7f4a30038e10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4b34054000 tx=0x7f4b3404e000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 msgr2=0x555a85573470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00c010 tx=0x7f4b3c000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 shutdown_connections 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555a8557cee0 0x555a8557f2d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555a8547c400 0x555a8557a6b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4a30036950 0x7f4a30038e10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 --2- 172.21.15.161:0/4086889936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a853eb040 0x555a85573470 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 >> 172.21.15.161:0/4086889936 conn(0x555a854725c0 msgr2=0x555a85477450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 shutdown_connections 2024-05-08T09:21:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.845+0000 7f4b4eb3f800 1 -- 172.21.15.161:0/4086889936 wait complete. 2024-05-08T09:21:53.861 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T09:21:53.864 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-05-08T09:21:53.907 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:21:53.907 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T09:21:53.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-05-08T09:21:53.907 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-05-08T09:21:53.953 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:53.954 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9e2d1f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55da4e87eb70 0x55da4e880f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9e2d1f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da4e884fb0 con 0x55da4e8814a0 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9e2d1f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55da4e70f050 con 0x55da4e87eb70 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de9ca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55da4e87eb70 0x55da4e880f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de9ca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55da4e87eb70 0x55da4e880f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33034/0 (socket says 172.21.15.161:33034) 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3561348556 learned_addr learned my addr 172.21.15.161:0/3561348556 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de1c9640 1 --1- 172.21.15.161:0/3561348556 >> v1:172.21.15.45:6789/0 conn(0x55da4e8814a0 0x55da4e883890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50886/0 (socket says 172.21.15.161:50886) 2024-05-08T09:21:53.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3561348556 >> v1:172.21.15.45:6789/0 conn(0x55da4e8814a0 legacy=0x55da4e883890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.955+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3561348556 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e886190 con 0x55da4e87eb70 2024-05-08T09:21:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.957+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/3561348556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e880f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000a520 tx=0x7fa9d001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996bee73943a70cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.957+0000 7fa9dd9c8640 1 -- 172.21.15.161:0/3561348556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0057070 con 0x55da4e87eb70 2024-05-08T09:21:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9dd9c8640 1 -- 172.21.15.161:0/3561348556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d0052570 con 0x55da4e87eb70 2024-05-08T09:21:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9dd9c8640 1 -- 172.21.15.161:0/3561348556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d004ae60 con 0x55da4e87eb70 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3561348556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 msgr2=0x55da4e880f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3561348556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e880f60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000a520 tx=0x7fa9d001d010 comp rx=0 tx=0).stop 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3561348556 shutdown_connections 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3561348556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e880f60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3561348556 >> 172.21.15.161:0/3561348556 conn(0x55da4e8785c0 msgr2=0x55da4e87a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3561348556 shutdown_connections 2024-05-08T09:21:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.958+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3561348556 wait complete. 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.972+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.972+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.972+0000 7fa9e2d1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.972+0000 7fa9e2d1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55da4e7c91c0 con 0x55da4e87eb70 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa9de9ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa9de9ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33050/0 (socket says 172.21.15.161:33050) 2024-05-08T09:21:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa9de9ca640 1 -- 172.21.15.161:0/1275574568 learned_addr learned my addr 172.21.15.161:0/1275574568 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa9de9ca640 1 -- 172.21.15.161:0/1275574568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e87ca70 con 0x55da4e87eb70 2024-05-08T09:21:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/1275574568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0055040 tx=0x7fa9d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3712d45c0e1d3262 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa8cce09640 1 -- 172.21.15.161:0/1275574568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0057040 con 0x55da4e87eb70 2024-05-08T09:21:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa8cce09640 1 -- 172.21.15.161:0/1275574568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d0052720 con 0x55da4e87eb70 2024-05-08T09:21:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.973+0000 7fa8cce09640 1 -- 172.21.15.161:0/1275574568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0052a20 con 0x55da4e87eb70 2024-05-08T09:21:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/1275574568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 msgr2=0x55da4e87e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/1275574568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0055040 tx=0x7fa9d004c000 comp rx=0 tx=0).stop 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/1275574568 shutdown_connections 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/1275574568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e87e4b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/1275574568 >> 172.21.15.161:0/1275574568 conn(0x55da4e8785c0 msgr2=0x55da4e96b010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/1275574568 shutdown_connections 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/1275574568 wait complete. 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.974+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9e2d1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9e2d1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55da4e885420 con 0x55da4e87eb70 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9de9ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9de9ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33060/0 (socket says 172.21.15.161:33060) 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3823824652 learned_addr learned my addr 172.21.15.161:0/3823824652 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e9798e0 con 0x55da4e87eb70 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0052540 tx=0x7fa9d0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa8cb606640 1 -- 172.21.15.161:0/3823824652 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0073070 con 0x55da4e87eb70 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa8cb606640 1 -- 172.21.15.161:0/3823824652 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d005d440 con 0x55da4e87eb70 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4e979b70 con 0x55da4e87eb70 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa8cb606640 1 -- 172.21.15.161:0/3823824652 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d0057070 con 0x55da4e87eb70 2024-05-08T09:21:53.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.975+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4e97c820 con 0x55da4e87eb70 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.976+0000 7fa8cb606640 1 -- 172.21.15.161:0/3823824652 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa9d0076070 con 0x55da4e87eb70 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.976+0000 7fa8cb606640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 0x7fa8c4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.976+0000 7fa8cb606640 1 -- 172.21.15.161:0/3823824652 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa9d008dc40 con 0x55da4e87eb70 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.976+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 0x7fa8c4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 0x55da4e9805e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e980b20 con 0x55da4e8814a0 2024-05-08T09:21:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 0x55da4e9805e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 0x7fa8c4038e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000f60 tx=0x7fa9d4001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 0x55da4e9805e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9df1cb640 1 -- 172.21.15.161:0/3823824652 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9d800a4a0 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.977+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e97dbb0 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9df1cb640 1 -- 172.21.15.161:0/3823824652 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9d800a4a0 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 0x55da4e985250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e985940 con 0x55da4e982e60 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 0x55da4e985250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 0x55da4e985250 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9de9ca640 1 -- 172.21.15.161:0/3823824652 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e982e60 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.978+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e981e10 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.979+0000 7fa9df1cb640 1 -- 172.21.15.161:0/3823824652 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9d800a4a0 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.979+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9822f0 con 0x55da4e8814a0 2024-05-08T09:21:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.979+0000 7fa9df1cb640 1 -- 172.21.15.161:0/3823824652 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9d800a4a0 con 0x55da4e8814a0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.979+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.979+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9e2d1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9e2d1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55da4e76fcf0 con 0x55da4e994ab0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33064/0 (socket says 172.21.15.161:33064) 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2414860274 learned_addr learned my addr 172.21.15.161:0/2414860274 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2414860274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e995410 con 0x55da4e994ab0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55da4e980ec0 tx=0x7fa9d8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa8c8e01640 1 -- 172.21.15.161:0/2414860274 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8014450 con 0x55da4e994ab0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa8c8e01640 1 -- 172.21.15.161:0/2414860274 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d8014610 con 0x55da4e994ab0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa8c8e01640 1 -- 172.21.15.161:0/2414860274 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8014930 con 0x55da4e994ab0 2024-05-08T09:21:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.980+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4e995e80 con 0x55da4e994ab0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.981+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4e996380 con 0x55da4e994ab0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.981+0000 7fa8c8e01640 1 -- 172.21.15.161:0/2414860274 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa9d8011040 con 0x55da4e994ab0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.981+0000 7fa8c8e01640 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 0x7fa8b8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.981+0000 7fa8c8e01640 1 -- 172.21.15.161:0/2414860274 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa9d801e070 con 0x55da4e994ab0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 0x7fa8b8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 0x7fa8b8038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55da4e980fb0 tx=0x7fa9d005df20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9e2d1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9e2d1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55da4e87cd30 con 0x55da4e9a1e00 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33076/0 (socket says 172.21.15.161:33076) 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9df1cb640 1 -- 172.21.15.161:0/711875053 learned_addr learned my addr 172.21.15.161:0/711875053 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.982+0000 7fa9df1cb640 1 -- 172.21.15.161:0/711875053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e9a27f0 con 0x55da4e9a1e00 2024-05-08T09:21:53.987 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/711875053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa9d804c9d0 tx=0x7fa9d8011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf97f7b4c5ddb3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa8c27fc640 1 -- 172.21.15.161:0/711875053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8016940 con 0x55da4e9a1e00 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa8c27fc640 1 -- 172.21.15.161:0/711875053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d804e0d0 con 0x55da4e9a1e00 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa8c27fc640 1 -- 172.21.15.161:0/711875053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d804e3d0 con 0x55da4e9a1e00 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/711875053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 msgr2=0x55da4e9a2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/711875053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa9d804c9d0 tx=0x7fa9d8011700 comp rx=0 tx=0).stop 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/711875053 shutdown_connections 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/711875053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a2220 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/711875053 >> 172.21.15.161:0/711875053 conn(0x55da4e99e110 msgr2=0x55da4e99c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/711875053 shutdown_connections 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/711875053 wait complete. 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 Processor -- start 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.983+0000 7fa9e2d1f800 1 -- start start 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9e2d1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.988 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9e2d1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55da4e9a2ee0 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9df1cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33086/0 (socket says 172.21.15.161:33086) 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 learned_addr learned my addr 172.21.15.161:0/2959110030 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da4e9a9850 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9d804c9d0 tx=0x7fa9d804c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa8c0ff9640 1 -- 172.21.15.161:0/2959110030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8045040 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa8c0ff9640 1 -- 172.21.15.161:0/2959110030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d8016940 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa8c0ff9640 1 -- 172.21.15.161:0/2959110030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8022cb0 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.984+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da4e9a9ae0 con 0x55da4e9a1e00 2024-05-08T09:21:53.989 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.985+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da4e9ac790 con 0x55da4e9a1e00 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.985+0000 7fa8c0ff9640 1 -- 172.21.15.161:0/2959110030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa9d804b1b0 con 0x55da4e9a1e00 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.985+0000 7fa8c0ff9640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8a8036950 0x7fa8a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.985+0000 7fa8c0ff9640 1 -- 172.21.15.161:0/2959110030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa9d800e040 con 0x55da4e9a1e00 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8a8036950 0x7fa8a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8a8036950 0x7fa8a8038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9d008c030 tx=0x7fa9d0090000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e9b5020 0x55da4e9b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9b7c30 con 0x55da4e9b5020 2024-05-08T09:21:53.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e9b5020 0x55da4e9b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.986+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e9b5020 0x55da4e9b74e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9d400f610 con 0x55da4e9b5020 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 realm 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9b4470 con 0x55da4e9b5020 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9d400f610 con 0x55da4e9b5020 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9b8720 con 0x55da4e9b5020 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9d400f610 con 0x55da4e9b5020 2024-05-08T09:21:53.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9b8ff0 con 0x55da4e9b5020 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9d400f610 con 0x55da4e9b5020 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e9b9a10 0x55da4e9bbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.987+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9bc4f0 con 0x55da4e9b9a10 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e9b9a10 0x55da4e9bbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9df1cb640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e9b9a10 0x55da4e9bbe00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9e2d1f800 20 searching for the correct realm 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55da4e9be4c0 0x55da4e9c0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:53.999 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.989+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55da4e9be4c0 0x55da4e9c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.990+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55da4e9be4c0 0x55da4e9c0980 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.990+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.990+0000 7fa9de9ca640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa9d0078060 0x7fa9d005c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.990+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.990+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa9d0078060 0x7fa9d005c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.991+0000 7fa9de1c9640 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa9d0078060 0x7fa9d005c750 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.991+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d400f610 con 0x7fa9d0078060 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.991+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d400f610 con 0x55da4e9b5020 2024-05-08T09:21:54.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.992+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.993+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.993+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.993+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.993+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.993+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x7fa9d0078060 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.994+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.994+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.994+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.994+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.994+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9d402b040 con 0x7fa9d0078060 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.995+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.996+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.996+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.996+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.996+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.003 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.997+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.998+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.998+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.998+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.998+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x7fa9d0078060 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:53.999+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x7fa9d0078060 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.000+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9be4c0 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.001+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.001+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b9a10 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.001+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.001+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x55da4e9b5020 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1050 con 0x7fa9d0078060 2024-05-08T09:21:54.012 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d402b040 con 0x7fa9d0078060 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9bceb0 con 0x55da4e9b5020 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9d402b040 con 0x55da4e9b5020 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9bd750 con 0x55da4e9b5020 2024-05-08T09:21:54.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.002+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9bcaf0 con 0x55da4e9b5020 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 zone default found 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 4 Realm: () 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 zonegroup default 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c1580 con 0x55da4e9b9a10 2024-05-08T09:21:54.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.003+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c3850 con 0x55da4e9be4c0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c3bf0 con 0x55da4e9be4c0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 20 started sync module instance, tier type = 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.004+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c2ce0 con 0x7fa9d0078060 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.005+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.005+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94396110090720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c2ce0 con 0x7fa9d0078060 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.005+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c4600 con 0x55da4e9b5020 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.006+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94396110090720] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.006+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.006+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94396110095152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c2ce0 con 0x55da4e9b5020 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.006+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c5050 con 0x55da4e9be4c0 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.007+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.007+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94396110097248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c58f0 con 0x55da4e9be4c0 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.007+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c63b0 con 0x7fa9d0078060 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.008+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94396110095152] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.008+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94396110097248] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.008+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.008+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94396110099520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c2830 con 0x7fa9d0078060 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.008+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c6c50 con 0x55da4e9b5020 2024-05-08T09:21:54.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.009+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94396110099520] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.009+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.009+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94396110102144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c6bd0 con 0x55da4e9b5020 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.009+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c7660 con 0x55da4e9b9a10 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.010+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.010+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94396110102144] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.010+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94396110104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c6b40 con 0x55da4e9b9a10 2024-05-08T09:21:54.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.010+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c84d0 con 0x55da4e9b9a10 2024-05-08T09:21:54.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.012+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94396110104352] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.012+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.012+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94396110109184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c84d0 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.012+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8e90 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94396110109184] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94396110111232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8e90 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=0 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=1 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=2 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=3 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=4 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=5 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.013+0000 7fa9e2d1f800 20 add_watcher() i=6 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94396110111232] v27'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9e2d1f800 20 add_watcher() i=7 2024-05-08T09:21:54.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9e2d1f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9cc200 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.014+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94396110113616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c9420 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.015+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94396110113616] v27'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.015+0000 7fa8957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.015+0000 7fa9e2d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.015+0000 7fa9e2d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.015+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9cb960 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.016+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.016+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d52c0 con 0x55da4e9b9a10 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.017+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.017+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d52c0 con 0x55da4e9be4c0 2024-05-08T09:21:54.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.018+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.018+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5bb0 con 0x55da4e9b5020 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.019+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'140 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.019+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5fb0 con 0x7fa9d0078060 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.020+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.020+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5fb0 con 0x55da4e9be4c0 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.021+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.023 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.021+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6430 con 0x55da4e9b5020 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.022+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.022+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6600 con 0x55da4e9b9a10 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.023+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.023+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6600 con 0x7fa9d0078060 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.025+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.025+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6600 con 0x55da4e9be4c0 2024-05-08T09:21:54.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.026+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'23 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.026+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6600 con 0x7fa9d0078060 2024-05-08T09:21:54.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.026+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.026 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.026+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6600 con 0x55da4e9b9a10 2024-05-08T09:21:54.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.028+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.027 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.028+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x7fa9d0078060 2024-05-08T09:21:54.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.028+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.028+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9b9a10 2024-05-08T09:21:54.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.030+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'33 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.030+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9b5020 2024-05-08T09:21:54.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.031+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.031+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9be4c0 2024-05-08T09:21:54.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.032+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'35 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.032+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x7fa9d0078060 2024-05-08T09:21:54.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.033+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.033+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9be4c0 2024-05-08T09:21:54.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.034+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.034+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9b5020 2024-05-08T09:21:54.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.035+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.035+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9b5020 2024-05-08T09:21:54.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.036+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.036+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9be4c0 2024-05-08T09:21:54.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.037+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'36 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.037+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x7fa9d0078060 2024-05-08T09:21:54.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.038+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.038+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d6c10 con 0x55da4e9be4c0 2024-05-08T09:21:54.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.039+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.039+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9be4c0 2024-05-08T09:21:54.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.040+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.040+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9be4c0 2024-05-08T09:21:54.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.041+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.041+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9be4c0 2024-05-08T09:21:54.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.042+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.042+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9b9a10 2024-05-08T09:21:54.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.045+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.045+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9be4c0 2024-05-08T09:21:54.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.046+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.046+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9b9a10 2024-05-08T09:21:54.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.047+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.047+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9be4c0 2024-05-08T09:21:54.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.049+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.049+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x55da4e9b9a10 2024-05-08T09:21:54.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.050+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'34 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.050+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d5660 con 0x7fa9d0078060 2024-05-08T09:21:54.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.051+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.051+0000 7fa80ffff640 20 reqs_thread_entry: start 2024-05-08T09:21:54.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.051+0000 7fa9e2d1f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.051+0000 7fa9e2d1f800 20 Filter name: none 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.051+0000 7fa80dffb640 20 reqs_thread_entry: start 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9d4e70 con 0x7fa9d0078060 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea035e0 con 0x7fa9d0078060 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(95 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:54.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 20 get_obj_state: octx=0x7fa9d802c3e0 obj=myfoo:four state=0x55da4ea048c8 s->prefetch_data=0 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.052+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 3.25s0 3:a6976fb9:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea056f0 con 0x55da4e9b5020 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(96 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1_four [getxattrs out=849b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 234+0+865 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 10 manifest: total_size = 4 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.3467604632326514481 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 20 get_obj_state: octx=0x7fa9d802c3e0 obj=myfoo:four state=0x55da4ea048c8 s->prefetch_data=0 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 20 prepare_atomic_modification: state is not atomic. state=0x55da4ea048c8 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 2024-05-08T09:21:54.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.053+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:97 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea0a0a0 con 0x55da4e9b9a10 2024-05-08T09:21:54.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.054+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(97 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.054+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 3.25s0 3:a6976fb9:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea0a0a0 con 0x55da4e9b5020 2024-05-08T09:21:54.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.055+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(98 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1_four [call] v27'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.055+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea0a520 con 0x55da4e9b9a10 2024-05-08T09:21:54.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.056+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(99 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.056+0000 7fa8957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.056+0000 7fa8c27fc640 20 handle_completion(): completion ok for obj=four 2024-05-08T09:21:54.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.056+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94396110113616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4ea0a520 con 0x55da4e9b5020 2024-05-08T09:21:54.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.057+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94396110113616] v27'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.057+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94396110090720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x7fa9d0078060 2024-05-08T09:21:54.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.059+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94396110090720] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.059+0000 7fa9e2d1f800 20 remove_watcher() i=0 2024-05-08T09:21:54.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.059+0000 7fa9e2d1f800 2 removed watcher, disabling cache 2024-05-08T09:21:54.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.059+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94396110095152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x55da4e9b5020 2024-05-08T09:21:54.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.060+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94396110095152] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.060+0000 7fa9e2d1f800 20 remove_watcher() i=1 2024-05-08T09:21:54.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.060+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94396110097248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x55da4e9be4c0 2024-05-08T09:21:54.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.061+0000 7fa9de9ca640 1 -- 172.21.15.161:0/2959110030 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94396110097248] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d0075030 con 0x55da4e9be4c0 2024-05-08T09:21:54.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.061+0000 7fa9e2d1f800 20 remove_watcher() i=2 2024-05-08T09:21:54.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.061+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94396110099520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x7fa9d0078060 2024-05-08T09:21:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.062+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94396110099520] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x7fa9d0078060 2024-05-08T09:21:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.062+0000 7fa9e2d1f800 20 remove_watcher() i=3 2024-05-08T09:21:54.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.062+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94396110102144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x55da4e9b5020 2024-05-08T09:21:54.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.063+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94396110102144] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d403d040 con 0x55da4e9b5020 2024-05-08T09:21:54.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.063+0000 7fa9e2d1f800 20 remove_watcher() i=4 2024-05-08T09:21:54.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.063+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94396110104352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x55da4e9b9a10 2024-05-08T09:21:54.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.064+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94396110104352] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.064+0000 7fa9e2d1f800 20 remove_watcher() i=5 2024-05-08T09:21:54.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.064+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94396110109184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c8b50 con 0x55da4e9b9a10 2024-05-08T09:21:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.065+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94396110109184] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.065+0000 7fa9e2d1f800 20 remove_watcher() i=6 2024-05-08T09:21:54.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.065+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94396110111232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55da4e9c7a00 con 0x55da4e9b9a10 2024-05-08T09:21:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9df1cb640 1 -- 172.21.15.161:0/2959110030 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94396110111232] v27'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d802a070 con 0x55da4e9b9a10 2024-05-08T09:21:54.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 20 remove_watcher() i=7 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e9b9a10 msgr2=0x55da4e9bbe00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e9b9a10 0x55da4e9bbe00 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e9b5020 msgr2=0x55da4e9b74e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e9b5020 0x55da4e9b74e0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa9d0078060 msgr2=0x7fa9d005c750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa9d0078060 0x7fa9d005c750 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55da4e9be4c0 msgr2=0x55da4e9c0980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55da4e9be4c0 0x55da4e9c0980 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8a8036950 msgr2=0x7fa8a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8a8036950 0x7fa8a8038e10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa9d008c030 tx=0x7fa9d0090000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 msgr2=0x55da4e9a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9de1c9640 1 -- 172.21.15.161:0/2959110030 reap_dead start 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa9d804c9d0 tx=0x7fa9d804c960 comp rx=0 tx=0).stop 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 shutdown_connections 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2959110030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e9a1e00 0x55da4e9a9310 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 >> 172.21.15.161:0/2959110030 conn(0x55da4e99e110 msgr2=0x55da4e9a3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 shutdown_connections 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.066+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2959110030 wait complete. 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 msgr2=0x7fa8b8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 0x7fa8b8038dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55da4e980fb0 tx=0x7fa9d005df20 comp rx=0 tx=0).stop 2024-05-08T09:21:54.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 msgr2=0x55da4e994ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x55da4e980ec0 tx=0x7fa9d8018830 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 shutdown_connections 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8b8036900 0x7fa8b8038dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/2414860274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e994ab0 0x55da4e994ed0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 >> 172.21.15.161:0/2414860274 conn(0x55da4e988b50 msgr2=0x55da4e988f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 shutdown_connections 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/2414860274 wait complete. 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 msgr2=0x55da4e985250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 0x55da4e985250 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 msgr2=0x55da4e9805e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 0x55da4e9805e0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 msgr2=0x7fa8c4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 0x7fa8c4038e60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4000f60 tx=0x7fa9d4001370 comp rx=0 tx=0).stop 2024-05-08T09:21:54.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 msgr2=0x55da4e9793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0052540 tx=0x7fa9d0003020 comp rx=0 tx=0).stop 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 shutdown_connections 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55da4e982e60 0x55da4e985250 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55da4e8814a0 0x55da4e9805e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fa8c40369a0 0x7fa8c4038e60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 --2- 172.21.15.161:0/3823824652 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55da4e87eb70 0x55da4e9793a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 >> 172.21.15.161:0/3823824652 conn(0x55da4e8785c0 msgr2=0x55da4e87d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 shutdown_connections 2024-05-08T09:21:54.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.067+0000 7fa9e2d1f800 1 -- 172.21.15.161:0/3823824652 wait complete. 2024-05-08T09:21:54.075 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:54.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-05-08T09:21:54.076 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-05-08T09:21:54.120 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:54.120 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:54.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.121+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.121+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.121+0000 7fe21b31f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564cd2208bd0 0x564cd220afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.121+0000 7fe21b31f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564cd220f010 con 0x564cd220b500 2024-05-08T09:21:54.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.121+0000 7fe21b31f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564cd2099050 con 0x564cd2208bd0 2024-05-08T09:21:54.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.122+0000 7fe216fca640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564cd2208bd0 0x564cd220afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.122+0000 7fe20ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x564cd220b500 0x564cd220d8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50902/0 (socket says 172.21.15.161:50902) 2024-05-08T09:21:54.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.122+0000 7fe20ffff640 1 -- 172.21.15.161:0/3617524632 learned_addr learned my addr 172.21.15.161:0/3617524632 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:54.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.122+0000 7fe216fca640 1 -- 172.21.15.161:0/3617524632 >> v1:172.21.15.45:6789/0 conn(0x564cd220b500 legacy=0x564cd220d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.122+0000 7fe216fca640 1 -- 172.21.15.161:0/3617524632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd22101f0 con 0x564cd2208bd0 2024-05-08T09:21:54.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.124+0000 7fe216fca640 1 --2- 172.21.15.161:0/3617524632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd220afc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe20800a470 tx=0x7fe20801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e0b25abe3814ec8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.124+0000 7fe2167c9640 1 -- 172.21.15.161:0/3617524632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208057070 con 0x564cd2208bd0 2024-05-08T09:21:54.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.124+0000 7fe2167c9640 1 -- 172.21.15.161:0/3617524632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe208052570 con 0x564cd2208bd0 2024-05-08T09:21:54.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.124+0000 7fe2167c9640 1 -- 172.21.15.161:0/3617524632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208052870 con 0x564cd2208bd0 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 -- 172.21.15.161:0/3617524632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 msgr2=0x564cd220afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3617524632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd220afc0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe20800a470 tx=0x7fe20801ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 -- 172.21.15.161:0/3617524632 shutdown_connections 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3617524632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd220afc0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 -- 172.21.15.161:0/3617524632 >> 172.21.15.161:0/3617524632 conn(0x564cd22025a0 msgr2=0x564cd22049c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 -- 172.21.15.161:0/3617524632 shutdown_connections 2024-05-08T09:21:54.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.125+0000 7fe21b31f800 1 -- 172.21.15.161:0/3617524632 wait complete. 2024-05-08T09:21:54.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe21b31f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe21b31f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cd21531d0 con 0x564cd2208bd0 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe216fca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe216fca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33104/0 (socket says 172.21.15.161:33104) 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe216fca640 1 -- 172.21.15.161:0/3863689156 learned_addr learned my addr 172.21.15.161:0/3863689156 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.139+0000 7fe216fca640 1 -- 172.21.15.161:0/3863689156 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd2206ad0 con 0x564cd2208bd0 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.140+0000 7fe216fca640 1 --2- 172.21.15.161:0/3863689156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe20801ced0 tx=0x7fe20804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9be045395242da8e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.140+0000 7fe104e09640 1 -- 172.21.15.161:0/3863689156 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208057040 con 0x564cd2208bd0 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.140+0000 7fe104e09640 1 -- 172.21.15.161:0/3863689156 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2080529a0 con 0x564cd2208bd0 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.140+0000 7fe104e09640 1 -- 172.21.15.161:0/3863689156 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208052cc0 con 0x564cd2208bd0 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- 172.21.15.161:0/3863689156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 msgr2=0x564cd2208510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3863689156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe20801ced0 tx=0x7fe20804c000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- 172.21.15.161:0/3863689156 shutdown_connections 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3863689156 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2208510 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- 172.21.15.161:0/3863689156 >> 172.21.15.161:0/3863689156 conn(0x564cd22025a0 msgr2=0x564cd22f4f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- 172.21.15.161:0/3863689156 shutdown_connections 2024-05-08T09:21:54.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- 172.21.15.161:0/3863689156 wait complete. 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe21b31f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cd220f480 con 0x564cd2208bd0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe216fca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe216fca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33118/0 (socket says 172.21.15.161:33118) 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.141+0000 7fe216fca640 1 -- 172.21.15.161:0/3298520764 learned_addr learned my addr 172.21.15.161:0/3298520764 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe216fca640 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd2303860 con 0x564cd2208bd0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe216fca640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe208000c00 tx=0x7fe208003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe103606640 1 -- 172.21.15.161:0/3298520764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208073070 con 0x564cd2208bd0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe103606640 1 -- 172.21.15.161:0/3298520764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe20805d780 con 0x564cd2208bd0 2024-05-08T09:21:54.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cd2303af0 con 0x564cd2208bd0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe103606640 1 -- 172.21.15.161:0/3298520764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe208057070 con 0x564cd2208bd0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.142+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd23067a0 con 0x564cd2208bd0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe103606640 1 -- 172.21.15.161:0/3298520764 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe208076070 con 0x564cd2208bd0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe103606640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 0x7fe0fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe103606640 1 -- 172.21.15.161:0/3298520764 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe20808dfd0 con 0x564cd2208bd0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe20ffff640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 0x7fe0fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 0x564cd230a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd230ab30 con 0x564cd220b500 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe2177cb640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 0x564cd230a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.143+0000 7fe20ffff640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 0x7fe0fc038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe200000f60 tx=0x7fe2000012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe2177cb640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 0x564cd230a560 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe2177cb640 1 -- 172.21.15.161:0/3298520764 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe21000a4a0 con 0x564cd220b500 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2307b30 con 0x564cd220b500 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe2177cb640 1 -- 172.21.15.161:0/3298520764 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe21000a4a0 con 0x564cd220b500 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 0x564cd230f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd230f940 con 0x564cd230ce60 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.144+0000 7fe216fca640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 0x564cd230f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.145+0000 7fe216fca640 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 0x564cd230f250 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.155 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.145+0000 7fe216fca640 1 -- 172.21.15.161:0/3298520764 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe208075030 con 0x564cd230ce60 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.145+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd230be10 con 0x564cd220b500 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.145+0000 7fe2177cb640 1 -- 172.21.15.161:0/3298520764 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe21000a4a0 con 0x564cd220b500 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.145+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd230c2f0 con 0x564cd220b500 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe2177cb640 1 -- 172.21.15.161:0/3298520764 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe21000a4a0 con 0x564cd220b500 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe21b31f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe21b31f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cd20f9cf0 con 0x564cd231eab0 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33132/0 (socket says 172.21.15.161:33132) 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.146+0000 7fe2177cb640 1 -- 172.21.15.161:0/1125746321 learned_addr learned my addr 172.21.15.161:0/1125746321 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe2177cb640 1 -- 172.21.15.161:0/1125746321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd231f410 con 0x564cd231eab0 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe2177cb640 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x564cd230af10 tx=0x7fe210018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe100e01640 1 -- 172.21.15.161:0/1125746321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe210014450 con 0x564cd231eab0 2024-05-08T09:21:54.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe100e01640 1 -- 172.21.15.161:0/1125746321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210014610 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cd231fe80 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe100e01640 1 -- 172.21.15.161:0/1125746321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe210014930 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.147+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd2320380 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe100e01640 1 -- 172.21.15.161:0/1125746321 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe210011040 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe100e01640 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 0x7fe0f0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe100e01640 1 -- 172.21.15.161:0/1125746321 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe21001e070 con 0x564cd231eab0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe216fca640 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 0x7fe0f0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe216fca640 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 0x7fe0f0038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x564cd230afb0 tx=0x7fe208052f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.148+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe21b31f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe21b31f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cd2206d90 con 0x564cd232bd60 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33134/0 (socket says 172.21.15.161:33134) 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe2177cb640 1 -- 172.21.15.161:0/2218404477 learned_addr learned my addr 172.21.15.161:0/2218404477 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe2177cb640 1 -- 172.21.15.161:0/2218404477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd232c750 con 0x564cd232bd60 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe2177cb640 1 --2- 172.21.15.161:0/2218404477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe21004c8c0 tx=0x7fe2100139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f493d78eda0e4959 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe0fa7fc640 1 -- 172.21.15.161:0/2218404477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe210016960 con 0x564cd232bd60 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe0fa7fc640 1 -- 172.21.15.161:0/2218404477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210016440 con 0x564cd232bd60 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.149+0000 7fe0fa7fc640 1 -- 172.21.15.161:0/2218404477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe210016b00 con 0x564cd232bd60 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- 172.21.15.161:0/2218404477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 msgr2=0x564cd232c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2218404477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe21004c8c0 tx=0x7fe2100139d0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- 172.21.15.161:0/2218404477 shutdown_connections 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2218404477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd232c180 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- 172.21.15.161:0/2218404477 >> 172.21.15.161:0/2218404477 conn(0x564cd2328110 msgr2=0x564cd2326170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- 172.21.15.161:0/2218404477 shutdown_connections 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- 172.21.15.161:0/2218404477 wait complete. 2024-05-08T09:21:54.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 Processor -- start 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- start start 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe21b31f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cd232ceb0 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.150+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe2177cb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33142/0 (socket says 172.21.15.161:33142) 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 learned_addr learned my addr 172.21.15.161:0/2723888329 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cd2333850 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe2177cb640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe21004b740 tx=0x7fe21004c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe0f8ff9640 1 -- 172.21.15.161:0/2723888329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21004b410 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe0f8ff9640 1 -- 172.21.15.161:0/2723888329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe210014b20 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cd2333ae0 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe0f8ff9640 1 -- 172.21.15.161:0/2723888329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe210014e00 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.151+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cd2336790 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe0f8ff9640 1 -- 172.21.15.161:0/2723888329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe21003bb10 con 0x564cd232bd60 2024-05-08T09:21:54.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe0f8ff9640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0e0036950 0x7fe0e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe0f8ff9640 1 -- 172.21.15.161:0/2723888329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe21000e040 con 0x564cd232bd60 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe216fca640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0e0036950 0x7fe0e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd233eda0 0x564cd2341260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.152+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23419b0 con 0x564cd233eda0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe20ffff640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd233eda0 0x564cd2341260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe216fca640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0e0036950 0x7fe0e0038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe20808c530 tx=0x7fe208089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe20ffff640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd233eda0 0x564cd2341260 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe200009050 con 0x564cd233eda0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 20 realm 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd233e1f0 con 0x564cd233eda0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe200009050 con 0x564cd233eda0 2024-05-08T09:21:54.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.153+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2342490 con 0x564cd233eda0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe200009050 con 0x564cd233eda0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2342d60 con 0x564cd233eda0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe200009050 con 0x564cd233eda0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd2343610 0x564cd2345a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2346140 con 0x564cd2343610 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.154+0000 7fe2177cb640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd2343610 0x564cd2345a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe2177cb640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd2343610 0x564cd2345a00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe21b31f800 20 searching for the correct realm 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564cd23481e0 0x564cd234a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe216fca640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564cd23481e0 0x564cd234a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.155+0000 7fe216fca640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564cd23481e0 0x564cd234a6a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.156+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.156+0000 7fe216fca640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe2080a1040 0x7fe20808d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.156+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.156+0000 7fe20ffff640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe2080a1040 0x7fe20808d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.156+0000 7fe20ffff640 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe2080a1040 0x7fe20808d6f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200009050 con 0x7fe2080a1040 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200009050 con 0x564cd233eda0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.157+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.158+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.159+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.160+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.161+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.162+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.178 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.163+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd23481e0 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd2343610 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x564cd233eda0 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.164+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564cd234ad70 con 0x7fe2080a1040 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:54.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2346be0 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23467f0 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23474d0 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 zone default found 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 4 Realm: () 2024-05-08T09:21:54.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 zonegroup default 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.165+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd234b1f0 con 0x564cd2343610 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd234d420 con 0x564cd23481e0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.181 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd234d7c0 con 0x564cd23481e0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 started sync module instance, tier type = 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.166+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234c860 con 0x7fe2080a1040 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.167+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.167+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94887944179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234c860 con 0x7fe2080a1040 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.167+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234e180 con 0x564cd233eda0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.168+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94887944179088] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.169+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.169+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94887944177040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234e180 con 0x564cd233eda0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.169+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234eb80 con 0x564cd23481e0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.170+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.170+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94887944185488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234f420 con 0x564cd23481e0 2024-05-08T09:21:54.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.170+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234fec0 con 0x7fe2080a1040 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.170+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94887944177040] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.171+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94887944185488] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.171+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.171+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94887944187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234dcd0 con 0x7fe2080a1040 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.171+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2350760 con 0x564cd233eda0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.172+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.172+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94887944192608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2350680 con 0x564cd233eda0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.172+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2351660 con 0x564cd2343610 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.172+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94887944187760] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.173+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94887944192608] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.173+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.174+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94887944194896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2351170 con 0x564cd2343610 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.174+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2351f30 con 0x564cd2343610 2024-05-08T09:21:54.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.175+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.175+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94887944198784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23523b0 con 0x564cd2343610 2024-05-08T09:21:54.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.175+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2352ed0 con 0x564cd2343610 2024-05-08T09:21:54.184 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.175+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94887944194896] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94887944198784] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94887944199840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd234f990 con 0x564cd2343610 2024-05-08T09:21:54.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=0 2024-05-08T09:21:54.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=1 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=2 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=3 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=4 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=5 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe21b31f800 20 add_watcher() i=6 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.176+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94887944199840] v27'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.177+0000 7fe21b31f800 20 add_watcher() i=7 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.177+0000 7fe21b31f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.177+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2355ec0 con 0x564cd233eda0 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.177+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.177+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94887944202656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd2353340 con 0x564cd233eda0 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94887944202656] v27'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe200029040 con 0x564cd233eda0 2024-05-08T09:21:54.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe0cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe21b31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe21b31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe21b31f800 5 note: GC not initialized 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe047fff640 20 reqs_thread_entry: start 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe21b31f800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.178+0000 7fe21b31f800 20 Filter name: none 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe045ffb640 20 reqs_thread_entry: start 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2389350 con 0x7fe2080a1040 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2389be0 con 0x7fe2080a1040 2024-05-08T09:21:54.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.179+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23886f0 con 0x7fe2080a1040 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd238b1f0 con 0x7fe2080a1040 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(65 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe200029040 con 0x7fe2080a1040 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 4.7 4:e36019c5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd238cc20 con 0x564cd2343610 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 4.17 4:eba780b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd238f780 con 0x564cd2343610 2024-05-08T09:21:54.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 4.d 4:b0be4d53:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23923a0 con 0x564cd23481e0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 4.32 4:4ceb3478:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd238f780 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 4.2f 4:f5a2285c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd2397570 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 4.1f 4:f85c6e14:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd239a400 con 0x564cd23481e0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 4.33 4:ce0246b5:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd239ce50 con 0x564cd2343610 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 4.20 4:077f40c6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd239f880 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 4.13 4:ca8f0f6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23a2350 con 0x7fe2080a1040 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 4.c 4:339bb1ce:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23a4f40 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 4.24 4:27768d85:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564cd23a7b30 con 0x564cd2343610 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(69 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(70 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(73 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.7 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.180+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.8 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe200048060 con 0x7fe2080a1040 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(67 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(71 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.5 [call out=124b] v0'0 uv7 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(66 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(75 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.181+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(76 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.182+0000 7fe0cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.182+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94887944202656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd233eda0 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.183+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94887944202656] v27'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.183+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94887944179088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x7fe2080a1040 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.184+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94887944179088] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200048060 con 0x7fe2080a1040 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.184+0000 7fe21b31f800 20 remove_watcher() i=0 2024-05-08T09:21:54.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.184+0000 7fe21b31f800 2 removed watcher, disabling cache 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.184+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94887944177040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd233eda0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.185+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94887944177040] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.185+0000 7fe21b31f800 20 remove_watcher() i=1 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.185+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94887944185488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd23481e0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.186+0000 7fe216fca640 1 -- 172.21.15.161:0/2723888329 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94887944185488] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe208075030 con 0x564cd23481e0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.186+0000 7fe21b31f800 20 remove_watcher() i=2 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.186+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94887944187760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x7fe2080a1040 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.187+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94887944187760] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200048060 con 0x7fe2080a1040 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.187+0000 7fe21b31f800 20 remove_watcher() i=3 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.187+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94887944192608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd233eda0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.188+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94887944192608] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe200048060 con 0x564cd233eda0 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.188+0000 7fe21b31f800 20 remove_watcher() i=4 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.188+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94887944194896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd2343610 2024-05-08T09:21:54.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.189+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94887944194896] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.189+0000 7fe21b31f800 20 remove_watcher() i=5 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.189+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94887944198784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd2343610 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.190+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94887944198784] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.190+0000 7fe21b31f800 20 remove_watcher() i=6 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.190+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94887944199840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564cd23718b0 con 0x564cd2343610 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe2177cb640 1 -- 172.21.15.161:0/2723888329 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94887944199840] v27'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe21002a070 con 0x564cd2343610 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 20 remove_watcher() i=7 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd2343610 msgr2=0x564cd2345a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd2343610 0x564cd2345a00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd233eda0 msgr2=0x564cd2341260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd233eda0 0x564cd2341260 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe2080a1040 msgr2=0x7fe20808d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe2080a1040 0x7fe20808d6f0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564cd23481e0 msgr2=0x564cd234a6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564cd23481e0 0x564cd234a6a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0e0036950 msgr2=0x7fe0e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0e0036950 0x7fe0e0038e10 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe20808c530 tx=0x7fe208089000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 msgr2=0x564cd2333310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe21004b740 tx=0x7fe21004c850 comp rx=0 tx=0).stop 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe20ffff640 1 -- 172.21.15.161:0/2723888329 reap_dead start 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 shutdown_connections 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/2723888329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd232bd60 0x564cd2333310 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 >> 172.21.15.161:0/2723888329 conn(0x564cd2328110 msgr2=0x564cd232d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 shutdown_connections 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/2723888329 wait complete. 2024-05-08T09:21:54.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 msgr2=0x7fe0f0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 0x7fe0f0038dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x564cd230afb0 tx=0x7fe208052f90 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 msgr2=0x564cd231eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.191+0000 7fe21b31f800 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x564cd230af10 tx=0x7fe210018830 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 shutdown_connections 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0f0036900 0x7fe0f0038dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/1125746321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd231eab0 0x564cd231eed0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 >> 172.21.15.161:0/1125746321 conn(0x564cd2312b50 msgr2=0x564cd2312f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 shutdown_connections 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/1125746321 wait complete. 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 msgr2=0x564cd230f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 0x564cd230f250 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 msgr2=0x564cd230a560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 0x564cd230a560 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 msgr2=0x7fe0fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 0x7fe0fc038e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe200000f60 tx=0x7fe2000012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 msgr2=0x564cd2303320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe208000c00 tx=0x7fe208003020 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 shutdown_connections 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cd230ce60 0x564cd230f250 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cd220b500 0x564cd230a560 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe0fc036950 0x7fe0fc038e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 --2- 172.21.15.161:0/3298520764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cd2208bd0 0x564cd2303320 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 >> 172.21.15.161:0/3298520764 conn(0x564cd22025a0 msgr2=0x564cd22f4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 shutdown_connections 2024-05-08T09:21:54.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.192+0000 7fe21b31f800 1 -- 172.21.15.161:0/3298520764 wait complete. 2024-05-08T09:21:54.205 INFO:teuthology.orchestra.run.smithi161.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"05c85a99-f6a8-405d-b310-d83661265ff5","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","marker":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-05-08T09:21:53.657481Z","creation_time":"2024-05-08T09:21:50.820361Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}} 2024-05-08T09:21:54.205 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:21:53.657481Z', 'creation_time': '2024-05-08T09:21:50.820361Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:21:54.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-05-08T09:21:54.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-05-08T09:21:54.206 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-05-08T09:21:54.287 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:54.292 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.289+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.289+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.289+0000 7fe45be87800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560457928440 0x56045792a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.289+0000 7fe45be87800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56045792ae00 con 0x560457923fb0 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.289+0000 7fe45be87800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5604577b6050 con 0x560457928440 2024-05-08T09:21:54.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459185640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560457928440 0x56045792a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459185640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560457928440 0x56045792a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33152/0 (socket says 172.21.15.161:33152) 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459185640 1 -- 172.21.15.161:0/486918235 learned_addr learned my addr 172.21.15.161:0/486918235 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459986640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x560457923fb0 0x5604579243d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50912/0 (socket says 172.21.15.161:50912) 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459185640 1 -- 172.21.15.161:0/486918235 >> v1:172.21.15.45:6789/0 conn(0x560457923fb0 legacy=0x5604579243d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.290+0000 7fe459185640 1 -- 172.21.15.161:0/486918235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56045792c030 con 0x560457928440 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe459185640 1 --2- 172.21.15.161:0/486918235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457928440 0x56045792a830 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe45000a520 tx=0x7fe45001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9c1a697ae47ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe458984640 1 -- 172.21.15.161:0/486918235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe450057070 con 0x560457928440 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe458984640 1 -- 172.21.15.161:0/486918235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450052570 con 0x560457928440 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe458984640 1 -- 172.21.15.161:0/486918235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45004ae60 con 0x560457928440 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 -- 172.21.15.161:0/486918235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457928440 msgr2=0x56045792a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 --2- 172.21.15.161:0/486918235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457928440 0x56045792a830 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fe45000a520 tx=0x7fe45001d010 comp rx=0 tx=0).stop 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 -- 172.21.15.161:0/486918235 shutdown_connections 2024-05-08T09:21:54.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 --2- 172.21.15.161:0/486918235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457928440 0x56045792a830 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 -- 172.21.15.161:0/486918235 >> 172.21.15.161:0/486918235 conn(0x56045791f550 msgr2=0x560457921970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 -- 172.21.15.161:0/486918235 shutdown_connections 2024-05-08T09:21:54.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.292+0000 7fe45be87800 1 -- 172.21.15.161:0/486918235 wait complete. 2024-05-08T09:21:54.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe45be87800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe45be87800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5604578701c0 con 0x560457923fb0 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe459986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe459986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33164/0 (socket says 172.21.15.161:33164) 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe459986640 1 -- 172.21.15.161:0/609367145 learned_addr learned my addr 172.21.15.161:0/609367145 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.307+0000 7fe459986640 1 -- 172.21.15.161:0/609367145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560457a15b90 con 0x560457923fb0 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.308+0000 7fe459986640 1 --2- 172.21.15.161:0/609367145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe44c001650 tx=0x7fe44c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d80037c08d76d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.308+0000 7fe347e07640 1 -- 172.21.15.161:0/609367145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe44c013420 con 0x560457923fb0 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.308+0000 7fe347e07640 1 -- 172.21.15.161:0/609367145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44c0135c0 con 0x560457923fb0 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.308+0000 7fe347e07640 1 -- 172.21.15.161:0/609367145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe44c0138c0 con 0x560457923fb0 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- 172.21.15.161:0/609367145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 msgr2=0x560457a155c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 --2- 172.21.15.161:0/609367145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fe44c001650 tx=0x7fe44c001b10 comp rx=0 tx=0).stop 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- 172.21.15.161:0/609367145 shutdown_connections 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 --2- 172.21.15.161:0/609367145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a155c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- 172.21.15.161:0/609367145 >> 172.21.15.161:0/609367145 conn(0x56045791f550 msgr2=0x560457a10ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- 172.21.15.161:0/609367145 shutdown_connections 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- 172.21.15.161:0/609367145 wait complete. 2024-05-08T09:21:54.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe45be87800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56045792b2d0 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe459986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe459986640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33170/0 (socket says 172.21.15.161:33170) 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.309+0000 7fe459986640 1 -- 172.21.15.161:0/4193282706 learned_addr learned my addr 172.21.15.161:0/4193282706 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe459986640 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560457898780 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe459986640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x560457a16350 tx=0x7fe44c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe346604640 1 -- 172.21.15.161:0/4193282706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe44c022020 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe346604640 1 -- 172.21.15.161:0/4193282706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44c006830 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe346604640 1 -- 172.21.15.161:0/4193282706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe44c004b30 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560457898a10 con 0x560457923fb0 2024-05-08T09:21:54.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.310+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560457a21540 con 0x560457923fb0 2024-05-08T09:21:54.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe346604640 1 -- 172.21.15.161:0/4193282706 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe44c025020 con 0x560457923fb0 2024-05-08T09:21:54.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe346604640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 0x7fe340038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe346604640 1 -- 172.21.15.161:0/4193282706 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe44c018030 con 0x560457923fb0 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe459185640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 0x7fe340038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 0x560457a25360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a25960 con 0x560457928440 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe45a187640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 0x560457a25360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.311+0000 7fe459185640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 0x7fe340038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe450054000 tx=0x7fe45004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45a187640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 0x560457a25360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45a187640 1 -- 172.21.15.161:0/4193282706 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457928440 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a22910 con 0x560457928440 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45a187640 1 -- 172.21.15.161:0/4193282706 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe4540083e0 con 0x560457928440 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 0x560457a2a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a2a770 con 0x560457a27c90 2024-05-08T09:21:54.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.312+0000 7fe459986640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 0x560457a2a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe459986640 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 0x560457a2a080 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe459986640 1 -- 172.21.15.161:0/4193282706 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe44c01b070 con 0x560457a27c90 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a26c40 con 0x560457928440 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe45a187640 1 -- 172.21.15.161:0/4193282706 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe4540083e0 con 0x560457928440 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a27100 con 0x560457928440 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.313+0000 7fe45a187640 1 -- 172.21.15.161:0/4193282706 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe4540083e0 con 0x560457928440 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45be87800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45be87800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560457816cf0 con 0x560457a39920 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33178/0 (socket says 172.21.15.161:33178) 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.314+0000 7fe45a187640 1 -- 172.21.15.161:0/2932482717 learned_addr learned my addr 172.21.15.161:0/2932482717 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe45a187640 1 -- 172.21.15.161:0/2932482717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560457a3a280 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe45a187640 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5604578984c0 tx=0x7fe45400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe33f7fe640 1 -- 172.21.15.161:0/2932482717 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454007d00 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe33f7fe640 1 -- 172.21.15.161:0/2932482717 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45401e020 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560457a3acf0 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe33f7fe640 1 -- 172.21.15.161:0/2932482717 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454019420 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.315+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560457a3b1f0 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe33f7fe640 1 -- 172.21.15.161:0/2932482717 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe454016040 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe33f7fe640 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 0x7fe334038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe33f7fe640 1 -- 172.21.15.161:0/2932482717 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe45401f030 con 0x560457a39920 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe459986640 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 0x7fe334038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe459986640 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 0x7fe334038e60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x560457a25e00 tx=0x7fe44c01d370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.316+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45be87800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45be87800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560457a15f10 con 0x560457a46c40 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33188/0 (socket says 172.21.15.161:33188) 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45a187640 1 -- 172.21.15.161:0/1977648159 learned_addr learned my addr 172.21.15.161:0/1977648159 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45a187640 1 -- 172.21.15.161:0/1977648159 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560457a47630 con 0x560457a46c40 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe45a187640 1 --2- 172.21.15.161:0/1977648159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe45404c820 tx=0x7fe454014650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42705c28b3a4a7f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe33d7fa640 1 -- 172.21.15.161:0/1977648159 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45401d070 con 0x560457a46c40 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe33d7fa640 1 -- 172.21.15.161:0/1977648159 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45404b360 con 0x560457a46c40 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.317+0000 7fe33d7fa640 1 -- 172.21.15.161:0/1977648159 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4540176e0 con 0x560457a46c40 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- 172.21.15.161:0/1977648159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 msgr2=0x560457a47060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 --2- 172.21.15.161:0/1977648159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe45404c820 tx=0x7fe454014650 comp rx=0 tx=0).stop 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- 172.21.15.161:0/1977648159 shutdown_connections 2024-05-08T09:21:54.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 --2- 172.21.15.161:0/1977648159 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a47060 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- 172.21.15.161:0/1977648159 >> 172.21.15.161:0/1977648159 conn(0x560457a42f50 msgr2=0x560457a41000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- 172.21.15.161:0/1977648159 shutdown_connections 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- 172.21.15.161:0/1977648159 wait complete. 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 Processor -- start 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- start start 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a1e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.318+0000 7fe45be87800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560457a47e00 con 0x560457a46c40 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a1e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45a187640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a1e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33192/0 (socket says 172.21.15.161:33192) 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 learned_addr learned my addr 172.21.15.161:0/1385965918 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560457a1ce10 con 0x560457a46c40 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45a187640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a1e720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe4540157d0 tx=0x7fe45404c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe32b7fe640 1 -- 172.21.15.161:0/1385965918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe454032070 con 0x560457a46c40 2024-05-08T09:21:54.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe32b7fe640 1 -- 172.21.15.161:0/1385965918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45404cb70 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe32b7fe640 1 -- 172.21.15.161:0/1385965918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45404ce50 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560457a1d0a0 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.319+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560457a1d540 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe32b7fe640 1 -- 172.21.15.161:0/1385965918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe454014950 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe32b7fe640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe324036aa0 0x7fe324038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe32b7fe640 1 -- 172.21.15.161:0/1385965918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe45402c430 con 0x560457a46c40 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe459986640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe324036aa0 0x7fe324038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457a5be60 0x560457a5e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.320+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a5ea70 con 0x560457a5be60 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe459986640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe324036aa0 0x7fe324038f60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe44c002060 tx=0x7fe44c028000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe459185640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457a5be60 0x560457a5e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe459185640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457a5be60 0x560457a5e320 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 20 realm 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a5ee40 con 0x560457a5be60 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.321+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a5f710 con 0x560457a5be60 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a5fab0 con 0x560457a5be60 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a605a0 0x560457a629b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a63110 con 0x560457a605a0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45a187640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a605a0 0x560457a629b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.322+0000 7fe45a187640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a605a0 0x560457a629b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe45be87800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe45be87800 20 searching for the correct realm 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560457a651c0 0x560457a67680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe459986640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560457a651c0 0x560457a67680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.323+0000 7fe459986640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560457a651c0 0x560457a67680 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459986640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe44c027020 0x7fe44c0265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459185640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe44c027020 0x7fe44c0265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459185640 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe44c027020 0x7fe44c0265d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.324+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.325+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.326+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.327+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.328+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.329+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.330+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a651c0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.331+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.332+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.332+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x560457a5be60 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.332+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.332+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a67d50 con 0x7fe44c027020 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a63bc0 con 0x560457a5be60 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a644f0 con 0x560457a5be60 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 zone default found 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 4 Realm: () 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 zonegroup default 2024-05-08T09:21:54.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.333+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a681d0 con 0x560457a605a0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a6a400 con 0x560457a651c0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a6a7a0 con 0x560457a651c0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 started sync module instance, tier type = 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:54.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.334+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a69840 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.335+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.335+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94576650394720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a69840 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.335+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6b070 con 0x560457a5be60 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.336+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94576650394720] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.337+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.337+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94576650398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a69840 con 0x560457a5be60 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.337+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6bb00 con 0x560457a651c0 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.338+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94576650398528] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.338+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.338+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94576650392464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a697b0 con 0x560457a651c0 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.338+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6c8a0 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.339+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.339+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94576650392464] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.339+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94576650404768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6d170 con 0x7fe44c027020 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.339+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6bef0 con 0x560457a5be60 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.340+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.340+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94576650409728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6bef0 con 0x560457a5be60 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.340+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6e5f0 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.340+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94576650404768] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.341+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94576650409728] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.341+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.341+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94576650410784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6e140 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.341+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6ee90 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.342+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.342+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94576650414560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6f2b0 con 0x560457a605a0 2024-05-08T09:21:54.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.342+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6fb00 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.342+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94576650410784] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94576650414560] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94576650415616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6f6d0 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=1 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=2 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=3 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=4 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=5 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.343+0000 7fe45be87800 20 add_watcher() i=6 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.344+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94576650415616] v27'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.344+0000 7fe45be87800 20 add_watcher() i=7 2024-05-08T09:21:54.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.344+0000 7fe45be87800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:54.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.344+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560457a728e0 con 0x560457a5be60 2024-05-08T09:21:54.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.344+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.345+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94576650429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a6f6d0 con 0x560457a5be60 2024-05-08T09:21:54.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.345+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94576650429120] v27'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe30b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 5 note: GC not initialized 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe30a7fc640 20 reqs_thread_entry: start 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 20 Filter name: none 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe27bfff640 20 reqs_thread_entry: start 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.346+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457aa53e0 con 0x560457a605a0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.347+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(62 [pgnls start_epoch 27 out=254b] v27'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.347+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a681d0 con 0x560457a605a0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.348+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(63 [pgnls start_epoch 27 out=131b] v27'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.348+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a681d0 con 0x560457a651c0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.348+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.348+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a697b0 con 0x560457a605a0 2024-05-08T09:21:54.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(65 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a697b0 con 0x560457a5be60 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(66 [pgnls start_epoch 27 out=335b] v27'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(67 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.349+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(69 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(70 [pgnls start_epoch 27 out=213b] v27'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(71 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.350+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 [pgnls start_epoch 27 out=336b] v27'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 [pgnls start_epoch 27 out=131b] v27'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(74 [pgnls start_epoch 27 out=254b] v27'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(75 [pgnls start_epoch 27 out=90b] v27'18 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.351+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(76 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(77 [pgnls start_epoch 27 out=254b] v27'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(78 [pgnls start_epoch 27 out=254b] v27'15 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.352+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(79 [pgnls start_epoch 27 out=213b] v27'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(80 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(81 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(82 [pgnls start_epoch 27 out=276b] v27'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.353+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.354+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(83 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.354+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.354+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(84 [pgnls start_epoch 27 out=295b] v27'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.354+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a605a0 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(85 [pgnls start_epoch 27 out=172b] v27'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(86 [pgnls start_epoch 27 out=213b] v27'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a605a0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(87 [pgnls start_epoch 27 out=172b] v27'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.355+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(88 [pgnls start_epoch 27 out=172b] v27'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(89 [pgnls start_epoch 27 out=90b] v27'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(90 [pgnls start_epoch 27 out=90b] v27'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a5be60 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(91 [pgnls start_epoch 27 out=131b] v27'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.356+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x7fe44c027020 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.357+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(92 [pgnls start_epoch 27 out=295b] v27'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.357+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560457a64010 con 0x560457a605a0 2024-05-08T09:21:54.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.357+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(93 [pgnls start_epoch 27 out=213b] v27'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.368 INFO:teuthology.orchestra.run.smithi161.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.359+0000 7fe30b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.359+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94576650429120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457a697b0 con 0x560457a5be60 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.360+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94576650429120] v27'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.360+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94576650394720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa3890 con 0x7fe44c027020 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.361+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94576650394720] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.361+0000 7fe45be87800 20 remove_watcher() i=0 2024-05-08T09:21:54.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.361+0000 7fe45be87800 2 removed watcher, disabling cache 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.361+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94576650398528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa3890 con 0x560457a5be60 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.362+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94576650398528] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.362+0000 7fe45be87800 20 remove_watcher() i=1 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.362+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94576650392464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa3890 con 0x560457a651c0 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.363+0000 7fe459986640 1 -- 172.21.15.161:0/1385965918 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94576650392464] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe44c053040 con 0x560457a651c0 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.363+0000 7fe45be87800 20 remove_watcher() i=2 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.363+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94576650404768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa4e20 con 0x7fe44c027020 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.364+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94576650404768] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x7fe44c027020 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.364+0000 7fe45be87800 20 remove_watcher() i=3 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.364+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94576650409728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa4e20 con 0x560457a5be60 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.365+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94576650409728] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45005a040 con 0x560457a5be60 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.365+0000 7fe45be87800 20 remove_watcher() i=4 2024-05-08T09:21:54.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.365+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94576650410784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa4e20 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.366+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94576650410784] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.367+0000 7fe45be87800 20 remove_watcher() i=5 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.367+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94576650414560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa4e20 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.368+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94576650414560] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.368+0000 7fe45be87800 20 remove_watcher() i=6 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.368+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94576650415616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560457aa4e20 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45a187640 1 -- 172.21.15.161:0/1385965918 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94576650415616] v27'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe4540083e0 con 0x560457a605a0 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 20 remove_watcher() i=7 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a605a0 msgr2=0x560457a629b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a605a0 0x560457a629b0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457a5be60 msgr2=0x560457a5e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457a5be60 0x560457a5e320 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe44c027020 msgr2=0x7fe44c0265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe44c027020 0x7fe44c0265d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560457a651c0 msgr2=0x560457a67680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560457a651c0 0x560457a67680 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe324036aa0 msgr2=0x7fe324038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe324036aa0 0x7fe324038f60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe44c002060 tx=0x7fe44c028000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 msgr2=0x560457a1e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/1385965918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a46c40 0x560457a1e720 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe4540157d0 tx=0x7fe45404c7b0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 reap_dead start 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe459185640 1 -- 172.21.15.161:0/1385965918 reap_dead start 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 shutdown_connections 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 >> 172.21.15.161:0/1385965918 conn(0x560457a42f50 msgr2=0x560457a40600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 shutdown_connections 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/1385965918 wait complete. 2024-05-08T09:21:54.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 msgr2=0x7fe334038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 0x7fe334038e60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x560457a25e00 tx=0x7fe44c01d370 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 msgr2=0x560457a39d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5604578984c0 tx=0x7fe45400aec0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 shutdown_connections 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe3340369a0 0x7fe334038e60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 --2- 172.21.15.161:0/2932482717 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457a39920 0x560457a39d40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.369+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 >> 172.21.15.161:0/2932482717 conn(0x560457a2d9c0 msgr2=0x560457a2ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 shutdown_connections 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/2932482717 wait complete. 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 msgr2=0x560457a2a080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 0x560457a2a080 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 msgr2=0x560457a25360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 0x560457a25360 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 msgr2=0x7fe340038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 0x7fe340038e10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe450054000 tx=0x7fe45004e000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 msgr2=0x560457a20df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x560457a16350 tx=0x7fe44c001250 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 shutdown_connections 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560457a27c90 0x560457a2a080 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560457928440 0x560457a25360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe340036950 0x7fe340038e10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 --2- 172.21.15.161:0/4193282706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560457923fb0 0x560457a20df0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 >> 172.21.15.161:0/4193282706 conn(0x56045791f550 msgr2=0x560457a0f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 shutdown_connections 2024-05-08T09:21:54.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.370+0000 7fe45be87800 1 -- 172.21.15.161:0/4193282706 wait complete. 2024-05-08T09:21:54.379 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-05-08T09:21:54.379 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-05-08T09:21:54.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-05-08T09:21:54.380 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-05-08T09:21:54.463 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:54.463 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.464+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.464+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5678575800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c2b20916e0 0x55c2b2093ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5678575800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c2b2094010 con 0x55c2b208dbd0 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5678575800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55c2b1f1e050 con 0x55c2b20916e0 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5675873640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55c2b20916e0 0x55c2b2093ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5676074640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55c2b208dbd0 0x55c2b208ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50926/0 (socket says 172.21.15.161:50926) 2024-05-08T09:21:54.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5676074640 1 -- 172.21.15.161:0/3298843540 learned_addr learned my addr 172.21.15.161:0/3298843540 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:54.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5675873640 1 -- 172.21.15.161:0/3298843540 >> v1:172.21.15.45:6789/0 conn(0x55c2b208dbd0 legacy=0x55c2b208ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5675072640 1 -- 172.21.15.161:0/3298843540 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314408003 0 0) 0x55c2b2094010 con 0x55c2b208dbd0 2024-05-08T09:21:54.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.465+0000 7f5675873640 1 -- 172.21.15.161:0/3298843540 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b20951f0 con 0x55c2b20916e0 2024-05-08T09:21:54.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.467+0000 7f5675873640 1 --2- 172.21.15.161:0/3298843540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b20916e0 0x55c2b2093ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f566c00a470 tx=0x7f566c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b11dff4f8c7866d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.467+0000 7f5675072640 1 -- 172.21.15.161:0/3298843540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c057070 con 0x55c2b20916e0 2024-05-08T09:21:54.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.467+0000 7f5675072640 1 -- 172.21.15.161:0/3298843540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566c052570 con 0x55c2b20916e0 2024-05-08T09:21:54.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.467+0000 7f5675072640 1 -- 172.21.15.161:0/3298843540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566c052870 con 0x55c2b20916e0 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 -- 172.21.15.161:0/3298843540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b20916e0 msgr2=0x55c2b2093ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 --2- 172.21.15.161:0/3298843540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b20916e0 0x55c2b2093ad0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f566c00a470 tx=0x7f566c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 -- 172.21.15.161:0/3298843540 shutdown_connections 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 --2- 172.21.15.161:0/3298843540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b20916e0 0x55c2b2093ad0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 -- 172.21.15.161:0/3298843540 >> 172.21.15.161:0/3298843540 conn(0x55c2b20875a0 msgr2=0x55c2b20899c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 -- 172.21.15.161:0/3298843540 shutdown_connections 2024-05-08T09:21:54.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.468+0000 7f5678575800 1 -- 172.21.15.161:0/3298843540 wait complete. 2024-05-08T09:21:54.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.481+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.481+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5678575800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5678575800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c2b1fd81d0 con 0x55c2b208dbd0 2024-05-08T09:21:54.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5676074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5676074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33214/0 (socket says 172.21.15.161:33214) 2024-05-08T09:21:54.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5676074640 1 -- 172.21.15.161:0/1660962718 learned_addr learned my addr 172.21.15.161:0/1660962718 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.482+0000 7f5676074640 1 -- 172.21.15.161:0/1660962718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b208bad0 con 0x55c2b208dbd0 2024-05-08T09:21:54.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5676074640 1 --2- 172.21.15.161:0/1660962718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f566800b210 tx=0x7f566800b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710dfd6a56ba7c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5564608640 1 -- 172.21.15.161:0/1660962718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5668008070 con 0x55c2b208dbd0 2024-05-08T09:21:54.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5564608640 1 -- 172.21.15.161:0/1660962718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f566800d500 con 0x55c2b208dbd0 2024-05-08T09:21:54.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5564608640 1 -- 172.21.15.161:0/1660962718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f566800d840 con 0x55c2b208dbd0 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5678575800 1 -- 172.21.15.161:0/1660962718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 msgr2=0x55c2b208d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.483+0000 7f5678575800 1 --2- 172.21.15.161:0/1660962718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f566800b210 tx=0x7f566800b6d0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- 172.21.15.161:0/1660962718 shutdown_connections 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 --2- 172.21.15.161:0/1660962718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b208d510 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- 172.21.15.161:0/1660962718 >> 172.21.15.161:0/1660962718 conn(0x55c2b20875a0 msgr2=0x55c2b2179e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- 172.21.15.161:0/1660962718 shutdown_connections 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- 172.21.15.161:0/1660962718 wait complete. 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5678575800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c2b20944e0 con 0x55c2b208dbd0 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5676074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5676074640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33228/0 (socket says 172.21.15.161:33228) 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5676074640 1 -- 172.21.15.161:0/3979347897 learned_addr learned my addr 172.21.15.161:0/3979347897 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.484+0000 7f5676074640 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b21887e0 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5676074640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5668001e60 tx=0x7f5668000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5562e05640 1 -- 172.21.15.161:0/3979347897 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5668019870 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5562e05640 1 -- 172.21.15.161:0/3979347897 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5668019a10 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5562e05640 1 -- 172.21.15.161:0/3979347897 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5668019cf0 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2b2188a70 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.485+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b218b720 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5562e05640 1 -- 172.21.15.161:0/3979347897 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5668017040 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5562e05640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 0x7f555c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5562e05640 1 -- 172.21.15.161:0/3979347897 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5668015020 con 0x55c2b208dbd0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5675873640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 0x7f555c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 0x55c2b218f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b218fa70 con 0x55c2b20916e0 2024-05-08T09:21:54.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5676875640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 0x55c2b218f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5675873640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 0x7f555c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f566c054000 tx=0x7f566c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.486+0000 7f5676875640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 0x55c2b218f4e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5676875640 1 -- 172.21.15.161:0/3979347897 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f567000a4a0 con 0x55c2b20916e0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b218cab0 con 0x55c2b20916e0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5676875640 1 -- 172.21.15.161:0/3979347897 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f567000a4a0 con 0x55c2b20916e0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 0x55c2b2194190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2194830 con 0x55c2b2191da0 2024-05-08T09:21:54.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.487+0000 7f5676074640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 0x55c2b2194190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.488+0000 7f5676074640 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 0x55c2b2194190 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.488+0000 7f5676074640 1 -- 172.21.15.161:0/3979347897 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f566802d070 con 0x55c2b2191da0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.488+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2190d50 con 0x55c2b20916e0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.488+0000 7f5676875640 1 -- 172.21.15.161:0/3979347897 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f567000a4a0 con 0x55c2b20916e0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.488+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2191230 con 0x55c2b20916e0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5676875640 1 -- 172.21.15.161:0/3979347897 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f567000a4a0 con 0x55c2b20916e0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5678575800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5678575800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c2b1f7ecf0 con 0x55c2b21a39e0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33242/0 (socket says 172.21.15.161:33242) 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.489+0000 7f5676875640 1 -- 172.21.15.161:0/1753187638 learned_addr learned my addr 172.21.15.161:0/1753187638 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f5676875640 1 -- 172.21.15.161:0/1753187638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b21a4340 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f5676875640 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55c2b2189170 tx=0x7f56700188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f555bfff640 1 -- 172.21.15.161:0/1753187638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5670014450 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f555bfff640 1 -- 172.21.15.161:0/1753187638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56700145f0 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2b21a4db0 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f555bfff640 1 -- 172.21.15.161:0/1753187638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f56700148d0 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.490+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b21a52b0 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f555bfff640 1 -- 172.21.15.161:0/1753187638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5670011040 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f555bfff640 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 0x7f5550038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f555bfff640 1 -- 172.21.15.161:0/1753187638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f567001e070 con 0x55c2b21a39e0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f5676074640 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 0x7f5550038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.491+0000 7f5676074640 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 0x7f5550038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c2b218fec0 tx=0x7f566804b2d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5678575800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5678575800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c2b208be50 con 0x55c2b21b0d70 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33256/0 (socket says 172.21.15.161:33256) 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5676875640 1 -- 172.21.15.161:0/1648581830 learned_addr learned my addr 172.21.15.161:0/1648581830 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5676875640 1 -- 172.21.15.161:0/1648581830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b21b1760 con 0x55c2b21b0d70 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5676875640 1 --2- 172.21.15.161:0/1648581830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f567004c8a0 tx=0x7f5670011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4818d8a88e0e2ac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5559ffb640 1 -- 172.21.15.161:0/1648581830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567004e200 con 0x55c2b21b0d70 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5559ffb640 1 -- 172.21.15.161:0/1648581830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567004b1d0 con 0x55c2b21b0d70 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.492+0000 7f5559ffb640 1 -- 172.21.15.161:0/1648581830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567004b4b0 con 0x55c2b21b0d70 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- 172.21.15.161:0/1648581830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 msgr2=0x55c2b21b1190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 --2- 172.21.15.161:0/1648581830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f567004c8a0 tx=0x7f5670011700 comp rx=0 tx=0).stop 2024-05-08T09:21:54.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- 172.21.15.161:0/1648581830 shutdown_connections 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 --2- 172.21.15.161:0/1648581830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b1190 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- 172.21.15.161:0/1648581830 >> 172.21.15.161:0/1648581830 conn(0x55c2b21ad040 msgr2=0x55c2b21ab0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- 172.21.15.161:0/1648581830 shutdown_connections 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- 172.21.15.161:0/1648581830 wait complete. 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 Processor -- start 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- start start 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.493+0000 7f5678575800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55c2b21b1eb0 con 0x55c2b21b0d70 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5676875640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33258/0 (socket says 172.21.15.161:33258) 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 learned_addr learned my addr 172.21.15.161:0/2766808406 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2b21b8770 con 0x55c2b21b0d70 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5676875640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b8230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5670042040 tx=0x7f567004c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5547fff640 1 -- 172.21.15.161:0/2766808406 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5670022c90 con 0x55c2b21b0d70 2024-05-08T09:21:54.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5547fff640 1 -- 172.21.15.161:0/2766808406 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5670022e30 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5547fff640 1 -- 172.21.15.161:0/2766808406 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f567004cb10 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c2b21b8a00 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.494+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2b21bb6b0 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.495+0000 7f5547fff640 1 -- 172.21.15.161:0/2766808406 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f567004ccb0 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.495+0000 7f5547fff640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5540036950 0x7f5540038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.495+0000 7f5547fff640 1 -- 172.21.15.161:0/2766808406 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5670046040 con 0x55c2b21b0d70 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.495+0000 7f5676074640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5540036950 0x7f5540038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5676074640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5540036950 0x7f5540038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f566800e710 tx=0x7f5668034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b21c3ef0 0x55c2b21c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21c6b00 con 0x55c2b21c3ef0 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5675873640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b21c3ef0 0x55c2b21c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.496+0000 7f5675873640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b21c3ef0 0x55c2b21c63b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 realm 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21c6ed0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21c77a0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.514 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21c7b40 con 0x55c2b21c3ef0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b21c88a0 0x55c2b21cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.497+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cb2a0 con 0x55c2b21c88a0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5676875640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b21c88a0 0x55c2b21cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5676875640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b21c88a0 0x55c2b21cac90 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5678575800 20 searching for the correct realm 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c2b21cd230 0x55c2b21cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.515 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.498+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.499+0000 7f5676074640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c2b21cd230 0x55c2b21cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.499+0000 7f5676074640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c2b21cd230 0x55c2b21cf6f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5676074640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5668040850 0x7f56680187f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5675873640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5668040850 0x7f56680187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5675873640 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5668040850 0x7f56680187f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.500+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.516 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.501+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.502+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.503+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.504+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.505+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.506+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.506+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.506+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.506+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.507+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21cd230 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c88a0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.508+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cfdc0 con 0x7f5668040850 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cc780 con 0x55c2b21c3ef0 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cbff0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21cb730 con 0x55c2b21c3ef0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 zone default found 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 4 Realm: () 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 zonegroup default 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.509+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d06f0 con 0x55c2b21c88a0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d2970 con 0x55c2b21cd230 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d2d10 con 0x55c2b21cd230 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 started sync module instance, tier type = 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.510+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d1db0 con 0x7f5668040850 2024-05-08T09:21:54.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.511+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.511+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94294700270336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d1db0 con 0x7f5668040850 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.511+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3710 con 0x55c2b21c3ef0 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.512+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94294700270336] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.513+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.513+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94294700274208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d1db0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.513+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d41a0 con 0x55c2b21cd230 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.514+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.514+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94294700276848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d4a40 con 0x55c2b21cd230 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.514+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d54f0 con 0x7f5668040850 2024-05-08T09:21:54.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.514+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94294700274208] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.515+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94294700276848] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.515+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.515+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94294700279184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d4fd0 con 0x7f5668040850 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.515+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d5d90 con 0x55c2b21c3ef0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.516+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94294700279184] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.516+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.516+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94294700267776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d5d40 con 0x55c2b21c3ef0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.516+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d67a0 con 0x55c2b21c88a0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.517+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94294700267776] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.517+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.517+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94294700284048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d5cb0 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.517+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d7530 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.518+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94294700284048] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.518+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.518+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94294700288832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d7470 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.518+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d7f80 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94294700288832] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94294700292656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d7f40 con 0x55c2b21c88a0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=0 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=1 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=2 2024-05-08T09:21:54.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=3 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=4 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=5 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.519+0000 7f5678575800 20 add_watcher() i=6 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94294700292656] v27'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5678575800 20 add_watcher() i=7 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5678575800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21db3d0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.520+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94294700289888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d8920 con 0x55c2b21c3ef0 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.521+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94294700289888] v27'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f552cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:54.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 5 note: GC not initialized 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f54a77fe640 20 reqs_thread_entry: start 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 20 Filter name: none 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f54a57fa640 20 reqs_thread_entry: start 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b220e880 con 0x55c2b21c3ef0 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.522+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b22111b0 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 20 disabling bucket name=myfoo 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b220f190 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.523+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b22118a0 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.524+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b22194d0 con 0x7f5668040850 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5678575800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5678575800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5678575800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5678575800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94294700531552 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2214b80 con 0x55c2b21cd230 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94294700276848 notify 115964117003 ret 0) ==== 794+0+0 (crc 0 0 0) 0x55c2b218b720 con 0x55c2b21cd230 2024-05-08T09:21:54.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5559ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117003 cookie 94294700276848 notifier 4582 bl.length()=752 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5559ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5559ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5559ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94294700531552 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5559ffb640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f553c003ea0 con 0x55c2b21cd230 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.525+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94294700531552 notify 115964117003 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c2b2188a70 con 0x55c2b21cd230 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.526+0000 7f5678575800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.526+0000 7f5678575800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.526+0000 7f5678575800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.526+0000 7f5678575800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:54.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.526+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2214f20 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5678575800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5678575800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5678575800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94294700541584 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2214f20 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94294700267776 notify 115964117008 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55c2b2211c90 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f55597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117008 cookie 94294700267776 notifier 4582 bl.length()=567 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f55597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f55597fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f55597fa640 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f54ac003430 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(70 notify.4 [notify cookie 94294700541584 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.527+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94294700541584 notify 115964117008 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c2b2210d90 con 0x55c2b21c3ef0 2024-05-08T09:21:54.540 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.528+0000 7f552cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.528+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94294700289888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b2212910 con 0x55c2b21c3ef0 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.529+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94294700289888] v27'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.529+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94294700270336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d6f60 con 0x7f5668040850 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.530+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94294700270336] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.530+0000 7f5678575800 20 remove_watcher() i=0 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.530+0000 7f5678575800 2 removed watcher, disabling cache 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.530+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94294700274208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d22e0 con 0x55c2b21c3ef0 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.531+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94294700274208] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.531+0000 7f5678575800 20 remove_watcher() i=1 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.531+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94294700276848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3220 con 0x55c2b21cd230 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.532+0000 7f5676074640 1 -- 172.21.15.161:0/2766808406 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94294700276848] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5668054040 con 0x55c2b21cd230 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.532+0000 7f5678575800 20 remove_watcher() i=2 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.532+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94294700279184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3220 con 0x7f5668040850 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.533+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94294700279184] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x7f5668040850 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.533+0000 7f5678575800 20 remove_watcher() i=3 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.533+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94294700267776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3220 con 0x55c2b21c3ef0 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.534+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94294700267776] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f566c05a040 con 0x55c2b21c3ef0 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.534+0000 7f5678575800 20 remove_watcher() i=4 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.534+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94294700284048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3220 con 0x55c2b21c88a0 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.535+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94294700284048] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.535+0000 7f5678575800 20 remove_watcher() i=5 2024-05-08T09:21:54.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.535+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94294700288832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d3220 con 0x55c2b21c88a0 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.537+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94294700288832] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.537+0000 7f5678575800 20 remove_watcher() i=6 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.537+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94294700292656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55c2b21d6ff0 con 0x55c2b21c88a0 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5676875640 1 -- 172.21.15.161:0/2766808406 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94294700292656] v27'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f567002a070 con 0x55c2b21c88a0 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 20 remove_watcher() i=7 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b21c88a0 msgr2=0x55c2b21cac90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b21c88a0 0x55c2b21cac90 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b21c3ef0 msgr2=0x55c2b21c63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b21c3ef0 0x55c2b21c63b0 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5668040850 msgr2=0x7f56680187f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5668040850 0x7f56680187f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c2b21cd230 msgr2=0x55c2b21cf6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55c2b21cd230 0x55c2b21cf6f0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5540036950 msgr2=0x7f5540038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5540036950 0x7f5540038e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f566800e710 tx=0x7f5668034000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 msgr2=0x55c2b21b8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/2766808406 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21b0d70 0x55c2b21b8230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5670042040 tx=0x7f567004c830 comp rx=0 tx=0).stop 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 reap_dead start 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5675873640 1 -- 172.21.15.161:0/2766808406 reap_dead start 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 shutdown_connections 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 >> 172.21.15.161:0/2766808406 conn(0x55c2b21ad040 msgr2=0x55c2b21aa6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 shutdown_connections 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/2766808406 wait complete. 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 msgr2=0x7f5550038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 0x7f5550038dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x55c2b218fec0 tx=0x7f566804b2d0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 msgr2=0x55c2b21a3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x55c2b2189170 tx=0x7f56700188f0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 shutdown_connections 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5550036900 0x7f5550038dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 --2- 172.21.15.161:0/1753187638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b21a39e0 0x55c2b21a3e00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.538+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 >> 172.21.15.161:0/1753187638 conn(0x55c2b2197a80 msgr2=0x55c2b2197e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 shutdown_connections 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/1753187638 wait complete. 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 msgr2=0x55c2b2194190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 0x55c2b2194190 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 msgr2=0x55c2b218f4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 0x55c2b218f4e0 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 msgr2=0x7f555c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 0x7f555c038e10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f566c054000 tx=0x7f566c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 msgr2=0x55c2b21882a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f5668001e60 tx=0x7f5668000ed0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 shutdown_connections 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55c2b2191da0 0x55c2b2194190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55c2b20916e0 0x55c2b218f4e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f555c036950 0x7f555c038e10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 --2- 172.21.15.161:0/3979347897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2b208dbd0 0x55c2b21882a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 >> 172.21.15.161:0/3979347897 conn(0x55c2b20875a0 msgr2=0x55c2b208c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 shutdown_connections 2024-05-08T09:21:54.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.539+0000 7f5678575800 1 -- 172.21.15.161:0/3979347897 wait complete. 2024-05-08T09:21:54.551 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:54.553 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-05-08T09:21:54.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-05-08T09:21:54.553 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-05-08T09:21:54.597 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:21:54.597 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc09d52b800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f8b536efd0 0x55f8b536f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc09d52b800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f8b536fa70 con 0x55f8b5370230 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc09d52b800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55f8b5201050 con 0x55f8b536efd0 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc0992ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f8b536efd0 0x55f8b536f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc098aee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55f8b5370230 0x55f8b53706b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:50928/0 (socket says 172.21.15.161:50928) 2024-05-08T09:21:54.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc0992ef640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55f8b536efd0 0x55f8b536f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33264/0 (socket says 172.21.15.161:33264) 2024-05-08T09:21:54.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.599+0000 7fc098aee640 1 -- 172.21.15.161:0/4134197392 learned_addr learned my addr 172.21.15.161:0/4134197392 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:21:54.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.600+0000 7fc0992ef640 1 -- 172.21.15.161:0/4134197392 >> v1:172.21.15.45:6789/0 conn(0x55f8b5370230 legacy=0x55f8b53706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.600+0000 7fc0992ef640 1 -- 172.21.15.161:0/4134197392 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5370df0 con 0x55f8b536efd0 2024-05-08T09:21:54.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.601+0000 7fc0992ef640 1 --2- 172.21.15.161:0/4134197392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b536f3f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00a600 tx=0x7fc08c01ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8c609320002792 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.601+0000 7fc08bfff640 1 -- 172.21.15.161:0/4134197392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c00a200 con 0x55f8b536efd0 2024-05-08T09:21:54.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc08bfff640 1 -- 172.21.15.161:0/4134197392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c00a3a0 con 0x55f8b536efd0 2024-05-08T09:21:54.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc08bfff640 1 -- 172.21.15.161:0/4134197392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c0086e0 con 0x55f8b536efd0 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 -- 172.21.15.161:0/4134197392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 msgr2=0x55f8b536f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 --2- 172.21.15.161:0/4134197392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b536f3f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00a600 tx=0x7fc08c01ed70 comp rx=0 tx=0).stop 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 -- 172.21.15.161:0/4134197392 shutdown_connections 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 --2- 172.21.15.161:0/4134197392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b536f3f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 -- 172.21.15.161:0/4134197392 >> 172.21.15.161:0/4134197392 conn(0x55f8b536a5b0 msgr2=0x55f8b536c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 -- 172.21.15.161:0/4134197392 shutdown_connections 2024-05-08T09:21:54.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.602+0000 7fc09d52b800 1 -- 172.21.15.161:0/4134197392 wait complete. 2024-05-08T09:21:54.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.616+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.616+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.616+0000 7fc09d52b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.616+0000 7fc09d52b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8b52bb1d0 con 0x55f8b536efd0 2024-05-08T09:21:54.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.617+0000 7fc0992ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.617+0000 7fc0992ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33268/0 (socket says 172.21.15.161:33268) 2024-05-08T09:21:54.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.617+0000 7fc0992ef640 1 -- 172.21.15.161:0/810900123 learned_addr learned my addr 172.21.15.161:0/810900123 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.617+0000 7fc0992ef640 1 -- 172.21.15.161:0/810900123 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b545fbf0 con 0x55f8b536efd0 2024-05-08T09:21:54.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.617+0000 7fc0992ef640 1 --2- 172.21.15.161:0/810900123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000c00 tx=0x7fc08c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedee9e51e23925a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fbf87606640 1 -- 172.21.15.161:0/810900123 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c065070 con 0x55f8b536efd0 2024-05-08T09:21:54.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fbf87606640 1 -- 172.21.15.161:0/810900123 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c0086c0 con 0x55f8b536efd0 2024-05-08T09:21:54.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fbf87606640 1 -- 172.21.15.161:0/810900123 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c0089c0 con 0x55f8b536efd0 2024-05-08T09:21:54.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 -- 172.21.15.161:0/810900123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 msgr2=0x55f8b545f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 --2- 172.21.15.161:0/810900123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000c00 tx=0x7fc08c04e000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 -- 172.21.15.161:0/810900123 shutdown_connections 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 --2- 172.21.15.161:0/810900123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b545f620 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 -- 172.21.15.161:0/810900123 >> 172.21.15.161:0/810900123 conn(0x55f8b536a5b0 msgr2=0x55f8b545af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 -- 172.21.15.161:0/810900123 shutdown_connections 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.618+0000 7fc09d52b800 1 -- 172.21.15.161:0/810900123 wait complete. 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc09d52b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc09d52b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8b52e2540 con 0x55f8b536efd0 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc0992ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc0992ef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33284/0 (socket says 172.21.15.161:33284) 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.619+0000 7fc0992ef640 1 -- 172.21.15.161:0/2568812278 learned_addr learned my addr 172.21.15.161:0/2568812278 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fc0992ef640 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5467680 con 0x55f8b536efd0 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fc0992ef640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000c00 tx=0x7fc08c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fbf85e03640 1 -- 172.21.15.161:0/2568812278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c06d020 con 0x55f8b536efd0 2024-05-08T09:21:54.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fbf85e03640 1 -- 172.21.15.161:0/2568812278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc08c060680 con 0x55f8b536efd0 2024-05-08T09:21:54.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8b5467910 con 0x55f8b536efd0 2024-05-08T09:21:54.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fbf85e03640 1 -- 172.21.15.161:0/2568812278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc08c065040 con 0x55f8b536efd0 2024-05-08T09:21:54.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.620+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b546a5c0 con 0x55f8b536efd0 2024-05-08T09:21:54.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fbf85e03640 1 -- 172.21.15.161:0/2568812278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc08c070020 con 0x55f8b536efd0 2024-05-08T09:21:54.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fbf85e03640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 0x7fbf80038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fbf85e03640 1 -- 172.21.15.161:0/2568812278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc08c08fbf0 con 0x55f8b536efd0 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fc098aee640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 0x7fbf80038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 0x55f8b546e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b546e960 con 0x55f8b5370230 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fc099af0640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 0x55f8b546e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.621+0000 7fc098aee640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 0x7fbf80038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc090000f60 tx=0x7fc0900012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc099af0640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 0x55f8b546e380 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc099af0640 1 -- 172.21.15.161:0/2568812278 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc09400a4a0 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b546b950 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc099af0640 1 -- 172.21.15.161:0/2568812278 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc09400a4a0 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 0x55f8b5473080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b5473720 con 0x55f8b5470c90 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.622+0000 7fc0992ef640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 0x55f8b5473080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.623+0000 7fc0992ef640 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 0x55f8b5473080 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.623+0000 7fc0992ef640 1 -- 172.21.15.161:0/2568812278 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b5470c90 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.623+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b546fb80 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.623+0000 7fc099af0640 1 -- 172.21.15.161:0/2568812278 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc09400a4a0 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.623+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b5470060 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc099af0640 1 -- 172.21.15.161:0/2568812278 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc09400a4a0 con 0x55f8b5370230 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc09d52b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc09d52b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8b5261cf0 con 0x55f8b5486c10 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33296/0 (socket says 172.21.15.161:33296) 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.624+0000 7fc099af0640 1 -- 172.21.15.161:0/3623900165 learned_addr learned my addr 172.21.15.161:0/3623900165 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fc099af0640 1 -- 172.21.15.161:0/3623900165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5487570 con 0x55f8b5486c10 2024-05-08T09:21:54.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fc099af0640 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55f8b5468010 tx=0x7fc0940188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fbf7effd640 1 -- 172.21.15.161:0/3623900165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc094014450 con 0x55f8b5486c10 2024-05-08T09:21:54.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fbf7effd640 1 -- 172.21.15.161:0/3623900165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0940145f0 con 0x55f8b5486c10 2024-05-08T09:21:54.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8b5487fe0 con 0x55f8b5486c10 2024-05-08T09:21:54.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fbf7effd640 1 -- 172.21.15.161:0/3623900165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc0940148d0 con 0x55f8b5486c10 2024-05-08T09:21:54.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.625+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b54884e0 con 0x55f8b5486c10 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fbf7effd640 1 -- 172.21.15.161:0/3623900165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc094011040 con 0x55f8b5486c10 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fbf7effd640 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 0x7fbf70038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fbf7effd640 1 -- 172.21.15.161:0/3623900165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc09401e070 con 0x55f8b5486c10 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fc0992ef640 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 0x7fbf70038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fc0992ef640 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 0x7fbf70038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55f8b546edb0 tx=0x7fc08c053e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.626+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc09d52b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc09d52b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8b545ff10 con 0x55f8b5493fa0 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33306/0 (socket says 172.21.15.161:33306) 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc099af0640 1 -- 172.21.15.161:0/2233980883 learned_addr learned my addr 172.21.15.161:0/2233980883 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc099af0640 1 -- 172.21.15.161:0/2233980883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b5494990 con 0x55f8b5493fa0 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.627+0000 7fc099af0640 1 --2- 172.21.15.161:0/2233980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc09404c8a0 tx=0x7fc094011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42686e7b22ba2b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fbf7cff9640 1 -- 172.21.15.161:0/2233980883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc094016940 con 0x55f8b5493fa0 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fbf7cff9640 1 -- 172.21.15.161:0/2233980883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc09404e0d0 con 0x55f8b5493fa0 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fbf7cff9640 1 -- 172.21.15.161:0/2233980883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc09404b1d0 con 0x55f8b5493fa0 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- 172.21.15.161:0/2233980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 msgr2=0x55f8b54943c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2233980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fc09404c8a0 tx=0x7fc094011700 comp rx=0 tx=0).stop 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- 172.21.15.161:0/2233980883 shutdown_connections 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2233980883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b54943c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- 172.21.15.161:0/2233980883 >> 172.21.15.161:0/2233980883 conn(0x55f8b5490220 msgr2=0x55f8b548e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- 172.21.15.161:0/2233980883 shutdown_connections 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- 172.21.15.161:0/2233980883 wait complete. 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 Processor -- start 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.628+0000 7fc09d52b800 1 -- start start 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc09d52b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b549b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc09d52b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55f8b54950e0 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b549b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc099af0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b549b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33314/0 (socket says 172.21.15.161:33314) 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 learned_addr learned my addr 172.21.15.161:0/1866607223 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.629+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8b549b980 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fc099af0640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b549b440 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc094011740 tx=0x7fc09404c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fbf6effd640 1 -- 172.21.15.161:0/1866607223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc094022a80 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f8b549bc10 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fbf6effd640 1 -- 172.21.15.161:0/1866607223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc094022c20 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fbf6effd640 1 -- 172.21.15.161:0/1866607223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc09402b350 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.630+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8b549e8c0 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.631+0000 7fbf6effd640 1 -- 172.21.15.161:0/1866607223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fc09402b4f0 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.631+0000 7fbf6effd640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf64036900 0x7fbf64038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.631+0000 7fbf6effd640 1 -- 172.21.15.161:0/1866607223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fc09400e040 con 0x55f8b5493fa0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.631+0000 7fc0992ef640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf64036900 0x7fbf64038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.631+0000 7fc0992ef640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf64036900 0x7fbf64038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc08c05df90 tx=0x7fc08c085000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b54a7150 0x55f8b54a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54a9d60 con 0x55f8b54a7150 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc098aee640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b54a7150 0x55f8b54a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc098aee640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b54a7150 0x55f8b54a9610 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc090009050 con 0x55f8b54a7150 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 realm 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54a65a0 con 0x55f8b54a7150 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc090009050 con 0x55f8b54a7150 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.632+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54aa850 con 0x55f8b54a7150 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc090009050 con 0x55f8b54a7150 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ab120 con 0x55f8b54a7150 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc090009050 con 0x55f8b54a7150 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b54aba60 0x55f8b54ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.633+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ae5e0 con 0x55f8b54aba60 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.634+0000 7fc099af0640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b54aba60 0x55f8b54ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.637+0000 7fc099af0640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b54aba60 0x55f8b54ade50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc09d52b800 20 searching for the correct realm 2024-05-08T09:21:54.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8b54b05b0 0x55f8b54b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc0992ef640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8b54b05b0 0x55f8b54b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.638+0000 7fc0992ef640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8b54b05b0 0x55f8b54b2a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc0992ef640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc08c072020 0x7fc08c0758a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc098aee640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc08c072020 0x7fc08c0758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc098aee640 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc08c072020 0x7fc08c0758a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090009050 con 0x7fc08c072020 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.639+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090009050 con 0x55f8b54a7150 2024-05-08T09:21:54.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.640+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.641+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.641+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.641+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.641+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.642+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.643+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.644+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.645+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.646+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54b05b0 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.647+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54aba60 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x55f8b54a7150 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b3140 con 0x7fc08c072020 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:21:54.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.648+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54aefa0 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54af840 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54aebe0 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:21:54.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 zone default found 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 4 Realm: () 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 zonegroup default 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.649+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54af470 con 0x55f8b54aba60 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b5980 con 0x55f8b54b05b0 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b5d20 con 0x55f8b54b05b0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 started sync module instance, tier type = 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.650+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b4dc0 con 0x7fc08c072020 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.651+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.651+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94526681862880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b4dc0 con 0x7fc08c072020 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.651+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b66e0 con 0x55f8b54a7150 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.652+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94526681862880] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.652+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.652+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94526681867280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b4dc0 con 0x55f8b54a7150 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.652+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b7170 con 0x55f8b54b05b0 2024-05-08T09:21:54.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.653+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.653+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94526681869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b7a10 con 0x55f8b54b05b0 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.653+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b84d0 con 0x7fc08c072020 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.654+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94526681867280] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.654+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.654+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94526681874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b88c0 con 0x7fc08c072020 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.654+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b92c0 con 0x55f8b54a7150 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.655+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94526681869376] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.656+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.656+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94526681871712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b9280 con 0x55f8b54a7150 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.656+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b9cd0 con 0x55f8b54aba60 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.656+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94526681874336] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.657+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94526681871712] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.657+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.657+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94526681860368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b9280 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.657+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ba520 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.659+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94526681860368] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.660+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.660+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94526681878448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ba520 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.660+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54baee0 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v27'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94526681885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bb340 con 0x55f8b54aba60 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=0 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=1 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=2 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=3 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=4 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=5 2024-05-08T09:21:54.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94526681878448] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.661+0000 7fc09d52b800 20 add_watcher() i=6 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94526681885232] v27'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc09d52b800 20 add_watcher() i=7 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc09d52b800 2 all 8 watchers are set, enabling cache 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ba070 con 0x55f8b54a7150 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.662+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94526681886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54ba070 con 0x55f8b54a7150 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.663+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94526681886288] v27'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.663+0000 7fbf4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 5 note: GC not initialized 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fbf4e7e4640 20 reqs_thread_entry: start 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 20 init_complete bucket index max shards: 11 2024-05-08T09:21:54.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 20 Filter name: none 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fbebffff640 20 reqs_thread_entry: start 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.664+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54f1900 con 0x55f8b54a7150 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54f13e0 con 0x7fc08c072020 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 20 enabling bucket name=myfoo 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:21:54.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54f2210 con 0x7fc08c072020 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 : miss 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 20 rados->read ofs=0 len=0 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.665+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54f3af0 con 0x7fc08c072020 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:21:54.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.666+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 8.1f 8:fb598df8:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~379 in=379b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54fc4e0 con 0x7fc08c072020 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(66 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 [delete,create,call,call,writefull 0~379,setxattr (123)] v27'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc09d52b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc09d52b800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc09d52b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc09d52b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1, ofs0, ns] 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94526682120560 in=764b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54fb130 con 0x55f8b54b05b0 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94526681869376 notify 115964117004 ret 0) ==== 794+0+0 (crc 0 0 0) 0x7fc08c0a4040 con 0x55f8b54b05b0 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fbf7cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117004 cookie 94526681869376 notifier 4589 bl.length()=752 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fbf7cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 info.flags=0x17 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fbf7cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1 to cache LRU end 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fbf7cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:21:54.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fbf7cff9640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbf5c003ea0 con 0x55f8b54b05b0 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.667+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 notify.2 [notify cookie 94526682120560 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify_complete (2) cookie 94526682120560 notify 115964117004 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f8b546a5c0 con 0x55f8b54b05b0 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc09d52b800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_sources= new_sources= 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc09d52b800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential sources added=[] removed=[] 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc09d52b800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): orig_dests= new_dests= 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc09d52b800 20 handle_bi_update(): bucket=:myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1]): potential dests added=[] removed=[] 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.668+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54fb4d0 con 0x55f8b54a7150 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v27'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc09d52b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc09d52b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc09d52b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94526682147968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54fb4d0 con 0x55f8b54a7150 2024-05-08T09:21:54.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94526681871712 notify 115964117009 ret 0) ==== 609+0+0 (crc 0 0 0) 0x55f8b54f3ee0 con 0x55f8b54a7150 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fbf6ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94526681871712 notifier 4589 bl.length()=567 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fbf6ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fbf6ffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fbf6ffff640 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7fbecc003430 con 0x55f8b54a7150 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.669+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(70 notify.4 [notify cookie 94526682147968 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.670+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== watch-notify(notify_complete (2) cookie 94526682147968 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f8b54f1d50 con 0x55f8b54a7150 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.670+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.678 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.670+0000 7fbf4f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.670+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94526681886288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54f0040 con 0x55f8b54a7150 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.671+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94526681886288] v27'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.671+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94526681862880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bae50 con 0x7fc08c072020 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.672+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94526681862880] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.672+0000 7fc09d52b800 20 remove_watcher() i=0 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.672+0000 7fc09d52b800 2 removed watcher, disabling cache 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.672+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94526681867280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bae50 con 0x55f8b54a7150 2024-05-08T09:21:54.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.674+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94526681867280] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.674+0000 7fc09d52b800 20 remove_watcher() i=1 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.674+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94526681869376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bae50 con 0x55f8b54b05b0 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.675+0000 7fc0992ef640 1 -- 172.21.15.161:0/1866607223 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94526681869376] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc08c05dcc0 con 0x55f8b54b05b0 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.675+0000 7fc09d52b800 20 remove_watcher() i=2 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.675+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94526681874336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b6c40 con 0x7fc08c072020 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.676+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94526681874336] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x7fc08c072020 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.676+0000 7fc09d52b800 20 remove_watcher() i=3 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.676+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94526681871712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bae50 con 0x55f8b54a7150 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.677+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94526681871712] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc090029040 con 0x55f8b54a7150 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.677+0000 7fc09d52b800 20 remove_watcher() i=4 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.677+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94526681860368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b7fa0 con 0x55f8b54aba60 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.678+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94526681860368] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.678+0000 7fc09d52b800 20 remove_watcher() i=5 2024-05-08T09:21:54.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.678+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94526681878448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54b6c40 con 0x55f8b54aba60 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.679+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94526681878448] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.679+0000 7fc09d52b800 20 remove_watcher() i=6 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.679+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94526681885232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55f8b54bae50 con 0x55f8b54aba60 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc099af0640 1 -- 172.21.15.161:0/1866607223 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94526681885232] v27'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc09403c020 con 0x55f8b54aba60 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 20 remove_watcher() i=7 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b54aba60 msgr2=0x55f8b54ade50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b54aba60 0x55f8b54ade50 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b54a7150 msgr2=0x55f8b54a9610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b54a7150 0x55f8b54a9610 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc08c072020 msgr2=0x7fc08c0758a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fc08c072020 0x7fc08c0758a0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8b54b05b0 msgr2=0x55f8b54b2a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.680+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55f8b54b05b0 0x55f8b54b2a70 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf64036900 msgr2=0x7fbf64038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf64036900 0x7fbf64038dc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc08c05df90 tx=0x7fc08c085000 comp rx=0 tx=0).stop 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 msgr2=0x55f8b549b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/1866607223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5493fa0 0x55f8b549b440 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc094011740 tx=0x7fc09404c830 comp rx=0 tx=0).stop 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 reap_dead start 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc098aee640 1 -- 172.21.15.161:0/1866607223 reap_dead start 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 shutdown_connections 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 >> 172.21.15.161:0/1866607223 conn(0x55f8b5490220 msgr2=0x55f8b548d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 shutdown_connections 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/1866607223 wait complete. 2024-05-08T09:21:54.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 msgr2=0x7fbf70038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 0x7fbf70038dc0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x55f8b546edb0 tx=0x7fc08c053e10 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 msgr2=0x55f8b5487030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55f8b5468010 tx=0x7fc0940188f0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 shutdown_connections 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf70036900 0x7fbf70038dc0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/3623900165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b5486c10 0x55f8b5487030 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 >> 172.21.15.161:0/3623900165 conn(0x55f8b54768a0 msgr2=0x55f8b5476ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 shutdown_connections 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/3623900165 wait complete. 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 msgr2=0x55f8b5473080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 0x55f8b5473080 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 msgr2=0x55f8b546e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.681+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 0x55f8b546e380 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.688 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 msgr2=0x7fbf80038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 0x7fbf80038e10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc090000f60 tx=0x7fc0900012b0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 msgr2=0x55f8b5467140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc08c000c00 tx=0x7fc08c002fb0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 shutdown_connections 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55f8b5470c90 0x55f8b5473080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55f8b5370230 0x55f8b546e380 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbf80036950 0x7fbf80038e10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 --2- 172.21.15.161:0/2568812278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8b536efd0 0x55f8b5467140 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 >> 172.21.15.161:0/2568812278 conn(0x55f8b536a5b0 msgr2=0x55f8b5459740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 shutdown_connections 2024-05-08T09:21:54.689 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:21:54.682+0000 7fc09d52b800 1 -- 172.21.15.161:0/2568812278 wait complete. 2024-05-08T09:21:54.690 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:21:54.697 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T09:21:54.911 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-05-08T09:21:54.918 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:09.919 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T09:22:09.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T09:22:09.919 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T09:22:09.971 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:09.972 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:09.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.973+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:09.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.973+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.973+0000 7fcb57133800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ec61cc8560 0x55ec61cd1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.973+0000 7fcb57133800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ec61c3b8e0 con 0x55ec61cc6a20 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.973+0000 7fcb57133800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55ec61b59050 con 0x55ec61cc8560 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb4bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ec61cc8560 0x55ec61cd1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb4bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ec61cc8560 0x55ec61cd1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41590/0 (socket says 172.21.15.161:41590) 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb52df5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55ec61cc6a20 0x55ec61cc6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43716/0 (socket says 172.21.15.161:43716) 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2188724061 learned_addr learned my addr 172.21.15.161:0/2188724061 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2188724061 >> v1:172.21.15.45:6789/0 conn(0x55ec61cc6a20 legacy=0x55ec61cc6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2188724061 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61c3bab0 con 0x55ec61cc8560 2024-05-08T09:22:09.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.974+0000 7fcb525f4640 1 -- 172.21.15.161:0/2188724061 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567552588 0 0) 0x55ec61c3b8e0 con 0x55ec61cc6a20 2024-05-08T09:22:09.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.976+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2188724061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc8560 0x55ec61cd1060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a520 tx=0x7fcb3c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ced0dcd8a9cde1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.976+0000 7fcb525f4640 1 -- 172.21.15.161:0/2188724061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c057070 con 0x55ec61cc8560 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.976+0000 7fcb525f4640 1 -- 172.21.15.161:0/2188724061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c052570 con 0x55ec61cc8560 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.976+0000 7fcb525f4640 1 -- 172.21.15.161:0/2188724061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb3c04ae60 con 0x55ec61cc8560 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 -- 172.21.15.161:0/2188724061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc8560 msgr2=0x55ec61cd1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 --2- 172.21.15.161:0/2188724061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc8560 0x55ec61cd1060 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00a520 tx=0x7fcb3c01d010 comp rx=0 tx=0).stop 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 -- 172.21.15.161:0/2188724061 shutdown_connections 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 --2- 172.21.15.161:0/2188724061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc8560 0x55ec61cd1060 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 -- 172.21.15.161:0/2188724061 >> 172.21.15.161:0/2188724061 conn(0x55ec61cc25a0 msgr2=0x55ec61cc49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 -- 172.21.15.161:0/2188724061 shutdown_connections 2024-05-08T09:22:09.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.977+0000 7fcb57133800 1 -- 172.21.15.161:0/2188724061 wait complete. 2024-05-08T09:22:09.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.993+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:09.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.994+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:09.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.994+0000 7fcb57133800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:09.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.994+0000 7fcb57133800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ec61c131d0 con 0x55ec61cc6a20 2024-05-08T09:22:09.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.995+0000 7fcb52df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:09.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.996+0000 7fcb52df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41592/0 (socket says 172.21.15.161:41592) 2024-05-08T09:22:09.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.996+0000 7fcb52df5640 1 -- 172.21.15.161:0/88284332 learned_addr learned my addr 172.21.15.161:0/88284332 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:09.997 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.997+0000 7fcb52df5640 1 -- 172.21.15.161:0/88284332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61dbbc30 con 0x55ec61cc6a20 2024-05-08T09:22:09.998 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:09.999+0000 7fcb52df5640 1 --2- 172.21.15.161:0/88284332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b210 tx=0x7fcb4400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeca94bc10e4819 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.000+0000 7fca40e09640 1 -- 172.21.15.161:0/88284332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb44008070 con 0x55ec61cc6a20 2024-05-08T09:22:10.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.000+0000 7fca40e09640 1 -- 172.21.15.161:0/88284332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400d500 con 0x55ec61cc6a20 2024-05-08T09:22:10.000 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.000+0000 7fca40e09640 1 -- 172.21.15.161:0/88284332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4400d840 con 0x55ec61cc6a20 2024-05-08T09:22:10.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 -- 172.21.15.161:0/88284332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 msgr2=0x55ec61dbb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 --2- 172.21.15.161:0/88284332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b210 tx=0x7fcb4400b6d0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.001 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 -- 172.21.15.161:0/88284332 shutdown_connections 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 --2- 172.21.15.161:0/88284332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dbb660 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 -- 172.21.15.161:0/88284332 >> 172.21.15.161:0/88284332 conn(0x55ec61cc25a0 msgr2=0x55ec61db6f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 -- 172.21.15.161:0/88284332 shutdown_connections 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 -- 172.21.15.161:0/88284332 wait complete. 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.001+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.002+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.002+0000 7fcb57133800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.002 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.002+0000 7fcb57133800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ec61cd1870 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.003+0000 7fcb52df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.003+0000 7fcb52df5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41604/0 (socket says 172.21.15.161:41604) 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.003+0000 7fcb52df5640 1 -- 172.21.15.161:0/2012295491 learned_addr learned my addr 172.21.15.161:0/2012295491 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fcb52df5640 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61dc37d0 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b210 tx=0x7fcb44000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fca3f606640 1 -- 172.21.15.161:0/2012295491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4400f880 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fca3f606640 1 -- 172.21.15.161:0/2012295491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4400fa20 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fca3f606640 1 -- 172.21.15.161:0/2012295491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4400fd00 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec61dc3a60 con 0x55ec61cc6a20 2024-05-08T09:22:10.004 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.004+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec61dc6710 con 0x55ec61cc6a20 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fca3f606640 1 -- 172.21.15.161:0/2012295491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb44017040 con 0x55ec61cc6a20 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fca3f606640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 0x7fca38038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fca3f606640 1 -- 172.21.15.161:0/2012295491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb44015020 con 0x55ec61cc6a20 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 0x7fca38038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 0x55ec61dca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.005+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61dcaaa0 con 0x55ec61cc8560 2024-05-08T09:22:10.007 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.006+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 0x55ec61dca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.006+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 0x7fca38038e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c054000 tx=0x7fcb3c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.006+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 0x55ec61dca4d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.006+0000 7fcb535f6640 1 -- 172.21.15.161:0/2012295491 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb4c00a4a0 con 0x55ec61cc8560 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.006+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61dc7aa0 con 0x55ec61cc8560 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.007+0000 7fcb535f6640 1 -- 172.21.15.161:0/2012295491 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb4c00a4a0 con 0x55ec61cc8560 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.007+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 0x55ec61dcf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.007+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61dcf840 con 0x55ec61dccdb0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.007+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 0x55ec61dcf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.007+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 0x55ec61dcf1a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.008+0000 7fcb52df5640 1 -- 172.21.15.161:0/2012295491 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcb4402d070 con 0x55ec61dccdb0 2024-05-08T09:22:10.008 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.008+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61dcbd30 con 0x55ec61cc8560 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.008+0000 7fcb535f6640 1 -- 172.21.15.161:0/2012295491 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb4c00a4a0 con 0x55ec61cc8560 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.008+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61dcc1c0 con 0x55ec61cc8560 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.009+0000 7fcb535f6640 1 -- 172.21.15.161:0/2012295491 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcb4c00a4a0 con 0x55ec61cc8560 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.009+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.009+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.009+0000 7fcb57133800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.009+0000 7fcb57133800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ec61bb9cf0 con 0x55ec61dde9f0 2024-05-08T09:22:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.011+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.011+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41616/0 (socket says 172.21.15.161:41616) 2024-05-08T09:22:10.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.011+0000 7fcb535f6640 1 -- 172.21.15.161:0/2781067888 learned_addr learned my addr 172.21.15.161:0/2781067888 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.013+0000 7fcb535f6640 1 -- 172.21.15.161:0/2781067888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61ddf350 con 0x55ec61dde9f0 2024-05-08T09:22:10.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.015+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55ec61dcae60 tx=0x7fcb4c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.016+0000 7fca3ce01640 1 -- 172.21.15.161:0/2781067888 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014450 con 0x55ec61dde9f0 2024-05-08T09:22:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.016+0000 7fca3ce01640 1 -- 172.21.15.161:0/2781067888 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c014610 con 0x55ec61dde9f0 2024-05-08T09:22:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.016+0000 7fca3ce01640 1 -- 172.21.15.161:0/2781067888 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c014930 con 0x55ec61dde9f0 2024-05-08T09:22:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.016+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec61ddfdc0 con 0x55ec61dde9f0 2024-05-08T09:22:10.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.017+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec61de02c0 con 0x55ec61dde9f0 2024-05-08T09:22:10.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.019+0000 7fca3ce01640 1 -- 172.21.15.161:0/2781067888 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb4c011040 con 0x55ec61dde9f0 2024-05-08T09:22:10.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.019+0000 7fca3ce01640 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 0x7fca2c038eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.019+0000 7fca3ce01640 1 -- 172.21.15.161:0/2781067888 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb4c01e070 con 0x55ec61dde9f0 2024-05-08T09:22:10.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 0x7fca2c038eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:10.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 0x7fca2c038eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000fb0 tx=0x7fcb4400ff70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:10.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb57133800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.020+0000 7fcb57133800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ec61dbbfb0 con 0x55ec61debc30 2024-05-08T09:22:10.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.022+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.022+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41632/0 (socket says 172.21.15.161:41632) 2024-05-08T09:22:10.022 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.022+0000 7fcb535f6640 1 -- 172.21.15.161:0/101554375 learned_addr learned my addr 172.21.15.161:0/101554375 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.024 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.024+0000 7fcb535f6640 1 -- 172.21.15.161:0/101554375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61dec620 con 0x55ec61debc30 2024-05-08T09:22:10.025 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.026+0000 7fcb535f6640 1 --2- 172.21.15.161:0/101554375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c011830 tx=0x7fcb4c014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16baaa1816ffcbe7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fca367fc640 1 -- 172.21.15.161:0/101554375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c02bd80 con 0x55ec61debc30 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fca367fc640 1 -- 172.21.15.161:0/101554375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c04e0d0 con 0x55ec61debc30 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fca367fc640 1 -- 172.21.15.161:0/101554375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c04b200 con 0x55ec61debc30 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 -- 172.21.15.161:0/101554375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 msgr2=0x55ec61dec050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 --2- 172.21.15.161:0/101554375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c011830 tx=0x7fcb4c014ea0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 -- 172.21.15.161:0/101554375 shutdown_connections 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 --2- 172.21.15.161:0/101554375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61dec050 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 -- 172.21.15.161:0/101554375 >> 172.21.15.161:0/101554375 conn(0x55ec61de7f40 msgr2=0x55ec61de5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.028 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 -- 172.21.15.161:0/101554375 shutdown_connections 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.027+0000 7fcb57133800 1 -- 172.21.15.161:0/101554375 wait complete. 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.028+0000 7fcb57133800 1 Processor -- start 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.028+0000 7fcb57133800 1 -- start start 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.028+0000 7fcb57133800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.028+0000 7fcb57133800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ec61decdf0 con 0x55ec61debc30 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.029+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.029+0000 7fcb535f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41638/0 (socket says 172.21.15.161:41638) 2024-05-08T09:22:10.029 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.029+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 learned_addr learned my addr 172.21.15.161:0/2192504200 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec61df36e0 con 0x55ec61debc30 2024-05-08T09:22:10.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x55ec61de8660 tx=0x7fcb4c04c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fca34ff9640 1 -- 172.21.15.161:0/2192504200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c031020 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fca34ff9640 1 -- 172.21.15.161:0/2192504200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c03bdb0 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ec61df3970 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fca34ff9640 1 -- 172.21.15.161:0/2192504200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcb4c022bc0 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.030+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec61df3970 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fca34ff9640 1 -- 172.21.15.161:0/2192504200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcb4c034020 con 0x55ec61debc30 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fca34ff9640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca1c036950 0x7fca1c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fca34ff9640 1 -- 172.21.15.161:0/2192504200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fcb4c00e040 con 0x55ec61debc30 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca1c036950 0x7fca1c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61dfeac0 0x55ec61e00f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.031+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e016d0 con 0x55ec61dfeac0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61dfeac0 0x55ec61e00f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca1c036950 0x7fca1c038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400bc70 tx=0x7fcb44027000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61dfeac0 0x55ec61e00f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 20 realm 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e01aa0 con 0x55ec61dfeac0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.032+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e02370 con 0x55ec61dfeac0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e02710 con 0x55ec61dfeac0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61e031c0 0x55ec61e055b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e05d10 con 0x55ec61e031c0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.033+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61e031c0 0x55ec61e055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb535f6640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61e031c0 0x55ec61e055b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb57133800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb57133800 20 searching for the correct realm 2024-05-08T09:22:10.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ec61e07dc0 0x55ec61e0a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.034+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.035+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ec61e07dc0 0x55ec61e0a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.035+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ec61e07dc0 0x55ec61e0a280 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.035+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4402d070 con 0x55ec61e07dc0 2024-05-08T09:22:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.035+0000 7fcb52df5640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb4403e070 0x7fcb440441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.035+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.036+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb4403e070 0x7fcb440441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.036+0000 7fcb4bfff640 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb4403e070 0x7fcb440441a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.036+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.036+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.037+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4402d070 con 0x55ec61e07dc0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.038+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.039+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4402d070 con 0x55ec61e07dc0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.040+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.041+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.042+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.043+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e07dc0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61e031c0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.044+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x55ec61dfeac0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0a950 con 0x7fcb4403e070 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:10.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e067c0 con 0x55ec61dfeac0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e06c40 con 0x55ec61dfeac0 2024-05-08T09:22:10.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.045+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e07120 con 0x55ec61dfeac0 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 zone default found 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 4 Realm: () 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:10.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 zonegroup default 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0add0 con 0x55ec61e031c0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0d000 con 0x55ec61e07dc0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.046+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0d3a0 con 0x55ec61e07dc0 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.047+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.047+0000 7fcb57133800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.047+0000 7fcb57133800 20 started sync module instance, tier type = 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.047+0000 7fcb57133800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.047+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0c440 con 0x7fcb4403e070 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.048+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.048+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94473742764352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0c440 con 0x7fcb4403e070 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.048+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0dd60 con 0x55ec61dfeac0 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.049+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94473742764352] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.049+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.049+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94473742768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0c440 con 0x55ec61dfeac0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.049+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0e7b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.050+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94473742768784] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.051+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.051+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94473742761872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0c3b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.051+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0f670 con 0x7fcb4403e070 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.052+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.052+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94473742761872] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.052+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94473742775200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0fe10 con 0x7fcb4403e070 2024-05-08T09:22:10.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.052+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0ebe0 con 0x55ec61dfeac0 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.053+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94473742775200] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.053+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.053+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94473742776416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e0ebe0 con 0x55ec61dfeac0 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.053+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e10ed0 con 0x55ec61e031c0 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.054+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.054+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94473742776416] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.054+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94473742780960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e11270 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.054+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e11c30 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.056+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.056+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94473742784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e11ba0 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.056+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e12be0 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.056+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94473742780960] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94473742784384] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94473742786592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e126f0 con 0x55ec61e031c0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=0 2024-05-08T09:22:10.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=1 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=2 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=3 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=4 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=5 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.057+0000 7fcb57133800 20 add_watcher() i=6 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.058+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94473742786592] v27'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.058+0000 7fcb57133800 20 add_watcher() i=7 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.058+0000 7fcb57133800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.058+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e15af0 con 0x55ec61dfeac0 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.059+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.059+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94473742779392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e12fa0 con 0x55ec61dfeac0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.060+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94473742779392] v27'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.060+0000 7fca097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.060+0000 7fcb57133800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.060+0000 7fcb57133800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.060+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1e1b0 con 0x55ec61dfeac0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.061+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.061+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1e720 con 0x55ec61e031c0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.063+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.063+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1e720 con 0x55ec61e07dc0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.064+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.064+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1ec90 con 0x55ec61dfeac0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.065+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'153 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.065+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1f140 con 0x7fcb4403e070 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.066+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'44 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.066+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c310 con 0x55ec61e07dc0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.067+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.067+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61dfeac0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.068+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.068+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61e031c0 2024-05-08T09:22:10.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.070+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.070+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x7fcb4403e070 2024-05-08T09:22:10.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.071+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.071+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61e07dc0 2024-05-08T09:22:10.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.072+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.072+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x7fcb4403e070 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.073+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'45 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.073+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61e031c0 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.074+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.074+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x7fcb4403e070 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.075+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.075+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61e031c0 2024-05-08T09:22:10.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.076+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'35 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.076+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61dfeac0 2024-05-08T09:22:10.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.077+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.077+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1fca0 con 0x55ec61e07dc0 2024-05-08T09:22:10.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.078+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'38 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.078+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e202f0 con 0x7fcb4403e070 2024-05-08T09:22:10.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.079+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.079+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e202b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.081+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.081+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e202b0 con 0x55ec61dfeac0 2024-05-08T09:22:10.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.082+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.082+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61dfeac0 2024-05-08T09:22:10.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.083+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.083+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.084+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'39 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.084+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x7fcb4403e070 2024-05-08T09:22:10.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.085+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.085+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.086+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'21 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.086+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.087+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.087+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.088+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.088+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.089+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.089+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e031c0 2024-05-08T09:22:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.090+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.090+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.091+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.091+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e031c0 2024-05-08T09:22:10.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.093+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.093+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e07dc0 2024-05-08T09:22:10.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.094+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'40 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.094+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x55ec61e031c0 2024-05-08T09:22:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.095+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'36 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.095+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e1c2b0 con 0x7fcb4403e070 2024-05-08T09:22:10.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.096+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.096+0000 7fc983fff640 20 reqs_thread_entry: start 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.096+0000 7fcb57133800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.096+0000 7fcb57133800 20 Filter name: none 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.096+0000 7fc981ffb640 20 reqs_thread_entry: start 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.097+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.098+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.099+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv11 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv11 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.100+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.101+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.102+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv6 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv6 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.103+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.104+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.105+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.106+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.107+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.107+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.107+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.107+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.108+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.109+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.110+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.111+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.112+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.113+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.114+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.115+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4a960 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.116+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b970 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(162 gc.22 [call out=1701b] v0'0 uv20 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.117+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.118+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.119+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.119+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.119+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.119+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e031c0 2024-05-08T09:22:10.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.120+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.121+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e07dc0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.121+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.121+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.121+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.121+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv4 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv4 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.122+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e07dc0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e07dc0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.123+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.124+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x7fcb4403e070 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.125+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.125+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4b370 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.125+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.125+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e4c380 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.125+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.126+0000 7fca097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.126+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94473742779392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61dfeac0 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.127+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94473742779392] v27'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.127+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94473742764352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.128+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94473742764352] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.129+0000 7fcb57133800 20 remove_watcher() i=0 2024-05-08T09:22:10.138 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.129+0000 7fcb57133800 2 removed watcher, disabling cache 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.129+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94473742768784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61dfeac0 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.130+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94473742768784] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.130+0000 7fcb57133800 20 remove_watcher() i=1 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.130+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94473742761872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61e07dc0 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.131+0000 7fcb52df5640 1 -- 172.21.15.161:0/2192504200 <== osd.3 v2:172.21.15.161:6804/1879099265 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94473742761872] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb44064040 con 0x55ec61e07dc0 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.131+0000 7fcb57133800 20 remove_watcher() i=2 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.131+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94473742775200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x7fcb4403e070 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.132+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.2 v2:172.21.15.161:6800/1967789976 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94473742775200] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x7fcb4403e070 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.132+0000 7fcb57133800 20 remove_watcher() i=3 2024-05-08T09:22:10.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.132+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94473742776416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61dfeac0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.133+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94473742776416] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb3c05a040 con 0x55ec61dfeac0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.133+0000 7fcb57133800 20 remove_watcher() i=4 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.133+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94473742780960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61e031c0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.134+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94473742780960] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.134+0000 7fcb57133800 20 remove_watcher() i=5 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.134+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94473742784384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61e031c0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.135+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94473742784384] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.135+0000 7fcb57133800 20 remove_watcher() i=6 2024-05-08T09:22:10.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.135+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94473742786592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55ec61e49950 con 0x55ec61e031c0 2024-05-08T09:22:10.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.136+0000 7fcb535f6640 1 -- 172.21.15.161:0/2192504200 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94473742786592] v27'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcb4c057040 con 0x55ec61e031c0 2024-05-08T09:22:10.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.136+0000 7fcb57133800 20 remove_watcher() i=7 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61e031c0 msgr2=0x55ec61e055b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61e031c0 0x55ec61e055b0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61dfeac0 msgr2=0x55ec61e00f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61dfeac0 0x55ec61e00f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb4403e070 msgr2=0x7fcb440441a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcb4403e070 0x7fcb440441a0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ec61e07dc0 msgr2=0x55ec61e0a280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ec61e07dc0 0x55ec61e0a280 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca1c036950 msgr2=0x7fca1c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca1c036950 0x7fca1c038e10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400bc70 tx=0x7fcb44027000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 msgr2=0x55ec61df31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x55ec61de8660 tx=0x7fcb4c04c7b0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb4bfff640 1 -- 172.21.15.161:0/2192504200 reap_dead start 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 shutdown_connections 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2192504200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61debc30 0x55ec61df31a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 >> 172.21.15.161:0/2192504200 conn(0x55ec61de7f40 msgr2=0x55ec61de55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 shutdown_connections 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2192504200 wait complete. 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 msgr2=0x7fca2c038eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 0x7fca2c038eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcb44000fb0 tx=0x7fcb4400ff70 comp rx=0 tx=0).stop 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 msgr2=0x55ec61ddee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55ec61dcae60 tx=0x7fcb4c018830 comp rx=0 tx=0).stop 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 shutdown_connections 2024-05-08T09:22:10.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca2c0369f0 0x7fca2c038eb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 --2- 172.21.15.161:0/2781067888 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61dde9f0 0x55ec61ddee10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 >> 172.21.15.161:0/2781067888 conn(0x55ec61dd2a90 msgr2=0x55ec61dd2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 shutdown_connections 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.137+0000 7fcb57133800 1 -- 172.21.15.161:0/2781067888 wait complete. 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 msgr2=0x55ec61dcf1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 0x55ec61dcf1a0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 msgr2=0x55ec61dca4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 0x55ec61dca4d0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 msgr2=0x7fca38038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 0x7fca38038e60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c054000 tx=0x7fcb3c04e000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 msgr2=0x55ec61dc3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fcb4400b210 tx=0x7fcb44000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 shutdown_connections 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ec61dccdb0 0x55ec61dcf1a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ec61cc8560 0x55ec61dca4d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fca380369a0 0x7fca38038e60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 --2- 172.21.15.161:0/2012295491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ec61cc6a20 0x55ec61dc3290 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 >> 172.21.15.161:0/2012295491 conn(0x55ec61cc25a0 msgr2=0x55ec61db57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 shutdown_connections 2024-05-08T09:22:10.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.138+0000 7fcb57133800 1 -- 172.21.15.161:0/2012295491 wait complete. 2024-05-08T09:22:10.148 INFO:teuthology.orchestra.run.smithi161.stdout:[{"tag":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.3271386485123670751\u0000","time":"2024-05-08T09:22:09.917846+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_7","key":"","instance":""}]}] 2024-05-08T09:22:10.149 DEBUG:tasks.util.rgw: json result: [{'tag': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.3271386485123670751\x00', 'time': '2024-05-08T09:22:09.917846+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_7', 'key': '', 'instance': ''}]}] 2024-05-08T09:22:10.149 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-05-08T09:22:10.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-05-08T09:22:10.149 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-05-08T09:22:10.191 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:10.192 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a6d38800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b7c8047450 0x55b7c8049840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a6d38800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b7c8049e10 con 0x55b7c8042fc0 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a6d38800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55b7c7ed5050 con 0x55b7c8047450 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa09bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b7c8047450 0x55b7c8049840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa09bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b7c8047450 0x55b7c8049840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41648/0 (socket says 172.21.15.161:41648) 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa09bfff640 1 -- 172.21.15.161:0/437246046 learned_addr learned my addr 172.21.15.161:0/437246046 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.193+0000 7fa0a2a96640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55b7c8042fc0 0x55b7c80433e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43726/0 (socket says 172.21.15.161:43726) 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.194+0000 7fa09bfff640 1 -- 172.21.15.161:0/437246046 >> v1:172.21.15.45:6789/0 conn(0x55b7c8042fc0 legacy=0x55b7c80433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.194+0000 7fa09bfff640 1 -- 172.21.15.161:0/437246046 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c804b040 con 0x55b7c8047450 2024-05-08T09:22:10.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa09bfff640 1 --2- 172.21.15.161:0/437246046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8047450 0x55b7c8049840 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00a520 tx=0x7fa08c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a17f4870d0f8981 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a2295640 1 -- 172.21.15.161:0/437246046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c057070 con 0x55b7c8047450 2024-05-08T09:22:10.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a2295640 1 -- 172.21.15.161:0/437246046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa08c052570 con 0x55b7c8047450 2024-05-08T09:22:10.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a2295640 1 -- 172.21.15.161:0/437246046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa08c04ae60 con 0x55b7c8047450 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 -- 172.21.15.161:0/437246046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8047450 msgr2=0x55b7c8049840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/437246046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8047450 0x55b7c8049840 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00a520 tx=0x7fa08c01d010 comp rx=0 tx=0).stop 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 -- 172.21.15.161:0/437246046 shutdown_connections 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/437246046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8047450 0x55b7c8049840 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 -- 172.21.15.161:0/437246046 >> 172.21.15.161:0/437246046 conn(0x55b7c803e5a0 msgr2=0x55b7c80409c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 -- 172.21.15.161:0/437246046 shutdown_connections 2024-05-08T09:22:10.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.196+0000 7fa0a6d38800 1 -- 172.21.15.161:0/437246046 wait complete. 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.210+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.210+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.210+0000 7fa0a6d38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.210+0000 7fa0a6d38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b7c7f8f1c0 con 0x55b7c8042fc0 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7fa0a2a96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7fa0a2a96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41656/0 (socket says 172.21.15.161:41656) 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2299611784 learned_addr learned my addr 172.21.15.161:0/2299611784 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2299611784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c8134b50 con 0x55b7c8042fc0 2024-05-08T09:22:10.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2299611784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa094001e40 tx=0x7fa094001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8625a17c0885b8b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7f9f90e09640 1 -- 172.21.15.161:0/2299611784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09400e5c0 con 0x55b7c8042fc0 2024-05-08T09:22:10.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7f9f90e09640 1 -- 172.21.15.161:0/2299611784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa094006070 con 0x55b7c8042fc0 2024-05-08T09:22:10.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.211+0000 7f9f90e09640 1 -- 172.21.15.161:0/2299611784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09400e910 con 0x55b7c8042fc0 2024-05-08T09:22:10.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2299611784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 msgr2=0x55b7c8134580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2299611784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa094001e40 tx=0x7fa094001e70 comp rx=0 tx=0).stop 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2299611784 shutdown_connections 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2299611784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c8134580 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2299611784 >> 172.21.15.161:0/2299611784 conn(0x55b7c803e5a0 msgr2=0x55b7c812fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2299611784 shutdown_connections 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2299611784 wait complete. 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.212+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a6d38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a6d38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b7c804a2e0 con 0x55b7c8042fc0 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a2a96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a2a96640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41662/0 (socket says 172.21.15.161:41662) 2024-05-08T09:22:10.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2994323745 learned_addr learned my addr 172.21.15.161:0/2994323745 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c813b580 con 0x55b7c8042fc0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.213+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa094000f60 tx=0x7fa094000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7f9f8f606640 1 -- 172.21.15.161:0/2994323745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09400f8d0 con 0x55b7c8042fc0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7f9f8f606640 1 -- 172.21.15.161:0/2994323745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09400fa70 con 0x55b7c8042fc0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c813b810 con 0x55b7c8042fc0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7f9f8f606640 1 -- 172.21.15.161:0/2994323745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09400fd90 con 0x55b7c8042fc0 2024-05-08T09:22:10.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c813e4c0 con 0x55b7c8042fc0 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.214+0000 7f9f8f606640 1 -- 172.21.15.161:0/2994323745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa094017070 con 0x55b7c8042fc0 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7f9f8f606640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 0x7f9f8803af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7f9f8f606640 1 -- 172.21.15.161:0/2994323745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa094015020 con 0x55b7c8042fc0 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 0x7f9f8803af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 0x55b7c8142280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8142850 con 0x55b7c8047450 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 0x55b7c8142280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 0x7f9f8803af80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa08c054000 tx=0x7fa08c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 0x55b7c8142280 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.215+0000 7fa0a3297640 1 -- 172.21.15.161:0/2994323745 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa09c00a4a0 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.216+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c813f850 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.216+0000 7fa0a3297640 1 -- 172.21.15.161:0/2994323745 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa09c00a4a0 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.216+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 0x55b7c8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.216+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81475f0 con 0x55b7c8144b60 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.216+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 0x55b7c8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 0x55b7c8146f50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2994323745 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa09402e070 con 0x55b7c8144b60 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8143b10 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a3297640 1 -- 172.21.15.161:0/2994323745 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa09c00a4a0 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8143ff0 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.217+0000 7fa0a3297640 1 -- 172.21.15.161:0/2994323745 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa09c00a4a0 con 0x55b7c8047450 2024-05-08T09:22:10.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a6d38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a6d38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b7c7f35cf0 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41676/0 (socket says 172.21.15.161:41676) 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a3297640 1 -- 172.21.15.161:0/63779516 learned_addr learned my addr 172.21.15.161:0/63779516 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.218+0000 7fa0a3297640 1 -- 172.21.15.161:0/63779516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c8157080 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7fa0a3297640 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55b7c8142c10 tx=0x7fa09c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7f9f8ce01640 1 -- 172.21.15.161:0/63779516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c014450 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7f9f8ce01640 1 -- 172.21.15.161:0/63779516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c014610 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c8157af0 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7f9f8ce01640 1 -- 172.21.15.161:0/63779516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c014930 con 0x55b7c8156720 2024-05-08T09:22:10.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.219+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c8157ff0 con 0x55b7c8156720 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7f9f8ce01640 1 -- 172.21.15.161:0/63779516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa09c011040 con 0x55b7c8156720 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7f9f8ce01640 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 0x7f9f7c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7f9f8ce01640 1 -- 172.21.15.161:0/63779516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa09c01e070 con 0x55b7c8156720 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 0x7f9f7c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 0x7f9f7c038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55b7c8142c80 tx=0x7fa09401c450 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.220+0000 7fa0a6d38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a6d38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b7c8134ea0 con 0x55b7c8163a30 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41692/0 (socket says 172.21.15.161:41692) 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a3297640 1 -- 172.21.15.161:0/2535254890 learned_addr learned my addr 172.21.15.161:0/2535254890 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a3297640 1 -- 172.21.15.161:0/2535254890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c8164420 con 0x55b7c8163a30 2024-05-08T09:22:10.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2535254890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa09c04c890 tx=0x7fa09c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1962a150d1e6f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7f9f867fc640 1 -- 172.21.15.161:0/2535254890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c014ad0 con 0x55b7c8163a30 2024-05-08T09:22:10.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7f9f867fc640 1 -- 172.21.15.161:0/2535254890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c014c70 con 0x55b7c8163a30 2024-05-08T09:22:10.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.221+0000 7f9f867fc640 1 -- 172.21.15.161:0/2535254890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c04e0d0 con 0x55b7c8163a30 2024-05-08T09:22:10.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2535254890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 msgr2=0x55b7c8163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2535254890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa09c04c890 tx=0x7fa09c011f20 comp rx=0 tx=0).stop 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2535254890 shutdown_connections 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2535254890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c8163e50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2535254890 >> 172.21.15.161:0/2535254890 conn(0x55b7c815fd00 msgr2=0x55b7c815dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2535254890 shutdown_connections 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2535254890 wait complete. 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 Processor -- start 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- start start 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.222+0000 7fa0a6d38800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b7c8164bb0 con 0x55b7c8163a30 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a3297640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41706/0 (socket says 172.21.15.161:41706) 2024-05-08T09:22:10.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 learned_addr learned my addr 172.21.15.161:0/2754558494 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7c816f920 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa09c011680 tx=0x7fa09c04c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7f9f84ff9640 1 -- 172.21.15.161:0/2754558494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c031020 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7f9f84ff9640 1 -- 172.21.15.161:0/2754558494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09c04ca90 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b7c816fc10 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7f9f84ff9640 1 -- 172.21.15.161:0/2754558494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa09c0133b0 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.223+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7c8172860 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.224+0000 7f9f84ff9640 1 -- 172.21.15.161:0/2754558494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa09c034020 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.224+0000 7f9f84ff9640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f6c036950 0x7f9f6c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.224+0000 7f9f84ff9640 1 -- 172.21.15.161:0/2754558494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fa09c00e040 con 0x55b7c8163a30 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f6c036950 0x7f9f6c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f6c036950 0x7f9f6c038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55b7c81479f0 tx=0x7fa09404d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c817afa0 0x55b7c817d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c817dbb0 con 0x55b7c817afa0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.225+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c817afa0 0x55b7c817d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c817afa0 0x55b7c817d460 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 realm 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c817df80 con 0x55b7c817afa0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:10.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c817e850 con 0x55b7c817afa0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.226+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c817ebf0 con 0x55b7c817afa0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a6d38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c817f950 0x55b7c8181d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8182300 con 0x55b7c817f950 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c817f950 0x55b7c8181d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.227+0000 7fa0a3297640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c817f950 0x55b7c8181d40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a6d38800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a6d38800 20 searching for the correct realm 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b7c81842d0 0x55b7c8186790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b7c81842d0 0x55b7c8186790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.228+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b7c81842d0 0x55b7c8186790 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09402e070 con 0x55b7c81842d0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa0a2a96640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa09400f070 0x7fa094019820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa09400f070 0x7fa094019820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa09bfff640 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa09400f070 0x7fa094019820 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.229+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.230+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09402e070 con 0x55b7c81842d0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.231+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.232+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.233+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.234+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.235+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.236+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c81842d0 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x55b7c817afa0 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8186e60 con 0x7fa09400f070 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.237+0000 7fa0a6d38800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8182cc0 con 0x55b7c817afa0 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81828d0 con 0x55b7c817afa0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8183630 con 0x55b7c817afa0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 zone default found 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 4 Realm: () 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:10.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 zonegroup default 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8187340 con 0x55b7c817f950 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.238+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8189610 con 0x55b7c81842d0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81899b0 con 0x55b7c81842d0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 started sync module instance, tier type = 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.239+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188aa0 con 0x7fa09400f070 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.240+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.240+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247824428960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188aa0 con 0x7fa09400f070 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.240+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818a400 con 0x55b7c817afa0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.241+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247824428960] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.241+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.241+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247824432912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188aa0 con 0x55b7c817afa0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.241+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818ae70 con 0x55b7c81842d0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.242+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.242+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247824435552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818b710 con 0x55b7c81842d0 2024-05-08T09:22:10.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.242+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818c1b0 con 0x7fa09400f070 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.243+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247824432912] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.243+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247824435552] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.244+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.244+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247824437856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81885f0 con 0x7fa09400f070 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.244+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818ca50 con 0x55b7c817afa0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.245+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247824437856] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.245+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.245+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247824440448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818ca00 con 0x55b7c817afa0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.245+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818d460 con 0x55b7c817f950 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.246+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247824440448] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.246+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.246+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247824442704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818c970 con 0x55b7c817f950 2024-05-08T09:22:10.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.246+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818e2d0 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.247+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247824442704] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.247+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.247+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247824447488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818e2d0 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.247+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818ecd0 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247824447488] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247824451552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818e2d0 con 0x55b7c817f950 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=0 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=1 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=2 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=3 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=4 2024-05-08T09:22:10.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=5 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.248+0000 7fa0a6d38800 20 add_watcher() i=6 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.249+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247824451552] v27'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.249+0000 7fa0a6d38800 20 add_watcher() i=7 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.249+0000 7fa0a6d38800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.249+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81920f0 con 0x55b7c817afa0 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.250+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.250+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247824449520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818f610 con 0x55b7c817afa0 2024-05-08T09:22:10.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.251+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247824449520] v27'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.251+0000 7f9f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.251+0000 7fa0a6d38800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.251+0000 7fa0a6d38800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.251+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8191da0 con 0x55b7c817afa0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.252+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.252+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819b140 con 0x55b7c817f950 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.253+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.253+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819b140 con 0x55b7c81842d0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.254+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.254+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819bbc0 con 0x55b7c817afa0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.255+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'158 uv11 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.256+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819a7b0 con 0x7fa09400f070 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.257+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'47 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.257+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819a7b0 con 0x55b7c81842d0 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.258+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'31 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.258+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x55b7c817afa0 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.259+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.259+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x55b7c817f950 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.260+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.260+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x7fa09400f070 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.261+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.261+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x55b7c81842d0 2024-05-08T09:22:10.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.262+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'25 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.262+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x7fa09400f070 2024-05-08T09:22:10.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.263+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'48 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.263+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819c9a0 con 0x55b7c817f950 2024-05-08T09:22:10.263 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.264+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.264+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ca30 con 0x7fa09400f070 2024-05-08T09:22:10.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.265+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.264 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.265+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ca30 con 0x55b7c817f950 2024-05-08T09:22:10.265 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.266+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'37 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.266+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ca30 con 0x55b7c817afa0 2024-05-08T09:22:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.267+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.266 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.267+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ca30 con 0x55b7c81842d0 2024-05-08T09:22:10.267 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.268+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'41 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.268+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cfc0 con 0x7fa09400f070 2024-05-08T09:22:10.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.269+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.268 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.269+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cf70 con 0x55b7c81842d0 2024-05-08T09:22:10.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.270+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.270+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cf70 con 0x55b7c817afa0 2024-05-08T09:22:10.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.271+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.271+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cf70 con 0x55b7c817afa0 2024-05-08T09:22:10.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.272+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.272+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cf70 con 0x55b7c81842d0 2024-05-08T09:22:10.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.273+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'42 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.273+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x7fa09400f070 2024-05-08T09:22:10.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.274+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.274+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x55b7c81842d0 2024-05-08T09:22:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.275+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'22 uv20 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.275+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x55b7c81842d0 2024-05-08T09:22:10.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.276+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.276+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x55b7c81842d0 2024-05-08T09:22:10.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.277+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.277+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x55b7c81842d0 2024-05-08T09:22:10.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.278+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.278+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819cee0 con 0x55b7c817f950 2024-05-08T09:22:10.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.279+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.279+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ce50 con 0x55b7c81842d0 2024-05-08T09:22:10.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.280+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.280+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ce50 con 0x55b7c817f950 2024-05-08T09:22:10.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.281+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.281 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.281+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ce50 con 0x55b7c81842d0 2024-05-08T09:22:10.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.282+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'43 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.282 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.282+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ce50 con 0x55b7c817f950 2024-05-08T09:22:10.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.284+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'38 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.283 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.284+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c819ce50 con 0x7fa09400f070 2024-05-08T09:22:10.284 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7f9ed3fff640 20 reqs_thread_entry: start 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7fa0a6d38800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7fa0a6d38800 20 Filter name: none 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7f9ed1ffb640 20 reqs_thread_entry: start 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.285+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-05-08T09:22:10.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.286+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:94 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(94 gc.2 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:95 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(95 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:96 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(96 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(97 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.287+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.288+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(98 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.288+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.288+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.289+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(99 gc.2 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.289+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-05-08T09:22:10.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.289+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(100 gc.3 [call] v27'161 uv161 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(101 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:102 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(102 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.290+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.291+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(104 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.291+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.291+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.292+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(105 gc.3 [call] v27'162 uv162 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.292+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-05-08T09:22:10.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.292+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.292+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(106 gc.4 [call] v27'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(107 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(108 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:109 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(109 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.293 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:110 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(110 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.294 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.293+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:111 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.294+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(111 gc.4 [call] v27'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.294+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.294+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:112 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.295+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(112 gc.5 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.295+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:113 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(113 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:114 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(114 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:115 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(115 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:116 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(116 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.296+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:117 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.297+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(117 gc.5 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.297+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-05-08T09:22:10.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.297+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:118 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.298+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(118 gc.6 [call] v27'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.298+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:119 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.298+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(119 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.298+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.298+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:120 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(120 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:121 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(121 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:122 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(122 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.299 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.299+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:123 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.300+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(123 gc.6 [call] v27'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.300+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-05-08T09:22:10.300 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.300+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:124 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(124 gc.7 [call] v27'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:125 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(125 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.301 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:126 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(126 gc.7 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:127 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(127 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.302+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:128 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.303+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(128 gc.7 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.302 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.303+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.303+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:129 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.304+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(129 gc.7 [call] v27'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.304+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-05-08T09:22:10.303 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.304+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:130 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.305 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.305+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(130 gc.8 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.305+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:131 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.305+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(131 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.305+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.305+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:132 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(132 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:133 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(133 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:134 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(134 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.306+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:135 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.307+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(135 gc.8 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.307+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.307+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:136 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(136 gc.9 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:137 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(137 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:138 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(138 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.308+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:139 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(139 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:140 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(140 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.309+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:141 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.310+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(141 gc.9 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.310+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-05-08T09:22:10.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.310+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:142 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(142 gc.10 [call] v27'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:143 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(143 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:144 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(144 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:145 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(145 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.311+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:146 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.312+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(146 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.312+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.312+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:147 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.313+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 35 ==== osd_op_reply(147 gc.10 [call] v27'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.313+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-05-08T09:22:10.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.313+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:148 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(148 gc.11 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:149 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(149 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:150 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(150 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.314+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:151 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(151 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:152 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(152 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.315+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:153 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.316+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(153 gc.11 [call] v27'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.316+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-05-08T09:22:10.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.316+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:154 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.317+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 36 ==== osd_op_reply(154 gc.12 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.317+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:155 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 37 ==== osd_op_reply(155 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:156 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 38 ==== osd_op_reply(156 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:157 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 39 ==== osd_op_reply(157 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:158 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 40 ==== osd_op_reply(158 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.318 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.318+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:159 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.319+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 41 ==== osd_op_reply(159 gc.12 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.319+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-05-08T09:22:10.319 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.319+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:160 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.320 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.320+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(160 gc.13 [call] v27'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.320+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:161 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(161 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:162 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(162 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:163 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(163 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:164 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(164 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.321+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:165 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817f950 2024-05-08T09:22:10.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.322+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(165 gc.13 [call] v27'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.322+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-05-08T09:22:10.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.322+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:166 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.323+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(166 gc.14 [call] v27'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.323+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:167 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(167 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:168 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(168 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:169 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(169 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:170 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(170 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.324+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:171 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.325+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(171 gc.14 [call] v27'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.325+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-05-08T09:22:10.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.325+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:172 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.326+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(172 gc.15 [call] v27'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.326+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:173 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(173 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:174 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(174 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:175 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(175 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09405e040 con 0x55b7c81842d0 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:176 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(176 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.327+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:177 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.328+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(177 gc.15 [call] v27'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.328+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-05-08T09:22:10.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.328+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:178 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.329+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 42 ==== osd_op_reply(178 gc.16 [call] v27'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.329+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:179 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 43 ==== osd_op_reply(179 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:180 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 44 ==== osd_op_reply(180 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:181 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 45 ==== osd_op_reply(181 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:182 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 46 ==== osd_op_reply(182 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.330+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:183 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.331+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 47 ==== osd_op_reply(183 gc.16 [call] v27'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.331+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.331+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:184 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.332+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(184 gc.17 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.332+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:185 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.332+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== osd_op_reply(185 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.332+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.332+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:186 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(186 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:187 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(187 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:188 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(188 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.333+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:189 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.334+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 55 ==== osd_op_reply(189 gc.17 [call] v27'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.334+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-05-08T09:22:10.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.334+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:190 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.335+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(190 gc.18 [call] v27'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.335+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:191 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.335+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== osd_op_reply(191 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.335+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.335+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:192 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(192 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:193 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 49 ==== osd_op_reply(193 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:194 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 50 ==== osd_op_reply(194 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.336+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:195 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.337+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 51 ==== osd_op_reply(195 gc.18 [call] v27'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.337+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-05-08T09:22:10.337 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.337+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:196 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.338+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 52 ==== osd_op_reply(196 gc.19 [call] v27'165 uv165 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.338+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:197 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.338 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 53 ==== osd_op_reply(197 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:198 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 54 ==== osd_op_reply(198 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:199 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 55 ==== osd_op_reply(199 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:200 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 56 ==== osd_op_reply(200 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.339 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.339+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:201 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c817afa0 2024-05-08T09:22:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.340+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 57 ==== osd_op_reply(201 gc.19 [call] v27'166 uv166 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.340+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-05-08T09:22:10.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.340+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:202 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.341+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 56 ==== osd_op_reply(202 gc.20 [call] v27'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.341+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:203 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 57 ==== osd_op_reply(203 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:204 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 58 ==== osd_op_reply(204 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:205 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 59 ==== osd_op_reply(205 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:206 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 60 ==== osd_op_reply(206 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.342+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:207 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.343+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 61 ==== osd_op_reply(207 gc.20 [call] v27'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.343+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-05-08T09:22:10.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.343+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:208 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.344+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 48 ==== osd_op_reply(208 gc.21 [call] v27'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.344+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:209 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 49 ==== osd_op_reply(209 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:210 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 50 ==== osd_op_reply(210 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:211 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 51 ==== osd_op_reply(211 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:212 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 52 ==== osd_op_reply(212 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.345+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:213 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x7fa09400f070 2024-05-08T09:22:10.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.346+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 53 ==== osd_op_reply(213 gc.21 [call] v27'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.346+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-05-08T09:22:10.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.346+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:214 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.347+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 62 ==== osd_op_reply(214 gc.22 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.347+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:215 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 63 ==== osd_op_reply(215 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:216 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c8180 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 64 ==== osd_op_reply(216 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:217 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 65 ==== osd_op_reply(217 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:218 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c9190 con 0x55b7c81842d0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 66 ==== osd_op_reply(218 gc.22 [call out=1701b] v0'0 uv23 ondisk = 0) ==== 149+0+1701 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 20 garbage collection: RGWGC::process iterating over entry tag='7cebcda8-1953-4641-9d19-b10f40cc5883.4223.3271386485123670751', time=2024-05-08T09:22:09.917846+0000, chain.objs.size()=7 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_1 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:219 3.es0 3:7109b4d3:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_1:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c7480 con 0x7fa09400f070 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_2 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:220 3.19s0 3:99c55f0f:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_2:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81cc2f0 con 0x55b7c817afa0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_3 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.348+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:221 3.13s0 3:c9b64102:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_3:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81ceb60 con 0x55b7c81842d0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_4 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:222 3.ds0 3:b14ff1a8:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_4:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81d13d0 con 0x55b7c81842d0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_5 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:223 3.2bs0 3:d7a6de70:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_5:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81d3c40 con 0x55b7c817afa0 2024-05-08T09:22:10.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_6 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:224 3.26s0 3:65b6eebf:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_6:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81d64b0 con 0x7fa09400f070 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_7 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.349+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:225 3.3s0 3:c0185674:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_7:head [call refcount.put in=84b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81d8d20 con 0x7fa09400f070 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.351+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 67 ==== osd_op_reply(221 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_3 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.351+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 68 ==== osd_op_reply(222 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_4 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.351+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 58 ==== osd_op_reply(220 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_2 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.353+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 54 ==== osd_op_reply(219 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_1 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.354+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 59 ==== osd_op_reply(223 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_5 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.354+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 55 ==== osd_op_reply(225 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_7 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.354+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 56 ==== osd_op_reply(224 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.1__shadow_.If2sbHtpkzvHBkvlRa1qzNsLC6wODxG_6 [call] v27'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.354+0000 7fa0a6d38800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T09:22:10.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.354+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6eb0 con 0x55b7c81842d0 2024-05-08T09:22:10.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.359+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 69 ==== osd_op_reply(226 gc.22 [call] v27'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.359 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.359+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6eb0 con 0x55b7c81842d0 2024-05-08T09:22:10.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.362+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 70 ==== osd_op_reply(227 gc.22 [call] v27'25 uv25 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.362+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-05-08T09:22:10.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.362+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:228 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6eb0 con 0x55b7c81842d0 2024-05-08T09:22:10.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 71 ==== osd_op_reply(228 gc.23 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:229 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 72 ==== osd_op_reply(229 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:230 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81cd650 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 73 ==== osd_op_reply(230 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.363+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:231 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 74 ==== osd_op_reply(231 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:232 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 75 ==== osd_op_reply(232 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.364+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:233 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.365+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 76 ==== osd_op_reply(233 gc.23 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.365+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-05-08T09:22:10.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.365+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:234 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 77 ==== osd_op_reply(234 gc.24 [call] v27'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:235 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 78 ==== osd_op_reply(235 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:236 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81cd650 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 79 ==== osd_op_reply(236 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:237 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 80 ==== osd_op_reply(237 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.366+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:238 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 81 ==== osd_op_reply(238 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:239 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 82 ==== osd_op_reply(239 gc.24 [call] v27'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-05-08T09:22:10.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.367+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:240 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.368+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 83 ==== osd_op_reply(240 gc.25 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.368+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:241 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 84 ==== osd_op_reply(241 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:242 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81cd650 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 85 ==== osd_op_reply(242 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:243 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 86 ==== osd_op_reply(243 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.369+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:244 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 87 ==== osd_op_reply(244 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:245 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.372 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 88 ==== osd_op_reply(245 gc.25 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.370+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:246 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(246 gc.26 [call] v27'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:247 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(247 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:248 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(248 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:249 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.372+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(249 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.373+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.373+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.373+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(250 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.373+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.373+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.374+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(251 gc.26 [call] v27'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.374+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.374+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:252 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 89 ==== osd_op_reply(252 gc.27 [call] v27'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:253 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 90 ==== osd_op_reply(253 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:254 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 91 ==== osd_op_reply(254 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.375+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:255 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 92 ==== osd_op_reply(255 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:256 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 93 ==== osd_op_reply(256 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.376+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:257 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.377+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 94 ==== osd_op_reply(257 gc.27 [call] v27'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.377+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-05-08T09:22:10.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.377+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:258 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 49 ==== osd_op_reply(258 gc.28 [call] v27'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:259 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 50 ==== osd_op_reply(259 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:260 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 51 ==== osd_op_reply(260 gc.28 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.378+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:261 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 52 ==== osd_op_reply(261 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:262 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 53 ==== osd_op_reply(262 gc.28 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.379+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:263 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.380+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 54 ==== osd_op_reply(263 gc.28 [call] v27'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.380+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.380+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:264 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.381+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 95 ==== osd_op_reply(264 gc.29 [call] v27'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.381+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:265 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.381+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 96 ==== osd_op_reply(265 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.381+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.381+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:266 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 97 ==== osd_op_reply(266 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:267 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 98 ==== osd_op_reply(267 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:268 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 99 ==== osd_op_reply(268 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.382+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:269 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c81842d0 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.383+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 100 ==== osd_op_reply(269 gc.29 [call] v27'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.383+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.383+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:270 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.384+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 55 ==== osd_op_reply(270 gc.30 [call] v27'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.384+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:271 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.384+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 56 ==== osd_op_reply(271 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.384+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.384+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:272 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 57 ==== osd_op_reply(272 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:273 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 58 ==== osd_op_reply(273 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:274 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 59 ==== osd_op_reply(274 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.385+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:275 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.386+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 60 ==== osd_op_reply(275 gc.30 [call] v27'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.386+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.386+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:276 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 57 ==== osd_op_reply(276 gc.31 [call] v27'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:277 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 58 ==== osd_op_reply(277 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:278 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 59 ==== osd_op_reply(278 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.387+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:279 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 60 ==== osd_op_reply(279 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:280 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 61 ==== osd_op_reply(280 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.388+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:281 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x7fa09400f070 2024-05-08T09:22:10.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.389+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 62 ==== osd_op_reply(281 gc.31 [call] v27'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.389+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.389+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:282 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.390+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 60 ==== osd_op_reply(282 gc.0 [call] v27'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.390+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:283 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.390+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 61 ==== osd_op_reply(283 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.390+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.390+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:284 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 62 ==== osd_op_reply(284 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:285 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 63 ==== osd_op_reply(285 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:286 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 64 ==== osd_op_reply(286 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.391+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:287 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817afa0 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.392+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 65 ==== osd_op_reply(287 gc.0 [call] v27'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.392+0000 7fa0a6d38800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.392+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:288 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.393+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 61 ==== osd_op_reply(288 gc.1 [call] v27'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.393+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:289 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.393+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 62 ==== osd_op_reply(289 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.393+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.393+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:290 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 63 ==== osd_op_reply(290 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:291 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 64 ==== osd_op_reply(291 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:22:10.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:292 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 65 ==== osd_op_reply(292 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a6d38800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.394+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:293 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c6e60 con 0x55b7c817f950 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.395+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 66 ==== osd_op_reply(293 gc.1 [call] v27'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.396+0000 7f9f597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.396+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247824449520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c81c66b0 con 0x55b7c817afa0 2024-05-08T09:22:10.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.397+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94247824449520] v27'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.397+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247824428960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818dfc0 con 0x7fa09400f070 2024-05-08T09:22:10.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.398+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 63 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94247824428960] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.398+0000 7fa0a6d38800 20 remove_watcher() i=0 2024-05-08T09:22:10.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.398+0000 7fa0a6d38800 2 removed watcher, disabling cache 2024-05-08T09:22:10.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.398+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247824432912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188fa0 con 0x55b7c817afa0 2024-05-08T09:22:10.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.399+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94247824432912] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.399+0000 7fa0a6d38800 20 remove_watcher() i=1 2024-05-08T09:22:10.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.399+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247824435552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188fa0 con 0x55b7c81842d0 2024-05-08T09:22:10.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.400+0000 7fa0a2a96640 1 -- 172.21.15.161:0/2754558494 <== osd.3 v2:172.21.15.161:6804/1879099265 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94247824435552] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09406c040 con 0x55b7c81842d0 2024-05-08T09:22:10.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.400+0000 7fa0a6d38800 20 remove_watcher() i=2 2024-05-08T09:22:10.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.400+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247824437856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818a960 con 0x7fa09400f070 2024-05-08T09:22:10.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.401+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.2 v2:172.21.15.161:6800/1967789976 64 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94247824437856] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x7fa09400f070 2024-05-08T09:22:10.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.401+0000 7fa0a6d38800 20 remove_watcher() i=3 2024-05-08T09:22:10.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.401+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247824440448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188fa0 con 0x55b7c817afa0 2024-05-08T09:22:10.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.402+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 <== osd.1 v2:172.21.15.161:6801/4188235102 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94247824440448] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa08c05a040 con 0x55b7c817afa0 2024-05-08T09:22:10.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.402+0000 7fa0a6d38800 20 remove_watcher() i=4 2024-05-08T09:22:10.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.402+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247824442704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818b260 con 0x55b7c817f950 2024-05-08T09:22:10.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.403+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94247824442704] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.403+0000 7fa0a6d38800 20 remove_watcher() i=5 2024-05-08T09:22:10.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.403+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247824447488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c818a960 con 0x55b7c817f950 2024-05-08T09:22:10.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.404+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94247824447488] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.404+0000 7fa0a6d38800 20 remove_watcher() i=6 2024-05-08T09:22:10.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.404+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247824451552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55b7c8188fa0 con 0x55b7c817f950 2024-05-08T09:22:10.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.405+0000 7fa0a3297640 1 -- 172.21.15.161:0/2754558494 <== osd.0 v2:172.21.15.45:6800/2579517728 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94247824451552] v27'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa09c057040 con 0x55b7c817f950 2024-05-08T09:22:10.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.405+0000 7fa0a6d38800 20 remove_watcher() i=7 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c817f950 msgr2=0x55b7c8181d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c817f950 0x55b7c8181d40 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c817afa0 msgr2=0x55b7c817d460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c817afa0 0x55b7c817d460 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa09400f070 msgr2=0x7fa094019820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa09400f070 0x7fa094019820 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b7c81842d0 msgr2=0x55b7c8186790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b7c81842d0 0x55b7c8186790 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f6c036950 msgr2=0x7f9f6c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f6c036950 0x7f9f6c038e10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x55b7c81479f0 tx=0x7fa09404d000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 msgr2=0x55b7c816f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa09c011680 tx=0x7fa09c04c820 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa09bfff640 1 -- 172.21.15.161:0/2754558494 reap_dead start 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 shutdown_connections 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2754558494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8163a30 0x55b7c816f3e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 >> 172.21.15.161:0/2754558494 conn(0x55b7c815fd00 msgr2=0x55b7c815d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 shutdown_connections 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2754558494 wait complete. 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 msgr2=0x7f9f7c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 0x7f9f7c038e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x55b7c8142c80 tx=0x7fa09401c450 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 msgr2=0x55b7c8156b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x55b7c8142c10 tx=0x7fa09c018830 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 shutdown_connections 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f7c036950 0x7f9f7c038e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/63779516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8156720 0x55b7c8156b40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 >> 172.21.15.161:0/63779516 conn(0x55b7c814a7c0 msgr2=0x55b7c814abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 shutdown_connections 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.406+0000 7fa0a6d38800 1 -- 172.21.15.161:0/63779516 wait complete. 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 msgr2=0x55b7c8146f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 0x55b7c8146f50 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 msgr2=0x55b7c8142280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 0x55b7c8142280 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 msgr2=0x7f9f8803af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 0x7f9f8803af80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa08c054000 tx=0x7fa08c04e000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 msgr2=0x55b7c813b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa094000f60 tx=0x7fa094000bc0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 shutdown_connections 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b7c8144b60 0x55b7c8146f50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b7c8047450 0x55b7c8142280 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9f88038ac0 0x7f9f8803af80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 --2- 172.21.15.161:0/2994323745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b7c8042fc0 0x55b7c813b040 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 >> 172.21.15.161:0/2994323745 conn(0x55b7c803e5a0 msgr2=0x55b7c7fb6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 shutdown_connections 2024-05-08T09:22:10.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.407+0000 7fa0a6d38800 1 -- 172.21.15.161:0/2994323745 wait complete. 2024-05-08T09:22:10.415 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-05-08T09:22:10.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-05-08T09:22:10.415 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-05-08T09:22:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:10.499 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.500+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.500+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.500+0000 7f5a3812b800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f83bb96e0 0x564f83bbbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.500+0000 7f5a3812b800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564f83bbc010 con 0x564f83bb5bd0 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.500+0000 7f5a3812b800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564f83a46050 con 0x564f83bb96e0 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33551640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f83bb96e0 0x564f83bbbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33551640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564f83bb96e0 0x564f83bbbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41714/0 (socket says 172.21.15.161:41714) 2024-05-08T09:22:10.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33551640 1 -- 172.21.15.161:0/3388977417 learned_addr learned my addr 172.21.15.161:0/3388977417 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33d52640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x564f83bb5bd0 0x564f83bb7fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43740/0 (socket says 172.21.15.161:43740) 2024-05-08T09:22:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33551640 1 -- 172.21.15.161:0/3388977417 >> v1:172.21.15.45:6789/0 conn(0x564f83bb5bd0 legacy=0x564f83bb7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.501+0000 7f5a33551640 1 -- 172.21.15.161:0/3388977417 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83bbd1f0 con 0x564f83bb96e0 2024-05-08T09:22:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.503+0000 7f5a33551640 1 --2- 172.21.15.161:0/3388977417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb96e0 0x564f83bbbad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800a520 tx=0x7f5a2801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd769c80966261e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.503+0000 7f5a32d50640 1 -- 172.21.15.161:0/3388977417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a28057070 con 0x564f83bb96e0 2024-05-08T09:22:10.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.503+0000 7f5a32d50640 1 -- 172.21.15.161:0/3388977417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a28052570 con 0x564f83bb96e0 2024-05-08T09:22:10.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.503+0000 7f5a32d50640 1 -- 172.21.15.161:0/3388977417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2804ae60 con 0x564f83bb96e0 2024-05-08T09:22:10.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 -- 172.21.15.161:0/3388977417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb96e0 msgr2=0x564f83bbbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3388977417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb96e0 0x564f83bbbad0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800a520 tx=0x7f5a2801d010 comp rx=0 tx=0).stop 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 -- 172.21.15.161:0/3388977417 shutdown_connections 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3388977417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb96e0 0x564f83bbbad0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 -- 172.21.15.161:0/3388977417 >> 172.21.15.161:0/3388977417 conn(0x564f83baf5a0 msgr2=0x564f83bb19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 -- 172.21.15.161:0/3388977417 shutdown_connections 2024-05-08T09:22:10.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.504+0000 7f5a3812b800 1 -- 172.21.15.161:0/3388977417 wait complete. 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.517+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.517+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.517+0000 7f5a3812b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.517+0000 7f5a3812b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f83b001d0 con 0x564f83bb5bd0 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5a33d52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5a33d52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41726/0 (socket says 172.21.15.161:41726) 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5a33d52640 1 -- 172.21.15.161:0/3806023792 learned_addr learned my addr 172.21.15.161:0/3806023792 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5a33d52640 1 -- 172.21.15.161:0/3806023792 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83ca6c50 con 0x564f83bb5bd0 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3806023792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5a24001610 tx=0x7f5a24006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2dc9ea1d922c87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5921e0b640 1 -- 172.21.15.161:0/3806023792 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24013420 con 0x564f83bb5bd0 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5921e0b640 1 -- 172.21.15.161:0/3806023792 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a240135e0 con 0x564f83bb5bd0 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.518+0000 7f5921e0b640 1 -- 172.21.15.161:0/3806023792 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24013940 con 0x564f83bb5bd0 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- 172.21.15.161:0/3806023792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 msgr2=0x564f83ca6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3806023792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5a24001610 tx=0x7f5a24006f90 comp rx=0 tx=0).stop 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- 172.21.15.161:0/3806023792 shutdown_connections 2024-05-08T09:22:10.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3806023792 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83ca6680 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- 172.21.15.161:0/3806023792 >> 172.21.15.161:0/3806023792 conn(0x564f83baf5a0 msgr2=0x564f83ca1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- 172.21.15.161:0/3806023792 shutdown_connections 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- 172.21.15.161:0/3806023792 wait complete. 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.519+0000 7f5a3812b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f83bbc4e0 con 0x564f83bb5bd0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a33d52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a33d52640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41740/0 (socket says 172.21.15.161:41740) 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a33d52640 1 -- 172.21.15.161:0/423741489 learned_addr learned my addr 172.21.15.161:0/423741489 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a33d52640 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83cae760 con 0x564f83bb5bd0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a33d52640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400f000 tx=0x7f5a24000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f591bfff640 1 -- 172.21.15.161:0/423741489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24022020 con 0x564f83bb5bd0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f591bfff640 1 -- 172.21.15.161:0/423741489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a24019040 con 0x564f83bb5bd0 2024-05-08T09:22:10.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f591bfff640 1 -- 172.21.15.161:0/423741489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a24004b20 con 0x564f83bb5bd0 2024-05-08T09:22:10.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f83cae9f0 con 0x564f83bb5bd0 2024-05-08T09:22:10.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.520+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f83cb16a0 con 0x564f83bb5bd0 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.521+0000 7f591bfff640 1 -- 172.21.15.161:0/423741489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5a24025020 con 0x564f83bb5bd0 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.521+0000 7f591bfff640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 0x7f591c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.521+0000 7f591bfff640 1 -- 172.21.15.161:0/423741489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a2404c710 con 0x564f83bb5bd0 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a33551640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 0x7f591c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 0x564f83cb5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cb5a30 con 0x564f83bb96e0 2024-05-08T09:22:10.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a34553640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 0x564f83cb5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a33551640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 0x7f591c038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a28054000 tx=0x7f5a2804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a34553640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 0x564f83cb5460 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a34553640 1 -- 172.21.15.161:0/423741489 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83bb96e0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.522+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cb2a10 con 0x564f83bb96e0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.523+0000 7f5a34553640 1 -- 172.21.15.161:0/423741489 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83bb96e0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.523+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 0x564f83cba130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.523+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cba820 con 0x564f83cb7d40 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.523+0000 7f5a33d52640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 0x564f83cba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.523+0000 7f5a33d52640 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 0x564f83cba130 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a33d52640 1 -- 172.21.15.161:0/423741489 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cb7d40 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cb6cc0 con 0x564f83bb96e0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a34553640 1 -- 172.21.15.161:0/423741489 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83bb96e0 2024-05-08T09:22:10.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cb7180 con 0x564f83bb96e0 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a34553640 1 -- 172.21.15.161:0/423741489 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83bb96e0 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.524+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a3812b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a3812b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f83aa6cf0 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41748/0 (socket says 172.21.15.161:41748) 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a34553640 1 -- 172.21.15.161:0/544846098 learned_addr learned my addr 172.21.15.161:0/544846098 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a34553640 1 -- 172.21.15.161:0/544846098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83bb4120 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.525+0000 7f5a34553640 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x564f83caf440 tx=0x7f5a2c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f59197fa640 1 -- 172.21.15.161:0/544846098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c007d00 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f59197fa640 1 -- 172.21.15.161:0/544846098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c01e020 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f83bb43b0 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f59197fa640 1 -- 172.21.15.161:0/544846098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c019420 con 0x564f83bb5770 2024-05-08T09:22:10.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f83bb48b0 con 0x564f83bb5770 2024-05-08T09:22:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.526+0000 7f59197fa640 1 -- 172.21.15.161:0/544846098 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5a2c016040 con 0x564f83bb5770 2024-05-08T09:22:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f59197fa640 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 0x7f590c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f59197fa640 1 -- 172.21.15.161:0/544846098 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a2c01f030 con 0x564f83bb5770 2024-05-08T09:22:10.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a33d52640 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 0x7f590c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a33d52640 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 0x7f590c038e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a24010520 tx=0x7f5a24004cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a3812b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.527+0000 7f5a3812b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f83ca6fd0 con 0x564f83cd8ec0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41762/0 (socket says 172.21.15.161:41762) 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5a34553640 1 -- 172.21.15.161:0/2441172219 learned_addr learned my addr 172.21.15.161:0/2441172219 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5a34553640 1 -- 172.21.15.161:0/2441172219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83cd98b0 con 0x564f83cd8ec0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5a34553640 1 --2- 172.21.15.161:0/2441172219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c04c850 tx=0x7f5a2c017ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd6553b6192365b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5912ffd640 1 -- 172.21.15.161:0/2441172219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c01d070 con 0x564f83cd8ec0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5912ffd640 1 -- 172.21.15.161:0/2441172219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c0155a0 con 0x564f83cd8ec0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.528+0000 7f5912ffd640 1 -- 172.21.15.161:0/2441172219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c04e240 con 0x564f83cd8ec0 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- 172.21.15.161:0/2441172219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 msgr2=0x564f83cd92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 --2- 172.21.15.161:0/2441172219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c04c850 tx=0x7f5a2c017ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- 172.21.15.161:0/2441172219 shutdown_connections 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 --2- 172.21.15.161:0/2441172219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83cd92e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- 172.21.15.161:0/2441172219 >> 172.21.15.161:0/2441172219 conn(0x564f83cd5220 msgr2=0x564f83cd3280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- 172.21.15.161:0/2441172219 shutdown_connections 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- 172.21.15.161:0/2441172219 wait complete. 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 Processor -- start 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- start start 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a3812b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564f83cda050 con 0x564f83cd8ec0 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a34553640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41776/0 (socket says 172.21.15.161:41776) 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.529+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 learned_addr learned my addr 172.21.15.161:0/3778284171 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f83ce0990 con 0x564f83cd8ec0 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f5a34553640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c017f10 tx=0x7f5a2c04c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f59117fa640 1 -- 172.21.15.161:0/3778284171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c032070 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f59117fa640 1 -- 172.21.15.161:0/3778284171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a2c014a80 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f59117fa640 1 -- 172.21.15.161:0/3778284171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a2c014d60 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564f83ce0c20 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.530+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f83ce38d0 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f59117fa640 1 -- 172.21.15.161:0/3778284171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5a2c0195c0 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f59117fa640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f58fc036900 0x7f58fc038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f59117fa640 1 -- 172.21.15.161:0/3778284171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f5a2c02dc90 con 0x564f83cd8ec0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f58fc036900 0x7f58fc038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83cebf40 0x564f83cee400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83ceeb50 con 0x564f83cebf40 2024-05-08T09:22:10.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.531+0000 7f5a33551640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83cebf40 0x564f83cee400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f58fc036900 0x7f58fc038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a2404c680 tx=0x7f5a24041000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a33551640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83cebf40 0x564f83cee400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 realm 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83ceef20 con 0x564f83cebf40 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cef7f0 con 0x564f83cebf40 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.532+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cefb90 con 0x564f83cebf40 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a3812b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cf0640 0x564f83cf2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf3190 con 0x564f83cf0640 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a34553640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cf0640 0x564f83cf2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.533+0000 7f5a34553640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cf0640 0x564f83cf2a30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a3812b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a3812b800 20 searching for the correct realm 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f83cf5240 0x564f83cf7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f83cf5240 0x564f83cf7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f83cf5240 0x564f83cf7700 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.534+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33d52640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5a24027020 0x7f5a2401d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33551640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5a24027020 0x7f5a2401d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33551640 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5a24027020 0x7f5a2401d380 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.535+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.536+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.537+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.538+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.539+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.540+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.541+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf5240 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.542+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cf0640 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x564f83cebf40 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf7dd0 con 0x7f5a24027020 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf3c40 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.543+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf4090 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf4570 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 zone default found 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 4 Realm: () 2024-05-08T09:22:10.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 zonegroup default 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf8250 con 0x564f83cf0640 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.544+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfa480 con 0x564f83cf5240 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfa820 con 0x564f83cf5240 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 started sync module instance, tier type = 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.545+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf98c0 con 0x7f5a24027020 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.546+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.546+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94899513826480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf98c0 con 0x7f5a24027020 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.546+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfb1e0 con 0x564f83cebf40 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.547+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94899513826480] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.547+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.547+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94899513824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfb1e0 con 0x564f83cebf40 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.547+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfbba0 con 0x564f83cf5240 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.548+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94899513824752] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.549+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.549+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94899513830704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfb150 con 0x564f83cf5240 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.549+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfca60 con 0x7f5a24027020 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.550+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.550+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94899513837456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfd200 con 0x7f5a24027020 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.550+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfdd20 con 0x564f83cebf40 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.550+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94899513830704] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.552+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.552+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94899513841648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfdce0 con 0x564f83cebf40 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.552+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfe730 con 0x564f83cf0640 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.553+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94899513837456] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.554+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94899513841648] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.554+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.554+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94899513835408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfe280 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.554+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfefd0 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.555+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.555+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94899513846560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfe280 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.555+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cffb70 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.555+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94899513835408] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94899513846560] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94899513849408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfef40 con 0x564f83cf0640 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=0 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=1 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=2 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=3 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=4 2024-05-08T09:22:10.562 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=5 2024-05-08T09:22:10.563 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.556+0000 7f5a3812b800 20 add_watcher() i=6 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94899513849408] v27'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a3812b800 20 add_watcher() i=7 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a3812b800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d02b60 con 0x564f83cebf40 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.557+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94899513838672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfffe0 con 0x564f83cebf40 2024-05-08T09:22:10.565 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.558+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94899513838672] v27'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.558+0000 7f58e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.558+0000 7f5a3812b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.558+0000 7f5a3812b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.558+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0b0e0 con 0x564f83cebf40 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.559+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.559+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0b6a0 con 0x564f83cf0640 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.560+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.560+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0b6a0 con 0x564f83cf5240 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.561+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.561+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0bb50 con 0x564f83cebf40 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.562+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'169 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.562+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d09120 con 0x7f5a24027020 2024-05-08T09:22:10.566 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.563+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.563+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d090c0 con 0x564f83cf5240 2024-05-08T09:22:10.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.564+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.564+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x564f83cebf40 2024-05-08T09:22:10.567 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.566+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.566+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x564f83cf0640 2024-05-08T09:22:10.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.568+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'37 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.568 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.568+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x7f5a24027020 2024-05-08T09:22:10.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.570+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.569 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.570+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x564f83cf5240 2024-05-08T09:22:10.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.571+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.571+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x7f5a24027020 2024-05-08T09:22:10.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.572+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.572+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0c660 con 0x564f83cf0640 2024-05-08T09:22:10.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.573+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.573+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca60 con 0x7f5a24027020 2024-05-08T09:22:10.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.574+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.574+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf0640 2024-05-08T09:22:10.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.576+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.576+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cebf40 2024-05-08T09:22:10.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.577+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'170 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.577+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.578+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.578+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x7f5a24027020 2024-05-08T09:22:10.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.579+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.579+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.580+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'23 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.580+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cebf40 2024-05-08T09:22:10.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.581+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.581+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cebf40 2024-05-08T09:22:10.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.582+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'171 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.582+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.583+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.582 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.583+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x7f5a24027020 2024-05-08T09:22:10.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.584+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.583 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.584+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.585+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'26 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.584 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.585+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.586+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.585 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.586+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.587+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.586 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.587+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.588+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.587 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.588+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf0640 2024-05-08T09:22:10.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.589+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.588 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.589+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.590+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.590+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf0640 2024-05-08T09:22:10.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.591+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'38 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.591+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf5240 2024-05-08T09:22:10.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.592+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.591 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.592+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x564f83cf0640 2024-05-08T09:22:10.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.594+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.593 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.594+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0ca40 con 0x7f5a24027020 2024-05-08T09:22:10.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f58e8fe1640 20 reqs_thread_entry: start 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a3812b800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a3812b800 20 Filter name: none 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f58627fc640 20 reqs_thread_entry: start 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.595+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.596+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.596+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.596+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.596+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.597+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.597+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.597+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.597+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.598+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.598+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.598+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.598+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.599+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.600+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.601+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.602+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.603+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.603+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.604+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.605+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.606+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.607+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.608+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.609+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.610+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.611+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.612+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.613+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cebf40 2024-05-08T09:22:10.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cebf40 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.614+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 35 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.615+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv25 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv25 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.616+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.622 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.617+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.623 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 55 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.618+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.619+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.619+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.619+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.619+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 56 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 57 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 58 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.620+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.621+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 59 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 60 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 61 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.622+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x564f83cf0640 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 36 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.623+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d37300 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.624+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 37 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.624+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x564f83d38310 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.624+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 38 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.625+0000 7f58e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.625+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94899513838672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83d0b650 con 0x564f83cebf40 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.626+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94899513838672] v27'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.626+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94899513826480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfcc50 con 0x7f5a24027020 2024-05-08T09:22:10.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.627+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 39 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94899513826480] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.627+0000 7f5a3812b800 20 remove_watcher() i=0 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.627+0000 7f5a3812b800 2 removed watcher, disabling cache 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.627+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94899513824752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf9cb0 con 0x564f83cebf40 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.628+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94899513824752] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.628+0000 7f5a3812b800 20 remove_watcher() i=1 2024-05-08T09:22:10.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.628+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94899513830704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cf9cb0 con 0x564f83cf5240 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.630+0000 7f5a33d52640 1 -- 172.21.15.161:0/3778284171 <== osd.3 v2:172.21.15.161:6804/1879099265 62 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94899513830704] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2400f030 con 0x564f83cf5240 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.630+0000 7f5a3812b800 20 remove_watcher() i=2 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.630+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94899513837456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfad30 con 0x7f5a24027020 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.631+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.2 v2:172.21.15.161:6800/1967789976 40 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94899513837456] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x7f5a24027020 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.631+0000 7f5a3812b800 20 remove_watcher() i=3 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.631+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94899513841648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfc790 con 0x564f83cebf40 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.632+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94899513841648] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2805a040 con 0x564f83cebf40 2024-05-08T09:22:10.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.632+0000 7f5a3812b800 20 remove_watcher() i=4 2024-05-08T09:22:10.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.632+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94899513835408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfad30 con 0x564f83cf0640 2024-05-08T09:22:10.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.633+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94899513835408] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.633+0000 7f5a3812b800 20 remove_watcher() i=5 2024-05-08T09:22:10.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.633+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94899513846560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfc790 con 0x564f83cf0640 2024-05-08T09:22:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.635+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94899513846560] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.635+0000 7f5a3812b800 20 remove_watcher() i=6 2024-05-08T09:22:10.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.635+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94899513849408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x564f83cfbf90 con 0x564f83cf0640 2024-05-08T09:22:10.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a34553640 1 -- 172.21.15.161:0/3778284171 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94899513849408] v27'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a2c0083e0 con 0x564f83cf0640 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 20 remove_watcher() i=7 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cf0640 msgr2=0x564f83cf2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cf0640 0x564f83cf2a30 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83cebf40 msgr2=0x564f83cee400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83cebf40 0x564f83cee400 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5a24027020 msgr2=0x7f5a2401d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5a24027020 0x7f5a2401d380 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f83cf5240 msgr2=0x564f83cf7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x564f83cf5240 0x564f83cf7700 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f58fc036900 msgr2=0x7f58fc038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f58fc036900 0x7f58fc038dc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5a2404c680 tx=0x7f5a24041000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 msgr2=0x564f83ce0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a33551640 1 -- 172.21.15.161:0/3778284171 reap_dead start 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c017f10 tx=0x7f5a2c04c7b0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 shutdown_connections 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/3778284171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83cd8ec0 0x564f83ce0450 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 >> 172.21.15.161:0/3778284171 conn(0x564f83cd5220 msgr2=0x564f83cd28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 shutdown_connections 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/3778284171 wait complete. 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 msgr2=0x7f590c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 0x7f590c038e10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5a24010520 tx=0x7f5a24004cc0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 msgr2=0x564f83bb3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.636+0000 7f5a3812b800 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x564f83caf440 tx=0x7f5a2c00aec0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 shutdown_connections 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f590c036950 0x7f590c038e10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/544846098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5770 0x564f83bb3be0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 >> 172.21.15.161:0/544846098 conn(0x564f83cbda40 msgr2=0x564f83cbde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 shutdown_connections 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/544846098 wait complete. 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 msgr2=0x564f83cba130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 0x564f83cba130 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 msgr2=0x564f83cb5460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 0x564f83cb5460 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 msgr2=0x7f591c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 0x7f591c038e10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5a28054000 tx=0x7f5a2804e000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 msgr2=0x564f83cae220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5a2400f000 tx=0x7f5a24000f40 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 shutdown_connections 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564f83cb7d40 0x564f83cba130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564f83bb96e0 0x564f83cb5460 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f591c036950 0x7f591c038e10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 --2- 172.21.15.161:0/423741489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564f83bb5bd0 0x564f83cae220 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 >> 172.21.15.161:0/423741489 conn(0x564f83baf5a0 msgr2=0x564f83ca07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 shutdown_connections 2024-05-08T09:22:10.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.637+0000 7f5a3812b800 1 -- 172.21.15.161:0/423741489 wait complete. 2024-05-08T09:22:10.645 INFO:teuthology.orchestra.run.smithi161.stdout:[] 2024-05-08T09:22:10.645 DEBUG:tasks.util.rgw: json result: [] 2024-05-08T09:22:10.645 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T09:22:10.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T09:22:10.646 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T09:22:10.729 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:10.730 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc7c325800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55767962c670 0x55767962ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc7c325800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55767962efa0 con 0x557679628b60 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc7c325800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5576794b9050 con 0x55767962c670 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc6ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55767962c670 0x55767962ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc780b7640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x557679628b60 0x55767962af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43748/0 (socket says 172.21.15.161:43748) 2024-05-08T09:22:10.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.731+0000 7efc780b7640 1 -- 172.21.15.161:0/2071185963 learned_addr learned my addr 172.21.15.161:0/2071185963 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:10.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.732+0000 7efc6ffff640 1 -- 172.21.15.161:0/2071185963 >> v1:172.21.15.45:6789/0 conn(0x557679628b60 legacy=0x55767962af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.732+0000 7efc6ffff640 1 -- 172.21.15.161:0/2071185963 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557679630180 con 0x55767962c670 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc6ffff640 1 --2- 172.21.15.161:0/2071185963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767962c670 0x55767962ea60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a470 tx=0x7efc6001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30de7e50faf4abd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc778b6640 1 -- 172.21.15.161:0/2071185963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60057070 con 0x55767962c670 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc778b6640 1 -- 172.21.15.161:0/2071185963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc60052570 con 0x55767962c670 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc778b6640 1 -- 172.21.15.161:0/2071185963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc60052870 con 0x55767962c670 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 -- 172.21.15.161:0/2071185963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767962c670 msgr2=0x55767962ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 --2- 172.21.15.161:0/2071185963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767962c670 0x55767962ea60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc6000a470 tx=0x7efc6001ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 -- 172.21.15.161:0/2071185963 shutdown_connections 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 --2- 172.21.15.161:0/2071185963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767962c670 0x55767962ea60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 -- 172.21.15.161:0/2071185963 >> 172.21.15.161:0/2071185963 conn(0x5576796225b0 msgr2=0x5576796249d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 -- 172.21.15.161:0/2071185963 shutdown_connections 2024-05-08T09:22:10.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.734+0000 7efc7c325800 1 -- 172.21.15.161:0/2071185963 wait complete. 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.748+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc7c325800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc7c325800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5576795731d0 con 0x557679628b60 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc780b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc780b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41804/0 (socket says 172.21.15.161:41804) 2024-05-08T09:22:10.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc780b7640 1 -- 172.21.15.161:0/2882764768 learned_addr learned my addr 172.21.15.161:0/2882764768 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.749+0000 7efc780b7640 1 -- 172.21.15.161:0/2882764768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557679626a60 con 0x557679628b60 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efc780b7640 1 --2- 172.21.15.161:0/2882764768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc68001de0 tx=0x7efc6800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cbd0f2ccd729b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efb6660c640 1 -- 172.21.15.161:0/2882764768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc68012020 con 0x557679628b60 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efb6660c640 1 -- 172.21.15.161:0/2882764768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6800e5a0 con 0x557679628b60 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efb6660c640 1 -- 172.21.15.161:0/2882764768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6800e8c0 con 0x557679628b60 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efc7c325800 1 -- 172.21.15.161:0/2882764768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 msgr2=0x5576796284a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efc7c325800 1 --2- 172.21.15.161:0/2882764768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc68001de0 tx=0x7efc6800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efc7c325800 1 -- 172.21.15.161:0/2882764768 shutdown_connections 2024-05-08T09:22:10.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.750+0000 7efc7c325800 1 --2- 172.21.15.161:0/2882764768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x5576796284a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 -- 172.21.15.161:0/2882764768 >> 172.21.15.161:0/2882764768 conn(0x5576796225b0 msgr2=0x557679715030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 -- 172.21.15.161:0/2882764768 shutdown_connections 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 -- 172.21.15.161:0/2882764768 wait complete. 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc7c325800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55767962f470 con 0x557679628b60 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc780b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc780b7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41812/0 (socket says 172.21.15.161:41812) 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.751+0000 7efc780b7640 1 -- 172.21.15.161:0/6550641 learned_addr learned my addr 172.21.15.161:0/6550641 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efc780b7640 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576797239b0 con 0x557679628b60 2024-05-08T09:22:10.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efc780b7640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c010 tx=0x7efc68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efb64e09640 1 -- 172.21.15.161:0/6550641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc68012070 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efb64e09640 1 -- 172.21.15.161:0/6550641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6801a7a0 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557679723c40 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efb64e09640 1 -- 172.21.15.161:0/6550641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6801aa80 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.752+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576797268f0 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efb64e09640 1 -- 172.21.15.161:0/6550641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc68015020 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efb64e09640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 0x7efb60038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efb64e09640 1 -- 172.21.15.161:0/6550641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efc68020070 con 0x557679628b60 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efc6ffff640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 0x7efb60038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 0x55767972a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.753+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767972abf0 con 0x55767962c670 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc788b8640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 0x55767972a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc6ffff640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 0x7efb60038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc60054000 tx=0x7efc6004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc788b8640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 0x55767972a6b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc788b8640 1 -- 172.21.15.161:0/6550641 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7000a4a0 con 0x55767962c670 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679727c80 con 0x55767962c670 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc788b8640 1 -- 172.21.15.161:0/6550641 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7000a4a0 con 0x55767962c670 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 0x55767972f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.754+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767972f9c0 con 0x55767972cee0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.755+0000 7efc780b7640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 0x55767972f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.755+0000 7efc780b7640 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 0x55767972f2d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.755+0000 7efc780b7640 1 -- 172.21.15.161:0/6550641 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc6802b070 con 0x55767972cee0 2024-05-08T09:22:10.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.755+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767972be90 con 0x55767962c670 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc788b8640 1 -- 172.21.15.161:0/6550641 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7000a4a0 con 0x55767962c670 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767972c370 con 0x55767962c670 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc788b8640 1 -- 172.21.15.161:0/6550641 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc7000a4a0 con 0x55767962c670 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc7c325800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.756+0000 7efc7c325800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557679519cf0 con 0x55767973eb30 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41828/0 (socket says 172.21.15.161:41828) 2024-05-08T09:22:10.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc788b8640 1 -- 172.21.15.161:0/3958487568 learned_addr learned my addr 172.21.15.161:0/3958487568 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc788b8640 1 -- 172.21.15.161:0/3958487568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55767973f490 con 0x55767973eb30 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc788b8640 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55767972af90 tx=0x7efc70018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efb5dffb640 1 -- 172.21.15.161:0/3958487568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70014450 con 0x55767973eb30 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efb5dffb640 1 -- 172.21.15.161:0/3958487568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70014610 con 0x55767973eb30 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55767973ff00 con 0x55767973eb30 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.757+0000 7efb5dffb640 1 -- 172.21.15.161:0/3958487568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70014930 con 0x55767973eb30 2024-05-08T09:22:10.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.758+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557679740400 con 0x55767973eb30 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.758+0000 7efb5dffb640 1 -- 172.21.15.161:0/3958487568 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc70011040 con 0x55767973eb30 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.758+0000 7efb5dffb640 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 0x7efb50038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efb5dffb640 1 -- 172.21.15.161:0/3958487568 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efc7001e070 con 0x55767973eb30 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc780b7640 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 0x7efb50038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc780b7640 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 0x7efb50038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55767972b030 tx=0x7efc6800b6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc7c325800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc7c325800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557679626de0 con 0x55767974bea0 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41844/0 (socket says 172.21.15.161:41844) 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.759+0000 7efc788b8640 1 -- 172.21.15.161:0/3629336638 learned_addr learned my addr 172.21.15.161:0/3629336638 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc788b8640 1 -- 172.21.15.161:0/3629336638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55767974c890 con 0x55767974bea0 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc788b8640 1 --2- 172.21.15.161:0/3629336638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efc7004c8c0 tx=0x7efc700139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f326986b092a59e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efb577fe640 1 -- 172.21.15.161:0/3629336638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70016960 con 0x55767974bea0 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efb577fe640 1 -- 172.21.15.161:0/3629336638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70016440 con 0x55767974bea0 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efb577fe640 1 -- 172.21.15.161:0/3629336638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70016b00 con 0x55767974bea0 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 -- 172.21.15.161:0/3629336638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 msgr2=0x55767974c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 --2- 172.21.15.161:0/3629336638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7efc7004c8c0 tx=0x7efc700139d0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 -- 172.21.15.161:0/3629336638 shutdown_connections 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 --2- 172.21.15.161:0/3629336638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x55767974c2c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 -- 172.21.15.161:0/3629336638 >> 172.21.15.161:0/3629336638 conn(0x557679748170 msgr2=0x5576797461d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 -- 172.21.15.161:0/3629336638 shutdown_connections 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.760+0000 7efc7c325800 1 -- 172.21.15.161:0/3629336638 wait complete. 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc7c325800 1 Processor -- start 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc7c325800 1 -- start start 2024-05-08T09:22:10.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc7c325800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc7c325800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55767974cfe0 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc788b8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41856/0 (socket says 172.21.15.161:41856) 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.761+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 learned_addr learned my addr 172.21.15.161:0/8358363 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.762+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557679753870 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.762+0000 7efc788b8640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efc700119b0 tx=0x7efc7004c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.762+0000 7efb55ffb640 1 -- 172.21.15.161:0/8358363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc7004b330 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.763+0000 7efb55ffb640 1 -- 172.21.15.161:0/8358363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7004b4d0 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.763+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557679753b00 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.763+0000 7efb55ffb640 1 -- 172.21.15.161:0/8358363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc70014c90 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.763+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576797567b0 con 0x55767974bea0 2024-05-08T09:22:10.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efb55ffb640 1 -- 172.21.15.161:0/8358363 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7efc7003bb10 con 0x55767974bea0 2024-05-08T09:22:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efb55ffb640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb48036950 0x7efb48038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efb55ffb640 1 -- 172.21.15.161:0/8358363 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7efc7000e040 con 0x55767974bea0 2024-05-08T09:22:10.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc780b7640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb48036950 0x7efb48038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc780b7640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb48036950 0x7efb48038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc68016e90 tx=0x7efc68031040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767975ee00 0x5576797612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679761a10 con 0x55767975ee00 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.764+0000 7efc6ffff640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767975ee00 0x5576797612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc6ffff640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767975ee00 0x5576797612c0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 realm 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679761de0 con 0x55767975ee00 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576797626b0 con 0x55767975ee00 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.765+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679762a50 con 0x55767975ee00 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc7c325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5576797637b0 0x557679765ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679766160 con 0x5576797637b0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.766+0000 7efc788b8640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5576797637b0 0x557679765ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc788b8640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5576797637b0 0x557679765ba0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc7c325800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:10.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc7c325800 20 searching for the correct realm 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x557679768130 0x55767976a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x557679768130 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc780b7640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x557679768130 0x55767976a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.767+0000 7efc780b7640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x557679768130 0x55767976a5f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc780b7640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7efc68017050 0x7efc680163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x7efc68017050 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc6ffff640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7efc68017050 0x7efc680163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc6ffff640 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7efc68017050 0x7efc680163b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.768+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x5576797637b0 2024-05-08T09:22:10.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x55767975ee00 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x55767975ee00 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.769+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x5576797637b0 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x5576797637b0 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x7efc68017050 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x557679768130 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.770+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x55767975ee00 2024-05-08T09:22:10.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x5576797637b0 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x55767975ee00 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x7efc68017050 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.771+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55767976acc0 con 0x557679768130 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x5576797637b0 2024-05-08T09:22:10.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.772+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x55767975ee00 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x55767975ee00 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.773+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x5576797637b0 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x7efc68017050 2024-05-08T09:22:10.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.774+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x55767975ee00 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x5576797637b0 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x5576797637b0 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.775+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x7efc68017050 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x557679768130 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x5576797637b0 2024-05-08T09:22:10.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.776+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x55767975ee00 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7efc68059040 con 0x7efc68017050 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679766b20 con 0x55767975ee00 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679766760 con 0x55767975ee00 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.777+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576797674c0 con 0x55767975ee00 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 zone default found 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 4 Realm: () 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 zonegroup default 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767976b180 con 0x5576797637b0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767976d450 con 0x557679768130 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.778+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55767976d7f0 con 0x557679768130 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.779+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.779+0000 7efc7c325800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.779+0000 7efc7c325800 20 started sync module instance, tier type = 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.779+0000 7efc7c325800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.779+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976c890 con 0x7efc68017050 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.780+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.780+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93967332330864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976c890 con 0x7efc68017050 2024-05-08T09:22:10.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.780+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976e1b0 con 0x55767975ee00 2024-05-08T09:22:10.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.781+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93967332330864] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.781+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.781+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93967332335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976c890 con 0x55767975ee00 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.781+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976ec20 con 0x557679768130 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.782+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93967332335328] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.782+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.782+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93967332328416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976c800 con 0x557679768130 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.782+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976fae0 con 0x7efc68017050 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.783+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.783+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93967332341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976ff00 con 0x7efc68017050 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.783+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93967332328416] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.783+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797709f0 con 0x55767975ee00 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.784+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.784+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93967332341296] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.784+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93967332345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797709b0 con 0x55767975ee00 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.784+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976fa70 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.785+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.785+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93967332345024] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.785+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93967332347584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797712e0 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.785+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557679771ca0 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.786+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93967332347584] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.789+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.789+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93967332339728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557679771ca0 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.789+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797726a0 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93967332339728] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93967332352432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797728a0 con 0x5576797637b0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=0 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=1 2024-05-08T09:22:10.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=2 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=3 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=4 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=5 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.790+0000 7efc7c325800 20 add_watcher() i=6 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.791+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93967332352432] v27'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.791+0000 7efc7c325800 20 add_watcher() i=7 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.791+0000 7efc7c325800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.791+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x557679775c80 con 0x55767975ee00 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.792+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.792+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93967332353952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x557679773070 con 0x55767975ee00 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.793+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93967332353952] v27'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.793+0000 7efb2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.793+0000 7efc7c325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:10.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.793+0000 7efc7c325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.793+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977e440 con 0x55767975ee00 2024-05-08T09:22:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.794+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.794+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977eb10 con 0x5576797637b0 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.795+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.795+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977eb10 con 0x557679768130 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.796+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.796+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977eef0 con 0x55767975ee00 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.797+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'174 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.797+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f2b0 con 0x7efc68017050 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.798+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.798+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f6d0 con 0x557679768130 2024-05-08T09:22:10.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.799+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.799+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f760 con 0x55767975ee00 2024-05-08T09:22:10.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.801+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.801+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f760 con 0x5576797637b0 2024-05-08T09:22:10.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.802+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'39 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.802+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f870 con 0x7efc68017050 2024-05-08T09:22:10.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.803+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.803+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977f870 con 0x557679768130 2024-05-08T09:22:10.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.804+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.804+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x7efc68017050 2024-05-08T09:22:10.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.805+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.805+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x5576797637b0 2024-05-08T09:22:10.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.806+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.806+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x7efc68017050 2024-05-08T09:22:10.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.807+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.807+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x5576797637b0 2024-05-08T09:22:10.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.808+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.808+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x55767975ee00 2024-05-08T09:22:10.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.809+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'175 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.809+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.810+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.810+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x7efc68017050 2024-05-08T09:22:10.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.811+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.811+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.812+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'24 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.812+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x55767975ee00 2024-05-08T09:22:10.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.813+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.813+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x55767975ee00 2024-05-08T09:22:10.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.814+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'176 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.814+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.815+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.815+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x7efc68017050 2024-05-08T09:22:10.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.816+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.816+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.817+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'27 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.817+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.818+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.818+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.819+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.819+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.819+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.819+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x5576797637b0 2024-05-08T09:22:10.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.820+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.821+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.821+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.822+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x5576797637b0 2024-05-08T09:22:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.823+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'40 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.823+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x557679768130 2024-05-08T09:22:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.824+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.824+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x5576797637b0 2024-05-08T09:22:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.825+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.825+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767977fdb0 con 0x7efc68017050 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.826+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efb2d7e2640 20 reqs_thread_entry: start 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 20 Filter name: none 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efa9effd640 20 reqs_thread_entry: start 2024-05-08T09:22:10.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:22:10.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 20 rados->read ofs=0 len=0 2024-05-08T09:22:10.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576797aad70 con 0x55767975ee00 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.827+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5576797aad30 con 0x7efc68017050 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.828+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.828+0000 7efb2e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:10.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.829+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93967332353952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797780b0 con 0x55767975ee00 2024-05-08T09:22:10.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.830+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93967332353952] v27'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.830+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93967332330864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797727a0 con 0x7efc68017050 2024-05-08T09:22:10.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.830+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93967332330864] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.831+0000 7efc7c325800 20 remove_watcher() i=0 2024-05-08T09:22:10.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.831+0000 7efc7c325800 2 removed watcher, disabling cache 2024-05-08T09:22:10.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.831+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93967332335328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976cd70 con 0x55767975ee00 2024-05-08T09:22:10.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.832+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93967332335328] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.832+0000 7efc7c325800 20 remove_watcher() i=1 2024-05-08T09:22:10.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.832+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93967332328416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976cd70 con 0x557679768130 2024-05-08T09:22:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.833+0000 7efc780b7640 1 -- 172.21.15.161:0/8358363 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93967332328416] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6802b070 con 0x557679768130 2024-05-08T09:22:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.833+0000 7efc7c325800 20 remove_watcher() i=2 2024-05-08T09:22:10.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.833+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93967332341296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976cd70 con 0x7efc68017050 2024-05-08T09:22:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.834+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93967332341296] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x7efc68017050 2024-05-08T09:22:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.834+0000 7efc7c325800 20 remove_watcher() i=3 2024-05-08T09:22:10.833 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.834+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93967332345024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976f630 con 0x55767975ee00 2024-05-08T09:22:10.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.835+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93967332345024] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6005a040 con 0x55767975ee00 2024-05-08T09:22:10.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.835+0000 7efc7c325800 20 remove_watcher() i=4 2024-05-08T09:22:10.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.835+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93967332347584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976cd70 con 0x5576797637b0 2024-05-08T09:22:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.836+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93967332347584] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.836+0000 7efc7c325800 20 remove_watcher() i=5 2024-05-08T09:22:10.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.836+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93967332339728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5576797704c0 con 0x5576797637b0 2024-05-08T09:22:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.837+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93967332339728] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.837+0000 7efc7c325800 20 remove_watcher() i=6 2024-05-08T09:22:10.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.837+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93967332352432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55767976f630 con 0x5576797637b0 2024-05-08T09:22:10.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc788b8640 1 -- 172.21.15.161:0/8358363 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93967332352432] v27'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7002a070 con 0x5576797637b0 2024-05-08T09:22:10.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 20 remove_watcher() i=7 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5576797637b0 msgr2=0x557679765ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5576797637b0 0x557679765ba0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767975ee00 msgr2=0x5576797612c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767975ee00 0x5576797612c0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7efc68017050 msgr2=0x7efc680163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7efc68017050 0x7efc680163b0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x557679768130 msgr2=0x55767976a5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x557679768130 0x55767976a5f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb48036950 msgr2=0x7efb48038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb48036950 0x7efb48038e10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7efc68016e90 tx=0x7efc68031040 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc6ffff640 1 -- 172.21.15.161:0/8358363 reap_dead start 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 msgr2=0x557679753330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7efc700119b0 tx=0x7efc7004c850 comp rx=0 tx=0).stop 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 shutdown_connections 2024-05-08T09:22:10.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/8358363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767974bea0 0x557679753330 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 >> 172.21.15.161:0/8358363 conn(0x557679748170 msgr2=0x5576797457d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 shutdown_connections 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/8358363 wait complete. 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 msgr2=0x7efb50038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 0x7efb50038dc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55767972b030 tx=0x7efc6800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 msgr2=0x55767973ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.838+0000 7efc7c325800 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55767972af90 tx=0x7efc70018830 comp rx=0 tx=0).stop 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 shutdown_connections 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb50036900 0x7efb50038dc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/3958487568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55767973eb30 0x55767973ef50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 >> 172.21.15.161:0/3958487568 conn(0x557679732bd0 msgr2=0x557679732fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 shutdown_connections 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/3958487568 wait complete. 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 msgr2=0x55767972f2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 0x55767972f2d0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 msgr2=0x55767972a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 0x55767972a6b0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 msgr2=0x7efb60038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 0x7efb60038e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efc60054000 tx=0x7efc6004e000 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 msgr2=0x557679723470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7efc6800c010 tx=0x7efc68000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 shutdown_connections 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55767972cee0 0x55767972f2d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55767962c670 0x55767972a6b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7efb60036950 0x7efb60038e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 --2- 172.21.15.161:0/6550641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557679628b60 0x557679723470 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 >> 172.21.15.161:0/6550641 conn(0x5576796225b0 msgr2=0x557679627340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 shutdown_connections 2024-05-08T09:22:10.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.839+0000 7efc7c325800 1 -- 172.21.15.161:0/6550641 wait complete. 2024-05-08T09:22:10.847 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T09:22:10.855 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-05-08T09:22:10.860 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:10.885 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:10.894 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:10.939 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T09:22:10.943 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:10.943 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T09:22:10.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T09:22:10.943 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T09:22:10.991 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:10.991 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:10.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.992+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:10.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.992+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:10.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.992+0000 7fe0297a2800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x562136269b60 0x56213626bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:10.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.992+0000 7fe0297a2800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56213626ffa0 con 0x56213626c490 2024-05-08T09:22:10.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.992+0000 7fe0297a2800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5621360fa050 con 0x562136269b60 2024-05-08T09:22:10.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.993+0000 7fe0272a8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x562136269b60 0x56213626bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:10.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.993+0000 7fe01ffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x56213626c490 0x56213626e880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43762/0 (socket says 172.21.15.161:43762) 2024-05-08T09:22:10.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.993+0000 7fe01ffff640 1 -- 172.21.15.161:0/1435235572 learned_addr learned my addr 172.21.15.161:0/1435235572 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:10.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.993+0000 7fe0272a8640 1 -- 172.21.15.161:0/1435235572 >> v1:172.21.15.45:6789/0 conn(0x56213626c490 legacy=0x56213626e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.993+0000 7fe0272a8640 1 -- 172.21.15.161:0/1435235572 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562136271180 con 0x562136269b60 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0272a8640 1 --2- 172.21.15.161:0/1435235572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x56213626bf50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe01800a470 tx=0x7fe01801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6e500c7edd603b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe026aa7640 1 -- 172.21.15.161:0/1435235572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018057070 con 0x562136269b60 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe026aa7640 1 -- 172.21.15.161:0/1435235572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe018052570 con 0x562136269b60 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe026aa7640 1 -- 172.21.15.161:0/1435235572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018052870 con 0x562136269b60 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0297a2800 1 -- 172.21.15.161:0/1435235572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 msgr2=0x56213626bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0297a2800 1 --2- 172.21.15.161:0/1435235572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x56213626bf50 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe01800a470 tx=0x7fe01801ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0297a2800 1 -- 172.21.15.161:0/1435235572 shutdown_connections 2024-05-08T09:22:10.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0297a2800 1 --2- 172.21.15.161:0/1435235572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x56213626bf50 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:10.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.995+0000 7fe0297a2800 1 -- 172.21.15.161:0/1435235572 >> 172.21.15.161:0/1435235572 conn(0x5621362635b0 msgr2=0x5621362659d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:10.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.996+0000 7fe0297a2800 1 -- 172.21.15.161:0/1435235572 shutdown_connections 2024-05-08T09:22:10.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:10.996+0000 7fe0297a2800 1 -- 172.21.15.161:0/1435235572 wait complete. 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.009+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.009+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.009+0000 7fe0297a2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.009+0000 7fe0297a2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5621361b41c0 con 0x562136269b60 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fe0272a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.009 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fe0272a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41884/0 (socket says 172.21.15.161:41884) 2024-05-08T09:22:11.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fe0272a8640 1 -- 172.21.15.161:0/110010201 learned_addr learned my addr 172.21.15.161:0/110010201 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fe0272a8640 1 -- 172.21.15.161:0/110010201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562136267a60 con 0x562136269b60 2024-05-08T09:22:11.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fe0272a8640 1 --2- 172.21.15.161:0/110010201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe018055040 tx=0x7fe01804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1776dbf69dac48 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fdf1560a640 1 -- 172.21.15.161:0/110010201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018057040 con 0x562136269b60 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fdf1560a640 1 -- 172.21.15.161:0/110010201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe018052990 con 0x562136269b60 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.010+0000 7fdf1560a640 1 -- 172.21.15.161:0/110010201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018052c70 con 0x562136269b60 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- 172.21.15.161:0/110010201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 msgr2=0x5621362694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 --2- 172.21.15.161:0/110010201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe018055040 tx=0x7fe01804c000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- 172.21.15.161:0/110010201 shutdown_connections 2024-05-08T09:22:11.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 --2- 172.21.15.161:0/110010201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x5621362694a0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- 172.21.15.161:0/110010201 >> 172.21.15.161:0/110010201 conn(0x5621362635b0 msgr2=0x562136356050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- 172.21.15.161:0/110010201 shutdown_connections 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- 172.21.15.161:0/110010201 wait complete. 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.011+0000 7fe0297a2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562136270410 con 0x562136269b60 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0272a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0272a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41886/0 (socket says 172.21.15.161:41886) 2024-05-08T09:22:11.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0272a8640 1 -- 172.21.15.161:0/3898310210 learned_addr learned my addr 172.21.15.161:0/3898310210 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0272a8640 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621363648d0 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0272a8640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe01800a470 tx=0x7fe018003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fdf13e07640 1 -- 172.21.15.161:0/3898310210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018073070 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fdf13e07640 1 -- 172.21.15.161:0/3898310210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe01805d780 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562136364b60 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fdf13e07640 1 -- 172.21.15.161:0/3898310210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe018057070 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.012+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562136367810 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fdf13e07640 1 -- 172.21.15.161:0/3898310210 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe018076070 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fdf13e07640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 0x7fdf0c038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fdf13e07640 1 -- 172.21.15.161:0/3898310210 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe01808e060 con 0x562136269b60 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fe01ffff640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 0x7fdf0c038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 0x56213636b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.013+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56213636bb10 con 0x56213626c490 2024-05-08T09:22:11.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe027aa9640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 0x56213636b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe01ffff640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 0x7fdf0c038e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe010000f60 tx=0x7fe0100012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe027aa9640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 0x56213636b5d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe027aa9640 1 -- 172.21.15.161:0/3898310210 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe02000a4a0 con 0x56213626c490 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562136368ba0 con 0x56213626c490 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe027aa9640 1 -- 172.21.15.161:0/3898310210 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe02000a4a0 con 0x56213626c490 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 0x562136370250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.014+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x562136370940 con 0x56213636de60 2024-05-08T09:22:11.017 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.015+0000 7fe0272a8640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 0x562136370250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.015+0000 7fe0272a8640 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 0x562136370250 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.016+0000 7fe0272a8640 1 -- 172.21.15.161:0/3898310210 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe018075030 con 0x56213636de60 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.016+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56213636cde0 con 0x56213626c490 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.016+0000 7fe027aa9640 1 -- 172.21.15.161:0/3898310210 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe02000a4a0 con 0x56213626c490 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.016+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56213636d2c0 con 0x56213626c490 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.016+0000 7fe027aa9640 1 -- 172.21.15.161:0/3898310210 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe02000a4a0 con 0x56213626c490 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:11.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe0297a2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe0297a2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56213615acf0 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41890/0 (socket says 172.21.15.161:41890) 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe027aa9640 1 -- 172.21.15.161:0/4099885188 learned_addr learned my addr 172.21.15.161:0/4099885188 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe027aa9640 1 -- 172.21.15.161:0/4099885188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562136380410 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.017+0000 7fe027aa9640 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x56213636bf10 tx=0x7fe020018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fdf11602640 1 -- 172.21.15.161:0/4099885188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020014450 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fdf11602640 1 -- 172.21.15.161:0/4099885188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe020014610 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562136380e80 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fdf11602640 1 -- 172.21.15.161:0/4099885188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020014930 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562136381380 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.018+0000 7fdf11602640 1 -- 172.21.15.161:0/4099885188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe020011040 con 0x56213637fab0 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fdf11602640 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 0x7fdf00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fdf11602640 1 -- 172.21.15.161:0/4099885188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe02001e070 con 0x56213637fab0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0272a8640 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 0x7fdf00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0272a8640 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 0x7fdf00038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe01806d000 tx=0x7fe01804ac40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0297a2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe0297a2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x562136267d20 con 0x56213638cce0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41896/0 (socket says 172.21.15.161:41896) 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.019+0000 7fe027aa9640 1 -- 172.21.15.161:0/755268325 learned_addr learned my addr 172.21.15.161:0/755268325 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe027aa9640 1 -- 172.21.15.161:0/755268325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56213638d6d0 con 0x56213638cce0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe027aa9640 1 --2- 172.21.15.161:0/755268325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe02004c890 tx=0x7fe020014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3979bdc5ebe92d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fdf0affd640 1 -- 172.21.15.161:0/755268325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020028070 con 0x56213638cce0 2024-05-08T09:22:11.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fdf0affd640 1 -- 172.21.15.161:0/755268325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0200168f0 con 0x56213638cce0 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fdf0affd640 1 -- 172.21.15.161:0/755268325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020013dd0 con 0x56213638cce0 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe0297a2800 1 -- 172.21.15.161:0/755268325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 msgr2=0x56213638d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe0297a2800 1 --2- 172.21.15.161:0/755268325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe02004c890 tx=0x7fe020014ea0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe0297a2800 1 -- 172.21.15.161:0/755268325 shutdown_connections 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe0297a2800 1 --2- 172.21.15.161:0/755268325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x56213638d100 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.020+0000 7fe0297a2800 1 -- 172.21.15.161:0/755268325 >> 172.21.15.161:0/755268325 conn(0x562136388ff0 msgr2=0x5621363870a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 -- 172.21.15.161:0/755268325 shutdown_connections 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 -- 172.21.15.161:0/755268325 wait complete. 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 Processor -- start 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 -- start start 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x562136394310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe0297a2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56213638dea0 con 0x56213638cce0 2024-05-08T09:22:11.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x562136394310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe027aa9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x562136394310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41900/0 (socket says 172.21.15.161:41900) 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 learned_addr learned my addr 172.21.15.161:0/643649708 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.021+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562136394850 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fe027aa9640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x562136394310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe020011be0 tx=0x7fe02000a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fdf097fa640 1 -- 172.21.15.161:0/643649708 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020033070 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fdf097fa640 1 -- 172.21.15.161:0/643649708 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe02003bae0 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562136394ae0 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fdf097fa640 1 -- 172.21.15.161:0/643649708 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe020028050 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.022+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562136397790 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fdf097fa640 1 -- 172.21.15.161:0/643649708 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe02003bcd0 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fdf097fa640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdef0036950 0x7fdef0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fdf097fa640 1 -- 172.21.15.161:0/643649708 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7fe02000e040 con 0x56213638cce0 2024-05-08T09:22:11.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fe0272a8640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdef0036950 0x7fdef0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fe0272a8640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdef0036950 0x7fdef0038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe01805cfd0 tx=0x7fe01808d000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213639fef0 0x5621363a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.023+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a2b00 con 0x56213639fef0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe01ffff640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213639fef0 0x5621363a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe01ffff640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213639fef0 0x5621363a23b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe010009050 con 0x56213639fef0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 20 realm 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56213639f340 con 0x56213639fef0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe010009050 con 0x56213639fef0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.024+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a35f0 con 0x56213639fef0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe010009050 con 0x56213639fef0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a3ec0 con 0x56213639fef0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe010009050 con 0x56213639fef0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5621363a4800 0x5621363a6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a73a0 con 0x5621363a4800 2024-05-08T09:22:11.038 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.025+0000 7fe027aa9640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5621363a4800 0x5621363a6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe027aa9640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5621363a4800 0x5621363a6c10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe02002a070 con 0x5621363a4800 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0297a2800 20 searching for the correct realm 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5621363a9370 0x5621363ab830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0272a8640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5621363a9370 0x5621363ab830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.026+0000 7fe0272a8640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5621363a9370 0x5621363ab830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.027+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.027+0000 7fe0272a8640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe018078060 0x7fe01805ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.027+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.027+0000 7fe01ffff640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe018078060 0x7fe01805ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.039 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.027+0000 7fe01ffff640 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe018078060 0x7fe01805ba80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010009050 con 0x7fe018078060 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe02002a070 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010009050 con 0x56213639fef0 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.028+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.029+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.040 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.030+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.031+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.041 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.042 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.032+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.033+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.033+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.033+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.033+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.034+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a9370 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.035+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x56213639fef0 2024-05-08T09:22:11.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x5621363abf00 con 0x7fe018078060 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.036+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a7d60 con 0x56213639fef0 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a8600 con 0x56213639fef0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363a79a0 con 0x56213639fef0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 zone default found 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 4 Realm: () 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 zonegroup default 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.037+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363ac3e0 con 0x5621363a4800 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363ae6b0 con 0x5621363a9370 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363aea50 con 0x5621363a9370 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 started sync module instance, tier type = 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.038+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363adb40 con 0x7fe018078060 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.039+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.039+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94700643737664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363adb40 con 0x7fe018078060 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.039+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363af480 con 0x56213639fef0 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.040+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94700643737664] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.040+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.040+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94700643742128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363adb40 con 0x56213639fef0 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.040+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363afef0 con 0x5621363a9370 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.041+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94700643742128] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.042+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.042+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94700643735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363adab0 con 0x5621363a9370 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.042+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b0db0 con 0x7fe018078060 2024-05-08T09:22:11.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.043+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.043+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94700643748576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b14f0 con 0x7fe018078060 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.043+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b2010 con 0x56213639fef0 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.043+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94700643735184] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.044+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94700643748576] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.044+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.044+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94700643752672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b1fd0 con 0x56213639fef0 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.044+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b28b0 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.045+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.045+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94700643755008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b1fd0 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.045+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b3430 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.045+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94700643752672] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.046+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94700643755008] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.046+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.058 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.046+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94700643757856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b2820 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.046+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b3a10 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94700643757856] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94700643746528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b3a10 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=0 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=1 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=2 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=3 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=4 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=5 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.047+0000 7fe0297a2800 20 add_watcher() i=6 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94700643746528] v27'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe0297a2800 20 add_watcher() i=7 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe0297a2800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363b6cd0 con 0x56213639fef0 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.048+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94700643759824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363b3fa0 con 0x56213639fef0 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.049+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94700643759824] v27'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.049+0000 7fdeddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.049+0000 7fe0297a2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.049+0000 7fe0297a2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 5 note: GC not initialized 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fdedcfe1640 20 reqs_thread_entry: start 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 20 Filter name: none 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fde567fc640 20 reqs_thread_entry: start 2024-05-08T09:22:11.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363ea830 con 0x7fe018078060 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.050+0000 7fe0297a2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 : miss 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e08600f9:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363ec290 con 0x5621363a4800 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 info.flags=0x17 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 to cache LRU end 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:22:11.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 20 get_obj_state: octx=0x7fe02004b6c0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x5621363ee958 s->prefetch_data=0 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.051+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 3.1cs0 3:398dae3e:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x5621363ef780 con 0x56213639fef0 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.052+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(64 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 262+0+865 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.052+0000 7fe0297a2800 10 manifest: total_size = 5 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.052+0000 7fe0297a2800 20 get_obj_state: setting s->obj_tag to _Dj9n1nfJz9p1uom09oE8cdZtORMrD9M 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.052+0000 7fdeddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.052+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94700643759824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363e81e0 con 0x56213639fef0 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.054+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94700643759824] v27'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.054+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94700643737664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363e81e0 con 0x7fe018078060 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.055+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94700643737664] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.055+0000 7fe0297a2800 20 remove_watcher() i=0 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.055+0000 7fe0297a2800 2 removed watcher, disabling cache 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.055+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94700643742128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363e81e0 con 0x56213639fef0 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.056+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94700643742128] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.056+0000 7fe0297a2800 20 remove_watcher() i=1 2024-05-08T09:22:11.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.056+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94700643735184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363e81e0 con 0x5621363a9370 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.057+0000 7fe0272a8640 1 -- 172.21.15.161:0/643649708 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94700643735184] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe018075030 con 0x5621363a9370 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.057+0000 7fe0297a2800 20 remove_watcher() i=2 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.057+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94700643748576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363ae040 con 0x7fe018078060 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.058+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94700643748576] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x7fe018078060 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.058+0000 7fe0297a2800 20 remove_watcher() i=3 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.058+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94700643752672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363ad690 con 0x56213639fef0 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.059+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94700643752672] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe010029040 con 0x56213639fef0 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.059+0000 7fe0297a2800 20 remove_watcher() i=4 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.059+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94700643755008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363ae040 con 0x5621363a4800 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.060+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94700643755008] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.060+0000 7fe0297a2800 20 remove_watcher() i=5 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.060+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94700643757856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363ad690 con 0x5621363a4800 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.061+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94700643757856] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.061+0000 7fe0297a2800 20 remove_watcher() i=6 2024-05-08T09:22:11.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.061+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94700643746528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x5621363ae040 con 0x5621363a4800 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.062+0000 7fe027aa9640 1 -- 172.21.15.161:0/643649708 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94700643746528] v27'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe020058040 con 0x5621363a4800 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.062+0000 7fe0297a2800 20 remove_watcher() i=7 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5621363a4800 msgr2=0x5621363a6c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5621363a4800 0x5621363a6c10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213639fef0 msgr2=0x5621363a23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213639fef0 0x5621363a23b0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe018078060 msgr2=0x7fe01805ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe018078060 0x7fe01805ba80 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5621363a9370 msgr2=0x5621363ab830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5621363a9370 0x5621363ab830 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdef0036950 msgr2=0x7fdef0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdef0036950 0x7fdef0038e10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe01805cfd0 tx=0x7fe01808d000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 msgr2=0x562136394310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/643649708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213638cce0 0x562136394310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe020011be0 tx=0x7fe02000a9b0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 reap_dead start 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe01ffff640 1 -- 172.21.15.161:0/643649708 reap_dead start 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 shutdown_connections 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 >> 172.21.15.161:0/643649708 conn(0x562136388ff0 msgr2=0x5621363866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 shutdown_connections 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/643649708 wait complete. 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 msgr2=0x7fdf00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 0x7fdf00038e10 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe01806d000 tx=0x7fe01804ac40 comp rx=0 tx=0).stop 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 msgr2=0x56213637fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x56213636bf10 tx=0x7fe020018830 comp rx=0 tx=0).stop 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 shutdown_connections 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf00036950 0x7fdf00038e10 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 --2- 172.21.15.161:0/4099885188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56213637fab0 0x56213637fed0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 >> 172.21.15.161:0/4099885188 conn(0x562136373b50 msgr2=0x562136373f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 shutdown_connections 2024-05-08T09:22:11.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.063+0000 7fe0297a2800 1 -- 172.21.15.161:0/4099885188 wait complete. 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 msgr2=0x562136370250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 0x562136370250 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 msgr2=0x56213636b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 0x56213636b5d0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 msgr2=0x7fdf0c038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 0x7fdf0c038e60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe010000f60 tx=0x7fe0100012b0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 msgr2=0x562136364390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe01800a470 tx=0x7fe018003020 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 shutdown_connections 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56213636de60 0x562136370250 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56213626c490 0x56213636b5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fdf0c0369a0 0x7fdf0c038e60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 --2- 172.21.15.161:0/3898310210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562136269b60 0x562136364390 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 >> 172.21.15.161:0/3898310210 conn(0x5621362635b0 msgr2=0x562136268280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 shutdown_connections 2024-05-08T09:22:11.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.064+0000 7fe0297a2800 1 -- 172.21.15.161:0/3898310210 wait complete. 2024-05-08T09:22:11.072 INFO:teuthology.orchestra.run.smithi161.stdout:fooFoofooFooFULL_CONTROL 2024-05-08T09:22:11.073 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-05-08T09:22:11.075 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-05-08T09:22:11.081 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:11.081 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T09:22:11.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-05-08T09:22:11.081 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-05-08T09:22:11.125 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:11.126 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.127+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.127+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.127+0000 7f031a434800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e17ff94680 0x55e17ff96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.127+0000 7f031a434800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e17ff96fb0 con 0x55e17ff90b70 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.127+0000 7f031a434800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e17fe21050 con 0x55e17ff94680 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.128+0000 7f0314fbf640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e17ff94680 0x55e17ff96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.128+0000 7f03157c0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e17ff90b70 0x55e17ff92f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43770/0 (socket says 172.21.15.161:43770) 2024-05-08T09:22:11.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.128+0000 7f03157c0640 1 -- 172.21.15.161:0/3629479503 learned_addr learned my addr 172.21.15.161:0/3629479503 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:11.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.128+0000 7f0314fbf640 1 -- 172.21.15.161:0/3629479503 >> v1:172.21.15.45:6789/0 conn(0x55e17ff90b70 legacy=0x55e17ff92f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.128+0000 7f0314fbf640 1 -- 172.21.15.161:0/3629479503 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17ff98190 con 0x55e17ff94680 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f0314fbf640 1 --2- 172.21.15.161:0/3629479503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff94680 0x55e17ff96a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f030c00a470 tx=0x7f030c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367e2518cd733f6c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f0307fff640 1 -- 172.21.15.161:0/3629479503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c057070 con 0x55e17ff94680 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f0307fff640 1 -- 172.21.15.161:0/3629479503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030c052570 con 0x55e17ff94680 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f0307fff640 1 -- 172.21.15.161:0/3629479503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030c052870 con 0x55e17ff94680 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 -- 172.21.15.161:0/3629479503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff94680 msgr2=0x55e17ff96a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 --2- 172.21.15.161:0/3629479503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff94680 0x55e17ff96a70 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f030c00a470 tx=0x7f030c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 -- 172.21.15.161:0/3629479503 shutdown_connections 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 --2- 172.21.15.161:0/3629479503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff94680 0x55e17ff96a70 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 -- 172.21.15.161:0/3629479503 >> 172.21.15.161:0/3629479503 conn(0x55e17ff8a5c0 msgr2=0x55e17ff8c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 -- 172.21.15.161:0/3629479503 shutdown_connections 2024-05-08T09:22:11.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.130+0000 7f031a434800 1 -- 172.21.15.161:0/3629479503 wait complete. 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.144+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.144+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.144+0000 7f031a434800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.144+0000 7f031a434800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e17fedb1c0 con 0x55e17ff90b70 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f03157c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f03157c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41910/0 (socket says 172.21.15.161:41910) 2024-05-08T09:22:11.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f03157c0640 1 -- 172.21.15.161:0/2571225560 learned_addr learned my addr 172.21.15.161:0/2571225560 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f03157c0640 1 -- 172.21.15.161:0/2571225560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e180081d50 con 0x55e17ff90b70 2024-05-08T09:22:11.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f03157c0640 1 --2- 172.21.15.161:0/2571225560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0308001de0 tx=0x7f030800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47584212c953e0a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f0203606640 1 -- 172.21.15.161:0/2571225560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308012020 con 0x55e17ff90b70 2024-05-08T09:22:11.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f0203606640 1 -- 172.21.15.161:0/2571225560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030800e5a0 con 0x55e17ff90b70 2024-05-08T09:22:11.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.145+0000 7f0203606640 1 -- 172.21.15.161:0/2571225560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030800e8c0 con 0x55e17ff90b70 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- 172.21.15.161:0/2571225560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 msgr2=0x55e180081780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 --2- 172.21.15.161:0/2571225560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0308001de0 tx=0x7f030800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- 172.21.15.161:0/2571225560 shutdown_connections 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 --2- 172.21.15.161:0/2571225560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e180081780 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- 172.21.15.161:0/2571225560 >> 172.21.15.161:0/2571225560 conn(0x55e17ff8a5c0 msgr2=0x55e18007d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- 172.21.15.161:0/2571225560 shutdown_connections 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- 172.21.15.161:0/2571225560 wait complete. 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.146+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f031a434800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f031a434800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e17ff97480 con 0x55e17ff90b70 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f03157c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f03157c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41918/0 (socket says 172.21.15.161:41918) 2024-05-08T09:22:11.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f03157c0640 1 -- 172.21.15.161:0/2456402433 learned_addr learned my addr 172.21.15.161:0/2456402433 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f03157c0640 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e17ff8eba0 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f03157c0640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f030800c010 tx=0x7f0308000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f0201e03640 1 -- 172.21.15.161:0/2456402433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0308012070 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f0201e03640 1 -- 172.21.15.161:0/2456402433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f030801a7a0 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e17ff8ee30 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f0201e03640 1 -- 172.21.15.161:0/2456402433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f030801aa80 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.147+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e17ff8f350 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.148+0000 7f0201e03640 1 -- 172.21.15.161:0/2456402433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0308015020 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.148+0000 7f0201e03640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 0x7f01fc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.148+0000 7f0201e03640 1 -- 172.21.15.161:0/2456402433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f0308020070 con 0x55e17ff90b70 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f0314fbf640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 0x7f01fc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 0x55e180092690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e180092c60 con 0x55e17ff94680 2024-05-08T09:22:11.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f0315fc1640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 0x55e180092690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f0314fbf640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 0x7f01fc038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f030c054000 tx=0x7f030c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f0315fc1640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 0x55e180092690 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f0315fc1640 1 -- 172.21.15.161:0/2456402433 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f031000a4a0 con 0x55e17ff94680 2024-05-08T09:22:11.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.149+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e180093550 con 0x55e17ff94680 2024-05-08T09:22:11.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f0315fc1640 1 -- 172.21.15.161:0/2456402433 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f031000a4a0 con 0x55e17ff94680 2024-05-08T09:22:11.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 0x55e180097440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e180097bd0 con 0x55e180094f80 2024-05-08T09:22:11.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f03157c0640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 0x55e180097440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f03157c0640 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 0x55e180097440 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f03157c0640 1 -- 172.21.15.161:0/2456402433 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f030802b070 con 0x55e180094f80 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.150+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e180093dd0 con 0x55e17ff94680 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f0315fc1640 1 -- 172.21.15.161:0/2456402433 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f031000a4a0 con 0x55e17ff94680 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800942b0 con 0x55e17ff94680 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f0315fc1640 1 -- 172.21.15.161:0/2456402433 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f031000a4a0 con 0x55e17ff94680 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f031a434800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.151+0000 7f031a434800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e17ff909f0 con 0x55e1800a6dd0 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41920/0 (socket says 172.21.15.161:41920) 2024-05-08T09:22:11.162 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f0315fc1640 1 -- 172.21.15.161:0/2778836519 learned_addr learned my addr 172.21.15.161:0/2778836519 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f0315fc1640 1 -- 172.21.15.161:0/2778836519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1800a7730 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f0315fc1640 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55e180093020 tx=0x7f0310018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f01faffd640 1 -- 172.21.15.161:0/2778836519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310014450 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f01faffd640 1 -- 172.21.15.161:0/2778836519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03100145f0 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f01faffd640 1 -- 172.21.15.161:0/2778836519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0310014910 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.152+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1800a81a0 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.153+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1800a86a0 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.153+0000 7f01faffd640 1 -- 172.21.15.161:0/2778836519 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0310011040 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.153+0000 7f01faffd640 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 0x7f01ec038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f01faffd640 1 -- 172.21.15.161:0/2778836519 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f031001e070 con 0x55e1800a6dd0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f03157c0640 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 0x7f01ec038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f03157c0640 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 0x7f01ec038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55e17ff8f930 tx=0x7f030800b6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f031a434800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f031a434800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e17fe81cf0 con 0x55e1800b4050 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41930/0 (socket says 172.21.15.161:41930) 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f0315fc1640 1 -- 172.21.15.161:0/3672769026 learned_addr learned my addr 172.21.15.161:0/3672769026 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.154+0000 7f0315fc1640 1 -- 172.21.15.161:0/3672769026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1800b4a40 con 0x55e1800b4050 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f0315fc1640 1 --2- 172.21.15.161:0/3672769026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f031004c990 tx=0x7f03100118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f10cbe2739053 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f01f8ff9640 1 -- 172.21.15.161:0/3672769026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031004e0d0 con 0x55e1800b4050 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f01f8ff9640 1 -- 172.21.15.161:0/3672769026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031004e270 con 0x55e1800b4050 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f01f8ff9640 1 -- 172.21.15.161:0/3672769026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031004cc20 con 0x55e1800b4050 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 -- 172.21.15.161:0/3672769026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 msgr2=0x55e1800b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 --2- 172.21.15.161:0/3672769026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f031004c990 tx=0x7f03100118e0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 -- 172.21.15.161:0/3672769026 shutdown_connections 2024-05-08T09:22:11.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 --2- 172.21.15.161:0/3672769026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800b4470 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 -- 172.21.15.161:0/3672769026 >> 172.21.15.161:0/3672769026 conn(0x55e1800b03b0 msgr2=0x55e1800ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 -- 172.21.15.161:0/3672769026 shutdown_connections 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.155+0000 7f031a434800 1 -- 172.21.15.161:0/3672769026 wait complete. 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f031a434800 1 Processor -- start 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f031a434800 1 -- start start 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f031a434800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800bb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f031a434800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e1800b4fd0 con 0x55e1800b4050 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800bb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f0315fc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800bb470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41934/0 (socket says 172.21.15.161:41934) 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 learned_addr learned my addr 172.21.15.161:0/4186371443 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1800bb9b0 con 0x55e1800b4050 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f0315fc1640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800bb470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0310016ad0 tx=0x7f031004c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f01eaffd640 1 -- 172.21.15.161:0/4186371443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f031004e0d0 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f01eaffd640 1 -- 172.21.15.161:0/4186371443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f031004b410 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e1800bbc40 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.156+0000 7f01eaffd640 1 -- 172.21.15.161:0/4186371443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03100133b0 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.157+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1800be8f0 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.157+0000 7f01eaffd640 1 -- 172.21.15.161:0/4186371443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f031003b290 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.157+0000 7f01eaffd640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01e0036950 0x7f01e0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.157+0000 7f01eaffd640 1 -- 172.21.15.161:0/4186371443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f031000e040 con 0x55e1800b4050 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.157+0000 7f03157c0640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01e0036950 0x7f01e0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.158+0000 7f03157c0640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01e0036950 0x7f01e0038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0308016e90 tx=0x7f0308031040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.158+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.158+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e1800c6f10 0x55e1800c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.158+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800c9b20 con 0x55e1800c6f10 2024-05-08T09:22:11.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.158+0000 7f0314fbf640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e1800c6f10 0x55e1800c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f0314fbf640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e1800c6f10 0x55e1800c93d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 realm 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800c9ef0 con 0x55e1800c6f10 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800ca7c0 con 0x55e1800c6f10 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800cab60 con 0x55e1800c6f10 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e1800cb8c0 0x55e1800cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.159+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800ce270 con 0x55e1800cb8c0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f0315fc1640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e1800cb8c0 0x55e1800cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f0315fc1640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e1800cb8c0 0x55e1800cdcb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f031a434800 20 searching for the correct realm 2024-05-08T09:22:11.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e1800d0240 0x55e1800d2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.160+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800d0240 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.161+0000 7f03157c0640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e1800d0240 0x55e1800d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.161+0000 7f03157c0640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e1800d0240 0x55e1800d2700 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.161+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.161+0000 7f03157c0640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0308017050 0x7f03080163b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.161+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x7f0308017050 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.162+0000 7f0314fbf640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0308017050 0x7f03080163b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.162+0000 7f0314fbf640 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0308017050 0x7f03080163b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.162+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.162+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800cb8c0 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800c6f10 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800c6f10 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.163+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x7f0308017050 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800d0240 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800c6f10 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.164+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.186 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800c6f10 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x7f0308017050 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d2dd0 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.165+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800cb8c0 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.166+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800cb8c0 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.167+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x7f0308017050 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800cb8c0 2024-05-08T09:22:11.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.168+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800cb8c0 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x7f0308017050 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800d0240 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800cb8c0 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.169+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x55e1800c6f10 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x7f0308059040 con 0x7f0308017050 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800cec30 con 0x55e1800c6f10 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800cf4d0 con 0x55e1800c6f10 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.170+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800ce870 con 0x55e1800c6f10 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 zone default found 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 4 Realm: () 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 zonegroup default 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d3270 con 0x55e1800cb8c0 2024-05-08T09:22:11.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d5540 con 0x55e1800d0240 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.171+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d58e0 con 0x55e1800d0240 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.172+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.172+0000 7f031a434800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.172+0000 7f031a434800 20 started sync module instance, tier type = 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.172+0000 7f031a434800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.172+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d49d0 con 0x7f0308017050 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.173+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.173+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94427004358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d49d0 con 0x7f0308017050 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.173+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d62a0 con 0x55e1800c6f10 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.174+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94427004358432] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.174+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.174+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94427004362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d49d0 con 0x55e1800c6f10 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.174+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d6d10 con 0x55e1800d0240 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.175+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94427004362704] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.175+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.175+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94427004355872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d4940 con 0x55e1800d0240 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.175+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d7bd0 con 0x7f0308017050 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.176+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.176+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94427004355872] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.176+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94427004368672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d7ff0 con 0x7f0308017050 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.176+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d7140 con 0x55e1800c6f10 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.177+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.177+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94427004372352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d7140 con 0x55e1800c6f10 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.177+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d94b0 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.177+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94427004368672] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.178+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94427004372352] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.178+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.178+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94427004373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d8fc0 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.178+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d9d50 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.179+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.179+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94427004377168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800da1a0 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.179+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800dacc0 con 0x55e1800cb8c0 2024-05-08T09:22:11.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94427004373408] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94427004377168] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94427004378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800d7b40 con 0x55e1800cb8c0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=1 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=2 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=3 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=4 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=5 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.180+0000 7f031a434800 20 add_watcher() i=6 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.181+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94427004378224] v27'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.181+0000 7f031a434800 20 add_watcher() i=7 2024-05-08T09:22:11.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.181+0000 7f031a434800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.181+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1800ddcb0 con 0x55e1800c6f10 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.182+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.182+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94427004381072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e1800db130 con 0x55e1800c6f10 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94427004381072] v27'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f01cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 5 note: GC not initialized 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f01ca7e4640 20 reqs_thread_entry: start 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 20 Filter name: none 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f013bfff640 20 reqs_thread_entry: start 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.183+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e180111620 con 0x7f0308017050 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 : miss 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e08600f9:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1801130c0 con 0x55e1800cb8c0 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 info.flags=0x17 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 to cache LRU end 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 2024-05-08T09:22:11.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 20 get_obj_state: octx=0x7f031002bf10 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55e180115788 s->prefetch_data=0 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.184+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 3.1cs0 3:398dae3e:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e1801165b0 con 0x55e1800c6f10 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.185+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(64 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.185+0000 7f031a434800 10 manifest: total_size = 5 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.185+0000 7f031a434800 20 get_obj_state: setting s->obj_tag to _Wtv6jOI2BsVl3xgJy7OPAz7kfzLAykS 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.185+0000 7f01cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.185+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94427004381072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800c6f10 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.186+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94427004381072] v27'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.186+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94427004358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x7f0308017050 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.187+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94427004358432] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.187+0000 7f031a434800 20 remove_watcher() i=0 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.187+0000 7f031a434800 2 removed watcher, disabling cache 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.187+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94427004362704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800c6f10 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.189+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94427004362704] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.189+0000 7f031a434800 20 remove_watcher() i=1 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.189+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94427004355872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800d0240 2024-05-08T09:22:11.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.190+0000 7f03157c0640 1 -- 172.21.15.161:0/4186371443 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94427004355872] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030802b070 con 0x55e1800d0240 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.190+0000 7f031a434800 20 remove_watcher() i=2 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.190+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94427004368672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x7f0308017050 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.190+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94427004368672] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x7f0308017050 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.190+0000 7f031a434800 20 remove_watcher() i=3 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.191+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94427004372352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800c6f10 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.192+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94427004372352] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f030c05a040 con 0x55e1800c6f10 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.192+0000 7f031a434800 20 remove_watcher() i=4 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.192+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94427004373408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800cb8c0 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.193+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94427004373408] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.193+0000 7f031a434800 20 remove_watcher() i=5 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.193+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94427004377168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800cb8c0 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.194+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94427004377168] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.194+0000 7f031a434800 20 remove_watcher() i=6 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.194+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94427004378224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e18010ef70 con 0x55e1800cb8c0 2024-05-08T09:22:11.204 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f0315fc1640 1 -- 172.21.15.161:0/4186371443 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94427004378224] v27'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f031002a070 con 0x55e1800cb8c0 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 20 remove_watcher() i=7 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e1800cb8c0 msgr2=0x55e1800cdcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e1800cb8c0 0x55e1800cdcb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e1800c6f10 msgr2=0x55e1800c93d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e1800c6f10 0x55e1800c93d0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0308017050 msgr2=0x7f03080163b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0308017050 0x7f03080163b0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e1800d0240 msgr2=0x55e1800d2700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.195+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e1800d0240 0x55e1800d2700 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01e0036950 msgr2=0x7f01e0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01e0036950 0x7f01e0038e10 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0308016e90 tx=0x7f0308031040 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 msgr2=0x55e1800bb470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/4186371443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800b4050 0x55e1800bb470 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f0310016ad0 tx=0x7f031004c920 comp rx=0 tx=0).stop 2024-05-08T09:22:11.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f0314fbf640 1 -- 172.21.15.161:0/4186371443 reap_dead start 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 shutdown_connections 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 >> 172.21.15.161:0/4186371443 conn(0x55e1800b03b0 msgr2=0x55e1800ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 shutdown_connections 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/4186371443 wait complete. 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 msgr2=0x7f01ec038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 0x7f01ec038e10 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x55e17ff8f930 tx=0x7f030800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 msgr2=0x55e1800a71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x55e180093020 tx=0x7f0310018830 comp rx=0 tx=0).stop 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 shutdown_connections 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01ec036950 0x7f01ec038e10 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2778836519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e1800a6dd0 0x55e1800a71f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 >> 172.21.15.161:0/2778836519 conn(0x55e18009ae70 msgr2=0x55e18009b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 shutdown_connections 2024-05-08T09:22:11.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2778836519 wait complete. 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 msgr2=0x55e180097440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 0x55e180097440 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 msgr2=0x55e180092690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.196+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 0x55e180092690 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 msgr2=0x7f01fc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 0x7f01fc038e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f030c054000 tx=0x7f030c04e000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 msgr2=0x55e17ff904b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f030800c010 tx=0x7f0308000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 shutdown_connections 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e180094f80 0x55e180097440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e17ff94680 0x55e180092690 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f01fc036950 0x7f01fc038e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 --2- 172.21.15.161:0/2456402433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e17ff90b70 0x55e17ff904b0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 >> 172.21.15.161:0/2456402433 conn(0x55e17ff8a5c0 msgr2=0x55e18007b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 shutdown_connections 2024-05-08T09:22:11.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.197+0000 7f031a434800 1 -- 172.21.15.161:0/2456402433 wait complete. 2024-05-08T09:22:11.208 INFO:teuthology.orchestra.run.smithi161.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T09:22:11.209 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-05-08T09:22:11.211 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-05-08T09:22:11.225 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:11.326 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-05-08T09:22:11.327 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-05-08T09:22:11.327 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-05-08T09:22:11.327 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T09:22:11.327 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T09:22:11.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-05-08T09:22:11.327 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-05-08T09:22:11.373 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:11.373 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:11.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.374+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.374+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.374+0000 7f940200f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558b8c3619f0 0x558b8c361e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.374+0000 7f940200f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558b8c2d6a70 con 0x558b8c362350 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.374+0000 7f940200f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x558b8c1f4050 con 0x558b8c3619f0 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93fd76a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558b8c3619f0 0x558b8c361e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93fcf69640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x558b8c362350 0x558b8c362800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43778/0 (socket says 172.21.15.161:43778) 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93fcf69640 1 -- 172.21.15.161:0/3257070274 learned_addr learned my addr 172.21.15.161:0/3257070274 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93fd76a640 1 -- 172.21.15.161:0/3257070274 >> v1:172.21.15.45:6789/0 conn(0x558b8c362350 legacy=0x558b8c362800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93effff640 1 -- 172.21.15.161:0/3257070274 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1511331881 0 0) 0x558b8c2d6a70 con 0x558b8c362350 2024-05-08T09:22:11.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.375+0000 7f93fd76a640 1 -- 172.21.15.161:0/3257070274 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c362f10 con 0x558b8c3619f0 2024-05-08T09:22:11.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.377+0000 7f93fd76a640 1 --2- 172.21.15.161:0/3257070274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c361e10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93f000a470 tx=0x7f93f001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71815340fcfe1076 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.377+0000 7f93effff640 1 -- 172.21.15.161:0/3257070274 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0057070 con 0x558b8c3619f0 2024-05-08T09:22:11.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.377+0000 7f93effff640 1 -- 172.21.15.161:0/3257070274 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f0052570 con 0x558b8c3619f0 2024-05-08T09:22:11.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.377+0000 7f93effff640 1 -- 172.21.15.161:0/3257070274 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0052870 con 0x558b8c3619f0 2024-05-08T09:22:11.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 -- 172.21.15.161:0/3257070274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 msgr2=0x558b8c361e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 --2- 172.21.15.161:0/3257070274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c361e10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f93f000a470 tx=0x7f93f001ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 -- 172.21.15.161:0/3257070274 shutdown_connections 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 --2- 172.21.15.161:0/3257070274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c361e10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 -- 172.21.15.161:0/3257070274 >> 172.21.15.161:0/3257070274 conn(0x558b8c35d5b0 msgr2=0x558b8c35f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 -- 172.21.15.161:0/3257070274 shutdown_connections 2024-05-08T09:22:11.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.378+0000 7f940200f800 1 -- 172.21.15.161:0/3257070274 wait complete. 2024-05-08T09:22:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.391+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.391+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.392+0000 7f940200f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.392+0000 7f940200f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558b8c2ae1c0 con 0x558b8c3619f0 2024-05-08T09:22:11.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.393+0000 7f93fd76a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.393+0000 7f93fd76a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41966/0 (socket says 172.21.15.161:41966) 2024-05-08T09:22:11.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.393+0000 7f93fd76a640 1 -- 172.21.15.161:0/3287409184 learned_addr learned my addr 172.21.15.161:0/3287409184 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.394+0000 7f93fd76a640 1 -- 172.21.15.161:0/3287409184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c456e70 con 0x558b8c3619f0 2024-05-08T09:22:11.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.396+0000 7f93fd76a640 1 --2- 172.21.15.161:0/3287409184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f93f0055040 tx=0x7f93f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5fe5fd066cc724 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.397+0000 7f92eb606640 1 -- 172.21.15.161:0/3287409184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0062070 con 0x558b8c3619f0 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.397+0000 7f92eb606640 1 -- 172.21.15.161:0/3287409184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f00528d0 con 0x558b8c3619f0 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.397+0000 7f92eb606640 1 -- 172.21.15.161:0/3287409184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0057040 con 0x558b8c3619f0 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- 172.21.15.161:0/3287409184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 msgr2=0x558b8c4568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 --2- 172.21.15.161:0/3287409184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f93f0055040 tx=0x7f93f004c000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- 172.21.15.161:0/3287409184 shutdown_connections 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 --2- 172.21.15.161:0/3287409184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c4568a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- 172.21.15.161:0/3287409184 >> 172.21.15.161:0/3287409184 conn(0x558b8c35d5b0 msgr2=0x558b8c4521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- 172.21.15.161:0/3287409184 shutdown_connections 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- 172.21.15.161:0/3287409184 wait complete. 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.398+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f940200f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f940200f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558b8c3634a0 con 0x558b8c3619f0 2024-05-08T09:22:11.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f93fd76a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f93fd76a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41972/0 (socket says 172.21.15.161:41972) 2024-05-08T09:22:11.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f93fd76a640 1 -- 172.21.15.161:0/754996682 learned_addr learned my addr 172.21.15.161:0/754996682 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f93fd76a640 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c45e890 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f93fd76a640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f93f00528a0 tx=0x7f93f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f92e9e03640 1 -- 172.21.15.161:0/754996682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0057050 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f92e9e03640 1 -- 172.21.15.161:0/754996682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f0067660 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.399+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8c45eb20 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.400+0000 7f92e9e03640 1 -- 172.21.15.161:0/754996682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f0062040 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.400+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8c4617d0 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.400+0000 7f92e9e03640 1 -- 172.21.15.161:0/754996682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f93f0067940 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.400+0000 7f92e9e03640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 0x7f92e4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f92e9e03640 1 -- 172.21.15.161:0/754996682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f93f008e460 con 0x558b8c3619f0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f93fcf69640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 0x7f92e4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 0x558b8c465590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c465ad0 con 0x558b8c362350 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 0x558b8c465590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f93fcf69640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 0x7f92e4038e60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 0x558b8c465590 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f93fdf6b640 1 -- 172.21.15.161:0/754996682 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f800a4a0 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.401+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c462b40 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.402+0000 7f93fdf6b640 1 -- 172.21.15.161:0/754996682 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93f800a4a0 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.402+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 0x558b8c46a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.402+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c46a8f0 con 0x558b8c467e10 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.402+0000 7f93fd76a640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 0x558b8c46a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.402+0000 7f93fd76a640 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 0x558b8c46a200 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f93fd76a640 1 -- 172.21.15.161:0/754996682 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c467e10 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c466dc0 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f93fdf6b640 1 -- 172.21.15.161:0/754996682 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93f800a4a0 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4672a0 con 0x558b8c362350 2024-05-08T09:22:11.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f93fdf6b640 1 -- 172.21.15.161:0/754996682 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f93f800a4a0 con 0x558b8c362350 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.403+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f940200f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f940200f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558b8c254cf0 con 0x558b8c479a60 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41984/0 (socket says 172.21.15.161:41984) 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f93fdf6b640 1 -- 172.21.15.161:0/3538151970 learned_addr learned my addr 172.21.15.161:0/3538151970 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f93fdf6b640 1 -- 172.21.15.161:0/3538151970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c47a3c0 con 0x558b8c479a60 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x558b8c465e90 tx=0x7f93f8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f92e2ffd640 1 -- 172.21.15.161:0/3538151970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f8014450 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f92e2ffd640 1 -- 172.21.15.161:0/3538151970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f8014610 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f92e2ffd640 1 -- 172.21.15.161:0/3538151970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f8014930 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.404+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8c47ae30 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.405+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8c47b330 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.405+0000 7f92e2ffd640 1 -- 172.21.15.161:0/3538151970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f93f8011040 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.405+0000 7f92e2ffd640 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 0x7f92d4038e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f92e2ffd640 1 -- 172.21.15.161:0/3538151970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f93f801e070 con 0x558b8c479a60 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f93fd76a640 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 0x7f92d4038e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f93fd76a640 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 0x7f92d4038e60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x558b8c465f80 tx=0x7f93f008c720 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f940200f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f940200f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558b8c457130 con 0x558b8c486d00 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41986/0 (socket says 172.21.15.161:41986) 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.406+0000 7f93fdf6b640 1 -- 172.21.15.161:0/3722039297 learned_addr learned my addr 172.21.15.161:0/3722039297 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f93fdf6b640 1 -- 172.21.15.161:0/3722039297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c4876f0 con 0x558b8c486d00 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/3722039297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f93f804c9f0 tx=0x7f93f8011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4c0372a7bd38f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f92e0ff9640 1 -- 172.21.15.161:0/3722039297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f8013de0 con 0x558b8c486d00 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f92e0ff9640 1 -- 172.21.15.161:0/3722039297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f804cb30 con 0x558b8c486d00 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f92e0ff9640 1 -- 172.21.15.161:0/3722039297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f804e0d0 con 0x558b8c486d00 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 -- 172.21.15.161:0/3722039297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 msgr2=0x558b8c487120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 --2- 172.21.15.161:0/3722039297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f93f804c9f0 tx=0x7f93f8011b50 comp rx=0 tx=0).stop 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 -- 172.21.15.161:0/3722039297 shutdown_connections 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 --2- 172.21.15.161:0/3722039297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c487120 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 -- 172.21.15.161:0/3722039297 >> 172.21.15.161:0/3722039297 conn(0x558b8c4830a0 msgr2=0x558b8c481100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 -- 172.21.15.161:0/3722039297 shutdown_connections 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.407+0000 7f940200f800 1 -- 172.21.15.161:0/3722039297 wait complete. 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f940200f800 1 Processor -- start 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f940200f800 1 -- start start 2024-05-08T09:22:11.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f940200f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f940200f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558b8c487e50 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f93fdf6b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:41994/0 (socket says 172.21.15.161:41994) 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 learned_addr learned my addr 172.21.15.161:0/306177097 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b8c48e840 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.408+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f93f804b8c0 tx=0x7f93f804c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.409+0000 7f92d2ffd640 1 -- 172.21.15.161:0/306177097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f8031070 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.409+0000 7f92d2ffd640 1 -- 172.21.15.161:0/306177097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f802bda0 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.409+0000 7f92d2ffd640 1 -- 172.21.15.161:0/306177097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f93f8022bb0 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.409+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558b8c48ead0 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.409+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b8c491780 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f92d2ffd640 1 -- 172.21.15.161:0/306177097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f93f8034070 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f92d2ffd640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92c8036950 0x7f92c8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f92d2ffd640 1 -- 172.21.15.161:0/306177097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f93f800e040 con 0x558b8c486d00 2024-05-08T09:22:11.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f93fd76a640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92c8036950 0x7f92c8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c49a070 0x558b8c49c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c49cc80 con 0x558b8c49a070 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f93fcf69640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c49a070 0x558b8c49c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.410+0000 7f93fd76a640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92c8036950 0x7f92c8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93f0077da0 tx=0x7f93f007c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f93fcf69640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c49a070 0x558b8c49c530 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f400f5f0 con 0x558b8c49a070 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 realm 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4994c0 con 0x558b8c49a070 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f400f5f0 con 0x558b8c49a070 2024-05-08T09:22:11.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c49d770 con 0x558b8c49a070 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f400f5f0 con 0x558b8c49a070 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.411+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c49e040 con 0x558b8c49a070 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f93f400f5f0 con 0x558b8c49a070 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c49ea60 0x558b8c4a0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a15c0 con 0x558b8c49ea60 2024-05-08T09:22:11.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c49ea60 0x558b8c4a0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.412+0000 7f93fdf6b640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c49ea60 0x558b8c4a0e50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f940200f800 20 searching for the correct realm 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558b8c4a3590 0x558b8c4a5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fd76a640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558b8c4a3590 0x558b8c4a5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fd76a640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558b8c4a3590 0x558b8c4a5a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fd76a640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f93f008cba0 0x7f93f00065b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.413+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fcf69640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f93f008cba0 0x7f93f00065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fcf69640 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f93f008cba0 0x7f93f00065b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f400f5f0 con 0x7f93f008cba0 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.414+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f400f5f0 con 0x558b8c49a070 2024-05-08T09:22:11.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.415+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x7f93f008cba0 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.431 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.416+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f93f402b040 con 0x7f93f008cba0 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.417+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.432 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.418+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.419+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x7f93f008cba0 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.420+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x7f93f008cba0 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c4a3590 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.421+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49ea60 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x558b8c49a070 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a6120 con 0x7f93f008cba0 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f93f402b040 con 0x7f93f008cba0 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.422+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a1f80 con 0x558b8c49a070 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f93f402b040 con 0x558b8c49a070 2024-05-08T09:22:11.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a2820 con 0x558b8c49a070 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a1bc0 con 0x558b8c49a070 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 zone default found 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 4 Realm: () 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 zonegroup default 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.423+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a65a0 con 0x558b8c49ea60 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a8850 con 0x558b8c4a3590 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a8bf0 con 0x558b8c4a3590 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 started sync module instance, tier type = 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.424+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a7ce0 con 0x7f93f008cba0 2024-05-08T09:22:11.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.425+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.425+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94057842508336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a7ce0 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.425+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a95b0 con 0x558b8c49a070 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.426+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.426+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94057842508336] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.426+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94057842512128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a9560 con 0x558b8c49a070 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.426+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4a7870 con 0x558b8c4a3590 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.427+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94057842512128] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.427+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.427+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94057842514336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4aa4d0 con 0x558b8c4a3590 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.428+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4aae90 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.429+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.429+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94057842518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ab650 con 0x7f93f008cba0 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.429+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ac150 con 0x558b8c49a070 2024-05-08T09:22:11.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.429+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94057842514336] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.430+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.430+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94057842523200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ac110 con 0x558b8c49a070 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.430+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4acbd0 con 0x558b8c49ea60 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.430+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94057842518976] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.431+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.431+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94057842523200] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.431+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94057842520224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4acfc0 con 0x558b8c49ea60 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.431+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4aa020 con 0x558b8c49ea60 2024-05-08T09:22:11.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.431+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94057842520224] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.432+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(56 notify.6 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.432+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94057842516000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ad4d0 con 0x558b8c49ea60 2024-05-08T09:22:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.432+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4aded0 con 0x558b8c49ea60 2024-05-08T09:22:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94057842516000] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.442 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94057842525920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ade90 con 0x558b8c49ea60 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=0 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=1 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=2 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=3 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=4 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=5 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.433+0000 7f940200f800 20 add_watcher() i=6 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94057842525920] v27'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f940200f800 20 add_watcher() i=7 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f940200f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4b12f0 con 0x558b8c49a070 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.434+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94057842531248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ae740 con 0x558b8c49a070 2024-05-08T09:22:11.443 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.435+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94057842531248] v27'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.435+0000 7f92b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.435+0000 7f940200f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.435+0000 7f940200f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.436+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4b9c90 con 0x558b8c49a070 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.437+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.437+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ba2e0 con 0x558b8c49ea60 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.438+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.438+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ba2e0 con 0x558b8c4a3590 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.439+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.439+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bab50 con 0x558b8c49a070 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.440+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'183 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.440+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4b7b20 con 0x7f93f008cba0 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.441+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.441+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4b7b20 con 0x558b8c4a3590 2024-05-08T09:22:11.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.442+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.442+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49a070 2024-05-08T09:22:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.443+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.443+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.444+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'41 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.444+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.445+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.445+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.446+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.446+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.447+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.447+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.448+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.448+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.449+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.449+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.450+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.450+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49a070 2024-05-08T09:22:11.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.451+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'184 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.450 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.451+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.452+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.451 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.452+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.453+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.452 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.453+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.454+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'25 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.453 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.454+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49a070 2024-05-08T09:22:11.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.455+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.455+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49a070 2024-05-08T09:22:11.455 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.456+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'185 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.456 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.456+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.457+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.457 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.458+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.458+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.458 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.459+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.459+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'28 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.459 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.459+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.460+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.460 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.460+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.461+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.461+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.461 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.462+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.462 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.462+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.463+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.463 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.463+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.464+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.464 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.465+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.466+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'42 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.465 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.466+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.467+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.466 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.467+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x558b8c49ea60 2024-05-08T09:22:11.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.468+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.468+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4bb6b0 con 0x7f93f008cba0 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f92b27e4640 20 reqs_thread_entry: start 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f940200f800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f940200f800 20 Filter name: none 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f9223fff640 20 reqs_thread_entry: start 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f940200f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.469+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4e6ba0 con 0x7f93f008cba0 2024-05-08T09:22:11.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 : miss 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 8.7 8:e08600f9:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4e8330 con 0x558b8c49ea60 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(95 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 info.flags=0x17 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 to cache LRU end 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 2024-05-08T09:22:11.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:96 4.11 4:8b3a8213:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c565ae0 con 0x558b8c49ea60 2024-05-08T09:22:11.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(96 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.470+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 4.10 4:086350f2:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c565b20 con 0x558b8c4a3590 2024-05-08T09:22:11.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.471+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(97 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.472 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.471+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c565b20 con 0x558b8c49ea60 2024-05-08T09:22:11.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.471+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(98 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [call out=426b] v0'0 uv9 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.471+0000 7f940200f800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-05-08T09:22:11.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.471+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 4.1e 4:7b085508:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c49ea60 2024-05-08T09:22:11.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.472+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(99 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.472+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 4.2d 4:b77646c8:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c49ea60 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.472+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(100 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.472+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:101 4.6 4:632efdb7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c4a3590 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(101 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:102 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c49a070 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(102 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [call out=426b] v0'0 uv3 ondisk = 0) ==== 194+0+426 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f940200f800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 4.c 4:30c3163b:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c49a070 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(103 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.473+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:104 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c4a3590 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(104 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [call out=425b] v0'0 uv14 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:105 4.18 4:1ba7721e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x7f93f008cba0 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(105 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:106 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c566070 con 0x558b8c4a3590 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(106 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [call out=698b] v0'0 uv12 ondisk = 0) ==== 195+0+698 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.474+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:107 3.1ds0 3:bb713809:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c563640 con 0x558b8c4a3590 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(107 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 10 manifest: total_size = 6 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11605609903989513711 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 20 prepare_atomic_modification: state is not atomic. state=0x558b8c4e8bd8 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.475+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:108 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ed650 con 0x558b8c49ea60 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.476+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(108 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [stat,call,call] v27'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.477 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.476+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:109 3.1ds0 3:bb713809:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ed6b0 con 0x558b8c4a3590 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.477+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(109 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_9c8454ddf7aa50116496bac348d7550d [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.477+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:110 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4edad0 con 0x558b8c49ea60 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.477+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.477+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:111 3.2s0 3:4351f6f8:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4edad0 con 0x558b8c4a3590 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(111 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 10 manifest: total_size = 3 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.17061417816800211737 2024-05-08T09:22:11.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 20 prepare_atomic_modification: state is not atomic. state=0x558b8c4e8bd8 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.478+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:112 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f25e0 con 0x558b8c49a070 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.479+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(110 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [stat,call,call] v27'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.479+0000 7f92e0ff9640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.479+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(112 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [stat,call,call] v27'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.479+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:113 3.2s0 3:4351f6f8:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4eb570 con 0x558b8c4a3590 2024-05-08T09:22:11.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.480+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(113 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_b1b9a972ccd8c962a473909b97007eb4 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.480+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:114 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4eea00 con 0x558b8c49a070 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.480+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.480+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:115 3.3cs0 3:3f3f5efb:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ef650 con 0x7f93f008cba0 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(115 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f93f403d040 con 0x7f93f008cba0 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 10 manifest: total_size = 4 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.4961976181910143666 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 20 prepare_atomic_modification: state is not atomic. state=0x558b8c4e8bd8 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.481+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:116 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4eea00 con 0x558b8c4a3590 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.482+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(114 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [stat,call,call] v27'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f403d040 con 0x558b8c49a070 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.482+0000 7f92d3fff640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.482+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(116 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [stat,call,call] v27'15 uv15 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.482 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.482+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:117 3.3cs0 3:3f3f5efb:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ef650 con 0x7f93f008cba0 2024-05-08T09:22:11.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.484+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(117 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.484+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:118 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4eea00 con 0x558b8c4a3590 2024-05-08T09:22:11.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.484+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.484+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 3.3as0 3:5f640417:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4eea00 con 0x7f93f008cba0 2024-05-08T09:22:11.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.484+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(119 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+895 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 10 manifest: total_size = 5 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.12723181956081868053 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 20 prepare_atomic_modification: state is not atomic. state=0x558b8c4e8bd8 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 2024-05-08T09:22:11.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:120 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f1f20 con 0x558b8c4a3590 2024-05-08T09:22:11.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(118 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [stat,call,call] v27'16 uv16 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.485+0000 7f92e0ff9640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-05-08T09:22:11.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.487+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(120 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [stat,call,call] v27'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.486 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.487+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:121 3.3as0 3:5f640417:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f2500 con 0x7f93f008cba0 2024-05-08T09:22:11.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(121 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_24d27c169c2c881eb09a065116f2aa5c [call] v27'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:122 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f1a10 con 0x558b8c4a3590 2024-05-08T09:22:11.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:123 3.1cs0 3:398dae3e:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f20b0 con 0x558b8c49a070 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(123 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 262+0+927 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 10 manifest: total_size = 5 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 20 get_obj_state: setting s->obj_tag to _Wtv6jOI2BsVl3xgJy7OPAz7kfzLAykS 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 20 get_obj_state: octx=0x7f93f802cad0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x558b8c4e8bd8 s->prefetch_data=0 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 20 prepare_atomic_modification: state is not atomic. state=0x558b8c4e8bd8 2024-05-08T09:22:11.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 2024-05-08T09:22:11.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.488+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:124 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f4ba0 con 0x558b8c4a3590 2024-05-08T09:22:11.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.490+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(122 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [stat,call,call] v27'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.490+0000 7f92d3fff640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-05-08T09:22:11.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.490+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(124 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [stat,call,call] v27'19 uv19 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.490 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.490+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:125 3.1cs0 3:398dae3e:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4ee9e0 con 0x558b8c49a070 2024-05-08T09:22:11.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(125 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5_bb3aec0fdcdbc2974890f805c585d432 [call] v27'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.491 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:126 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f2500 con 0x558b8c4a3590 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 20 list_objects_ordered: starting attempt 1 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:127 4.11 4:8b3a8213:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c563800 con 0x558b8c49ea60 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:128 4.10 4:086350f2:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4f4cb0 con 0x558b8c4a3590 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:129 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c563800 con 0x558b8c49ea60 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:130 4.1e 4:7b085508:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c563800 con 0x558b8c49ea60 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:131 4.2d 4:b77646c8:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fbff0 con 0x558b8c49ea60 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:132 4.6 4:632efdb7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c563800 con 0x558b8c4a3590 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:133 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c501410 con 0x558b8c49a070 2024-05-08T09:22:11.497 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:134 4.c 4:30c3163b:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c503d00 con 0x558b8c49a070 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:135 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506af0 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.492+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(128 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:136 4.18 4:1ba7721e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506fb0 con 0x7f93f008cba0 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:137 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509cc0 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(127 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(129 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(131 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(130 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(132 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(135 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(133 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(134 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(126 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [stat,call,call] v27'20 uv20 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f92e0ff9640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-05-08T09:22:11.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.493+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(136 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(137 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [call out=124b] v0'0 uv20 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5])"; uploads.size()=0; is_truncated=0 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:138 4.11 4:8b3a8213:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c49ea60 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:139 4.10 4:086350f2:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506f90 con 0x558b8c4a3590 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:140 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb9a0 con 0x558b8c49ea60 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:141 4.1e 4:7b085508:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506950 con 0x558b8c49ea60 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:142 4.2d 4:b77646c8:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c5074d0 con 0x558b8c49ea60 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:143 4.6 4:632efdb7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:144 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb9a0 con 0x558b8c49a070 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:145 4.c 4:30c3163b:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506950 con 0x558b8c49a070 2024-05-08T09:22:11.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:146 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:147 4.18 4:1ba7721e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c5074d0 con 0x7f93f008cba0 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:148 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506f90 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(138 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(140 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(142 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(141 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(144 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [call out=124b] v0'0 uv5 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(147 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(139 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(143 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(145 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(146 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [call out=124b] v0'0 uv16 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.494+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(148 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [call out=124b] v0'0 uv20 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.495+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x7f93f008cba0 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.495+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(149 foo.buckets [call] v27'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.495+0000 7f940200f800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.496+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x7f93f008cba0 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.496+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(150 myfoo [call,call,delete] v27'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.496+0000 7f940200f800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.496+0000 7f940200f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94057842896784 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== watch-notify(notify (1) cookie 94057842516000 notify 115964117010 ret 0) ==== 191+0+0 (crc 0 0 0) 0x558b8c4e7850 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f92e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94057842516000 notifier 4638 bl.length()=149 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f92e0ff9640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f92c0003d60 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(151 notify.6 [notify cookie 94057842896784 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== watch-notify(notify_complete (2) cookie 94057842896784 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x558b8c48ead0 con 0x558b8c49ea60 2024-05-08T09:22:11.501 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.497+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:153 8.7 8:e08600f9:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x558b8c49ea60 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.498+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(153 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [call,call,delete] v27'3 uv3 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.498+0000 7f940200f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 from cache 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.498+0000 7f940200f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5, ofs0, ns] 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.498+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:154 7.15 7:a93a5511:::notify.2:head [notify cookie 94057842896784 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x558b8c4a3590 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== watch-notify(notify (1) cookie 94057842514336 notify 115964117009 ret 0) ==== 248+0+0 (crc 0 0 0) 0x558b8c4b82e0 con 0x558b8c4a3590 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f92d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117009 cookie 94057842514336 notifier 4638 bl.length()=206 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(154 notify.2 [notify cookie 94057842896784 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f92d3fff640 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:155 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f92300032c0 con 0x558b8c4a3590 2024-05-08T09:22:11.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(155 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== watch-notify(notify_complete (2) cookie 94057842896784 notify 115964117009 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f93f00a3040 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:156 4.11 4:8b3a8213:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c49ea60 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:157 4.10 4:086350f2:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506f90 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:158 4.33 4:cea5b865:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x558b8c49ea60 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:159 4.1e 4:7b085508:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49ea60 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:160 4.2d 4:b77646c8:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4e5b90 con 0x558b8c49ea60 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:161 4.6 4:632efdb7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:162 4.2c 4:34a7e0e1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4fb850 con 0x558b8c49a070 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:163 4.c 4:30c3163b:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49a070 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:164 4.3a 4:5f3653ab:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c4e5b90 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:165 4.18 4:1ba7721e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506f90 con 0x7f93f008cba0 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.499+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:166 4.3a 4:5e83ed00:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(162 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.6 [delete] v27'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(159 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.3 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(161 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.5 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(156 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.0 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(160 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.4 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(158 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.2 [delete] v27'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(164 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.8 [delete] v27'21 uv21 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(165 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.9 [delete] v27'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(157 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.1 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 55 ==== osd_op_reply(166 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.10 [delete] v27'22 uv22 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(163 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5.7 [delete] v27'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f940200f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 : miss 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f940200f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.501+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:167 6.9 6:958e27cb:::pubsub..bucket.myfoo%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.502+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 56 ==== osd_op_reply(167 pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.502+0000 7f940200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.502+0000 7f940200f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 info.flags=0x0 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.502+0000 7f940200f800 10 adding default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 to cache LRU end 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.502+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:168 6.9 6:958e27cb:::pubsub..bucket.myfoo%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c4a3590 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.504+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 57 ==== osd_op_reply(168 pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.5 [delete] v27'43 uv36 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.504+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x7f93f008cba0 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.505+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(169 foo.buckets [call] v27'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.506+0000 7f92b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.506+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94057842531248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x558b8c49a070 2024-05-08T09:22:11.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.507+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94057842531248] v27'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.507+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94057842508336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c509d20 con 0x7f93f008cba0 2024-05-08T09:22:11.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.508+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94057842508336] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.508+0000 7f940200f800 20 remove_watcher() i=0 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.508+0000 7f940200f800 2 removed watcher, disabling cache 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.508+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94057842512128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49a070 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.509+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94057842512128] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.509+0000 7f940200f800 20 remove_watcher() i=1 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.509+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94057842514336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c4a3590 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.510+0000 7f93fd76a640 1 -- 172.21.15.161:0/306177097 <== osd.3 v2:172.21.15.161:6804/1879099265 58 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94057842514336] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f0064070 con 0x558b8c4a3590 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.510+0000 7f940200f800 20 remove_watcher() i=2 2024-05-08T09:22:11.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.510+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94057842518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x7f93f008cba0 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.511+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94057842518976] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x7f93f008cba0 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.511+0000 7f940200f800 20 remove_watcher() i=3 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.511+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94057842523200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49a070 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.512+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94057842523200] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f404b040 con 0x558b8c49a070 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.512+0000 7f940200f800 20 remove_watcher() i=4 2024-05-08T09:22:11.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.512+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94057842520224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49ea60 2024-05-08T09:22:11.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.513+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 49 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94057842520224] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.513+0000 7f940200f800 20 remove_watcher() i=5 2024-05-08T09:22:11.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.513+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94057842516000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49ea60 2024-05-08T09:22:11.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.514+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 50 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94057842516000] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.514+0000 7f940200f800 20 remove_watcher() i=6 2024-05-08T09:22:11.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.514+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94057842525920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x558b8c506300 con 0x558b8c49ea60 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f93fdf6b640 1 -- 172.21.15.161:0/306177097 <== osd.0 v2:172.21.15.45:6800/2579517728 51 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94057842525920] v27'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f93f8033030 con 0x558b8c49ea60 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 20 remove_watcher() i=7 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c49ea60 msgr2=0x558b8c4a0e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c49ea60 0x558b8c4a0e50 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c49a070 msgr2=0x558b8c49c530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c49a070 0x558b8c49c530 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f93f008cba0 msgr2=0x7f93f00065b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f93f008cba0 0x7f93f00065b0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558b8c4a3590 msgr2=0x558b8c4a5a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558b8c4a3590 0x558b8c4a5a50 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92c8036950 msgr2=0x7f92c8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92c8036950 0x7f92c8038e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f93f0077da0 tx=0x7f93f007c000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f93fcf69640 1 -- 172.21.15.161:0/306177097 reap_dead start 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 msgr2=0x558b8c48e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f93f804b8c0 tx=0x7f93f804c980 comp rx=0 tx=0).stop 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 shutdown_connections 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 --2- 172.21.15.161:0/306177097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c486d00 0x558b8c48e300 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 >> 172.21.15.161:0/306177097 conn(0x558b8c4830a0 msgr2=0x558b8c480700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 shutdown_connections 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.515+0000 7f940200f800 1 -- 172.21.15.161:0/306177097 wait complete. 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 msgr2=0x7f92d4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 0x7f92d4038e60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x558b8c465f80 tx=0x7f93f008c720 comp rx=0 tx=0).stop 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 msgr2=0x558b8c479e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x558b8c465e90 tx=0x7f93f8018830 comp rx=0 tx=0).stop 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 shutdown_connections 2024-05-08T09:22:11.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92d40369a0 0x7f92d4038e60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/3538151970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c479a60 0x558b8c479e80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 >> 172.21.15.161:0/3538151970 conn(0x558b8c46db00 msgr2=0x558b8c46df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 shutdown_connections 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/3538151970 wait complete. 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 msgr2=0x558b8c46a200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 0x558b8c46a200 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 msgr2=0x558b8c465590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 0x558b8c465590 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 msgr2=0x7f92e4038e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 0x7f92e4038e60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f40013b0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 msgr2=0x558b8c45e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f93f00528a0 tx=0x7f93f0002fb0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 shutdown_connections 2024-05-08T09:22:11.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558b8c467e10 0x558b8c46a200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558b8c362350 0x558b8c465590 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f92e40369a0 0x7f92e4038e60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 --2- 172.21.15.161:0/754996682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558b8c3619f0 0x558b8c45e350 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 >> 172.21.15.161:0/754996682 conn(0x558b8c35d5b0 msgr2=0x558b8c4509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 shutdown_connections 2024-05-08T09:22:11.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.516+0000 7f940200f800 1 -- 172.21.15.161:0/754996682 wait complete. 2024-05-08T09:22:11.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T09:22:11.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T09:22:11.525 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-05-08T09:22:11.570 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:11.570 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:11.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f3863da2800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560b606f5fe0 0x560b606f6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f3863da2800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560b606f6a80 con 0x560b606f7240 2024-05-08T09:22:11.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f3863da2800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x560b60588050 con 0x560b606f5fe0 2024-05-08T09:22:11.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f385bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x560b606f7240 0x560b606f76c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43786/0 (socket says 172.21.15.161:43786) 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.572+0000 7f385bfff640 1 -- 172.21.15.161:0/1218718230 learned_addr learned my addr 172.21.15.161:0/1218718230 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.573+0000 7f38618a8640 1 --2- 172.21.15.161:0/1218718230 >> v2:172.21.15.45:3300/0 conn(0x560b606f5fe0 0x560b606f6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.573+0000 7f38610a7640 1 -- 172.21.15.161:0/1218718230 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402301411 0 0) 0x560b606f6a80 con 0x560b606f7240 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.573+0000 7f38610a7640 1 -- 172.21.15.161:0/1218718230 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3850001e10 con 0x560b606f7240 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.573+0000 7f38618a8640 1 -- 172.21.15.161:0/1218718230 >> v1:172.21.15.45:6789/0 conn(0x560b606f7240 legacy=0x560b606f76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.573+0000 7f38618a8640 1 -- 172.21.15.161:0/1218718230 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b606f7e00 con 0x560b606f5fe0 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f38618a8640 1 --2- 172.21.15.161:0/1218718230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b606f6400 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f385400a470 tx=0x7f385401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5753450cdaa0e45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f38610a7640 1 -- 172.21.15.161:0/1218718230 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3854057070 con 0x560b606f5fe0 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f38610a7640 1 -- 172.21.15.161:0/1218718230 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385404acd0 con 0x560b606f5fe0 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f38610a7640 1 -- 172.21.15.161:0/1218718230 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3854052440 con 0x560b606f5fe0 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 -- 172.21.15.161:0/1218718230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 msgr2=0x560b606f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 --2- 172.21.15.161:0/1218718230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b606f6400 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f385400a470 tx=0x7f385401cdb0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 -- 172.21.15.161:0/1218718230 shutdown_connections 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 --2- 172.21.15.161:0/1218718230 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b606f6400 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 -- 172.21.15.161:0/1218718230 >> 172.21.15.161:0/1218718230 conn(0x560b606f15c0 msgr2=0x560b606f39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 -- 172.21.15.161:0/1218718230 shutdown_connections 2024-05-08T09:22:11.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.575+0000 7f3863da2800 1 -- 172.21.15.161:0/1218718230 wait complete. 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.589+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.589+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.589+0000 7f3863da2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.589+0000 7f3863da2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560b606421c0 con 0x560b606f5fe0 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f38618a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f38618a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42010/0 (socket says 172.21.15.161:42010) 2024-05-08T09:22:11.589 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f38618a8640 1 -- 172.21.15.161:0/3339065112 learned_addr learned my addr 172.21.15.161:0/3339065112 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f38618a8640 1 -- 172.21.15.161:0/3339065112 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b607eb2c0 con 0x560b606f5fe0 2024-05-08T09:22:11.590 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f38618a8640 1 --2- 172.21.15.161:0/3339065112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3854055040 tx=0x7f385404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6640c4ecb3a720e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f374fe07640 1 -- 172.21.15.161:0/3339065112 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3854057040 con 0x560b606f5fe0 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f374fe07640 1 -- 172.21.15.161:0/3339065112 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3854063070 con 0x560b606f5fe0 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.590+0000 7f374fe07640 1 -- 172.21.15.161:0/3339065112 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38540527e0 con 0x560b606f5fe0 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- 172.21.15.161:0/3339065112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 msgr2=0x560b60669e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 --2- 172.21.15.161:0/3339065112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3854055040 tx=0x7f385404c000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- 172.21.15.161:0/3339065112 shutdown_connections 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 --2- 172.21.15.161:0/3339065112 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b60669e50 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- 172.21.15.161:0/3339065112 >> 172.21.15.161:0/3339065112 conn(0x560b606f15c0 msgr2=0x560b607e2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.594 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- 172.21.15.161:0/3339065112 shutdown_connections 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- 172.21.15.161:0/3339065112 wait complete. 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.591+0000 7f3863da2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560b606ff710 con 0x560b606f5fe0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f38618a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f38618a8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42016/0 (socket says 172.21.15.161:42016) 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f38618a8640 1 -- 172.21.15.161:0/3159584460 learned_addr learned my addr 172.21.15.161:0/3159584460 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f38618a8640 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b607f0550 con 0x560b606f5fe0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f38618a8640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3854005870 tx=0x7f3854002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f374e604640 1 -- 172.21.15.161:0/3159584460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385406d070 con 0x560b606f5fe0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f374e604640 1 -- 172.21.15.161:0/3159584460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3854052ca0 con 0x560b606f5fe0 2024-05-08T09:22:11.595 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f374e604640 1 -- 172.21.15.161:0/3159584460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3854057050 con 0x560b606f5fe0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b607f07e0 con 0x560b606f5fe0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.592+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b607f3490 con 0x560b606f5fe0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f374e604640 1 -- 172.21.15.161:0/3159584460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f385405d470 con 0x560b606f5fe0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f374e604640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 0x7f3748038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f374e604640 1 -- 172.21.15.161:0/3159584460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f385408d6f0 con 0x560b606f5fe0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f385bfff640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 0x7f3748038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 0x560b607f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.593+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b607f77d0 con 0x560b606f7240 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f38620a9640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 0x560b607f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f385bfff640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 0x7f3748038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f384c000f60 tx=0x7f384c0010a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f38620a9640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 0x560b607f7250 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f38620a9640 1 -- 172.21.15.161:0/3159584460 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f385c00a4a0 con 0x560b606f7240 2024-05-08T09:22:11.596 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b607f4800 con 0x560b606f7240 2024-05-08T09:22:11.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.594+0000 7f38620a9640 1 -- 172.21.15.161:0/3159584460 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f385c00a4a0 con 0x560b606f7240 2024-05-08T09:22:11.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 0x560b607fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b607fc5a0 con 0x560b607f9b10 2024-05-08T09:22:11.597 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f38618a8640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 0x560b607fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f38618a8640 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 0x560b607fbf00 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f38618a8640 1 -- 172.21.15.161:0/3159584460 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f385405a040 con 0x560b607f9b10 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.595+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b607f8ac0 con 0x560b606f7240 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.596+0000 7f38620a9640 1 -- 172.21.15.161:0/3159584460 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f385c00a4a0 con 0x560b606f7240 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.596+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b607f8fa0 con 0x560b606f7240 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.596+0000 7f38620a9640 1 -- 172.21.15.161:0/3159584460 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f385c00a4a0 con 0x560b606f7240 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.596+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.596+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f3863da2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.609 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f3863da2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560b605e8cf0 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42030/0 (socket says 172.21.15.161:42030) 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f38620a9640 1 -- 172.21.15.161:0/3460633006 learned_addr learned my addr 172.21.15.161:0/3460633006 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f38620a9640 1 -- 172.21.15.161:0/3460633006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6080c0b0 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f38620a9640 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x560b607f7b90 tx=0x7f385c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f37477fe640 1 -- 172.21.15.161:0/3460633006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c014450 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f37477fe640 1 -- 172.21.15.161:0/3460633006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c0145f0 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b6080cb20 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.597+0000 7f37477fe640 1 -- 172.21.15.161:0/3460633006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c0148d0 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.598+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6080d020 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.598+0000 7f37477fe640 1 -- 172.21.15.161:0/3460633006 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f385c011040 con 0x560b6080b750 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.598+0000 7f37477fe640 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 0x7f373c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.610 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.598+0000 7f37477fe640 1 -- 172.21.15.161:0/3460633006 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f385c01e070 con 0x560b6080b750 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.598+0000 7f38618a8640 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 0x7f373c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38618a8640 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 0x7f373c038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x560b607f7c50 tx=0x7f385407c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f3863da2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f3863da2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560b607eb550 con 0x560b608189d0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42044/0 (socket says 172.21.15.161:42044) 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38620a9640 1 -- 172.21.15.161:0/2069668351 learned_addr learned my addr 172.21.15.161:0/2069668351 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38620a9640 1 -- 172.21.15.161:0/2069668351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b608193c0 con 0x560b608189d0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.599+0000 7f38620a9640 1 --2- 172.21.15.161:0/2069668351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f385c018430 tx=0x7f385c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226056b33c374f4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f37457fa640 1 -- 172.21.15.161:0/2069668351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c013dc0 con 0x560b608189d0 2024-05-08T09:22:11.611 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f37457fa640 1 -- 172.21.15.161:0/2069668351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c04e0d0 con 0x560b608189d0 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f37457fa640 1 -- 172.21.15.161:0/2069668351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c04e3f0 con 0x560b608189d0 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- 172.21.15.161:0/2069668351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 msgr2=0x560b60818df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 --2- 172.21.15.161:0/2069668351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f385c018430 tx=0x7f385c011700 comp rx=0 tx=0).stop 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- 172.21.15.161:0/2069668351 shutdown_connections 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 --2- 172.21.15.161:0/2069668351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60818df0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- 172.21.15.161:0/2069668351 >> 172.21.15.161:0/2069668351 conn(0x560b60814d30 msgr2=0x560b60812d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- 172.21.15.161:0/2069668351 shutdown_connections 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- 172.21.15.161:0/2069668351 wait complete. 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 Processor -- start 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.600+0000 7f3863da2800 1 -- start start 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f3863da2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f3863da2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560b60819b30 con 0x560b608189d0 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f38620a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42048/0 (socket says 172.21.15.161:42048) 2024-05-08T09:22:11.612 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 learned_addr learned my addr 172.21.15.161:0/1568009280 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b60820590 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f38620a9640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f385c018430 tx=0x7f385c04c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f37337fe640 1 -- 172.21.15.161:0/1568009280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c022c90 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f37337fe640 1 -- 172.21.15.161:0/1568009280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385c022e30 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560b60820820 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f37337fe640 1 -- 172.21.15.161:0/1568009280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f385c04b3a0 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.601+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b608234d0 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.602+0000 7f37337fe640 1 -- 172.21.15.161:0/1568009280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f385c0133b0 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.602+0000 7f37337fe640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f372c036950 0x7f372c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.602+0000 7f37337fe640 1 -- 172.21.15.161:0/1568009280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f385c00e040 con 0x560b608189d0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.602+0000 7f38618a8640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f372c036950 0x7f372c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f38618a8640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f372c036950 0x7f372c038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f385405d040 tx=0x7f3854080000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.613 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b6082bd80 0x560b6082e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6082e990 con 0x560b6082bd80 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f385bfff640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b6082bd80 0x560b6082e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.603+0000 7f385bfff640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b6082bd80 0x560b6082e240 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384c009050 con 0x560b6082bd80 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 realm 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6082b1d0 con 0x560b6082bd80 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384c009050 con 0x560b6082bd80 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.614 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6082f480 con 0x560b6082bd80 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384c009050 con 0x560b6082bd80 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6082fd50 con 0x560b6082bd80 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f384c009050 con 0x560b6082bd80 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b60830770 0x560b60832b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.604+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b60833250 con 0x560b60830770 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f38620a9640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b60830770 0x560b60832b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f38620a9640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b60830770 0x560b60832b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f3863da2800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f3863da2800 20 searching for the correct realm 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560b60835220 0x560b608376e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.605+0000 7f38618a8640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560b60835220 0x560b608376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.606+0000 7f38618a8640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560b60835220 0x560b608376e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.606+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.606+0000 7f38618a8640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f385408a1d0 0x7f385405d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.606+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.606+0000 7f385bfff640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f385408a1d0 0x7f385405d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.607+0000 7f385bfff640 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f385408a1d0 0x7f385405d760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.607+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c009050 con 0x7f385408a1d0 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.607+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.607+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.607+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.608+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c009050 con 0x560b6082bd80 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.608+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.608+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.608+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.609+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.610+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.611+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.612+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.613+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.614+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60835220 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b60830770 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.615+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x560b6082bd80 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x560b60837db0 con 0x7f385408a1d0 2024-05-08T09:22:11.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b60833c10 con 0x560b6082bd80 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.616+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b608344b0 con 0x560b6082bd80 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b60833850 con 0x560b6082bd80 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 zone default found 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 4 Realm: () 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 zonegroup default 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b60838250 con 0x560b60830770 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.617+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6083a520 con 0x560b60835220 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.634 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b6083a8c0 con 0x560b60835220 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 started sync module instance, tier type = 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.618+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b608399b0 con 0x7f385408a1d0 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.619+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.619+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94606863867648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b608399b0 con 0x7f385408a1d0 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.619+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083b2d0 con 0x560b6082bd80 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.620+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.620+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94606863871520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083b240 con 0x560b6082bd80 2024-05-08T09:22:11.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.620+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083c2c0 con 0x560b60835220 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.622+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94606863871520] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.622+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94606863867648] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.622+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.622+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94606863865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083b6c0 con 0x560b60835220 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.622+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083cb60 con 0x7f385408a1d0 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.623+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94606863865088] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.623+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.623+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94606863877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083cad0 con 0x7f385408a1d0 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.623+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083da20 con 0x560b6082bd80 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.624+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.624+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94606863881584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083de40 con 0x560b6082bd80 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.624+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083de40 con 0x560b60830770 2024-05-08T09:22:11.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.624+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94606863877808] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.625+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94606863881584] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.625+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.625+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94606863885136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083e840 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.625+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083f110 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.626+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.626+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94606863886400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083f7c0 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.626+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b60840180 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.626+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94606863885136] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94606863886400] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94606863889168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083f730 con 0x560b60830770 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=0 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=1 2024-05-08T09:22:11.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=2 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=3 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=4 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=5 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.627+0000 7f3863da2800 20 add_watcher() i=6 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.628+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94606863889168] v27'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.628+0000 7f3863da2800 20 add_watcher() i=7 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.628+0000 7f3863da2800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.628+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b608431b0 con 0x560b6082bd80 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.629+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.638 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.629+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94606863891664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b608405a0 con 0x560b6082bd80 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94606863891664] v27'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f37137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3863da2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3863da2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3863da2800 5 note: GC not initialized 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f37127fc640 20 reqs_thread_entry: start 2024-05-08T09:22:11.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3863da2800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3863da2800 20 Filter name: none 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.630+0000 7f3683fff640 20 reqs_thread_entry: start 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b608764c0 con 0x560b6082bd80 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.631+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6087c3d0 con 0x560b6082bd80 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v27'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f3863da2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:22:11.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f3863da2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f3863da2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94606864137920 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x560b60877de0 con 0x560b6082bd80 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94606863881584 notify 115964117010 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7f3850001e10 con 0x560b6082bd80 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f37457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117010 cookie 94606863881584 notifier 4645 bl.length()=579 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f37457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f37457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f37457fa640 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f3724003ea0 con 0x560b6082bd80 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.632+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94606864137920 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.633+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.633+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94606864137920 notify 115964117010 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f384c03d8f0 con 0x560b6082bd80 2024-05-08T09:22:11.644 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.634+0000 7f37137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.634+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94606863891664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6087ae50 con 0x560b6082bd80 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.635+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94606863891664] v27'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.635+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94606863867648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6087ae50 con 0x7f385408a1d0 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.636+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94606863867648] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.636+0000 7f3863da2800 20 remove_watcher() i=0 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.636+0000 7f3863da2800 2 removed watcher, disabling cache 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.636+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94606863871520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b60839ee0 con 0x560b6082bd80 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.637+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94606863871520] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.637+0000 7f3863da2800 20 remove_watcher() i=1 2024-05-08T09:22:11.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.637+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94606863865088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083ae20 con 0x560b60835220 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.638+0000 7f38618a8640 1 -- 172.21.15.161:0/1568009280 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94606863865088] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385405a040 con 0x560b60835220 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.638+0000 7f3863da2800 20 remove_watcher() i=2 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.638+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94606863877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083ae20 con 0x7f385408a1d0 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.639+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94606863877808] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x7f385408a1d0 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.639+0000 7f3863da2800 20 remove_watcher() i=3 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.639+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94606863881584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083c6b0 con 0x560b6082bd80 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.640+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94606863881584] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f384c029040 con 0x560b6082bd80 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.640+0000 7f3863da2800 20 remove_watcher() i=4 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.640+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94606863885136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083ae20 con 0x560b60830770 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.641+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94606863885136] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.641+0000 7f3863da2800 20 remove_watcher() i=5 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.641+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94606863886400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083d570 con 0x560b60830770 2024-05-08T09:22:11.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.642+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94606863886400] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.642+0000 7f3863da2800 20 remove_watcher() i=6 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.642+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94606863889168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x560b6083c6b0 con 0x560b60830770 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f38620a9640 1 -- 172.21.15.161:0/1568009280 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94606863889168] v27'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f385c02a070 con 0x560b60830770 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 20 remove_watcher() i=7 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b60830770 msgr2=0x560b60832b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b60830770 0x560b60832b60 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b6082bd80 msgr2=0x560b6082e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b6082bd80 0x560b6082e240 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f385408a1d0 msgr2=0x7f385405d760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f385408a1d0 0x7f385405d760 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560b60835220 msgr2=0x560b608376e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560b60835220 0x560b608376e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f372c036950 msgr2=0x7f372c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f372c036950 0x7f372c038e10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f385405d040 tx=0x7f3854080000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 msgr2=0x560b60820050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f385bfff640 1 -- 172.21.15.161:0/1568009280 reap_dead start 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.643+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f385c018430 tx=0x7f385c04c980 comp rx=0 tx=0).stop 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 shutdown_connections 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/1568009280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b608189d0 0x560b60820050 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 >> 172.21.15.161:0/1568009280 conn(0x560b60814d30 msgr2=0x560b60812390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 shutdown_connections 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/1568009280 wait complete. 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 msgr2=0x7f373c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 0x7f373c038e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x560b607f7c50 tx=0x7f385407c040 comp rx=0 tx=0).stop 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 msgr2=0x560b6080bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x560b607f7b90 tx=0x7f385c018830 comp rx=0 tx=0).stop 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 shutdown_connections 2024-05-08T09:22:11.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f373c036950 0x7f373c038e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3460633006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b6080b750 0x560b6080bb70 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 >> 172.21.15.161:0/3460633006 conn(0x560b607ff7f0 msgr2=0x560b607ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 shutdown_connections 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3460633006 wait complete. 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 msgr2=0x560b607fbf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 0x560b607fbf00 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 msgr2=0x560b607f7250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 0x560b607f7250 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 msgr2=0x7f3748038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 0x7f3748038e10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f384c000f60 tx=0x7f384c0010a0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 msgr2=0x560b607f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.644+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3854005870 tx=0x7f3854002fb0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 shutdown_connections 2024-05-08T09:22:11.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560b607f9b10 0x560b607fbf00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560b606f7240 0x560b607f7250 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3748036950 0x7f3748038e10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 --2- 172.21.15.161:0/3159584460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560b606f5fe0 0x560b607f0010 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 >> 172.21.15.161:0/3159584460 conn(0x560b606f15c0 msgr2=0x560b607e15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 shutdown_connections 2024-05-08T09:22:11.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.645+0000 7f3863da2800 1 -- 172.21.15.161:0/3159584460 wait complete. 2024-05-08T09:22:11.655 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:22:11.655 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T09:22:11.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-05-08T09:22:11.655 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-05-08T09:22:11.702 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:11.702 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:11.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.703+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.703+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ffcf2e800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56324a434460 0x56324a436850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ffcf2e800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56324a436e20 con 0x56324a42ffd0 2024-05-08T09:22:11.703 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ffcf2e800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x56324a2c2050 con 0x56324a434460 2024-05-08T09:22:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ff3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56324a434460 0x56324a436850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ff8c67640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x56324a42ffd0 0x56324a4303f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43802/0 (socket says 172.21.15.161:43802) 2024-05-08T09:22:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ff8c67640 1 -- 172.21.15.161:0/4156785341 learned_addr learned my addr 172.21.15.161:0/4156785341 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ff3fff640 1 -- 172.21.15.161:0/4156785341 >> v1:172.21.15.45:6789/0 conn(0x56324a42ffd0 legacy=0x56324a4303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.704 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.704+0000 7f8ff3fff640 1 -- 172.21.15.161:0/4156785341 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a438050 con 0x56324a434460 2024-05-08T09:22:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.706+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/4156785341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a434460 0x56324a436850 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a470 tx=0x7f8fe401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a217c9bb072358d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.706+0000 7f8ff37fe640 1 -- 172.21.15.161:0/4156785341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4057070 con 0x56324a434460 2024-05-08T09:22:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.706+0000 7f8ff37fe640 1 -- 172.21.15.161:0/4156785341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe4052570 con 0x56324a434460 2024-05-08T09:22:11.706 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.706+0000 7f8ff37fe640 1 -- 172.21.15.161:0/4156785341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fe4052870 con 0x56324a434460 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4156785341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a434460 msgr2=0x56324a436850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4156785341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a434460 0x56324a436850 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400a470 tx=0x7f8fe401ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4156785341 shutdown_connections 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4156785341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a434460 0x56324a436850 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4156785341 >> 172.21.15.161:0/4156785341 conn(0x56324a42b5b0 msgr2=0x56324a42d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4156785341 shutdown_connections 2024-05-08T09:22:11.707 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.707+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4156785341 wait complete. 2024-05-08T09:22:11.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ffcf2e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ffcf2e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324a37c1c0 con 0x56324a42ffd0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ff8c67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ff8c67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42064/0 (socket says 172.21.15.161:42064) 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.721+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1320874447 learned_addr learned my addr 172.21.15.161:0/1320874447 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.722+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1320874447 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a51ca20 con 0x56324a42ffd0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.722+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1320874447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001e10 tx=0x7f8fec00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11ab8fbde652fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.722+0000 7f8ee6e05640 1 -- 172.21.15.161:0/1320874447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec012020 con 0x56324a42ffd0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.722+0000 7f8ee6e05640 1 -- 172.21.15.161:0/1320874447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec00e5a0 con 0x56324a42ffd0 2024-05-08T09:22:11.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.722+0000 7f8ee6e05640 1 -- 172.21.15.161:0/1320874447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec00e8e0 con 0x56324a42ffd0 2024-05-08T09:22:11.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1320874447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 msgr2=0x56324a51e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1320874447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8fec001e10 tx=0x7f8fec00b780 comp rx=0 tx=0).stop 2024-05-08T09:22:11.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1320874447 shutdown_connections 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1320874447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a51e460 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1320874447 >> 172.21.15.161:0/1320874447 conn(0x56324a42b5b0 msgr2=0x56324a520af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1320874447 shutdown_connections 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1320874447 wait complete. 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.723+0000 7f8ffcf2e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324a4372f0 con 0x56324a42ffd0 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ff8c67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ff8c67640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42078/0 (socket says 172.21.15.161:42078) 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ff8c67640 1 -- 172.21.15.161:0/2896989848 learned_addr learned my addr 172.21.15.161:0/2896989848 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ff8c67640 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a52c950 con 0x56324a42ffd0 2024-05-08T09:22:11.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b7c0 tx=0x7f8fec000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ee5602640 1 -- 172.21.15.161:0/2896989848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec012030 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ee5602640 1 -- 172.21.15.161:0/2896989848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec001470 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56324a52cbe0 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ee5602640 1 -- 172.21.15.161:0/2896989848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8fec01a8d0 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.724+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324a52f890 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.725+0000 7f8ee5602640 1 -- 172.21.15.161:0/2896989848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8fec015020 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.725+0000 7f8ee5602640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 0x7f8ee0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.725+0000 7f8ee5602640 1 -- 172.21.15.161:0/2896989848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8fec020030 con 0x56324a42ffd0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.725+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 0x7f8ee0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 0x56324a533650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a533b90 con 0x56324a434460 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ff9468640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 0x56324a533650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 0x7f8ee0038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4054000 tx=0x7f8fe404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ff9468640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 0x56324a533650 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ff9468640 1 -- 172.21.15.161:0/2896989848 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ff400a4a0 con 0x56324a434460 2024-05-08T09:22:11.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.726+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a530c20 con 0x56324a434460 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.727+0000 7f8ff9468640 1 -- 172.21.15.161:0/2896989848 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ff400a4a0 con 0x56324a434460 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.727+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 0x56324a5382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.727+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a5389c0 con 0x56324a535ee0 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.727+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 0x56324a5382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.727+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 0x56324a5382d0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.728+0000 7f8ff8c67640 1 -- 172.21.15.161:0/2896989848 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8fec02dcf0 con 0x56324a535ee0 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.728+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a534e90 con 0x56324a434460 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.728+0000 7f8ff9468640 1 -- 172.21.15.161:0/2896989848 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ff400a4a0 con 0x56324a434460 2024-05-08T09:22:11.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.728+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a535330 con 0x56324a434460 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.728+0000 7f8ff9468640 1 -- 172.21.15.161:0/2896989848 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8ff400a4a0 con 0x56324a434460 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ffcf2e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ffcf2e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324a322cf0 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42088/0 (socket says 172.21.15.161:42088) 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ff9468640 1 -- 172.21.15.161:0/4161237303 learned_addr learned my addr 172.21.15.161:0/4161237303 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ff9468640 1 -- 172.21.15.161:0/4161237303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a5484a0 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.729+0000 7f8ff9468640 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x56324a52d810 tx=0x7f8ff4018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.730+0000 7f8ede7fc640 1 -- 172.21.15.161:0/4161237303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff4014450 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.730+0000 7f8ede7fc640 1 -- 172.21.15.161:0/4161237303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff40145f0 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.730+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56324a548f10 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.730+0000 7f8ede7fc640 1 -- 172.21.15.161:0/4161237303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff4014910 con 0x56324a547b40 2024-05-08T09:22:11.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.730+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324a549410 con 0x56324a547b40 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ede7fc640 1 -- 172.21.15.161:0/4161237303 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ff4011040 con 0x56324a547b40 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ede7fc640 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 0x7f8ed0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ede7fc640 1 -- 172.21.15.161:0/4161237303 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8ff401e070 con 0x56324a547b40 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 0x7f8ed0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 0x7f8ed0038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56324a534030 tx=0x7f8fec02df90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ffcf2e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.731+0000 7f8ffcf2e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324a51cda0 con 0x56324a554e40 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42098/0 (socket says 172.21.15.161:42098) 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ff9468640 1 -- 172.21.15.161:0/1566001508 learned_addr learned my addr 172.21.15.161:0/1566001508 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ff9468640 1 -- 172.21.15.161:0/1566001508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a555830 con 0x56324a554e40 2024-05-08T09:22:11.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ff9468640 1 --2- 172.21.15.161:0/1566001508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8ff404c940 tx=0x7f8ff4013da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1a3591b6fd49e72 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ecffff640 1 -- 172.21.15.161:0/1566001508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff404e200 con 0x56324a554e40 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ecffff640 1 -- 172.21.15.161:0/1566001508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff403bb60 con 0x56324a554e40 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.732+0000 7f8ecffff640 1 -- 172.21.15.161:0/1566001508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff403be60 con 0x56324a554e40 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1566001508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 msgr2=0x56324a555260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1566001508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8ff404c940 tx=0x7f8ff4013da0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1566001508 shutdown_connections 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1566001508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a555260 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1566001508 >> 172.21.15.161:0/1566001508 conn(0x56324a551110 msgr2=0x56324a54f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1566001508 shutdown_connections 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1566001508 wait complete. 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 Processor -- start 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- start start 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ffcf2e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56324a555fc0 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ff9468640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42114/0 (socket says 172.21.15.161:42114) 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.733+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 learned_addr learned my addr 172.21.15.161:0/1500209228 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324a55c900 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ff9468640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4011ac0 tx=0x7f8ff404c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ece7fc640 1 -- 172.21.15.161:0/1500209228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff4014be0 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ece7fc640 1 -- 172.21.15.161:0/1500209228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ff4014d80 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ece7fc640 1 -- 172.21.15.161:0/1500209228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ff404cb80 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56324a55cb90 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.734+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324a55f840 con 0x56324a554e40 2024-05-08T09:22:11.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.735+0000 7f8ece7fc640 1 -- 172.21.15.161:0/1500209228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8ff4022a50 con 0x56324a554e40 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.735+0000 7f8ece7fc640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ec4036900 0x7f8ec4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.735+0000 7f8ece7fc640 1 -- 172.21.15.161:0/1500209228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f8ff400e040 con 0x56324a554e40 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.735+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ec4036900 0x7f8ec4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ec4036900 0x7f8ec4038dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000fd0 tx=0x7f8fec039000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a567ec0 0x56324a56a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56aad0 con 0x56324a567ec0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a567ec0 0x56324a56a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a567ec0 0x56324a56a380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 realm 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56aea0 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.736+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56b770 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56bb10 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a56c870 0x56324a56ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56f220 con 0x56324a56c870 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.737+0000 7f8ff9468640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a56c870 0x56324a56ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ff9468640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a56c870 0x56324a56ec60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ffcf2e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ffcf2e800 20 searching for the correct realm 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324a5711f0 0x56324a5736b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.738+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324a5711f0 0x56324a5736b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324a5711f0 0x56324a5736b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff8c67640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8fec059040 0x7f8fec04c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8fec059040 0x7f8fec04c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.739+0000 7f8ff3fff640 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8fec059040 0x7f8fec04c230 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.740+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.741+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.742+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.743+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.744+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.745+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.746+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.747+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.747+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a5711f0 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.747+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.747+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a56c870 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x56324a567ec0 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x56324a573d80 con 0x7f8fec059040 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56fbe0 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.748+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a56f820 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a570580 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 zone default found 2024-05-08T09:22:11.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 4 Realm: () 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 zonegroup default 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a574220 con 0x56324a56c870 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a5764f0 con 0x56324a5711f0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.749+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a576890 con 0x56324a5711f0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 20 started sync module instance, tier type = 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.750+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a575930 con 0x7f8fec059040 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.751+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.751+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94773995593296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a575930 con 0x7f8fec059040 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.751+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a577290 con 0x56324a567ec0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.752+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.752+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94773995593296] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.752+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94773995597216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a577240 con 0x56324a567ec0 2024-05-08T09:22:11.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.752+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a577d50 con 0x56324a5711f0 2024-05-08T09:22:11.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.753+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.753+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94773995597216] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.753+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94773995599488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a578140 con 0x56324a5711f0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.753+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a578b00 con 0x7f8fec059040 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.754+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94773995599488] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.754+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.754+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94773995603536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a578a70 con 0x7f8fec059040 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.754+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a5799c0 con 0x56324a567ec0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.755+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.755+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94773995607312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a579de0 con 0x56324a567ec0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.755+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57a850 con 0x56324a56c870 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.756+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94773995603536] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.756+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94773995607312] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.756+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.756+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94773995605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a579de0 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.756+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57b0f0 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.757+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.757+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94773995613168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57b560 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.757+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57c080 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.757+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94773995605744] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94773995613168] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94773995614224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57c040 con 0x56324a56c870 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=0 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=1 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=2 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=3 2024-05-08T09:22:11.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=4 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=5 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.758+0000 7f8ffcf2e800 20 add_watcher() i=6 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.759+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94773995614224] v27'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.759+0000 7f8ffcf2e800 20 add_watcher() i=7 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.759+0000 7f8ffcf2e800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.759+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a579930 con 0x56324a567ec0 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.760+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.760+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94773995617104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a579930 con 0x56324a567ec0 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94773995617104] v27'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8eaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ffcf2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ffcf2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ffcf2e800 5 note: GC not initialized 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8eae7e4640 20 reqs_thread_entry: start 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ffcf2e800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.761+0000 7f8ffcf2e800 20 Filter name: none 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ea77fe640 20 reqs_thread_entry: start 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a5b23e0 con 0x56324a567ec0 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 20 rados_obj.operate() r=0 bl.length=403 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.762+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a5b8330 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.763+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v27'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.763+0000 7f8ffcf2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.763+0000 7f8ffcf2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.763+0000 7f8ffcf2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.763+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94773995863520 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x56324a5b3d00 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== watch-notify(notify (1) cookie 94773995607312 notify 115964117011 ret 0) ==== 609+0+0 (crc 0 0 0) 0x56324a438050 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ecffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 115964117011 cookie 94773995607312 notifier 4652 bl.length()=567 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ecffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ecffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ecffff640 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x7f8ebc003ea0 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(64 notify.4 [notify cookie 94773995863520 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.764+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== watch-notify(notify_complete (2) cookie 94773995863520 notify 115964117011 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8fe405da80 con 0x56324a567ec0 2024-05-08T09:22:11.773 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-05-08T09:21:48.078335Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:21:48.078323Z","tags":[],"group_ids":[]} 2024-05-08T09:22:11.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.765+0000 7f8eaf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.765+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94773995617104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a5b7160 con 0x56324a567ec0 2024-05-08T09:22:11.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.766+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94773995617104] v27'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.766+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94773995593296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57bb50 con 0x7f8fec059040 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.767+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94773995593296] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.767+0000 7f8ffcf2e800 20 remove_watcher() i=0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.767+0000 7f8ffcf2e800 2 removed watcher, disabling cache 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.767+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94773995597216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57bb50 con 0x56324a567ec0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.768+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94773995597216] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.768+0000 7f8ffcf2e800 20 remove_watcher() i=1 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.768+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94773995599488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a576da0 con 0x56324a5711f0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.769+0000 7f8ff8c67640 1 -- 172.21.15.161:0/1500209228 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94773995599488] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fec00d3d0 con 0x56324a5711f0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.769+0000 7f8ffcf2e800 20 remove_watcher() i=2 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.769+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94773995603536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57bb50 con 0x7f8fec059040 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.770+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94773995603536] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x7f8fec059040 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.770+0000 7f8ffcf2e800 20 remove_watcher() i=3 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.770+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94773995607312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a577680 con 0x56324a567ec0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.771+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94773995607312] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8fe405a040 con 0x56324a567ec0 2024-05-08T09:22:11.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.771+0000 7f8ffcf2e800 20 remove_watcher() i=4 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.771+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94773995605744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a578650 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.772+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94773995605744] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.772+0000 7f8ffcf2e800 20 remove_watcher() i=5 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.772+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94773995613168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a57bb50 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.773+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94773995613168] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.773+0000 7f8ffcf2e800 20 remove_watcher() i=6 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.773+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94773995614224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x56324a579510 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.774+0000 7f8ff9468640 1 -- 172.21.15.161:0/1500209228 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94773995614224] v27'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ff402a070 con 0x56324a56c870 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 20 remove_watcher() i=7 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a56c870 msgr2=0x56324a56ec60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a56c870 0x56324a56ec60 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a567ec0 msgr2=0x56324a56a380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a567ec0 0x56324a56a380 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8fec059040 msgr2=0x7f8fec04c230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8fec059040 0x7f8fec04c230 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324a5711f0 msgr2=0x56324a5736b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56324a5711f0 0x56324a5736b0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ec4036900 msgr2=0x7f8ec4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ec4036900 0x7f8ec4038dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8fec000fd0 tx=0x7f8fec039000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 msgr2=0x56324a55c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ff3fff640 1 -- 172.21.15.161:0/1500209228 reap_dead start 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4011ac0 tx=0x7f8ff404c8a0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 shutdown_connections 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/1500209228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a554e40 0x56324a55c3c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 >> 172.21.15.161:0/1500209228 conn(0x56324a551110 msgr2=0x56324a54e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 shutdown_connections 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/1500209228 wait complete. 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 msgr2=0x7f8ed0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 0x7f8ed0038e10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x56324a534030 tx=0x7f8fec02df90 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 msgr2=0x56324a547f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x56324a52d810 tx=0x7f8ff4018830 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 shutdown_connections 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ed0036950 0x7f8ed0038e10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/4161237303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a547b40 0x56324a547f60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 >> 172.21.15.161:0/4161237303 conn(0x56324a53bbe0 msgr2=0x56324a53bfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 shutdown_connections 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.775+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/4161237303 wait complete. 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 msgr2=0x56324a5382d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 0x56324a5382d0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 msgr2=0x56324a533650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 0x56324a533650 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 msgr2=0x7f8ee0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 0x7f8ee0038e10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4054000 tx=0x7f8fe404e000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 msgr2=0x56324a52c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00b7c0 tx=0x7f8fec000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 shutdown_connections 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56324a535ee0 0x56324a5382d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56324a434460 0x56324a533650 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ee0036950 0x7f8ee0038e10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 --2- 172.21.15.161:0/2896989848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56324a42ffd0 0x56324a52c410 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 >> 172.21.15.161:0/2896989848 conn(0x56324a42b5b0 msgr2=0x56324a51d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 shutdown_connections 2024-05-08T09:22:11.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.776+0000 7f8ffcf2e800 1 -- 172.21.15.161:0/2896989848 wait complete. 2024-05-08T09:22:11.784 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-05-08T09:21:48.078335Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:21:48.078323Z', 'tags': [], 'group_ids': []} 2024-05-08T09:22:11.794 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:11.794 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-05-08T09:22:11.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-05-08T09:22:11.794 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-05-08T09:22:11.838 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:11.839 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:11.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.840+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.840+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.840+0000 7f4de3b36800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e248859450 0x55e24885b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.840+0000 7f4de3b36800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e24885be10 con 0x55e248854fc0 2024-05-08T09:22:11.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.840+0000 7f4de3b36800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e2486e7050 con 0x55e248859450 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf0cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e248859450 0x55e24885b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf8cc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e248854fc0 0x55e2488553e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:43808/0 (socket says 172.21.15.161:43808) 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf0cb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e248859450 0x55e24885b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42128/0 (socket says 172.21.15.161:42128) 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/1727320281 learned_addr learned my addr 172.21.15.161:0/1727320281 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/1727320281 >> v1:172.21.15.45:6789/0 conn(0x55e248854fc0 legacy=0x55e2488553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.841+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/1727320281 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24885d040 con 0x55e248859450 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/1727320281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248859450 0x55e24885b840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400a470 tx=0x7f4dd401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c94ac4c3f2508b9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4dde8ca640 1 -- 172.21.15.161:0/1727320281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd4057070 con 0x55e248859450 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4dde8ca640 1 -- 172.21.15.161:0/1727320281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd4052570 con 0x55e248859450 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4dde8ca640 1 -- 172.21.15.161:0/1727320281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd4052870 con 0x55e248859450 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 -- 172.21.15.161:0/1727320281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248859450 msgr2=0x55e24885b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1727320281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248859450 0x55e24885b840 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400a470 tx=0x7f4dd401ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 -- 172.21.15.161:0/1727320281 shutdown_connections 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1727320281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248859450 0x55e24885b840 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 -- 172.21.15.161:0/1727320281 >> 172.21.15.161:0/1727320281 conn(0x55e248850560 msgr2=0x55e248852980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 -- 172.21.15.161:0/1727320281 shutdown_connections 2024-05-08T09:22:11.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.843+0000 7f4de3b36800 1 -- 172.21.15.161:0/1727320281 wait complete. 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4de3b36800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4de3b36800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e2487a11d0 con 0x55e248854fc0 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4ddf8cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4ddf8cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42142/0 (socket says 172.21.15.161:42142) 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.857+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/1890957751 learned_addr learned my addr 172.21.15.161:0/1890957751 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.858+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/1890957751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24894a400 con 0x55e248854fc0 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.858+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/1890957751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00017a0 tx=0x7f4dd0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c275bf9af7190bc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.858+0000 7f4ccde0b640 1 -- 172.21.15.161:0/1890957751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd0016070 con 0x55e248854fc0 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.858+0000 7f4ccde0b640 1 -- 172.21.15.161:0/1890957751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd0004520 con 0x55e248854fc0 2024-05-08T09:22:11.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.858+0000 7f4ccde0b640 1 -- 172.21.15.161:0/1890957751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd0004820 con 0x55e248854fc0 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- 172.21.15.161:0/1890957751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 msgr2=0x55e2487c96d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1890957751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4dd00017a0 tx=0x7f4dd0001c60 comp rx=0 tx=0).stop 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- 172.21.15.161:0/1890957751 shutdown_connections 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1890957751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e2487c96d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- 172.21.15.161:0/1890957751 >> 172.21.15.161:0/1890957751 conn(0x55e248850560 msgr2=0x55e248941ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- 172.21.15.161:0/1890957751 shutdown_connections 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- 172.21.15.161:0/1890957751 wait complete. 2024-05-08T09:22:11.864 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4de3b36800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e24885c2e0 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4ddf8cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4ddf8cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42154/0 (socket says 172.21.15.161:42154) 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.859+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/2142896836 learned_addr learned my addr 172.21.15.161:0/2142896836 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24894f790 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000f80 tx=0x7f4dd0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4cc7fff640 1 -- 172.21.15.161:0/2142896836 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd0016040 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4cc7fff640 1 -- 172.21.15.161:0/2142896836 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd0011530 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e24894fa20 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4cc7fff640 1 -- 172.21.15.161:0/2142896836 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd0011890 con 0x55e248854fc0 2024-05-08T09:22:11.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.860+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2489526d0 con 0x55e248854fc0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4cc7fff640 1 -- 172.21.15.161:0/2142896836 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4dd001c3f0 con 0x55e248854fc0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4cc7fff640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 0x7f4cc8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4cc7fff640 1 -- 172.21.15.161:0/2142896836 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4dd004b9b0 con 0x55e248854fc0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 0x7f4cc8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 0x55e248956490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248956a20 con 0x55e248859450 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.861+0000 7f4de00cd640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 0x55e248956490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 0x7f4cc8038dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4054000 tx=0x7f4dd404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de00cd640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 0x55e248956490 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de00cd640 1 -- 172.21.15.161:0/2142896836 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dd80083e0 con 0x55e248859450 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248953a40 con 0x55e248859450 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de00cd640 1 -- 172.21.15.161:0/2142896836 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dd80083e0 con 0x55e248859450 2024-05-08T09:22:11.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 0x55e24895b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.862+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e24895b830 con 0x55e248958d50 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 0x55e24895b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 0x55e24895b140 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/2142896836 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4dd0019050 con 0x55e248958d50 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248957d00 con 0x55e248859450 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4de00cd640 1 -- 172.21.15.161:0/2142896836 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dd80083e0 con 0x55e248859450 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.863+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489581c0 con 0x55e248859450 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de00cd640 1 -- 172.21.15.161:0/2142896836 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dd80083e0 con 0x55e248859450 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de3b36800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de3b36800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e248747cf0 con 0x55e248947f90 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42164/0 (socket says 172.21.15.161:42164) 2024-05-08T09:22:11.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.864+0000 7f4de00cd640 1 -- 172.21.15.161:0/1900176713 learned_addr learned my addr 172.21.15.161:0/1900176713 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4de00cd640 1 -- 172.21.15.161:0/1900176713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e248946940 con 0x55e248947f90 2024-05-08T09:22:11.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4de00cd640 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x55e248950650 tx=0x7f4dd800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4cc57fa640 1 -- 172.21.15.161:0/1900176713 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8007d00 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4cc57fa640 1 -- 172.21.15.161:0/1900176713 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd801e020 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e248946bd0 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4cc57fa640 1 -- 172.21.15.161:0/1900176713 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8019420 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.865+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2489470d0 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4cc57fa640 1 -- 172.21.15.161:0/1900176713 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4dd8016040 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4cc57fa640 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 0x7f4cb8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4cc57fa640 1 -- 172.21.15.161:0/1900176713 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4dd801f030 con 0x55e248947f90 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 0x7f4cb8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.866+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 0x7f4cb8038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e248956ec0 tx=0x7f4dd0049cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de3b36800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de3b36800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e24894a750 con 0x55e248979f20 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42172/0 (socket says 172.21.15.161:42172) 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de00cd640 1 -- 172.21.15.161:0/2549166635 learned_addr learned my addr 172.21.15.161:0/2549166635 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de00cd640 1 -- 172.21.15.161:0/2549166635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e24897a910 con 0x55e248979f20 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4de00cd640 1 --2- 172.21.15.161:0/2549166635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4dd804c820 tx=0x7f4dd8014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7e2acc785fc3e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4cbeffd640 1 -- 172.21.15.161:0/2549166635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd801d070 con 0x55e248979f20 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4cbeffd640 1 -- 172.21.15.161:0/2549166635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd804b230 con 0x55e248979f20 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.867+0000 7f4cbeffd640 1 -- 172.21.15.161:0/2549166635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8017570 con 0x55e248979f20 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- 172.21.15.161:0/2549166635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 msgr2=0x55e24897a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2549166635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f4dd804c820 tx=0x7f4dd8014640 comp rx=0 tx=0).stop 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- 172.21.15.161:0/2549166635 shutdown_connections 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2549166635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e24897a340 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- 172.21.15.161:0/2549166635 >> 172.21.15.161:0/2549166635 conn(0x55e248976230 msgr2=0x55e2489742e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- 172.21.15.161:0/2549166635 shutdown_connections 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- 172.21.15.161:0/2549166635 wait complete. 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 Processor -- start 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- start start 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.868+0000 7f4de3b36800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e24897b080 con 0x55e248979f20 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.869+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.869+0000 7f4de00cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:42188/0 (socket says 172.21.15.161:42188) 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.869+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 learned_addr learned my addr 172.21.15.161:0/646795660 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.869+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e248981a00 con 0x55e248979f20 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.869+0000 7f4de00cd640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4dd804b790 tx=0x7f4dd804c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4cbd7fa640 1 -- 172.21.15.161:0/646795660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8031030 con 0x55e248979f20 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4cbd7fa640 1 -- 172.21.15.161:0/646795660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd8014950 con 0x55e248979f20 2024-05-08T09:22:11.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e248981c90 con 0x55e248979f20 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4cbd7fa640 1 -- 172.21.15.161:0/646795660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dd8014c30 con 0x55e248979f20 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e248984940 con 0x55e248979f20 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.870+0000 7f4cbd7fa640 1 -- 172.21.15.161:0/646795660 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4dd8034070 con 0x55e248979f20 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4cbd7fa640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca8036950 0x7f4ca8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4cbd7fa640 1 -- 172.21.15.161:0/646795660 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6133+0+0 (secure 0 0 0) 0x7f4dd8032070 con 0x55e248979f20 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca8036950 0x7f4ca8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e24898cfb0 0x55e24898f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e24898fbc0 con 0x55e24898cfb0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca8036950 0x7f4ca8038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4dd003e1b0 tx=0x7f4dd0042000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.871+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e24898cfb0 0x55e24898f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e24898cfb0 0x55e24898f470 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 realm 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e24898ff90 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248990860 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.872+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248990c00 con 0x55e24898cfb0 2024-05-08T09:22:11.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de3b36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248991960 0x55e248993d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248994310 con 0x55e248991960 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de00cd640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248991960 0x55e248993d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.873+0000 7f4de00cd640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248991960 0x55e248993d50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4de3b36800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4de3b36800 20 searching for the correct realm 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e2489962c0 0x55e248998780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e2489962c0 0x55e248998780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.874+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e2489962c0 0x55e248998780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf8cc640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4dd000f300 0x7f4dd00433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4dd000f300 0x7f4dd00433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf0cb640 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4dd000f300 0x7f4dd00433b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.875+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.876+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 27 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.877+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 27 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.878+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 27 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.879+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.880+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 27 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.881+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.882+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e2489962c0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.883+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e248991960 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(35 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x55e24898cfb0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 27 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 27 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e27) -- 0x55e248998e50 con 0x7f4dd000f300 2024-05-08T09:22:11.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(37 [pgnls start_epoch 27 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248994cd0 con 0x55e24898cfb0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.884+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e248994910 con 0x55e24898cfb0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489956b0 con 0x55e24898cfb0 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 zone default found 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 4 Realm: () 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 zonegroup default 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489951b0 con 0x55e248991960 2024-05-08T09:22:11.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.885+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e24899b660 con 0x55e2489962c0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e24899ba00 con 0x55e2489962c0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 started sync module instance, tier type = 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.886+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899aaf0 con 0x7f4dd000f300 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.887+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(44 notify.0 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.900 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.887+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94430369001504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899aaf0 con 0x7f4dd000f300 2024-05-08T09:22:11.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.887+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899c400 con 0x55e24898cfb0 2024-05-08T09:22:11.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.888+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94430369001504] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.888+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.888+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94430369005328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899aaf0 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.888+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899ce90 con 0x55e2489962c0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.889+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94430369005328] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.890+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.890+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94430368998976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899aa60 con 0x55e2489962c0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.890+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899dd50 con 0x7f4dd000f300 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.890+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94430368998976] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.891+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(50 notify.3 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.891+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94430369011872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899e170 con 0x7f4dd000f300 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.891+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899ea20 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.892+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.892+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94430369014128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899e590 con 0x55e24898cfb0 2024-05-08T09:22:11.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.892+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899f9d0 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.892+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94430369011872] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.893+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94430369014128] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.893+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(54 notify.5 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.893+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94430369017360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899f9d0 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.893+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0270 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.894+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.894+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94430369021376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0690 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.894+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0ee0 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.894+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94430369017360] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94430369021376] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(58 notify.7 [create] v27'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94430369022432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0ab0 con 0x55e248991960 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=0 2024-05-08T09:22:11.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=1 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=2 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=3 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=4 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=5 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.895+0000 7f4de3b36800 20 add_watcher() i=6 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94430369022432] v27'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4de3b36800 20 add_watcher() i=7 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4de3b36800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a3d20 con 0x55e24898cfb0 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.896+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94430369023856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a1040 con 0x55e24898cfb0 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.897+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94430369023856] v27'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.897+0000 7f4c95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.897+0000 7f4de3b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.897+0000 7f4de3b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.898+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a3520 con 0x55e24898cfb0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.899+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.899+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489acde0 con 0x55e248991960 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.900+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.900+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489acde0 con 0x55e2489962c0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.900+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v27'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.901+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ad630 con 0x55e24898cfb0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.901+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v27'192 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.902+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ada20 con 0x7f4dd000f300 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.902+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v27'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.903+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489aded0 con 0x55e2489962c0 2024-05-08T09:22:11.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.903+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v27'44 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.903+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae270 con 0x55e24898cfb0 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.904+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v27'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.905+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae340 con 0x55e248991960 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.906+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v27'43 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.906+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.907+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.907+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.908+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.908+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.909+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v27'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.909+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e248991960 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.910+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.910+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.911+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.911+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e248991960 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.912+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v27'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.912+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e24898cfb0 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.913+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v27'193 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.913+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.914+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v27'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.914+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.915+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v27'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.915+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.916+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v27'26 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.916+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e24898cfb0 2024-05-08T09:22:11.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.917+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v27'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.917+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e24898cfb0 2024-05-08T09:22:11.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.918+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v27'194 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.918+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.919+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v27'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.919+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.920+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v27'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.920+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.921+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v27'29 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.921+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.922+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.922+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.923+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v27'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.923+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae8c0 con 0x55e2489962c0 2024-05-08T09:22:11.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.924+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v27'45 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.924+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae8c0 con 0x55e248991960 2024-05-08T09:22:11.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.926+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v27'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.926+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae8c0 con 0x55e2489962c0 2024-05-08T09:22:11.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.926+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v27'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.926+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae8c0 con 0x55e248991960 2024-05-08T09:22:11.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.928+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v27'44 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.928+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e2489962c0 2024-05-08T09:22:11.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.929+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v27'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.929+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x55e248991960 2024-05-08T09:22:11.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.930+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v27'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.930+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489ae830 con 0x7f4dd000f300 2024-05-08T09:22:11.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.931+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v27'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.931+0000 7f4c94fe1640 20 reqs_thread_entry: start 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.931+0000 7f4de3b36800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.931+0000 7f4de3b36800 20 Filter name: none 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4c0e7fc640 20 reqs_thread_entry: start 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 20 rados->read ofs=0 len=0 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489d9960 con 0x55e24898cfb0 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:22:11.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.932+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27) -- 0x55e2489d9900 con 0x7f4dd000f300 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.933+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.933+0000 7f4c95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:11.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.933+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94430369023856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489d9d70 con 0x55e24898cfb0 2024-05-08T09:22:11.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.934+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94430369023856] v27'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.934+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94430369001504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0770 con 0x7f4dd000f300 2024-05-08T09:22:11.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.936+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94430369001504] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.936+0000 7f4de3b36800 20 remove_watcher() i=0 2024-05-08T09:22:11.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.936+0000 7f4de3b36800 2 removed watcher, disabling cache 2024-05-08T09:22:11.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.936+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94430369005328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0770 con 0x55e24898cfb0 2024-05-08T09:22:11.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.937+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94430369005328] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.937+0000 7f4de3b36800 20 remove_watcher() i=1 2024-05-08T09:22:11.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.937+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94430368998976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0770 con 0x55e2489962c0 2024-05-08T09:22:11.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.938+0000 7f4ddf8cc640 1 -- 172.21.15.161:0/646795660 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94430368998976] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd0019050 con 0x55e2489962c0 2024-05-08T09:22:11.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.938+0000 7f4de3b36800 20 remove_watcher() i=2 2024-05-08T09:22:11.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.938+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94430369011872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899a640 con 0x7f4dd000f300 2024-05-08T09:22:11.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.939+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94430369011872] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x7f4dd000f300 2024-05-08T09:22:11.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.939+0000 7f4de3b36800 20 remove_watcher() i=3 2024-05-08T09:22:11.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.939+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94430369014128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e2489a0770 con 0x55e24898cfb0 2024-05-08T09:22:11.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.940+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94430369014128] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd405a040 con 0x55e24898cfb0 2024-05-08T09:22:11.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.940+0000 7f4de3b36800 20 remove_watcher() i=4 2024-05-08T09:22:11.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.940+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94430369017360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899d8a0 con 0x55e248991960 2024-05-08T09:22:11.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.941+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94430369017360] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.941+0000 7f4de3b36800 20 remove_watcher() i=5 2024-05-08T09:22:11.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.941+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94430369021376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899a640 con 0x55e248991960 2024-05-08T09:22:11.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.942+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94430369021376] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.942+0000 7f4de3b36800 20 remove_watcher() i=6 2024-05-08T09:22:11.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.942+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94430369022432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27) -- 0x55e24899e170 con 0x55e248991960 2024-05-08T09:22:11.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.943+0000 7f4de00cd640 1 -- 172.21.15.161:0/646795660 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94430369022432] v27'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dd8057040 con 0x55e248991960 2024-05-08T09:22:11.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.943+0000 7f4de3b36800 20 remove_watcher() i=7 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248991960 msgr2=0x55e248993d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248991960 0x55e248993d50 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e24898cfb0 msgr2=0x55e24898f470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e24898cfb0 0x55e24898f470 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4dd000f300 msgr2=0x7f4dd00433b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4dd000f300 0x7f4dd00433b0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e2489962c0 msgr2=0x55e248998780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e2489962c0 0x55e248998780 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca8036950 msgr2=0x7f4ca8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca8036950 0x7f4ca8038e10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4dd003e1b0 tx=0x7f4dd0042000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 msgr2=0x55e2489814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4ddf0cb640 1 -- 172.21.15.161:0/646795660 reap_dead start 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4dd804b790 tx=0x7f4dd804c7b0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 shutdown_connections 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/646795660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248979f20 0x55e2489814c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 >> 172.21.15.161:0/646795660 conn(0x55e248976230 msgr2=0x55e2489738e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 shutdown_connections 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/646795660 wait complete. 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 msgr2=0x7f4cb8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 0x7f4cb8038e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55e248956ec0 tx=0x7f4dd0049cb0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 msgr2=0x55e248946400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x55e248950650 tx=0x7f4dd800aec0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 shutdown_connections 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cb8036950 0x7f4cb8038e10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 --2- 172.21.15.161:0/1900176713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248947f90 0x55e248946400 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 >> 172.21.15.161:0/1900176713 conn(0x55e24895ea80 msgr2=0x55e24895ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 shutdown_connections 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.944+0000 7f4de3b36800 1 -- 172.21.15.161:0/1900176713 wait complete. 2024-05-08T09:22:11.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 msgr2=0x55e24895b140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 0x55e24895b140 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 msgr2=0x55e248956490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 0x55e248956490 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 msgr2=0x7f4cc8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 0x7f4cc8038dc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4054000 tx=0x7f4dd404e000 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 msgr2=0x55e24894f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000f80 tx=0x7f4dd0001250 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 shutdown_connections 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e248958d50 0x55e24895b140 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e248859450 0x55e248956490 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cc8036900 0x7f4cc8038dc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 --2- 172.21.15.161:0/2142896836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e248854fc0 0x55e24894f250 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 >> 172.21.15.161:0/2142896836 conn(0x55e248850560 msgr2=0x55e2489406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 shutdown_connections 2024-05-08T09:22:11.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:11.945+0000 7f4de3b36800 1 -- 172.21.15.161:0/2142896836 wait complete. 2024-05-08T09:22:11.952 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T09:22:11.973 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:11.977 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-05-08T09:22:46.978 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-05-08T09:22:46.978 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-05-08T09:22:46.978 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-05-08T09:22:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.029 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.031+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.031+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.031+0000 7f099c612800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559d45ba3640 0x559d45ba3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.031+0000 7f099c612800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d45bac110 con 0x559d45ba3fa0 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.031+0000 7f099c612800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x559d45a34050 con 0x559d45ba3640 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.032+0000 7f0997d5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559d45ba3640 0x559d45ba3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.032+0000 7f0997d5c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559d45ba3640 0x559d45ba3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33024/0 (socket says 172.21.15.161:33024) 2024-05-08T09:22:47.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.032+0000 7f0997d5c640 1 -- 172.21.15.161:0/3647276723 learned_addr learned my addr 172.21.15.161:0/3647276723 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.032+0000 7f0997d5c640 1 -- 172.21.15.161:0/3647276723 >> v1:172.21.15.45:6789/0 conn(0x559d45ba3fa0 legacy=0x559d45baa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.032+0000 7f0997d5c640 1 -- 172.21.15.161:0/3647276723 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45bad340 con 0x559d45ba3640 2024-05-08T09:22:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.034+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3647276723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45ba3a60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0988005fd0 tx=0x7f098801cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc06abf343ef238a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.034+0000 7f0996d5a640 1 -- 172.21.15.161:0/3647276723 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988052540 con 0x559d45ba3640 2024-05-08T09:22:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.034+0000 7f0996d5a640 1 -- 172.21.15.161:0/3647276723 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098804e070 con 0x559d45ba3640 2024-05-08T09:22:47.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.034+0000 7f0996d5a640 1 -- 172.21.15.161:0/3647276723 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988052890 con 0x559d45ba3640 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 -- 172.21.15.161:0/3647276723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 msgr2=0x559d45ba3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 --2- 172.21.15.161:0/3647276723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45ba3a60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0988005fd0 tx=0x7f098801cd80 comp rx=0 tx=0).stop 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 -- 172.21.15.161:0/3647276723 shutdown_connections 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 --2- 172.21.15.161:0/3647276723 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45ba3a60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 -- 172.21.15.161:0/3647276723 >> 172.21.15.161:0/3647276723 conn(0x559d45b9cd30 msgr2=0x559d45b9f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 -- 172.21.15.161:0/3647276723 shutdown_connections 2024-05-08T09:22:47.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.035+0000 7f099c612800 1 -- 172.21.15.161:0/3647276723 wait complete. 2024-05-08T09:22:47.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f099c612800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f099c612800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559d45aee1d0 con 0x559d45ba3640 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f0997d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f0997d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33026/0 (socket says 172.21.15.161:33026) 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.051+0000 7f0997d5c640 1 -- 172.21.15.161:0/2946384893 learned_addr learned my addr 172.21.15.161:0/2946384893 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.052+0000 7f0997d5c640 1 -- 172.21.15.161:0/2946384893 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45c96eb0 con 0x559d45ba3640 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.052+0000 7f0997d5c640 1 --2- 172.21.15.161:0/2946384893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f098801ba70 tx=0x7f098804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717ed533b5c4b80c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.052+0000 7f0885e0b640 1 -- 172.21.15.161:0/2946384893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988052820 con 0x559d45ba3640 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.052+0000 7f0885e0b640 1 -- 172.21.15.161:0/2946384893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0988062070 con 0x559d45ba3640 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.052+0000 7f0885e0b640 1 -- 172.21.15.161:0/2946384893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988052b10 con 0x559d45ba3640 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- 172.21.15.161:0/2946384893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 msgr2=0x559d45c968e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 --2- 172.21.15.161:0/2946384893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f098801ba70 tx=0x7f098804c000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- 172.21.15.161:0/2946384893 shutdown_connections 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 --2- 172.21.15.161:0/2946384893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c968e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- 172.21.15.161:0/2946384893 >> 172.21.15.161:0/2946384893 conn(0x559d45b9cd30 msgr2=0x559d45c92200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- 172.21.15.161:0/2946384893 shutdown_connections 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- 172.21.15.161:0/2946384893 wait complete. 2024-05-08T09:22:47.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.053+0000 7f099c612800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559d45bac580 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f0997d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f0997d5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33032/0 (socket says 172.21.15.161:33032) 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f0997d5c640 1 -- 172.21.15.161:0/3929444706 learned_addr learned my addr 172.21.15.161:0/3929444706 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f0997d5c640 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45c9e8a0 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f098800a190 tx=0x7f0988003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f087ffff640 1 -- 172.21.15.161:0/3929444706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988071570 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f087ffff640 1 -- 172.21.15.161:0/3929444706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0988058040 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d45c9eb30 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.054+0000 7f087ffff640 1 -- 172.21.15.161:0/3929444706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0988071880 con 0x559d45ba3640 2024-05-08T09:22:47.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.055+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d45ca17e0 con 0x559d45ba3640 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.055+0000 7f087ffff640 1 -- 172.21.15.161:0/3929444706 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0988050070 con 0x559d45ba3640 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f087ffff640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 0x7f0880038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f087ffff640 1 -- 172.21.15.161:0/3929444706 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f098808e710 con 0x559d45ba3640 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099755b640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 0x7f0880038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 0x559d45ca55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ca5b70 con 0x559d45ba3fa0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099855d640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 0x559d45ca55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099755b640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 0x7f0880038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f098c001e10 tx=0x7f098c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.056+0000 7f099855d640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 0x559d45ca55a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f099855d640 1 -- 172.21.15.161:0/3929444706 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45ba3fa0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ca2b70 con 0x559d45ba3fa0 2024-05-08T09:22:47.059 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f099855d640 1 -- 172.21.15.161:0/3929444706 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f09900083e0 con 0x559d45ba3fa0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 0x559d45caa2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45caa9d0 con 0x559d45ca7ef0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.057+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 0x559d45caa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.058+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 0x559d45caa2e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.058+0000 7f0997d5c640 1 -- 172.21.15.161:0/3929444706 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0988077020 con 0x559d45ca7ef0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.058+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ca6ea0 con 0x559d45ba3fa0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.058+0000 7f099855d640 1 -- 172.21.15.161:0/3929444706 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f09900083e0 con 0x559d45ba3fa0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.058+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ca7340 con 0x559d45ba3fa0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099855d640 1 -- 172.21.15.161:0/3929444706 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f09900083e0 con 0x559d45ba3fa0 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099c612800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099c612800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559d45a94cf0 con 0x559d45cb9b70 2024-05-08T09:22:47.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.059+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33036/0 (socket says 172.21.15.161:33036) 2024-05-08T09:22:47.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099855d640 1 -- 172.21.15.161:0/1269303886 learned_addr learned my addr 172.21.15.161:0/1269303886 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099855d640 1 -- 172.21.15.161:0/1269303886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45cba4d0 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099855d640 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x559d45c9f230 tx=0x7f099000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f087d7fa640 1 -- 172.21.15.161:0/1269303886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0990007d00 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f087d7fa640 1 -- 172.21.15.161:0/1269303886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099001e020 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f087d7fa640 1 -- 172.21.15.161:0/1269303886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0990019420 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d45cbaf40 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.060+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d45cbb440 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.061+0000 7f087d7fa640 1 -- 172.21.15.161:0/1269303886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0990016040 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.061+0000 7f087d7fa640 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 0x7f0870038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.061+0000 7f087d7fa640 1 -- 172.21.15.161:0/1269303886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f099001f030 con 0x559d45cb9b70 2024-05-08T09:22:47.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f0997d5c640 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 0x7f0870038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f0997d5c640 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 0x7f0870038dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x559d45ca6040 tx=0x7f09880513d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099c612800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099c612800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559d45c97170 con 0x559d45cc6ed0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33038/0 (socket says 172.21.15.161:33038) 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.062+0000 7f099855d640 1 -- 172.21.15.161:0/2648334992 learned_addr learned my addr 172.21.15.161:0/2648334992 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.063+0000 7f099855d640 1 -- 172.21.15.161:0/2648334992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45cc78c0 con 0x559d45cc6ed0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.063+0000 7f099855d640 1 --2- 172.21.15.161:0/2648334992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0990008a40 tx=0x7f099004cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fc1bf6932f8fee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.063+0000 7f0876ffd640 1 -- 172.21.15.161:0/2648334992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f099001d070 con 0x559d45cc6ed0 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.063+0000 7f0876ffd640 1 -- 172.21.15.161:0/2648334992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099003de50 con 0x559d45cc6ed0 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.063+0000 7f0876ffd640 1 -- 172.21.15.161:0/2648334992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0990018500 con 0x559d45cc6ed0 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- 172.21.15.161:0/2648334992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 msgr2=0x559d45cc72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 --2- 172.21.15.161:0/2648334992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0990008a40 tx=0x7f099004cb20 comp rx=0 tx=0).stop 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- 172.21.15.161:0/2648334992 shutdown_connections 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 --2- 172.21.15.161:0/2648334992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cc72f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- 172.21.15.161:0/2648334992 >> 172.21.15.161:0/2648334992 conn(0x559d45cc3230 msgr2=0x559d45cc1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- 172.21.15.161:0/2648334992 shutdown_connections 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- 172.21.15.161:0/2648334992 wait complete. 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 Processor -- start 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- start start 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099c612800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559d45cc8030 con 0x559d45cc6ed0 2024-05-08T09:22:47.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099855d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33044/0 (socket says 172.21.15.161:33044) 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.064+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 learned_addr learned my addr 172.21.15.161:0/3529872095 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d45cce9d0 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f099855d640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0990014830 tx=0x7f099004c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f08757fa640 1 -- 172.21.15.161:0/3529872095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0990030020 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f08757fa640 1 -- 172.21.15.161:0/3529872095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f099004e0d0 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f08757fa640 1 -- 172.21.15.161:0/3529872095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f099004e3f0 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d45ccec60 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.065+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d45cd1910 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f08757fa640 1 -- 172.21.15.161:0/3529872095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0990033020 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f08757fa640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0860036a00 0x7f0860038ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f08757fa640 1 -- 172.21.15.161:0/3529872095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0990036d60 con 0x559d45cc6ed0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0860036a00 0x7f0860038ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45cd9f60 0x559d45cdc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.066+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45cdcb70 con 0x559d45cd9f60 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099755b640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45cd9f60 0x559d45cdc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0860036a00 0x7f0860038ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09880514a0 tx=0x7f0988091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099755b640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45cd9f60 0x559d45cdc420 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f098c00bdb0 con 0x559d45cd9f60 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 20 realm 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45cd93b0 con 0x559d45cd9f60 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f098c00bdb0 con 0x559d45cd9f60 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.067+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45cdd650 con 0x559d45cd9f60 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f098c00bdb0 con 0x559d45cd9f60 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45cddf20 con 0x559d45cd9f60 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f098c00bdb0 con 0x559d45cd9f60 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45cde7d0 0x559d45ce0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.068+0000 7f099855d640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45cde7d0 0x559d45ce0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099855d640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45cde7d0 0x559d45ce0be0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099c612800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099c612800 20 searching for the correct realm 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559d45ce33f0 0x559d45ce58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce5f80 con 0x559d45ce33f0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559d45ce33f0 0x559d45ce58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.069+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559d45ce33f0 0x559d45ce58b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.070+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.070+0000 7f0997d5c640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0988052030 0x7f0988066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.070+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce5f80 con 0x7f0988052030 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.070+0000 7f099755b640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0988052030 0x7f0988066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.070+0000 7f099755b640 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0988052030 0x7f0988066ac0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c00bdb0 con 0x7f0988052030 2024-05-08T09:22:47.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce5f80 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c00bdb0 con 0x559d45cd9f60 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.071+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x7f0988052030 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.072+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.073+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f098c02a040 con 0x7f0988052030 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.074+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.075+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.076+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x7f0988052030 2024-05-08T09:22:47.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.077+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cde7d0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x7f0988052030 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45ce33f0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.078+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c02a040 con 0x7f0988052030 2024-05-08T09:22:47.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x559d45cd9f60 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f098c02a040 con 0x559d45cd9f60 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1340 con 0x7f0988052030 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce1cf0 con 0x559d45cd9f60 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.079+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce20e0 con 0x559d45cd9f60 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce2500 con 0x559d45cd9f60 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 zone default found 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 4 Realm: () 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 zonegroup default 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce2930 con 0x559d45cde7d0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.080+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce8290 con 0x559d45ce33f0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce8630 con 0x559d45ce33f0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 20 started sync module instance, tier type = 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.081+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce76d0 con 0x7f0988052030 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.082+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.082+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94133969386480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce76d0 con 0x7f0988052030 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.082+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce8ff0 con 0x559d45cd9f60 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.083+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94133969386480] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.084+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.084+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94133969390880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce76d0 con 0x559d45cd9f60 2024-05-08T09:22:47.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.084+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce9a60 con 0x559d45ce33f0 2024-05-08T09:22:47.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.085+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94133969390880] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.085+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.085+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94133969383968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce7640 con 0x559d45ce33f0 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.085+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45cea850 con 0x7f0988052030 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.086+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94133969383968] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.086+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.086+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94133969395328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceac40 con 0x7f0988052030 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.086+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb640 con 0x559d45cd9f60 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.087+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94133969395328] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.087+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.087+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94133969396384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb600 con 0x559d45cd9f60 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.087+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45cec050 con 0x559d45cde7d0 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.089+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94133969396384] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.089+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.089+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94133969403264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb600 con 0x559d45cde7d0 2024-05-08T09:22:47.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.089+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceca80 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.090+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(56 notify.6 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.090+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94133969405360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45cecf30 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.090+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ced9f0 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.090+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94133969403264] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94133969405360] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94133969409216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceca80 con 0x559d45cde7d0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=0 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=1 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=2 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=3 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=4 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=5 2024-05-08T09:22:47.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.091+0000 7f099c612800 20 add_watcher() i=6 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.092+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94133969409216] v29'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.092+0000 7f099c612800 20 add_watcher() i=7 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.092+0000 7f099c612800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.092+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45cf0af0 con 0x559d45cd9f60 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.093+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.093+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94133969400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45cedf70 con 0x559d45cd9f60 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94133969400144] v29'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f084dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 5 note: GC not initialized 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f084cfe1640 20 reqs_thread_entry: start 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 20 Filter name: none 2024-05-08T09:22:47.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f07c67fc640 20 reqs_thread_entry: start 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.094+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24390 con 0x559d45cd9f60 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24390 con 0x7f0988052030 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24350 con 0x559d45cd9f60 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24350 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.095+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d248a0 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24cb0 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24cb0 con 0x559d45cd9f60 2024-05-08T09:22:47.106 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24cb0 con 0x559d45cd9f60 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24cb0 con 0x559d45ce33f0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.096+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24c40 con 0x559d45ce33f0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d24c40 con 0x559d45cde7d0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26690 con 0x559d45cd9f60 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.097+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26690 con 0x7f0988052030 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26690 con 0x559d45ce33f0 2024-05-08T09:22:47.107 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26690 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26690 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.098+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26640 con 0x559d45ce33f0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26610 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26610 con 0x559d45cd9f60 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.099+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26610 con 0x559d45ce33f0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265c0 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265c0 con 0x7f0988052030 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.100+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45cde7d0 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45ce33f0 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.101+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d265a0 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26590 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26550 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.102+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559d45d26550 con 0x559d45cde7d0 2024-05-08T09:22:47.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.103+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.104+0000 7f084dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.104+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94133969400144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45d21fa0 con 0x559d45cd9f60 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.105+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94133969400144] v29'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.105+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94133969386480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb150 con 0x7f0988052030 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.106+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94133969386480] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.106+0000 7f099c612800 20 remove_watcher() i=0 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.106+0000 7f099c612800 2 removed watcher, disabling cache 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.106+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94133969390880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb150 con 0x559d45cd9f60 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.107+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94133969390880] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.107+0000 7f099c612800 20 remove_watcher() i=1 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.107+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94133969383968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb150 con 0x559d45ce33f0 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.108+0000 7f0997d5c640 1 -- 172.21.15.161:0/3529872095 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94133969383968] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0988077020 con 0x559d45ce33f0 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.109+0000 7f099c612800 20 remove_watcher() i=2 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.109+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94133969395328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce7220 con 0x7f0988052030 2024-05-08T09:22:47.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.110+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94133969395328] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x7f0988052030 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.110+0000 7f099c612800 20 remove_watcher() i=3 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.110+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94133969396384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb150 con 0x559d45cd9f60 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.111+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94133969396384] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f098c03c040 con 0x559d45cd9f60 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.111+0000 7f099c612800 20 remove_watcher() i=4 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.111+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94133969403264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce7220 con 0x559d45cde7d0 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.112+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94133969403264] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.112+0000 7f099c612800 20 remove_watcher() i=5 2024-05-08T09:22:47.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.112+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94133969405360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ceb150 con 0x559d45cde7d0 2024-05-08T09:22:47.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.114+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94133969405360] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.114+0000 7f099c612800 20 remove_watcher() i=6 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.114+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94133969409216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559d45ce7220 con 0x559d45cde7d0 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099855d640 1 -- 172.21.15.161:0/3529872095 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94133969409216] v29'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f09900083e0 con 0x559d45cde7d0 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 20 remove_watcher() i=7 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45cde7d0 msgr2=0x559d45ce0be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45cde7d0 0x559d45ce0be0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45cd9f60 msgr2=0x559d45cdc420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45cd9f60 0x559d45cdc420 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0988052030 msgr2=0x7f0988066ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0988052030 0x7f0988066ac0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559d45ce33f0 msgr2=0x559d45ce58b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559d45ce33f0 0x559d45ce58b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0860036a00 msgr2=0x7f0860038ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0860036a00 0x7f0860038ec0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f09880514a0 tx=0x7f0988091000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 msgr2=0x559d45cce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099755b640 1 -- 172.21.15.161:0/3529872095 reap_dead start 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f0990014830 tx=0x7f099004c7e0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 shutdown_connections 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 --2- 172.21.15.161:0/3529872095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cc6ed0 0x559d45cce490 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 >> 172.21.15.161:0/3529872095 conn(0x559d45cc3230 msgr2=0x559d45cc0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 shutdown_connections 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.115+0000 7f099c612800 1 -- 172.21.15.161:0/3529872095 wait complete. 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 msgr2=0x7f0870038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 0x7f0870038dc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x559d45ca6040 tx=0x7f09880513d0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 msgr2=0x559d45cb9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x559d45c9f230 tx=0x7f099000aea0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 shutdown_connections 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0870036900 0x7f0870038dc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/1269303886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45cb9b70 0x559d45cb9f90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 >> 172.21.15.161:0/1269303886 conn(0x559d45cadc10 msgr2=0x559d45cae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 shutdown_connections 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/1269303886 wait complete. 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 msgr2=0x559d45caa2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 0x559d45caa2e0 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 msgr2=0x559d45ca55a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 0x559d45ca55a0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 msgr2=0x7f0880038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 0x7f0880038e10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f098c001e10 tx=0x7f098c001390 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 msgr2=0x559d45c9e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f098800a190 tx=0x7f0988003330 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 shutdown_connections 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559d45ca7ef0 0x559d45caa2e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559d45ba3fa0 0x559d45ca55a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0880036950 0x7f0880038e10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 --2- 172.21.15.161:0/3929444706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559d45ba3640 0x559d45c9e360 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 >> 172.21.15.161:0/3929444706 conn(0x559d45b9cd30 msgr2=0x559d45c90a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 shutdown_connections 2024-05-08T09:22:47.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.116+0000 7f099c612800 1 -- 172.21.15.161:0/3929444706 wait complete. 2024-05-08T09:22:47.124 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-08T09:22:47.124 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-08T09:22:47.124 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-05-08T09:22:47.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-05-08T09:22:47.125 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-05-08T09:22:47.166 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.166 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.168+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.168+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.168+0000 7fdf94e12800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cea17df660 0x55cea17e1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.168+0000 7fdf94e12800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cea17e1f90 con 0x55cea17dbb50 2024-05-08T09:22:47.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.168+0000 7fdf94e12800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55cea166c050 con 0x55cea17df660 2024-05-08T09:22:47.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.169+0000 7fdf87fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cea17df660 0x55cea17e1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.169+0000 7fdf87fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cea17df660 0x55cea17e1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33056/0 (socket says 172.21.15.161:33056) 2024-05-08T09:22:47.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.169+0000 7fdf87fff640 1 -- 172.21.15.161:0/109803278 learned_addr learned my addr 172.21.15.161:0/109803278 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.169+0000 7fdf87fff640 1 -- 172.21.15.161:0/109803278 >> v1:172.21.15.45:6789/0 conn(0x55cea17dbb50 legacy=0x55cea17ddf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.169+0000 7fdf87fff640 1 -- 172.21.15.161:0/109803278 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea17e3170 con 0x55cea17df660 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf87fff640 1 --2- 172.21.15.161:0/109803278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17df660 0x55cea17e1a50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800a520 tx=0x7fdf7801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c40074dee41725d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf8fbed640 1 -- 172.21.15.161:0/109803278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf78057070 con 0x55cea17df660 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf8fbed640 1 -- 172.21.15.161:0/109803278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf78052570 con 0x55cea17df660 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf8fbed640 1 -- 172.21.15.161:0/109803278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf7804ae60 con 0x55cea17df660 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 -- 172.21.15.161:0/109803278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17df660 msgr2=0x55cea17e1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 --2- 172.21.15.161:0/109803278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17df660 0x55cea17e1a50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800a520 tx=0x7fdf7801d010 comp rx=0 tx=0).stop 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 -- 172.21.15.161:0/109803278 shutdown_connections 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 --2- 172.21.15.161:0/109803278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17df660 0x55cea17e1a50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 -- 172.21.15.161:0/109803278 >> 172.21.15.161:0/109803278 conn(0x55cea17d55a0 msgr2=0x55cea17d79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 -- 172.21.15.161:0/109803278 shutdown_connections 2024-05-08T09:22:47.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.171+0000 7fdf94e12800 1 -- 172.21.15.161:0/109803278 wait complete. 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.185+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.185+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf94e12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf94e12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cea17261c0 con 0x55cea17dbb50 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf903ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf903ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33062/0 (socket says 172.21.15.161:33062) 2024-05-08T09:22:47.185 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf903ee640 1 -- 172.21.15.161:0/3320209827 learned_addr learned my addr 172.21.15.161:0/3320209827 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf903ee640 1 -- 172.21.15.161:0/3320209827 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea18cccd0 con 0x55cea17dbb50 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.186+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3320209827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdf80001d20 tx=0x7fdf8000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cfd45fdbc54a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fde7e60c640 1 -- 172.21.15.161:0/3320209827 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8000f400 con 0x55cea17dbb50 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fde7e60c640 1 -- 172.21.15.161:0/3320209827 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8000f5a0 con 0x55cea17dbb50 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fde7e60c640 1 -- 172.21.15.161:0/3320209827 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8000f7d0 con 0x55cea17dbb50 2024-05-08T09:22:47.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 -- 172.21.15.161:0/3320209827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 msgr2=0x55cea18cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3320209827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fdf80001d20 tx=0x7fdf8000b5b0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 -- 172.21.15.161:0/3320209827 shutdown_connections 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3320209827 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18cc700 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 -- 172.21.15.161:0/3320209827 >> 172.21.15.161:0/3320209827 conn(0x55cea17d55a0 msgr2=0x55cea18c8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 -- 172.21.15.161:0/3320209827 shutdown_connections 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.187+0000 7fdf94e12800 1 -- 172.21.15.161:0/3320209827 wait complete. 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf94e12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf94e12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cea17e2460 con 0x55cea17dbb50 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf903ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf903ee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33074/0 (socket says 172.21.15.161:33074) 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf903ee640 1 -- 172.21.15.161:0/3332505073 learned_addr learned my addr 172.21.15.161:0/3332505073 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.188+0000 7fdf903ee640 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea18d47b0 con 0x55cea17dbb50 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cea18cd490 tx=0x7fdf80000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fde7ce09640 1 -- 172.21.15.161:0/3332505073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8001a690 con 0x55cea17dbb50 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fde7ce09640 1 -- 172.21.15.161:0/3332505073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8001a830 con 0x55cea17dbb50 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cea18d4a40 con 0x55cea17dbb50 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fde7ce09640 1 -- 172.21.15.161:0/3332505073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8001ab30 con 0x55cea17dbb50 2024-05-08T09:22:47.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.189+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea18d76f0 con 0x55cea17dbb50 2024-05-08T09:22:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fde7ce09640 1 -- 172.21.15.161:0/3332505073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdf80017070 con 0x55cea17dbb50 2024-05-08T09:22:47.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fde7ce09640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 0x7fde78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fde7ce09640 1 -- 172.21.15.161:0/3332505073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdf80015020 con 0x55cea17dbb50 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 0x7fde78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 0x55cea18db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea18dba30 con 0x55cea17df660 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fdf90bef640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 0x55cea18db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.190+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 0x7fde78038e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdf78054000 tx=0x7fdf7804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf90bef640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 0x55cea18db4b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf90bef640 1 -- 172.21.15.161:0/3332505073 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf8800a4a0 con 0x55cea17df660 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea18d8a80 con 0x55cea17df660 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf90bef640 1 -- 172.21.15.161:0/3332505073 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf8800a4a0 con 0x55cea17df660 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 0x55cea18e0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea18e0820 con 0x55cea18ddd40 2024-05-08T09:22:47.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.191+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 0x55cea18e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.192+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 0x55cea18e0130 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.192+0000 7fdf903ee640 1 -- 172.21.15.161:0/3332505073 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea18ddd40 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.192+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea18dccf0 con 0x55cea17df660 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.192+0000 7fdf90bef640 1 -- 172.21.15.161:0/3332505073 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf8800a4a0 con 0x55cea17df660 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.192+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea18dd1d0 con 0x55cea17df660 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf90bef640 1 -- 172.21.15.161:0/3332505073 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdf8800a4a0 con 0x55cea17df660 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf94e12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf94e12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cea16cccf0 con 0x55cea18ef990 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33078/0 (socket says 172.21.15.161:33078) 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.193+0000 7fdf90bef640 1 -- 172.21.15.161:0/1813967638 learned_addr learned my addr 172.21.15.161:0/1813967638 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fdf90bef640 1 -- 172.21.15.161:0/1813967638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea18f02f0 con 0x55cea18ef990 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fdf90bef640 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55cea18dbdf0 tx=0x7fdf88018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fde75ffb640 1 -- 172.21.15.161:0/1813967638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88014450 con 0x55cea18ef990 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fde75ffb640 1 -- 172.21.15.161:0/1813967638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf88014610 con 0x55cea18ef990 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cea18f0d60 con 0x55cea18ef990 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fde75ffb640 1 -- 172.21.15.161:0/1813967638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88014930 con 0x55cea18ef990 2024-05-08T09:22:47.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.194+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea18f1260 con 0x55cea18ef990 2024-05-08T09:22:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.195+0000 7fde75ffb640 1 -- 172.21.15.161:0/1813967638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdf88011040 con 0x55cea18ef990 2024-05-08T09:22:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.195+0000 7fde75ffb640 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 0x7fde68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.195+0000 7fde75ffb640 1 -- 172.21.15.161:0/1813967638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdf8801e070 con 0x55cea18ef990 2024-05-08T09:22:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.195+0000 7fdf903ee640 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 0x7fde68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.195+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf903ee640 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 0x7fde68038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55cea18dbe90 tx=0x7fdf8000e3e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf94e12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf94e12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cea18cd050 con 0x55cea18fcc70 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33084/0 (socket says 172.21.15.161:33084) 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf90bef640 1 -- 172.21.15.161:0/61678890 learned_addr learned my addr 172.21.15.161:0/61678890 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf90bef640 1 -- 172.21.15.161:0/61678890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea18fd660 con 0x55cea18fcc70 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fdf90bef640 1 --2- 172.21.15.161:0/61678890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdf8804c8c0 tx=0x7fdf880139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662b12cd931448f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fde6f7fe640 1 -- 172.21.15.161:0/61678890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88016960 con 0x55cea18fcc70 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fde6f7fe640 1 -- 172.21.15.161:0/61678890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf88016440 con 0x55cea18fcc70 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.196+0000 7fde6f7fe640 1 -- 172.21.15.161:0/61678890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88016b00 con 0x55cea18fcc70 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- 172.21.15.161:0/61678890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 msgr2=0x55cea18fd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 --2- 172.21.15.161:0/61678890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdf8804c8c0 tx=0x7fdf880139d0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- 172.21.15.161:0/61678890 shutdown_connections 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 --2- 172.21.15.161:0/61678890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea18fd090 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- 172.21.15.161:0/61678890 >> 172.21.15.161:0/61678890 conn(0x55cea18f8fd0 msgr2=0x55cea18f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- 172.21.15.161:0/61678890 shutdown_connections 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- 172.21.15.161:0/61678890 wait complete. 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 Processor -- start 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- start start 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.197+0000 7fdf94e12800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cea18fddd0 con 0x55cea18fcc70 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf90bef640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33090/0 (socket says 172.21.15.161:33090) 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 learned_addr learned my addr 172.21.15.161:0/3711308794 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea1904760 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf90bef640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdf880119b0 tx=0x7fdf8804c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fde6dffb640 1 -- 172.21.15.161:0/3711308794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf88014e50 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fde6dffb640 1 -- 172.21.15.161:0/3711308794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8803bd20 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fde6dffb640 1 -- 172.21.15.161:0/3711308794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdf8804e0d0 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cea19049f0 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.198+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea19076a0 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.199+0000 7fde6dffb640 1 -- 172.21.15.161:0/3711308794 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fdf8804e270 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.199+0000 7fde6dffb640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde60036aa0 0x7fde60038f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.199+0000 7fde6dffb640 1 -- 172.21.15.161:0/3711308794 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fdf8800e040 con 0x55cea18fcc70 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.199+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde60036aa0 0x7fde60038f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea190fd40 0x55cea1912200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1912950 con 0x55cea190fd40 2024-05-08T09:22:47.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea190fd40 0x55cea1912200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde60036aa0 0x7fde60038f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000f550 tx=0x7fdf80044500 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea190fd40 0x55cea1912200 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 realm 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1912d20 con 0x55cea190fd40 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.200+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea19135f0 con 0x55cea190fd40 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1913990 con 0x55cea190fd40 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea1914440 0x55cea1916870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1916fd0 con 0x55cea1914440 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.201+0000 7fdf90bef640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea1914440 0x55cea1916870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf90bef640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea1914440 0x55cea1916870 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf94e12800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf94e12800 20 searching for the correct realm 2024-05-08T09:22:47.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cea1919080 0x55cea191b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cea1919080 0x55cea191b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.202+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cea1919080 0x55cea191b540 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf903ee640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fdf8004c810 0x7fdf8000e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fdf8004c810 0x7fdf8000e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf87fff640 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fdf8004c810 0x7fdf8000e590 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.203+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.204+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.205+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.206+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.207+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.208+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.209+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1914440 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.210+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea1919080 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x55cea190fd40 2024-05-08T09:22:47.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.211+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cea191bc10 con 0x7fdf8004c810 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1917a80 con 0x55cea190fd40 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1917f00 con 0x55cea190fd40 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea19183e0 con 0x55cea190fd40 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 zone default found 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 4 Realm: () 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 zonegroup default 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.212+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea191c090 con 0x55cea1914440 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea191e2c0 con 0x55cea1919080 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea191e660 con 0x55cea1919080 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 started sync module instance, tier type = 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.213+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191d700 con 0x7fdf8004c810 2024-05-08T09:22:47.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.214+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.214+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345962314480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191d700 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.214+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191f020 con 0x55cea190fd40 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.215+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345962314480] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.216+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.216+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345962312752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191f020 con 0x55cea190fd40 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.216+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191f9e0 con 0x55cea1919080 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.217+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345962312752] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.217+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.217+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345962318704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191ef90 con 0x55cea1919080 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.217+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea19208a0 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.218+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.218+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345962318704] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.218+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345962325456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1921140 con 0x7fdf8004c810 2024-05-08T09:22:47.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.218+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191fdd0 con 0x55cea190fd40 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.219+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345962325456] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.219+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.219+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345962327104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1921060 con 0x55cea190fd40 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.219+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1922020 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.220+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.220+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345962327104] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.221+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345962329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1922410 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.221+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1922dd0 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.221+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345962329728] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.222+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.222+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345962330784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1922dd0 con 0x55cea1914440 2024-05-08T09:22:47.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.222+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923830 con 0x55cea1914440 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345962330784] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345962337040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923a10 con 0x55cea1914440 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=0 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=1 2024-05-08T09:22:47.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=2 2024-05-08T09:22:47.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=3 2024-05-08T09:22:47.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=4 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=5 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.223+0000 7fdf94e12800 20 add_watcher() i=6 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345962337040] v29'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf94e12800 20 add_watcher() i=7 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf94e12800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea1926de0 con 0x55cea190fd40 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.224+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345962338560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea19241d0 con 0x55cea190fd40 2024-05-08T09:22:47.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.225+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345962338560] v29'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.225+0000 7fde467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.225+0000 7fdf94e12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.225+0000 7fdf94e12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.225+0000 7fdf94e12800 5 note: GC not initialized 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fde457e2640 20 reqs_thread_entry: start 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf94e12800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf94e12800 20 Filter name: none 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fddb6ffd640 20 reqs_thread_entry: start 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195a740 con 0x55cea190fd40 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195a740 con 0x7fdf8004c810 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195a700 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.226+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195a700 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195abc0 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195b010 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195b010 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.227+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195b010 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195b010 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195afc0 con 0x55cea1919080 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.228+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195afc0 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x7fdf8004c810 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.229+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv5 ondisk = 0) ==== 152+0+163 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.230+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x7fdf8004c810 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.231+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.232+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1919080 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.233+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cea195cb90 con 0x55cea1914440 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.234+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.235+0000 7fde467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.235+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345962338560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea195c6e0 con 0x55cea190fd40 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.236+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94345962338560] v29'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.236+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345962314480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923900 con 0x7fdf8004c810 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.237+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94345962314480] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.237+0000 7fdf94e12800 20 remove_watcher() i=0 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.237+0000 7fdf94e12800 2 removed watcher, disabling cache 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.237+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345962312752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923900 con 0x55cea190fd40 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.238+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94345962312752] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.252 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.238+0000 7fdf94e12800 20 remove_watcher() i=1 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.238+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345962318704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191d430 con 0x55cea1919080 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.239+0000 7fdf903ee640 1 -- 172.21.15.161:0/3711308794 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94345962318704] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8002e070 con 0x55cea1919080 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.239+0000 7fdf94e12800 20 remove_watcher() i=2 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.239+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345962325456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923900 con 0x7fdf8004c810 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.240+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94345962325456] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x7fdf8004c810 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.240+0000 7fdf94e12800 20 remove_watcher() i=3 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.240+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345962327104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea191eb70 con 0x55cea190fd40 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.241+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94345962327104] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf7805a040 con 0x55cea190fd40 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.241+0000 7fdf94e12800 20 remove_watcher() i=4 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.241+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345962329728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea19205d0 con 0x55cea1914440 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.242+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94345962329728] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.242+0000 7fdf94e12800 20 remove_watcher() i=5 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.242+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345962330784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1923900 con 0x55cea1914440 2024-05-08T09:22:47.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.243+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94345962330784] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.243+0000 7fdf94e12800 20 remove_watcher() i=6 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.243+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345962337040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cea1920c40 con 0x55cea1914440 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf90bef640 1 -- 172.21.15.161:0/3711308794 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94345962337040] v29'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdf8802a070 con 0x55cea1914440 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 20 remove_watcher() i=7 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea1914440 msgr2=0x55cea1916870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea1914440 0x55cea1916870 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea190fd40 msgr2=0x55cea1912200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea190fd40 0x55cea1912200 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fdf8004c810 msgr2=0x7fdf8000e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fdf8004c810 0x7fdf8000e590 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cea1919080 msgr2=0x55cea191b540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cea1919080 0x55cea191b540 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde60036aa0 msgr2=0x7fde60038f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde60036aa0 0x7fde60038f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000f550 tx=0x7fdf80044500 comp rx=0 tx=0).stop 2024-05-08T09:22:47.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf87fff640 1 -- 172.21.15.161:0/3711308794 reap_dead start 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 msgr2=0x55cea1904220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fdf880119b0 tx=0x7fdf8804c850 comp rx=0 tx=0).stop 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 shutdown_connections 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3711308794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18fcc70 0x55cea1904220 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 >> 172.21.15.161:0/3711308794 conn(0x55cea18f8fd0 msgr2=0x55cea18f6630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 shutdown_connections 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.244+0000 7fdf94e12800 1 -- 172.21.15.161:0/3711308794 wait complete. 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 msgr2=0x7fde68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 0x7fde68038dc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x55cea18dbe90 tx=0x7fdf8000e3e0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 msgr2=0x55cea18efdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55cea18dbdf0 tx=0x7fdf88018830 comp rx=0 tx=0).stop 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 shutdown_connections 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde68036900 0x7fde68038dc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/1813967638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea18ef990 0x55cea18efdb0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 >> 172.21.15.161:0/1813967638 conn(0x55cea18e3a30 msgr2=0x55cea18e3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 shutdown_connections 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/1813967638 wait complete. 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 msgr2=0x55cea18e0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 0x55cea18e0130 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 msgr2=0x55cea18db4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 0x55cea18db4b0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 msgr2=0x7fde78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 0x7fde78038e10 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdf78054000 tx=0x7fdf7804e000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 msgr2=0x55cea18d4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x55cea18cd490 tx=0x7fdf80000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 shutdown_connections 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cea18ddd40 0x55cea18e0130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cea17df660 0x55cea18db4b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fde78036950 0x7fde78038e10 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 --2- 172.21.15.161:0/3332505073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cea17dbb50 0x55cea18d4270 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 >> 172.21.15.161:0/3332505073 conn(0x55cea17d55a0 msgr2=0x55cea18c6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 shutdown_connections 2024-05-08T09:22:47.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.245+0000 7fdf94e12800 1 -- 172.21.15.161:0/3332505073 wait complete. 2024-05-08T09:22:47.258 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-08T09:22:47.258 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-08T09:22:47.258 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T09:22:47.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T09:22:47.259 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T09:22:47.342 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.342 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d3c71f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5617df0736e0 0x5617df075ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d3c71f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5617df076010 con 0x5617df06fbd0 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d3c71f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5617def00050 con 0x5617df0736e0 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5617df0736e0 0x5617df075ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d2ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5617df0736e0 0x5617df075ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33102/0 (socket says 172.21.15.161:33102) 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d2ffff640 1 -- 172.21.15.161:0/3812027620 learned_addr learned my addr 172.21.15.161:0/3812027620 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.344+0000 7f0d383ca640 1 --1- 172.21.15.161:0/3812027620 >> v1:172.21.15.45:6789/0 conn(0x5617df06fbd0 0x5617df071fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55458/0 (socket says 172.21.15.161:55458) 2024-05-08T09:22:47.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.345+0000 7f0d2ffff640 1 -- 172.21.15.161:0/3812027620 >> v1:172.21.15.45:6789/0 conn(0x5617df06fbd0 legacy=0x5617df071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.345+0000 7f0d2ffff640 1 -- 172.21.15.161:0/3812027620 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df0771f0 con 0x5617df0736e0 2024-05-08T09:22:47.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.346+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/3812027620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df0736e0 0x5617df075ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000a520 tx=0x7f0d2001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed85ed5bb13034b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d37bc9640 1 -- 172.21.15.161:0/3812027620 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d20057070 con 0x5617df0736e0 2024-05-08T09:22:47.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d37bc9640 1 -- 172.21.15.161:0/3812027620 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d20052570 con 0x5617df0736e0 2024-05-08T09:22:47.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d37bc9640 1 -- 172.21.15.161:0/3812027620 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2004ae60 con 0x5617df0736e0 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3812027620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df0736e0 msgr2=0x5617df075ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/3812027620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df0736e0 0x5617df075ad0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0d2000a520 tx=0x7f0d2001d010 comp rx=0 tx=0).stop 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3812027620 shutdown_connections 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/3812027620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df0736e0 0x5617df075ad0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3812027620 >> 172.21.15.161:0/3812027620 conn(0x5617df0695a0 msgr2=0x5617df06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3812027620 shutdown_connections 2024-05-08T09:22:47.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.347+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3812027620 wait complete. 2024-05-08T09:22:47.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d3c71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d3c71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5617defba1d0 con 0x5617df06fbd0 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d383ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d383ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33106/0 (socket says 172.21.15.161:33106) 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d383ca640 1 -- 172.21.15.161:0/3778819011 learned_addr learned my addr 172.21.15.161:0/3778819011 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d383ca640 1 -- 172.21.15.161:0/3778819011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df160cb0 con 0x5617df06fbd0 2024-05-08T09:22:47.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.362+0000 7f0d383ca640 1 --2- 172.21.15.161:0/3778819011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001e90 tx=0x7f0d2800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2e9af95cc6da42 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0c2660c640 1 -- 172.21.15.161:0/3778819011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2800e5c0 con 0x5617df06fbd0 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0c2660c640 1 -- 172.21.15.161:0/3778819011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d28006070 con 0x5617df06fbd0 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0c2660c640 1 -- 172.21.15.161:0/3778819011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2800e890 con 0x5617df06fbd0 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3778819011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 msgr2=0x5617df1606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/3778819011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001e90 tx=0x7f0d2800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3778819011 shutdown_connections 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/3778819011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df1606e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3778819011 >> 172.21.15.161:0/3778819011 conn(0x5617df0695a0 msgr2=0x5617df15c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3778819011 shutdown_connections 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.363+0000 7f0d3c71f800 1 -- 172.21.15.161:0/3778819011 wait complete. 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d3c71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d3c71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5617df0764e0 con 0x5617df06fbd0 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d383ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d383ca640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33110/0 (socket says 172.21.15.161:33110) 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.364+0000 7f0d383ca640 1 -- 172.21.15.161:0/598136984 learned_addr learned my addr 172.21.15.161:0/598136984 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0d383ca640 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df1687c0 con 0x5617df06fbd0 2024-05-08T09:22:47.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0d383ca640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001ed0 tx=0x7f0d28000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0c24e09640 1 -- 172.21.15.161:0/598136984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2801a880 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0c24e09640 1 -- 172.21.15.161:0/598136984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2801aa20 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0c24e09640 1 -- 172.21.15.161:0/598136984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d2801ad40 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617df168a50 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.365+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617df16b700 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0c24e09640 1 -- 172.21.15.161:0/598136984 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d28017070 con 0x5617df06fbd0 2024-05-08T09:22:47.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0c24e09640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 0x7f0c20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0c24e09640 1 -- 172.21.15.161:0/598136984 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0d28015020 con 0x5617df06fbd0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 0x7f0c20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 0x5617df16f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df16fa90 con 0x5617df0736e0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.366+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 0x5617df16f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 0x7f0c20038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d20054000 tx=0x7f0d2004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 0x5617df16f4c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d38bcb640 1 -- 172.21.15.161:0/598136984 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d3000a4a0 con 0x5617df0736e0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df16ca70 con 0x5617df0736e0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d38bcb640 1 -- 172.21.15.161:0/598136984 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d3000a4a0 con 0x5617df0736e0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 0x5617df174190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.367+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df174830 con 0x5617df171da0 2024-05-08T09:22:47.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.368+0000 7f0d383ca640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 0x5617df174190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.368+0000 7f0d383ca640 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 0x5617df174190 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d383ca640 1 -- 172.21.15.161:0/598136984 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0d2802e070 con 0x5617df171da0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df170d50 con 0x5617df0736e0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d38bcb640 1 -- 172.21.15.161:0/598136984 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d3000a4a0 con 0x5617df0736e0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df171230 con 0x5617df0736e0 2024-05-08T09:22:47.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d38bcb640 1 -- 172.21.15.161:0/598136984 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0d3000a4a0 con 0x5617df0736e0 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.369+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d3c71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d3c71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5617def60cf0 con 0x5617df06f770 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33126/0 (socket says 172.21.15.161:33126) 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2529747779 learned_addr learned my addr 172.21.15.161:0/2529747779 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2529747779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df06e120 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x5617df169150 tx=0x7f0d300188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0c1dffb640 1 -- 172.21.15.161:0/2529747779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d30014450 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0c1dffb640 1 -- 172.21.15.161:0/2529747779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d300145f0 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.370+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617df06e3b0 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.371+0000 7f0c1dffb640 1 -- 172.21.15.161:0/2529747779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d300148d0 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.371+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617df06e8b0 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.371+0000 7f0c1dffb640 1 -- 172.21.15.161:0/2529747779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d30011040 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0c1dffb640 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 0x7f0c10038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0c1dffb640 1 -- 172.21.15.161:0/2529747779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0d3001e070 con 0x5617df06f770 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 0x7f0c10038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 0x7f0c10038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5617df16fee0 tx=0x7f0d2804b360 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d3c71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d3c71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5617df161030 con 0x5617df192ef0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.372+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33136/0 (socket says 172.21.15.161:33136) 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d38bcb640 1 -- 172.21.15.161:0/96615722 learned_addr learned my addr 172.21.15.161:0/96615722 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d38bcb640 1 -- 172.21.15.161:0/96615722 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df1938e0 con 0x5617df192ef0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/96615722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d3004c890 tx=0x7f0d30011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3369457bbb2ae75 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0c177fe640 1 -- 172.21.15.161:0/96615722 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d30013c80 con 0x5617df192ef0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0c177fe640 1 -- 172.21.15.161:0/96615722 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d30013e20 con 0x5617df192ef0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0c177fe640 1 -- 172.21.15.161:0/96615722 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3004b350 con 0x5617df192ef0 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d3c71f800 1 -- 172.21.15.161:0/96615722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 msgr2=0x5617df193310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.373+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/96615722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f0d3004c890 tx=0x7f0d30011700 comp rx=0 tx=0).stop 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- 172.21.15.161:0/96615722 shutdown_connections 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/96615722 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df193310 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- 172.21.15.161:0/96615722 >> 172.21.15.161:0/96615722 conn(0x5617df18f250 msgr2=0x5617df18d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- 172.21.15.161:0/96615722 shutdown_connections 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- 172.21.15.161:0/96615722 wait complete. 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 Processor -- start 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- start start 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d3c71f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5617df194050 con 0x5617df192ef0 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d38bcb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33146/0 (socket says 172.21.15.161:33146) 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 learned_addr learned my addr 172.21.15.161:0/2662246478 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.374+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617df19a9d0 con 0x5617df192ef0 2024-05-08T09:22:47.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d30040040 tx=0x7f0d3004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0c15ffb640 1 -- 172.21.15.161:0/2662246478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d30031030 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0c15ffb640 1 -- 172.21.15.161:0/2662246478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3004e3f0 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5617df19ac60 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0c15ffb640 1 -- 172.21.15.161:0/2662246478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d3002bbd0 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.375+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617df19d910 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0c15ffb640 1 -- 172.21.15.161:0/2662246478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d30034030 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0c15ffb640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c08036950 0x7f0c08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0c15ffb640 1 -- 172.21.15.161:0/2662246478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0d30032070 con 0x5617df192ef0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c08036950 0x7f0c08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df1a5f10 0x5617df1a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1a8b20 con 0x5617df1a5f10 2024-05-08T09:22:47.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df1a5f10 0x5617df1a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.376+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c08036950 0x7f0c08038e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d280178f0 tx=0x7f0d28034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df1a5f10 0x5617df1a83d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 realm 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1a8ef0 con 0x5617df1a5f10 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1a97c0 con 0x5617df1a5f10 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1a9b60 con 0x5617df1a5f10 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.377+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df1aa610 0x5617df1aca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1ad1a0 con 0x5617df1aa610 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df1aa610 0x5617df1aca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d38bcb640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df1aa610 0x5617df1aca40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 20 searching for the correct realm 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5617df1af250 0x5617df1b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.378+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5617df1af250 0x5617df1b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5617df1af250 0x5617df1b1710 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d383ca640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0d2800f070 0x7f0d2803f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.379+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0d2800f070 0x7f0d2803f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.380+0000 7f0d2ffff640 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0d2800f070 0x7f0d2803f160 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.380+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.380+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.380+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.380+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.381+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.382+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.383+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.384+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.399 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.385+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.386+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1aa610 2024-05-08T09:22:47.400 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1af250 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x5617df1a5f10 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.387+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b1de0 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1adc50 con 0x5617df1a5f10 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1ae0d0 con 0x5617df1a5f10 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1ae570 con 0x5617df1a5f10 2024-05-08T09:22:47.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.388+0000 7f0d3c71f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 zone default found 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 4 Realm: () 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 zonegroup default 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b2260 con 0x5617df1aa610 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1ad890 con 0x5617df1af250 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.389+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b45a0 con 0x5617df1af250 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.390+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.390+0000 7f0d3c71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.390+0000 7f0d3c71f800 20 started sync module instance, tier type = 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.390+0000 7f0d3c71f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.390+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b3920 con 0x7f0d2800f070 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.391+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.391+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94660527341120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b3920 con 0x7f0d2800f070 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.391+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b50f0 con 0x5617df1a5f10 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.392+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.392+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94660527344576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b50f0 con 0x5617df1a5f10 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.392+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b60f0 con 0x5617df1af250 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.392+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94660527341120] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.393+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94660527344576] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.393+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.393+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94660527348704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b54e0 con 0x5617df1af250 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.393+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b6990 con 0x7f0d2800f070 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.394+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94660527348704] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.394+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.394+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94660527351008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b6db0 con 0x7f0d2800f070 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.394+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b7770 con 0x5617df1a5f10 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.395+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.395+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94660527354560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b76e0 con 0x5617df1a5f10 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.395+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b86f0 con 0x5617df1aa610 2024-05-08T09:22:47.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.396+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94660527351008] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.396+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94660527354560] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.396+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.396+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94660527358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b86b0 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.397+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b8fc0 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.398+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(56 notify.6 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.398+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94660527360704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9390 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.398+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9be0 con 0x5617df1aa610 2024-05-08T09:22:47.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.398+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94660527358432] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94660527360704] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94660527361760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b97b0 con 0x5617df1aa610 2024-05-08T09:22:47.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=0 2024-05-08T09:22:47.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=1 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=2 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=3 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=4 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=5 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.399+0000 7f0d3c71f800 20 add_watcher() i=6 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94660527361760] v29'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d3c71f800 20 add_watcher() i=7 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d3c71f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1bca20 con 0x5617df1a5f10 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.400+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94660527363184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9d40 con 0x5617df1a5f10 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.401+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94660527363184] v29'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.401+0000 7f0bee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.401+0000 7f0d3c71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.401+0000 7f0d3c71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.401+0000 7f0d3c71f800 5 note: GC not initialized 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0bed7e2640 20 reqs_thread_entry: start 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 20 Filter name: none 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0b5effd640 20 reqs_thread_entry: start 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1efa30 con 0x5617df1a5f10 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.402+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5617df1f0e20 con 0x5617df1aa610 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.403+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.404+0000 7f0bee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.404+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94660527363184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1a35f0 con 0x5617df1a5f10 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.405+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94660527363184] v29'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.405+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94660527341120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9470 con 0x7f0d2800f070 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.406+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94660527341120] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.406+0000 7f0d3c71f800 20 remove_watcher() i=0 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.406+0000 7f0d3c71f800 2 removed watcher, disabling cache 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.406+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94660527344576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9470 con 0x5617df1a5f10 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.407+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94660527344576] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.407+0000 7f0d3c71f800 20 remove_watcher() i=1 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.407+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94660527348704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b9470 con 0x5617df1af250 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.408+0000 7f0d383ca640 1 -- 172.21.15.161:0/2662246478 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94660527348704] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2804e040 con 0x5617df1af250 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.408+0000 7f0d3c71f800 20 remove_watcher() i=2 2024-05-08T09:22:47.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.408+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94660527351008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b3e40 con 0x7f0d2800f070 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.409+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94660527351008] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x7f0d2800f070 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.409+0000 7f0d3c71f800 20 remove_watcher() i=3 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.409+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94660527354560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b3e40 con 0x5617df1a5f10 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.410+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94660527354560] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d2005a040 con 0x5617df1a5f10 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.410+0000 7f0d3c71f800 20 remove_watcher() i=4 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.410+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94660527358432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b72c0 con 0x5617df1aa610 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.411+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94660527358432] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.411+0000 7f0d3c71f800 20 remove_watcher() i=5 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.411+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94660527360704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b3e40 con 0x5617df1aa610 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.412+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94660527360704] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.412+0000 7f0d3c71f800 20 remove_watcher() i=6 2024-05-08T09:22:47.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.412+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94660527361760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5617df1b81e0 con 0x5617df1aa610 2024-05-08T09:22:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d38bcb640 1 -- 172.21.15.161:0/2662246478 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94660527361760] v29'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0d3002a070 con 0x5617df1aa610 2024-05-08T09:22:47.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 20 remove_watcher() i=7 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df1aa610 msgr2=0x5617df1aca40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df1aa610 0x5617df1aca40 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df1a5f10 msgr2=0x5617df1a83d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df1a5f10 0x5617df1a83d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0d2800f070 msgr2=0x7f0d2803f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0d2800f070 0x7f0d2803f160 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5617df1af250 msgr2=0x5617df1b1710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5617df1af250 0x5617df1b1710 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c08036950 msgr2=0x7f0c08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c08036950 0x7f0c08038e10 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0d280178f0 tx=0x7f0d28034000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 msgr2=0x5617df19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d2ffff640 1 -- 172.21.15.161:0/2662246478 reap_dead start 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f0d30040040 tx=0x7f0d3004c820 comp rx=0 tx=0).stop 2024-05-08T09:22:47.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 shutdown_connections 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2662246478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df192ef0 0x5617df19a490 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 >> 172.21.15.161:0/2662246478 conn(0x5617df18f250 msgr2=0x5617df18c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 shutdown_connections 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.413+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2662246478 wait complete. 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 msgr2=0x7f0c10038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 0x7f0c10038dc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5617df16fee0 tx=0x7f0d2804b360 comp rx=0 tx=0).stop 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 msgr2=0x5617df06dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x5617df169150 tx=0x7f0d300188f0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 shutdown_connections 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c10036900 0x7f0c10038dc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/2529747779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06f770 0x5617df06dbe0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 >> 172.21.15.161:0/2529747779 conn(0x5617df177a80 msgr2=0x5617df177e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 shutdown_connections 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/2529747779 wait complete. 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 msgr2=0x5617df174190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 0x5617df174190 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 msgr2=0x5617df16f4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 0x5617df16f4c0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 msgr2=0x7f0c20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 0x7f0c20038dc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0d20054000 tx=0x7f0d2004e000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 msgr2=0x5617df168280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0d28001ed0 tx=0x7f0d28000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 shutdown_connections 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5617df171da0 0x5617df174190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5617df0736e0 0x5617df16f4c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0c20036900 0x7f0c20038dc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 --2- 172.21.15.161:0/598136984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5617df06fbd0 0x5617df168280 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 >> 172.21.15.161:0/598136984 conn(0x5617df0695a0 msgr2=0x5617df15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 shutdown_connections 2024-05-08T09:22:47.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.414+0000 7f0d3c71f800 1 -- 172.21.15.161:0/598136984 wait complete. 2024-05-08T09:22:47.422 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-05-08T09:22:47.423 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-05-08T09:22:47.423 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T09:22:47.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-05-08T09:22:47.423 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-05-08T09:22:47.469 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.469 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc9f33800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5611a3748be0 0x5611a374afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc9f33800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5611a374f020 con 0x5611a374b510 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc9f33800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5611a35d9050 con 0x5611a3748be0 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc5bf5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5611a3748be0 0x5611a374afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc53f4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5611a374b510 0x5611a374d900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55464/0 (socket says 172.21.15.161:55464) 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.471+0000 7f4dc53f4640 1 -- 172.21.15.161:0/701514840 learned_addr learned my addr 172.21.15.161:0/701514840 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.472+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/701514840 >> v1:172.21.15.45:6789/0 conn(0x5611a374b510 legacy=0x5611a374d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.471 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.472+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/701514840 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a3750200 con 0x5611a3748be0 2024-05-08T09:22:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/701514840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a374afd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a470 tx=0x7f4db801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08eed502cc34b6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc4bf3640 1 -- 172.21.15.161:0/701514840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8057070 con 0x5611a3748be0 2024-05-08T09:22:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc4bf3640 1 -- 172.21.15.161:0/701514840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db8052570 con 0x5611a3748be0 2024-05-08T09:22:47.473 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc4bf3640 1 -- 172.21.15.161:0/701514840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8052870 con 0x5611a3748be0 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 -- 172.21.15.161:0/701514840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 msgr2=0x5611a374afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/701514840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a374afd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a470 tx=0x7f4db801ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 -- 172.21.15.161:0/701514840 shutdown_connections 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/701514840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a374afd0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 -- 172.21.15.161:0/701514840 >> 172.21.15.161:0/701514840 conn(0x5611a37425b0 msgr2=0x5611a37449d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.474 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 -- 172.21.15.161:0/701514840 shutdown_connections 2024-05-08T09:22:47.475 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.474+0000 7f4dc9f33800 1 -- 172.21.15.161:0/701514840 wait complete. 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc9f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc9f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a36931c0 con 0x5611a3748be0 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc5bf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc5bf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33166/0 (socket says 172.21.15.161:33166) 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.489+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/2034079039 learned_addr learned my addr 172.21.15.161:0/2034079039 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.490+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/2034079039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a3839d00 con 0x5611a3748be0 2024-05-08T09:22:47.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.490+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/2034079039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4db8055040 tx=0x7f4db804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc63a9fe94cfc135 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.490+0000 7f4cb3e07640 1 -- 172.21.15.161:0/2034079039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8057040 con 0x5611a3748be0 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.490+0000 7f4cb3e07640 1 -- 172.21.15.161:0/2034079039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db8052990 con 0x5611a3748be0 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.490+0000 7f4cb3e07640 1 -- 172.21.15.161:0/2034079039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8052c70 con 0x5611a3748be0 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2034079039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 msgr2=0x5611a3839730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2034079039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4db8055040 tx=0x7f4db804c000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2034079039 shutdown_connections 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2034079039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3839730 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2034079039 >> 172.21.15.161:0/2034079039 conn(0x5611a37425b0 msgr2=0x5611a3835050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2034079039 shutdown_connections 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2034079039 wait complete. 2024-05-08T09:22:47.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc9f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a374f490 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.491+0000 7f4dc5bf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc5bf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33168/0 (socket says 172.21.15.161:33168) 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/2887337513 learned_addr learned my addr 172.21.15.161:0/2887337513 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a3746c30 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a470 tx=0x7f4db8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4cb2604640 1 -- 172.21.15.161:0/2887337513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8073070 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4cb2604640 1 -- 172.21.15.161:0/2887337513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db805d780 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611a3746ec0 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4cb2604640 1 -- 172.21.15.161:0/2887337513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4db8057070 con 0x5611a3748be0 2024-05-08T09:22:47.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.492+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a37473e0 con 0x5611a3748be0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4cb2604640 1 -- 172.21.15.161:0/2887337513 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4db8076070 con 0x5611a3748be0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4cb2604640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 0x7f4cac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4cb2604640 1 -- 172.21.15.161:0/2887337513 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4db808e110 con 0x5611a3748be0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 0x7f4cac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 0x5611a384a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a384ac00 con 0x5611a374b510 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.493+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 0x5611a384a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 0x7f4cac038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000f60 tx=0x7f4dbc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 0x5611a384a6c0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc63f6640 1 -- 172.21.15.161:0/2887337513 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dc000a4a0 con 0x5611a374b510 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a37478b0 con 0x5611a374b510 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc63f6640 1 -- 172.21.15.161:0/2887337513 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dc000a4a0 con 0x5611a374b510 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 0x5611a384f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.494+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a384f980 con 0x5611a384cea0 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.495+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 0x5611a384f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.495+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 0x5611a384f290 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.495+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/2887337513 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4db8075030 con 0x5611a384cea0 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.495+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a384be80 con 0x5611a374b510 2024-05-08T09:22:47.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc63f6640 1 -- 172.21.15.161:0/2887337513 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dc000a4a0 con 0x5611a374b510 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a384c2a0 con 0x5611a374b510 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc63f6640 1 -- 172.21.15.161:0/2887337513 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4dc000a4a0 con 0x5611a374b510 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc9f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.496+0000 7f4dc9f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a3639cf0 con 0x5611a385ea80 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33172/0 (socket says 172.21.15.161:33172) 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc63f6640 1 -- 172.21.15.161:0/314529664 learned_addr learned my addr 172.21.15.161:0/314529664 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc63f6640 1 -- 172.21.15.161:0/314529664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a385f3e0 con 0x5611a385ea80 2024-05-08T09:22:47.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5611a3748b70 tx=0x7f4dc0012fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4cab7fe640 1 -- 172.21.15.161:0/314529664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0014450 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4cab7fe640 1 -- 172.21.15.161:0/314529664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc00145f0 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611a385fe50 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4cab7fe640 1 -- 172.21.15.161:0/314529664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0014910 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.497+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a3860350 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.498+0000 7f4cab7fe640 1 -- 172.21.15.161:0/314529664 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4dc0011040 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.498+0000 7f4cab7fe640 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 0x7f4ca0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.498+0000 7f4cab7fe640 1 -- 172.21.15.161:0/314529664 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4dc001e070 con 0x5611a385ea80 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 0x7f4ca0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 0x7f4ca0038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5611a384b010 tx=0x7f4db808c370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc9f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc9f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a3839fc0 con 0x5611a386bdb0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33182/0 (socket says 172.21.15.161:33182) 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc63f6640 1 -- 172.21.15.161:0/1182323596 learned_addr learned my addr 172.21.15.161:0/1182323596 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.499+0000 7f4dc63f6640 1 -- 172.21.15.161:0/1182323596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a386c7a0 con 0x5611a386bdb0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/1182323596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4dc004ca80 tx=0x7f4dc002b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6759243ffd52ecc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4ca97fa640 1 -- 172.21.15.161:0/1182323596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc00113f0 con 0x5611a386bdb0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4ca97fa640 1 -- 172.21.15.161:0/1182323596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc0011c40 con 0x5611a386bdb0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4ca97fa640 1 -- 172.21.15.161:0/1182323596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc002b820 con 0x5611a386bdb0 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 -- 172.21.15.161:0/1182323596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 msgr2=0x5611a386c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/1182323596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4dc004ca80 tx=0x7f4dc002b720 comp rx=0 tx=0).stop 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 -- 172.21.15.161:0/1182323596 shutdown_connections 2024-05-08T09:22:47.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/1182323596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a386c1d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 -- 172.21.15.161:0/1182323596 >> 172.21.15.161:0/1182323596 conn(0x5611a38680c0 msgr2=0x5611a3866120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 -- 172.21.15.161:0/1182323596 shutdown_connections 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 -- 172.21.15.161:0/1182323596 wait complete. 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.500+0000 7f4dc9f33800 1 Processor -- start 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc9f33800 1 -- start start 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc9f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc9f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5611a386cef0 con 0x5611a386bdb0 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc63f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33196/0 (socket says 172.21.15.161:33196) 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 learned_addr learned my addr 172.21.15.161:0/248884310 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a3873850 con 0x5611a386bdb0 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4dc002bf70 tx=0x7f4dc004ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4c977fe640 1 -- 172.21.15.161:0/248884310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0031070 con 0x5611a386bdb0 2024-05-08T09:22:47.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4c977fe640 1 -- 172.21.15.161:0/248884310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc00113f0 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.501+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5611a3873ae0 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.502+0000 7f4c977fe640 1 -- 172.21.15.161:0/248884310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4dc0028040 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.502+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a3876790 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.502+0000 7f4c977fe640 1 -- 172.21.15.161:0/248884310 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4dc0034070 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.502+0000 7f4c977fe640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c90036900 0x7f4c90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.502+0000 7f4c977fe640 1 -- 172.21.15.161:0/248884310 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4dc000e040 con 0x5611a386bdb0 2024-05-08T09:22:47.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c90036900 0x7f4c90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a387edb0 0x5611a3881270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a38819c0 con 0x5611a387edb0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a387edb0 0x5611a3881270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c90036900 0x7f4c90038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006d80 tx=0x7f4db8088000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a387edb0 0x5611a3881270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dbc009050 con 0x5611a387edb0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 20 realm 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.503+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a387e200 con 0x5611a387edb0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dbc009050 con 0x5611a387edb0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a38824a0 con 0x5611a387edb0 2024-05-08T09:22:47.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dbc009050 con 0x5611a387edb0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a3882d70 con 0x5611a387edb0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4dbc009050 con 0x5611a387edb0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a3883620 0x5611a3885a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.504+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a3886150 con 0x5611a3883620 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a3883620 0x5611a3885a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc63f6640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a3883620 0x5611a3885a10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc9f33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc9f33800 20 searching for the correct realm 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5611a3888200 0x5611a388a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3888200 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.505+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5611a3888200 0x5611a388a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.506+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5611a3888200 0x5611a388a6c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.506+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.506+0000 7f4dc5bf5640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4db8078060 0x7f4db8076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.506+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x7f4db8078060 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.506+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4db8078060 0x7f4db8076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc53f4640 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4db8078060 0x7f4db8076360 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc009050 con 0x7f4db8078060 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3883620 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a387edb0 2024-05-08T09:22:47.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc009050 con 0x5611a387edb0 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.507+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a387edb0 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3883620 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3883620 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x7f4db8078060 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.508+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3888200 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a387edb0 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3883620 2024-05-08T09:22:47.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.509+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a387edb0 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x7f4db8078060 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5611a388ad90 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.510+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3883620 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3888200 2024-05-08T09:22:47.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.511+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3883620 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3888200 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x7f4db8078060 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.512+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3883620 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3888200 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.513+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3883620 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x7f4db8078060 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a3888200 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x7f4db8078060 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.514+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x5611a387edb0 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f4db80a6040 con 0x7f4db8078060 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a3886c30 con 0x5611a387edb0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a38870b0 con 0x5611a387edb0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.515+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a3887590 con 0x5611a387edb0 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 zone default found 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 4 Realm: () 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 zonegroup default 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a388b210 con 0x5611a3883620 2024-05-08T09:22:47.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a388d440 con 0x5611a3888200 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a388d7e0 con 0x5611a3888200 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 started sync module instance, tier type = 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.516+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388c880 con 0x7f4db8078060 2024-05-08T09:22:47.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.517+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.518+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94633758084208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388c880 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.518+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388e1a0 con 0x5611a387edb0 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.519+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94633758084208] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.519+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.519+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94633758082272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388e1a0 con 0x5611a387edb0 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.519+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388eb60 con 0x5611a3888200 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.520+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.520+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94633758090928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388f3b0 con 0x5611a3888200 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.520+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388fdf0 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.520+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94633758082272] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.521+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94633758090928] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.521+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.521+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94633758093056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388dcf0 con 0x7f4db8078060 2024-05-08T09:22:47.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.521+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a38906d0 con 0x5611a387edb0 2024-05-08T09:22:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.522+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94633758093056] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.522+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.522+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94633758095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3890640 con 0x5611a387edb0 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.522+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3891120 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.523+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.523+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94633758095552] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.523+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94633758100528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3891970 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.523+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3891970 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.524+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94633758100528] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.524+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.524+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94633758102720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a38918e0 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.524+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3892a00 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v29'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94633758106960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3892e20 con 0x5611a3883620 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=0 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=1 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=2 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=3 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=4 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=5 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94633758102720] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.526+0000 7f4dc9f33800 20 add_watcher() i=6 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94633758106960] v29'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc9f33800 20 add_watcher() i=7 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc9f33800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a3891f30 con 0x5611a387edb0 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.527+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94633758108016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3891f30 con 0x5611a387edb0 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94633758108016] v29'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4c777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4dc9f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4dc9f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4dc9f33800 5 note: GC not initialized 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.528+0000 7f4c767fc640 20 reqs_thread_entry: start 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 20 Filter name: none 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4be7fff640 20 reqs_thread_entry: start 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a38c8f90 con 0x5611a387edb0 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:47.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.529+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5611a38ca380 con 0x5611a3883620 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.530+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.531+0000 7f4c777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.531+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94633758108016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a387c4d0 con 0x5611a387edb0 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.531+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94633758108016] v29'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.531+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94633758084208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a3892970 con 0x7f4db8078060 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.532+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94633758084208] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.532+0000 7f4dc9f33800 20 remove_watcher() i=0 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.532+0000 7f4dc9f33800 2 removed watcher, disabling cache 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.533+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94633758082272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388cc70 con 0x5611a387edb0 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.534+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94633758082272] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.534+0000 7f4dc9f33800 20 remove_watcher() i=1 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.534+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94633758090928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388cc70 con 0x5611a3888200 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.535+0000 7f4dc5bf5640 1 -- 172.21.15.161:0/248884310 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94633758090928] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4db8075030 con 0x5611a3888200 2024-05-08T09:22:47.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.535+0000 7f4dc9f33800 20 remove_watcher() i=2 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.535+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94633758093056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388e6b0 con 0x7f4db8078060 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.536+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94633758093056] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x7f4db8078060 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.536+0000 7f4dc9f33800 20 remove_watcher() i=3 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.536+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94633758095552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388cc70 con 0x5611a387edb0 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.537+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94633758095552] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dbc029040 con 0x5611a387edb0 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.537+0000 7f4dc9f33800 20 remove_watcher() i=4 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.537+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94633758100528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388f8c0 con 0x5611a3883620 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.538+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94633758100528] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.538+0000 7f4dc9f33800 20 remove_watcher() i=5 2024-05-08T09:22:47.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.538+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94633758102720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388cc70 con 0x5611a3883620 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.539+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94633758102720] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.539+0000 7f4dc9f33800 20 remove_watcher() i=6 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.539+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94633758106960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5611a388cc70 con 0x5611a3883620 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc63f6640 1 -- 172.21.15.161:0/248884310 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94633758106960] v29'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4dc0033030 con 0x5611a3883620 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 20 remove_watcher() i=7 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a3883620 msgr2=0x5611a3885a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a3883620 0x5611a3885a10 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a387edb0 msgr2=0x5611a3881270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a387edb0 0x5611a3881270 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4db8078060 msgr2=0x7f4db8076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4db8078060 0x7f4db8076360 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5611a3888200 msgr2=0x5611a388a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5611a3888200 0x5611a388a6c0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c90036900 msgr2=0x7f4c90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4c90036900 0x7f4c90038dc0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4db8006d80 tx=0x7f4db8088000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 msgr2=0x5611a3873310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc53f4640 1 -- 172.21.15.161:0/248884310 reap_dead start 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4dc002bf70 tx=0x7f4dc004ca10 comp rx=0 tx=0).stop 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 shutdown_connections 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/248884310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a386bdb0 0x5611a3873310 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 >> 172.21.15.161:0/248884310 conn(0x5611a38680c0 msgr2=0x5611a3865720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 shutdown_connections 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.540+0000 7f4dc9f33800 1 -- 172.21.15.161:0/248884310 wait complete. 2024-05-08T09:22:47.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 msgr2=0x7f4ca0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 0x7f4ca0038dc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x5611a384b010 tx=0x7f4db808c370 comp rx=0 tx=0).stop 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 msgr2=0x5611a385eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5611a3748b70 tx=0x7f4dc0012fd0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 shutdown_connections 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ca0036900 0x7f4ca0038dc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/314529664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a385ea80 0x5611a385eea0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 >> 172.21.15.161:0/314529664 conn(0x5611a3852b20 msgr2=0x5611a3852f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 shutdown_connections 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/314529664 wait complete. 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 msgr2=0x5611a384f290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 0x5611a384f290 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 msgr2=0x5611a384a6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 0x5611a384a6c0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 msgr2=0x7f4cac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 0x7f4cac038dc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc000f60 tx=0x7f4dbc0012b0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 msgr2=0x5611a3748540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f4db800a470 tx=0x7f4db8003020 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 shutdown_connections 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5611a384cea0 0x5611a384f290 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5611a374b510 0x5611a384a6c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4cac036900 0x7f4cac038dc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 --2- 172.21.15.161:0/2887337513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5611a3748be0 0x5611a3748540 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 >> 172.21.15.161:0/2887337513 conn(0x5611a37425b0 msgr2=0x5611a3833850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 shutdown_connections 2024-05-08T09:22:47.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.541+0000 7f4dc9f33800 1 -- 172.21.15.161:0/2887337513 wait complete. 2024-05-08T09:22:47.550 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-05-08T09:22:47.551 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-05-08T09:22:47.551 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T09:22:47.551 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-05-08T09:22:47.551 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-05-08T09:22:47.597 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.598 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dff92f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560361c29670 0x560361c2ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dff92f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560361c2bfa0 con 0x560361c25b60 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dff92f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x560361ab6050 con 0x560361c29670 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.599+0000 7f0dfadad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560361c29670 0x560361c2ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.600+0000 7f0dfb5ae640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x560361c25b60 0x560361c27f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55472/0 (socket says 172.21.15.161:55472) 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.600+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/1281763510 learned_addr learned my addr 172.21.15.161:0/1281763510 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:47.599 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.600+0000 7f0dfadad640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x560361c29670 0x560361c2ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33208/0 (socket says 172.21.15.161:33208) 2024-05-08T09:22:47.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.600+0000 7f0dfadad640 1 -- 172.21.15.161:0/1281763510 >> v1:172.21.15.45:6789/0 conn(0x560361c25b60 legacy=0x560361c27f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.600 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.600+0000 7f0dfadad640 1 -- 172.21.15.161:0/1281763510 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361c2d180 con 0x560361c29670 2024-05-08T09:22:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dfadad640 1 --2- 172.21.15.161:0/1281763510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c29670 0x560361c2ba60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0df000a470 tx=0x7f0df001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fd359aa3a1f287 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dfa5ac640 1 -- 172.21.15.161:0/1281763510 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df0057070 con 0x560361c29670 2024-05-08T09:22:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dfa5ac640 1 -- 172.21.15.161:0/1281763510 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df0052570 con 0x560361c29670 2024-05-08T09:22:47.601 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dfa5ac640 1 -- 172.21.15.161:0/1281763510 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df0052870 con 0x560361c29670 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 -- 172.21.15.161:0/1281763510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c29670 msgr2=0x560361c2ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 --2- 172.21.15.161:0/1281763510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c29670 0x560361c2ba60 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0df000a470 tx=0x7f0df001ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 -- 172.21.15.161:0/1281763510 shutdown_connections 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 --2- 172.21.15.161:0/1281763510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c29670 0x560361c2ba60 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 -- 172.21.15.161:0/1281763510 >> 172.21.15.161:0/1281763510 conn(0x560361c1f5b0 msgr2=0x560361c219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.602 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 -- 172.21.15.161:0/1281763510 shutdown_connections 2024-05-08T09:22:47.603 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.602+0000 7f0dff92f800 1 -- 172.21.15.161:0/1281763510 wait complete. 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dff92f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dff92f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560361b701c0 con 0x560361c25b60 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dfb5ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dfb5ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33224/0 (socket says 172.21.15.161:33224) 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/3099936038 learned_addr learned my addr 172.21.15.161:0/3099936038 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.616+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/3099936038 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361c23a60 con 0x560361c25b60 2024-05-08T09:22:47.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.617+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/3099936038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0017a0 tx=0x7f0dec001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c721f95e7270cd91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.617+0000 7f0ce960a640 1 -- 172.21.15.161:0/3099936038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec004520 con 0x560361c25b60 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.617+0000 7f0ce960a640 1 -- 172.21.15.161:0/3099936038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec0046c0 con 0x560361c25b60 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.617+0000 7f0ce960a640 1 -- 172.21.15.161:0/3099936038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec004a00 con 0x560361c25b60 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- 172.21.15.161:0/3099936038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 msgr2=0x560361c254a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3099936038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0017a0 tx=0x7f0dec001c60 comp rx=0 tx=0).stop 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- 172.21.15.161:0/3099936038 shutdown_connections 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3099936038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361c254a0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- 172.21.15.161:0/3099936038 >> 172.21.15.161:0/3099936038 conn(0x560361c1f5b0 msgr2=0x560361d12050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.619 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- 172.21.15.161:0/3099936038 shutdown_connections 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- 172.21.15.161:0/3099936038 wait complete. 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.618+0000 7f0dff92f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560361c2c470 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dfb5ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dfb5ae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33230/0 (socket says 172.21.15.161:33230) 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/426297536 learned_addr learned my addr 172.21.15.161:0/426297536 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361d209f0 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000f80 tx=0x7f0dec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0ce7e07640 1 -- 172.21.15.161:0/426297536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec022020 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0ce7e07640 1 -- 172.21.15.161:0/426297536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dec014870 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560361d20c80 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.619+0000 7f0ce7e07640 1 -- 172.21.15.161:0/426297536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0dec014bb0 con 0x560361c25b60 2024-05-08T09:22:47.620 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.620+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560361d23930 con 0x560361c25b60 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.620+0000 7f0ce7e07640 1 -- 172.21.15.161:0/426297536 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0dec025020 con 0x560361c25b60 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0ce7e07640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 0x7f0ce0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0ce7e07640 1 -- 172.21.15.161:0/426297536 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0dec018030 con 0x560361c25b60 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dfadad640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 0x7f0ce0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 0x560361d276f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d27c80 con 0x560361c29670 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 0x560361d276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dfadad640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 0x7f0ce0038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0df0054000 tx=0x7f0df004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 0x560361d276f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/426297536 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.621+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d24ca0 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.622+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/426297536 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0df40083e0 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.622+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 0x560361d2c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.622+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d2ca90 con 0x560361d29fb0 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.622+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 0x560361d2c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.622+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 0x560361d2c3a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.623+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/426297536 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d29fb0 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.623+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d28f60 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.623+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/426297536 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0df40083e0 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.623+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d29420 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.623+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/426297536 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0df40083e0 con 0x560361c29670 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.626 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dff92f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dff92f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560361b16cf0 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33232/0 (socket says 172.21.15.161:33232) 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/3187242738 learned_addr learned my addr 172.21.15.161:0/3187242738 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/3187242738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361d3c5a0 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.624+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x560361d218b0 tx=0x7f0df400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.625+0000 7f0ce5602640 1 -- 172.21.15.161:0/3187242738 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df4007d00 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.625+0000 7f0ce5602640 1 -- 172.21.15.161:0/3187242738 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df401e020 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.625+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560361d3d010 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.625+0000 7f0ce5602640 1 -- 172.21.15.161:0/3187242738 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df4019420 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.625+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560361d3d510 con 0x560361d3bc40 2024-05-08T09:22:47.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0ce5602640 1 -- 172.21.15.161:0/3187242738 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0df4016040 con 0x560361d3bc40 2024-05-08T09:22:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0ce5602640 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 0x7f0cd4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0ce5602640 1 -- 172.21.15.161:0/3187242738 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0df401f030 con 0x560361d3bc40 2024-05-08T09:22:47.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 0x7f0cd4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 0x7f0cd4038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560361d28120 tx=0x7f0dec011fb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dff92f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.626+0000 7f0dff92f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560361c23de0 con 0x560361d48f10 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33246/0 (socket says 172.21.15.161:33246) 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/234827905 learned_addr learned my addr 172.21.15.161:0/234827905 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/234827905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361d49900 con 0x560361d48f10 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/234827905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0df404c8b0 tx=0x7f0df40157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a8ae4c21f49f4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0cdeffd640 1 -- 172.21.15.161:0/234827905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df401d070 con 0x560361d48f10 2024-05-08T09:22:47.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0cdeffd640 1 -- 172.21.15.161:0/234827905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df40174e0 con 0x560361d48f10 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.627+0000 7f0cdeffd640 1 -- 172.21.15.161:0/234827905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df4017dd0 con 0x560361d48f10 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- 172.21.15.161:0/234827905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 msgr2=0x560361d49330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 --2- 172.21.15.161:0/234827905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0df404c8b0 tx=0x7f0df40157e0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- 172.21.15.161:0/234827905 shutdown_connections 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 --2- 172.21.15.161:0/234827905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d49330 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- 172.21.15.161:0/234827905 >> 172.21.15.161:0/234827905 conn(0x560361d452c0 msgr2=0x560361d43320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- 172.21.15.161:0/234827905 shutdown_connections 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- 172.21.15.161:0/234827905 wait complete. 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 Processor -- start 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- start start 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dff92f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x560361d4a060 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dfbdaf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33260/0 (socket says 172.21.15.161:33260) 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.628+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 learned_addr learned my addr 172.21.15.161:0/514183057 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560361d50a10 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0df4015a30 tx=0x7f0df404c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0cdd7fa640 1 -- 172.21.15.161:0/514183057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df4030020 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0cdd7fa640 1 -- 172.21.15.161:0/514183057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df403bad0 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560361d50ca0 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0cdd7fa640 1 -- 172.21.15.161:0/514183057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0df403bdb0 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.629+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560361d53950 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0cdd7fa640 1 -- 172.21.15.161:0/514183057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0df4033020 con 0x560361d48f10 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0cdd7fa640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cc4036900 0x7f0cc4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0cdd7fa640 1 -- 172.21.15.161:0/514183057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0df4036d20 con 0x560361d48f10 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cc4036900 0x7f0cc4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361d5bf70 0x560361d5e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d5eb80 con 0x560361d5bf70 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dfadad640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361d5bf70 0x560361d5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.630+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cc4036900 0x7f0cc4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dec010fd0 tx=0x7f0dec043000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dfadad640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361d5bf70 0x560361d5e430 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 realm 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d5ef50 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d5f820 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d5fbc0 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d60670 0x560361d62a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.631+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d631c0 con 0x560361d60670 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d60670 0x560361d62a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dfbdaf640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d60670 0x560361d62a60 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dff92f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dff92f800 20 searching for the correct realm 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560361d65270 0x560361d67730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.632+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560361d65270 0x560361d67730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.633+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560361d65270 0x560361d67730 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.633+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.633+0000 7f0dfb5ae640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0dec027020 0x7f0dec0265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.633+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.633+0000 7f0dfadad640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0dec027020 0x7f0dec0265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.634+0000 7f0dfadad640 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0dec027020 0x7f0dec0265d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.634+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.634+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.634+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.634+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.651 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.635+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.636+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.652 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.637+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.638+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.653 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.639+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.654 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.640+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d60670 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d65270 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.641+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x560361d5bf70 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x560361d67e00 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d63ca0 con 0x560361d5bf70 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d64120 con 0x560361d5bf70 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.642+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d64600 con 0x560361d5bf70 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 zone default found 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 4 Realm: () 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 zonegroup default 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d68280 con 0x560361d60670 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.643+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d6a4b0 con 0x560361d65270 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d6a850 con 0x560361d65270 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 20 started sync module instance, tier type = 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.644+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d698f0 con 0x7f0dec027020 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.645+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.645+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572526345440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d698f0 con 0x7f0dec027020 2024-05-08T09:22:47.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.645+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6b210 con 0x560361d5bf70 2024-05-08T09:22:47.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.646+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572526345440] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.646+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.646+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572526343744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6b210 con 0x560361d5bf70 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.646+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6bbd0 con 0x560361d65270 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.647+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572526343744] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.647+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.647+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572526349664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6b180 con 0x560361d65270 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.648+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6cac0 con 0x7f0dec027020 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.648+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572526349664] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.648+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.648+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572526355984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6cee0 con 0x7f0dec027020 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.649+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6d7b0 con 0x560361d5bf70 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.650+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.650+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572526355984] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.650+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572526358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6d300 con 0x560361d5bf70 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.650+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6ca70 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.651+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.651+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572526363200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6ca70 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.651+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f190 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.651+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572526358240] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.652+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572526363200] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.652+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.652+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572526364256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6dba0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.652+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f770 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v29'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572526364256] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572526367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x560361d60670 2024-05-08T09:22:47.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=0 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=1 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=2 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=3 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=4 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=5 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.653+0000 7f0dff92f800 20 add_watcher() i=6 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572526367424] v29'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dff92f800 20 add_watcher() i=7 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dff92f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361d72bc0 con 0x560361d5bf70 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.654+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572526368480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6ffb0 con 0x560361d5bf70 2024-05-08T09:22:47.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.655+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572526368480] v29'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.655+0000 7f0cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 5 note: GC not initialized 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0cb0fe1640 20 reqs_thread_entry: start 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 Filter name: none 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0c2a7fc640 20 reqs_thread_entry: start 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361da5a40 con 0x560361d5bf70 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.656+0000 7f0dff92f800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:47.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.657+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x560361da6e30 con 0x560361d60670 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.657+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.658+0000 7f0cb1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.658+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572526368480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361da4670 con 0x560361d5bf70 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.659+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94572526368480] v29'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.659+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572526345440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x7f0dec027020 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.660+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94572526345440] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.660+0000 7f0dff92f800 20 remove_watcher() i=0 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.660+0000 7f0dff92f800 2 removed watcher, disabling cache 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.660+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572526343744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x560361d5bf70 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.661+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94572526343744] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.661+0000 7f0dff92f800 20 remove_watcher() i=1 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.661+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572526349664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d69640 con 0x560361d65270 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.662+0000 7f0dfb5ae640 1 -- 172.21.15.161:0/514183057 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94572526349664] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0dec01b070 con 0x560361d65270 2024-05-08T09:22:47.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.662+0000 7f0dff92f800 20 remove_watcher() i=2 2024-05-08T09:22:47.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.662+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572526355984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x7f0dec027020 2024-05-08T09:22:47.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.663+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94572526355984] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x7f0dec027020 2024-05-08T09:22:47.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.663+0000 7f0dff92f800 20 remove_watcher() i=3 2024-05-08T09:22:47.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.663+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572526358240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6ad60 con 0x560361d5bf70 2024-05-08T09:22:47.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.664+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94572526358240] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df005a040 con 0x560361d5bf70 2024-05-08T09:22:47.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.664+0000 7f0dff92f800 20 remove_watcher() i=4 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.664+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572526363200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6c610 con 0x560361d60670 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.665+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94572526363200] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.665+0000 7f0dff92f800 20 remove_watcher() i=5 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.665+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572526364256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x560361d60670 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.666+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94572526364256] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.666+0000 7f0dff92f800 20 remove_watcher() i=6 2024-05-08T09:22:47.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.666+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572526367424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x560361d6f6e0 con 0x560361d60670 2024-05-08T09:22:47.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dfbdaf640 1 -- 172.21.15.161:0/514183057 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94572526367424] v29'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0df40083e0 con 0x560361d60670 2024-05-08T09:22:47.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 20 remove_watcher() i=7 2024-05-08T09:22:47.677 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d60670 msgr2=0x560361d62a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d60670 0x560361d62a60 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361d5bf70 msgr2=0x560361d5e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361d5bf70 0x560361d5e430 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0dec027020 msgr2=0x7f0dec0265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0dec027020 0x7f0dec0265d0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560361d65270 msgr2=0x560361d67730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x560361d65270 0x560361d67730 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cc4036900 msgr2=0x7f0cc4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cc4036900 0x7f0cc4038dc0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0dec010fd0 tx=0x7f0dec043000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 msgr2=0x560361d504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0df4015a30 tx=0x7f0df404c810 comp rx=0 tx=0).stop 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.667+0000 7f0dfadad640 1 -- 172.21.15.161:0/514183057 reap_dead start 2024-05-08T09:22:47.678 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 shutdown_connections 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/514183057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d48f10 0x560361d504d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 >> 172.21.15.161:0/514183057 conn(0x560361d452c0 msgr2=0x560361d4a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 shutdown_connections 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/514183057 wait complete. 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 msgr2=0x7f0cd4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 0x7f0cd4038dc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x560361d28120 tx=0x7f0dec011fb0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 msgr2=0x560361d3c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x560361d218b0 tx=0x7f0df400aec0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 shutdown_connections 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0cd4036900 0x7f0cd4038dc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/3187242738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361d3bc40 0x560361d3c060 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 >> 172.21.15.161:0/3187242738 conn(0x560361d2fce0 msgr2=0x560361d300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.679 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 shutdown_connections 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/3187242738 wait complete. 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 msgr2=0x560361d2c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 0x560361d2c3a0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 msgr2=0x560361d276f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 0x560361d276f0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 msgr2=0x7f0ce0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 0x7f0ce0038dc0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0df0054000 tx=0x7f0df004e000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 msgr2=0x560361d204b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0dec000f80 tx=0x7f0dec001250 comp rx=0 tx=0).stop 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.668+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 shutdown_connections 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x560361d29fb0 0x560361d2c3a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x560361c29670 0x560361d276f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0ce0036900 0x7f0ce0038dc0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 --2- 172.21.15.161:0/426297536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560361c25b60 0x560361d204b0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 >> 172.21.15.161:0/426297536 conn(0x560361c1f5b0 msgr2=0x560361c24340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 shutdown_connections 2024-05-08T09:22:47.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.669+0000 7f0dff92f800 1 -- 172.21.15.161:0/426297536 wait complete. 2024-05-08T09:22:47.682 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-05-08T09:22:47.682 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-05-08T09:22:47.682 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T09:22:47.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-05-08T09:22:47.682 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-05-08T09:22:47.728 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.728 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.730+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.730+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.730+0000 7fe980f33800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558064b50c50 0x558064b53040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.730+0000 7fe980f33800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558064b57090 con 0x558064b53580 2024-05-08T09:22:47.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.730+0000 7fe980f33800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5580649e1050 con 0x558064b50c50 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe97cbf5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558064b50c50 0x558064b53040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe97cbf5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x558064b50c50 0x558064b53040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33276/0 (socket says 172.21.15.161:33276) 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2680485348 learned_addr learned my addr 172.21.15.161:0/2680485348 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe9743f4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x558064b53580 0x558064b55970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55480/0 (socket says 172.21.15.161:55480) 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2680485348 >> v1:172.21.15.45:6789/0 conn(0x558064b53580 legacy=0x558064b55970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.731+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2680485348 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064b58270 con 0x558064b50c50 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.733+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2680485348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064b53040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a520 tx=0x7fe96c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9df788c754b798d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.733+0000 7fe977fff640 1 -- 172.21.15.161:0/2680485348 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c057070 con 0x558064b50c50 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.733+0000 7fe977fff640 1 -- 172.21.15.161:0/2680485348 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c052570 con 0x558064b50c50 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.733+0000 7fe977fff640 1 -- 172.21.15.161:0/2680485348 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c04ae60 con 0x558064b50c50 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 -- 172.21.15.161:0/2680485348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 msgr2=0x558064b53040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 --2- 172.21.15.161:0/2680485348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064b53040 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00a520 tx=0x7fe96c01d010 comp rx=0 tx=0).stop 2024-05-08T09:22:47.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 -- 172.21.15.161:0/2680485348 shutdown_connections 2024-05-08T09:22:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 --2- 172.21.15.161:0/2680485348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064b53040 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 -- 172.21.15.161:0/2680485348 >> 172.21.15.161:0/2680485348 conn(0x558064b4a5c0 msgr2=0x558064b4c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 -- 172.21.15.161:0/2680485348 shutdown_connections 2024-05-08T09:22:47.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.734+0000 7fe980f33800 1 -- 172.21.15.161:0/2680485348 wait complete. 2024-05-08T09:22:47.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe980f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe980f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558064a9b1c0 con 0x558064b50c50 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe97cbf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe97cbf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33278/0 (socket says 172.21.15.161:33278) 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.748+0000 7fe97cbf5640 1 -- 172.21.15.161:0/1509567669 learned_addr learned my addr 172.21.15.161:0/1509567669 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.749+0000 7fe97cbf5640 1 -- 172.21.15.161:0/1509567669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064c41d20 con 0x558064b50c50 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.749+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/1509567669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe96c055040 tx=0x7fe96c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8b4fedde2daed8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.749+0000 7fe86ae0d640 1 -- 172.21.15.161:0/1509567669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c057040 con 0x558064b50c50 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.749+0000 7fe86ae0d640 1 -- 172.21.15.161:0/1509567669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c052720 con 0x558064b50c50 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.749+0000 7fe86ae0d640 1 -- 172.21.15.161:0/1509567669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c052a20 con 0x558064b50c50 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- 172.21.15.161:0/1509567669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 msgr2=0x558064c41750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 --2- 172.21.15.161:0/1509567669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe96c055040 tx=0x7fe96c04c000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- 172.21.15.161:0/1509567669 shutdown_connections 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 --2- 172.21.15.161:0/1509567669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c41750 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- 172.21.15.161:0/1509567669 >> 172.21.15.161:0/1509567669 conn(0x558064b4a5c0 msgr2=0x558064c3d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- 172.21.15.161:0/1509567669 shutdown_connections 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- 172.21.15.161:0/1509567669 wait complete. 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.751 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.750+0000 7fe980f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558064b574a0 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe97cbf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe97cbf5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33294/0 (socket says 172.21.15.161:33294) 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2907471790 learned_addr learned my addr 172.21.15.161:0/2907471790 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064c49700 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe96c052540 tx=0x7fe96c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe86960a640 1 -- 172.21.15.161:0/2907471790 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c073070 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe86960a640 1 -- 172.21.15.161:0/2907471790 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe96c05d440 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe86960a640 1 -- 172.21.15.161:0/2907471790 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe96c057070 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558064c49990 con 0x558064b50c50 2024-05-08T09:22:47.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.751+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558064c4c640 con 0x558064b50c50 2024-05-08T09:22:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.752+0000 7fe86960a640 1 -- 172.21.15.161:0/2907471790 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe96c076070 con 0x558064b50c50 2024-05-08T09:22:47.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.752+0000 7fe86960a640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 0x7fe864038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.752+0000 7fe86960a640 1 -- 172.21.15.161:0/2907471790 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe96c08dd30 con 0x558064b50c50 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 0x7fe864038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 0x558064c50400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c50940 con 0x558064b53580 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 0x558064c50400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 0x7fe864038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe964000f60 tx=0x7fe964001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 0x558064c50400 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2907471790 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97800a4a0 con 0x558064b53580 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.753+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c4d9d0 con 0x558064b53580 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2907471790 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x558064b53580 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 0x558064c55080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c55770 con 0x558064c52c90 2024-05-08T09:22:47.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 0x558064c55080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 0x558064c55080 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.754+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2907471790 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe96c075030 con 0x558064c52c90 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c51c10 con 0x558064b53580 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2907471790 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97800a4a0 con 0x558064b53580 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c520f0 con 0x558064b53580 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2907471790 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe97800a4a0 con 0x558064b53580 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.755+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe980f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe980f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558064a41cf0 con 0x558064c648e0 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33298/0 (socket says 172.21.15.161:33298) 2024-05-08T09:22:47.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe97d3f6640 1 -- 172.21.15.161:0/3885497491 learned_addr learned my addr 172.21.15.161:0/3885497491 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe97d3f6640 1 -- 172.21.15.161:0/3885497491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064c65240 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x558064c50d40 tx=0x7fe978018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe8627fc640 1 -- 172.21.15.161:0/3885497491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978014450 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe8627fc640 1 -- 172.21.15.161:0/3885497491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe978014610 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558064c65cb0 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe8627fc640 1 -- 172.21.15.161:0/3885497491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978014930 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.756+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558064c661b0 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.757+0000 7fe8627fc640 1 -- 172.21.15.161:0/3885497491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe978011040 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.757+0000 7fe8627fc640 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 0x7fe854038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.757+0000 7fe8627fc640 1 -- 172.21.15.161:0/3885497491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe97801e070 con 0x558064c648e0 2024-05-08T09:22:47.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.757+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 0x7fe854038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 0x7fe854038dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe96c08c2e0 tx=0x7fe96c052f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe980f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe980f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558064c41fe0 con 0x558064c71b60 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33310/0 (socket says 172.21.15.161:33310) 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2706852210 learned_addr learned my addr 172.21.15.161:0/2706852210 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.758+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2706852210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064c72550 con 0x558064c71b60 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2706852210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe97804c900 tx=0x7fe978011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5523f073006fb82c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe853fff640 1 -- 172.21.15.161:0/2706852210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97800dd90 con 0x558064c71b60 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe853fff640 1 -- 172.21.15.161:0/2706852210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9780167e0 con 0x558064c71b60 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe853fff640 1 -- 172.21.15.161:0/2706852210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe978014ad0 con 0x558064c71b60 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- 172.21.15.161:0/2706852210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 msgr2=0x558064c71f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 --2- 172.21.15.161:0/2706852210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe97804c900 tx=0x7fe978011b30 comp rx=0 tx=0).stop 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- 172.21.15.161:0/2706852210 shutdown_connections 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 --2- 172.21.15.161:0/2706852210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c71f80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- 172.21.15.161:0/2706852210 >> 172.21.15.161:0/2706852210 conn(0x558064c6de70 msgr2=0x558064c6bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- 172.21.15.161:0/2706852210 shutdown_connections 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- 172.21.15.161:0/2706852210 wait complete. 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 Processor -- start 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.759+0000 7fe980f33800 1 -- start start 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe980f33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe980f33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x558064c72cc0 con 0x558064c71b60 2024-05-08T09:22:47.777 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe97d3f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33324/0 (socket says 172.21.15.161:33324) 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 learned_addr learned my addr 172.21.15.161:0/2012853413 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558064c79550 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe978040040 tx=0x7fe97804c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe8527fc640 1 -- 172.21.15.161:0/2012853413 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97804b410 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe8527fc640 1 -- 172.21.15.161:0/2012853413 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe97803bb20 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe8527fc640 1 -- 172.21.15.161:0/2012853413 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97803bcd0 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558064c797e0 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.760+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558064c7c490 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.761+0000 7fe8527fc640 1 -- 172.21.15.161:0/2012853413 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe97804e0d0 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.761+0000 7fe8527fc640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe848036950 0x7fe848038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.761+0000 7fe8527fc640 1 -- 172.21.15.161:0/2012853413 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe97800e040 con 0x558064c71b60 2024-05-08T09:22:47.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.761+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe848036950 0x7fe848038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064c84aa0 0x558064c86f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c876b0 con 0x558064c84aa0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064c84aa0 0x558064c86f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe848036950 0x7fe848038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0068b0 tx=0x7fe96c08f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064c84aa0 0x558064c86f60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96400f610 con 0x558064c84aa0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 20 realm 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.762+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c83ef0 con 0x558064c84aa0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96400f610 con 0x558064c84aa0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c88190 con 0x558064c84aa0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96400f610 con 0x558064c84aa0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c88a60 con 0x558064c84aa0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe96400f610 con 0x558064c84aa0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c89360 0x558064c8b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c8beb0 con 0x558064c89360 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.763+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c89360 0x558064c8b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe97d3f6640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c89360 0x558064c8b750 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe980f33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe980f33800 20 searching for the correct realm 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558064c8df60 0x558064c90420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.764+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558064c8df60 0x558064c90420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558064c8df60 0x558064c90420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe97cbf5640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe96c078060 0x7fe96c0766f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe96c078060 0x7fe96c0766f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.765+0000 7fe9743f4640 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe96c078060 0x7fe96c0766f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96400f610 con 0x7fe96c078060 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96400f610 con 0x558064c84aa0 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.766+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x7fe96c078060 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.767+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.768+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.768+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.768+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.768+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe96402b040 con 0x7fe96c078060 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.769+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.770+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x7fe96c078060 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.771+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.772+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c89360 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x7fe96c078060 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c8df60 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96402b040 con 0x7fe96c078060 2024-05-08T09:22:47.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.773+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x558064c84aa0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe96402b040 con 0x558064c84aa0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x558064c90af0 con 0x7fe96c078060 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c8c990 con 0x558064c84aa0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c8ce10 con 0x558064c84aa0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c8d2b0 con 0x558064c84aa0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 20 zone default found 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 4 Realm: () 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.774+0000 7fe980f33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 zonegroup default 2024-05-08T09:22:47.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c90f70 con 0x558064c89360 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c931a0 con 0x558064c8df60 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c93540 con 0x558064c8df60 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 started sync module instance, tier type = 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.775+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c925e0 con 0x7fe96c078060 2024-05-08T09:22:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.776+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.776+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94009935079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c925e0 con 0x7fe96c078060 2024-05-08T09:22:47.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.777+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c93e10 con 0x558064c84aa0 2024-05-08T09:22:47.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.777+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94009935079888] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.778+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.778+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94009935083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c925e0 con 0x558064c84aa0 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.778+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c94860 con 0x558064c8df60 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.779+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.779+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94009935083744] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.779+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94009935077680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c92550 con 0x558064c8df60 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.779+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c95720 con 0x7fe96c078060 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.780+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94009935077680] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.780+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.780+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94009935090288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c95690 con 0x7fe96c078060 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.780+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c965e0 con 0x558064c84aa0 2024-05-08T09:22:47.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.781+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.781+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94009935094064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c96a00 con 0x558064c84aa0 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.782+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c97470 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.782+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94009935090288] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.783+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.783+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94009935094064] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.783+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94009935097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c97860 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.783+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c96550 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.784+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94009935097664] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.784+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.784+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94009935095120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c97d70 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.784+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c98770 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v29'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94009935095120] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94009935102592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c98bb0 con 0x558064c89360 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=0 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=1 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=2 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=3 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=4 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=5 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.785+0000 7fe980f33800 20 add_watcher() i=6 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94009935102592] v29'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe980f33800 20 add_watcher() i=7 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe980f33800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064c95c00 con 0x558064c84aa0 2024-05-08T09:22:47.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.786+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94009935103648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c99480 con 0x558064c84aa0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.787+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94009935103648] v29'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.787+0000 7fe832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.787+0000 7fe980f33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.787+0000 7fe980f33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 5 note: GC not initialized 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe831fe3640 20 reqs_thread_entry: start 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 20 Filter name: none 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe7a37fe640 20 reqs_thread_entry: start 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064ccebf0 con 0x558064c84aa0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.788+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x558064ccffe0 con 0x558064c89360 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.789+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.790+0000 7fe832fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.790+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94009935103648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064ccd350 con 0x558064c84aa0 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.791+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94009935103648] v29'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.791+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94009935079888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c986a0 con 0x7fe96c078060 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.792+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94009935079888] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.792+0000 7fe980f33800 20 remove_watcher() i=0 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.792+0000 7fe980f33800 2 removed watcher, disabling cache 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.792+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94009935083744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c986a0 con 0x558064c84aa0 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.793+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94009935083744] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.793+0000 7fe980f33800 20 remove_watcher() i=1 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.793+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94009935077680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c938e0 con 0x558064c8df60 2024-05-08T09:22:47.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.794+0000 7fe97cbf5640 1 -- 172.21.15.161:0/2012853413 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94009935077680] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96c086040 con 0x558064c8df60 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.794+0000 7fe980f33800 20 remove_watcher() i=2 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.794+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94009935090288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c986a0 con 0x7fe96c078060 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.795+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94009935090288] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x7fe96c078060 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.795+0000 7fe980f33800 20 remove_watcher() i=3 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.795+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94009935094064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c92130 con 0x558064c84aa0 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.796+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94009935094064] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe96403d040 con 0x558064c84aa0 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.796+0000 7fe980f33800 20 remove_watcher() i=4 2024-05-08T09:22:47.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.796+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94009935097664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c95270 con 0x558064c89360 2024-05-08T09:22:47.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.797+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94009935097664] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.797+0000 7fe980f33800 20 remove_watcher() i=5 2024-05-08T09:22:47.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.797+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94009935095120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c986a0 con 0x558064c89360 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.798+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94009935095120] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.798+0000 7fe980f33800 20 remove_watcher() i=6 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.798+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94009935102592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x558064c92130 con 0x558064c89360 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe97d3f6640 1 -- 172.21.15.161:0/2012853413 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94009935102592] v29'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97802a070 con 0x558064c89360 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 20 remove_watcher() i=7 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c89360 msgr2=0x558064c8b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c89360 0x558064c8b750 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064c84aa0 msgr2=0x558064c86f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064c84aa0 0x558064c86f60 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe96c078060 msgr2=0x7fe96c0766f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe96c078060 0x7fe96c0766f0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558064c8df60 msgr2=0x558064c90420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.799+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x558064c8df60 0x558064c90420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe848036950 msgr2=0x7fe848038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe848036950 0x7fe848038e10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe96c0068b0 tx=0x7fe96c08f000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 msgr2=0x558064c79010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe9743f4640 1 -- 172.21.15.161:0/2012853413 reap_dead start 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe978040040 tx=0x7fe97804c860 comp rx=0 tx=0).stop 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 shutdown_connections 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/2012853413 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c71b60 0x558064c79010 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 >> 172.21.15.161:0/2012853413 conn(0x558064c6de70 msgr2=0x558064c6b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 shutdown_connections 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2012853413 wait complete. 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 msgr2=0x7fe854038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 0x7fe854038dc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe96c08c2e0 tx=0x7fe96c052f40 comp rx=0 tx=0).stop 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 msgr2=0x558064c64d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x558064c50d40 tx=0x7fe978018830 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 shutdown_connections 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe854036900 0x7fe854038dc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/3885497491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064c648e0 0x558064c64d00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 >> 172.21.15.161:0/3885497491 conn(0x558064c58980 msgr2=0x558064c58d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 shutdown_connections 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/3885497491 wait complete. 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 msgr2=0x558064c55080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 0x558064c55080 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 msgr2=0x558064c50400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.800+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 0x558064c50400 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 msgr2=0x7fe864038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 0x7fe864038dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe964000f60 tx=0x7fe964001370 comp rx=0 tx=0).stop 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 msgr2=0x558064c491c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe96c052540 tx=0x7fe96c003020 comp rx=0 tx=0).stop 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 shutdown_connections 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x558064c52c90 0x558064c55080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x558064b53580 0x558064c50400 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe864036900 0x7fe864038dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 --2- 172.21.15.161:0/2907471790 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558064b50c50 0x558064c491c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 >> 172.21.15.161:0/2907471790 conn(0x558064b4a5c0 msgr2=0x558064c3b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 shutdown_connections 2024-05-08T09:22:47.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.801+0000 7fe980f33800 1 -- 172.21.15.161:0/2907471790 wait complete. 2024-05-08T09:22:47.809 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-05-08T09:22:47.809 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-05-08T09:22:47.809 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T09:22:47.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-05-08T09:22:47.810 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-05-08T09:22:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.856 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.857+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.857+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.857+0000 7f3ab4f2d800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56128d4e8a20 0x56128d4e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.857+0000 7f3ab4f2d800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56128d45d1c0 con 0x56128d4e9380 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.857+0000 7f3ab4f2d800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x56128d37b050 con 0x56128d4e8a20 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3ab0b7f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56128d4e8a20 0x56128d4e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3ab0b7f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56128d4e8a20 0x56128d4e8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33330/0 (socket says 172.21.15.161:33330) 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/576509614 learned_addr learned my addr 172.21.15.161:0/576509614 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/576509614 >> v1:172.21.15.45:6789/0 conn(0x56128d4e9380 legacy=0x56128d4e9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3aab7fe640 1 -- 172.21.15.161:0/576509614 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351830118 0 0) 0x56128d45d1c0 con 0x56128d4e9380 2024-05-08T09:22:47.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.858+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/576509614 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d4e9f40 con 0x56128d4e8a20 2024-05-08T09:22:47.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.860+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/576509614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d4e8e40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400a520 tx=0x7f3aa401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801060466601f523 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.860+0000 7f3aab7fe640 1 -- 172.21.15.161:0/576509614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4057070 con 0x56128d4e8a20 2024-05-08T09:22:47.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.860+0000 7f3aab7fe640 1 -- 172.21.15.161:0/576509614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4052570 con 0x56128d4e8a20 2024-05-08T09:22:47.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.860+0000 7f3aab7fe640 1 -- 172.21.15.161:0/576509614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa404ae60 con 0x56128d4e8a20 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/576509614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 msgr2=0x56128d4e8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/576509614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d4e8e40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400a520 tx=0x7f3aa401d010 comp rx=0 tx=0).stop 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/576509614 shutdown_connections 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/576509614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d4e8e40 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/576509614 >> 172.21.15.161:0/576509614 conn(0x56128d4e45c0 msgr2=0x56128d4e69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/576509614 shutdown_connections 2024-05-08T09:22:47.861 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.861+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/576509614 wait complete. 2024-05-08T09:22:47.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.875+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.875+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.875+0000 7f3ab4f2d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.875+0000 7f3ab4f2d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56128d4351c0 con 0x56128d4e8a20 2024-05-08T09:22:47.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f3ab0b7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f3ab0b7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33336/0 (socket says 172.21.15.161:33336) 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/121396679 learned_addr learned my addr 172.21.15.161:0/121396679 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/121396679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d5ddf50 con 0x56128d4e8a20 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/121396679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4055040 tx=0x7f3aa404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d51c66a322be7f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f399ee05640 1 -- 172.21.15.161:0/121396679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4062070 con 0x56128d4e8a20 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f399ee05640 1 -- 172.21.15.161:0/121396679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4052720 con 0x56128d4e8a20 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.876+0000 7f399ee05640 1 -- 172.21.15.161:0/121396679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4057040 con 0x56128d4e8a20 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/121396679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 msgr2=0x56128d5dd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/121396679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4055040 tx=0x7f3aa404c000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/121396679 shutdown_connections 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/121396679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5dd980 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/121396679 >> 172.21.15.161:0/121396679 conn(0x56128d4e45c0 msgr2=0x56128d5d92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/121396679 shutdown_connections 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/121396679 wait complete. 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.877+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab4f2d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab4f2d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56128d4ea4d0 con 0x56128d4e8a20 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab0b7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab0b7f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33340/0 (socket says 172.21.15.161:33340) 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/4136768267 learned_addr learned my addr 172.21.15.161:0/4136768267 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d5e5940 con 0x56128d4e8a20 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.878+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40057e0 tx=0x7f3aa4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f399d602640 1 -- 172.21.15.161:0/4136768267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4057050 con 0x56128d4e8a20 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56128d5e5bd0 con 0x56128d4e8a20 2024-05-08T09:22:47.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f399d602640 1 -- 172.21.15.161:0/4136768267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa4067450 con 0x56128d4e8a20 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f399d602640 1 -- 172.21.15.161:0/4136768267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aa4062040 con 0x56128d4e8a20 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128d5e8880 con 0x56128d4e8a20 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.879+0000 7f399d602640 1 -- 172.21.15.161:0/4136768267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3aa4067600 con 0x56128d4e8a20 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f399d602640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 0x7f3998038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f399d602640 1 -- 172.21.15.161:0/4136768267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3aa408e190 con 0x56128d4e8a20 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3aabfff640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 0x7f3998038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 0x56128d5ec640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d5ecb80 con 0x56128d4e9380 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab1380640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 0x56128d5ec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3aabfff640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 0x7f3998038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f60 tx=0x7f3a9c0013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab1380640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 0x56128d5ec640 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab1380640 1 -- 172.21.15.161:0/4136768267 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3aac00a4a0 con 0x56128d4e9380 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.880+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d5e9bf0 con 0x56128d4e9380 2024-05-08T09:22:47.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.881+0000 7f3ab1380640 1 -- 172.21.15.161:0/4136768267 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3aac00a4a0 con 0x56128d4e9380 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.881+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 0x56128d5f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.881+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d5f19c0 con 0x56128d5eeee0 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.881+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 0x56128d5f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.881+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 0x56128d5f12d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/4136768267 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d5eeee0 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d5ede60 con 0x56128d4e9380 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab1380640 1 -- 172.21.15.161:0/4136768267 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3aac00a4a0 con 0x56128d4e9380 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d5ee340 con 0x56128d4e9380 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab1380640 1 -- 172.21.15.161:0/4136768267 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3aac00a4a0 con 0x56128d4e9380 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.882+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab4f2d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab4f2d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56128d3dbcf0 con 0x56128d600af0 2024-05-08T09:22:47.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33348/0 (socket says 172.21.15.161:33348) 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab1380640 1 -- 172.21.15.161:0/2599105805 learned_addr learned my addr 172.21.15.161:0/2599105805 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab1380640 1 -- 172.21.15.161:0/2599105805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d601450 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.883+0000 7f3ab1380640 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x56128d5ecf60 tx=0x7f3aac018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f39967fc640 1 -- 172.21.15.161:0/2599105805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac014450 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f39967fc640 1 -- 172.21.15.161:0/2599105805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac014610 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56128d601ec0 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f39967fc640 1 -- 172.21.15.161:0/2599105805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac014930 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128d6023c0 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.884+0000 7f39967fc640 1 -- 172.21.15.161:0/2599105805 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3aac011040 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f39967fc640 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 0x7f3988038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f39967fc640 1 -- 172.21.15.161:0/2599105805 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3aac01e070 con 0x56128d600af0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 0x7f3988038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 0x7f3988038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4052a50 tx=0x7f3aa408c3f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab4f2d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab4f2d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56128d5de210 con 0x56128d60ddd0 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33354/0 (socket says 172.21.15.161:33354) 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.885+0000 7f3ab1380640 1 -- 172.21.15.161:0/4068080622 learned_addr learned my addr 172.21.15.161:0/4068080622 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab1380640 1 -- 172.21.15.161:0/4068080622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d60e7c0 con 0x56128d60ddd0 2024-05-08T09:22:47.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab1380640 1 --2- 172.21.15.161:0/4068080622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3aac04c9d0 tx=0x7f3aac011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5334a56e7de0b963 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3987fff640 1 -- 172.21.15.161:0/4068080622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac016940 con 0x56128d60ddd0 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3987fff640 1 -- 172.21.15.161:0/4068080622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac02ba60 con 0x56128d60ddd0 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3987fff640 1 -- 172.21.15.161:0/4068080622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac02bd40 con 0x56128d60ddd0 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4068080622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 msgr2=0x56128d60e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4068080622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3aac04c9d0 tx=0x7f3aac011700 comp rx=0 tx=0).stop 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4068080622 shutdown_connections 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4068080622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d60e1f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4068080622 >> 172.21.15.161:0/4068080622 conn(0x56128d60a0e0 msgr2=0x56128d608190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4068080622 shutdown_connections 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.886+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4068080622 wait complete. 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab4f2d800 1 Processor -- start 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab4f2d800 1 -- start start 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab4f2d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab4f2d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56128d60ef30 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab1380640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33360/0 (socket says 172.21.15.161:33360) 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 learned_addr learned my addr 172.21.15.161:0/1792859388 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56128d615800 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.887+0000 7f3ab1380640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3aac04c930 tx=0x7f3aac04c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f39867fc640 1 -- 172.21.15.161:0/1792859388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac016940 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f39867fc640 1 -- 172.21.15.161:0/1792859388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aac031030 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f39867fc640 1 -- 172.21.15.161:0/1792859388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3aac04b4f0 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56128d615a90 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56128d618740 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.888+0000 7f39867fc640 1 -- 172.21.15.161:0/1792859388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f3aac04e0d0 con 0x56128d60ddd0 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f39867fc640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f397c036950 0x7f397c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f39867fc640 1 -- 172.21.15.161:0/1792859388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f3aac00e040 con 0x56128d60ddd0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f397c036950 0x7f397c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d620f80 0x56128d623440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d623b90 con 0x56128d620f80 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3aabfff640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d620f80 0x56128d623440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f397c036950 0x7f397c038e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56128d5f1dc0 tx=0x7f3aa407e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.889+0000 7f3aabfff640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d620f80 0x56128d623440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c010510 con 0x56128d620f80 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 realm 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d6203d0 con 0x56128d620f80 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c010510 con 0x56128d620f80 2024-05-08T09:22:47.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d624670 con 0x56128d620f80 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c010510 con 0x56128d620f80 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d624f40 con 0x56128d620f80 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3a9c010510 con 0x56128d620f80 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d625840 0x56128d627c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.890+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d6283c0 con 0x56128d625840 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab1380640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d625840 0x56128d627c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab1380640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d625840 0x56128d627c30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab4f2d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab4f2d800 20 searching for the correct realm 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56128d62a470 0x56128d62c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.891+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56128d62a470 0x56128d62c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56128d62a470 0x56128d62c930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3ab0b7f640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f3aa4084030 0x7f3aa40783f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.892+0000 7f3aabfff640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f3aa4084030 0x7f3aa40783f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3aabfff640 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f3aa4084030 0x7f3aa40783f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c010510 con 0x7f3aa4084030 2024-05-08T09:22:47.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c010510 con 0x56128d620f80 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.893+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.894+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x7f3aa4084030 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.895+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3a9c02a040 con 0x7f3aa4084030 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.896+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.897+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.898+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x7f3aa4084030 2024-05-08T09:22:47.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.899+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d625840 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x7f3aa4084030 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d62a470 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c02a040 con 0x7f3aa4084030 2024-05-08T09:22:47.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.900+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x56128d620f80 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3a9c02a040 con 0x56128d620f80 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d000 con 0x7f3aa4084030 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d628e70 con 0x56128d620f80 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d6292c0 con 0x56128d620f80 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.901+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d6297a0 con 0x56128d620f80 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 zone default found 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 4 Realm: () 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:47.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 zonegroup default 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d62d480 con 0x56128d625840 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d62f6b0 con 0x56128d62a470 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.902+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d62fa50 con 0x56128d62a470 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.903+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.903+0000 7f3ab4f2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:47.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.903+0000 7f3ab4f2d800 20 started sync module instance, tier type = 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.903+0000 7f3ab4f2d800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.903+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eaf0 con 0x7f3aa4084030 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.904+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.904+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637681471200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eaf0 con 0x7f3aa4084030 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.904+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d630300 con 0x56128d620f80 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.905+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637681471200] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.905+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.905+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637681475056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eaf0 con 0x56128d620f80 2024-05-08T09:22:47.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.905+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d630dc0 con 0x56128d62a470 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.906+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.906+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637681477776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d631660 con 0x56128d62a470 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.906+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d632100 con 0x7f3aa4084030 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.906+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637681475056] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.907+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637681477776] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.907+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.907+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637681480112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62e640 con 0x7f3aa4084030 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.907+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d6329a0 con 0x56128d620f80 2024-05-08T09:22:47.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.908+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.908+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637681484912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d632d90 con 0x56128d620f80 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.908+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d6338b0 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.908+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637681480112] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.909+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637681484912] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.910+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.910+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637681485968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d631bd0 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.910+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d634150 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.911+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637681485968] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.911+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.911+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637681488768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d634100 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.911+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d634b40 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637681488768] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637681493520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d634d20 con 0x56128d625840 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=0 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=1 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=2 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=3 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=4 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=5 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.912+0000 7f3ab4f2d800 20 add_watcher() i=6 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.913+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637681493520] v29'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.913+0000 7f3ab4f2d800 20 add_watcher() i=7 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.913+0000 7f3ab4f2d800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.913+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d6380f0 con 0x56128d620f80 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.914+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.914+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637681495056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d635510 con 0x56128d620f80 2024-05-08T09:22:47.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637681495056] v29'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f39677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3ab4f2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3ab4f2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3ab4f2d800 5 note: GC not initialized 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f39667e4640 20 reqs_thread_entry: start 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3ab4f2d800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f3ab4f2d800 20 Filter name: none 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.915+0000 7f395f7fe640 20 reqs_thread_entry: start 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.916+0000 7f3ab4f2d800 20 rados->read ofs=0 len=0 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.916+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d66b080 con 0x56128d620f80 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.916+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.916+0000 7f3ab4f2d800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.916+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56128d66c470 con 0x56128d625840 2024-05-08T09:22:47.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.917+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv29 ondisk = 0) ==== 152+0+1268 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.917+0000 7f39677e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.917+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637681495056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d61e470 con 0x56128d620f80 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.918+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94637681495056] v29'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.918+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637681471200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d61e470 con 0x7f3aa4084030 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.919+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94637681471200] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.919+0000 7f3ab4f2d800 20 remove_watcher() i=0 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.919+0000 7f3ab4f2d800 2 removed watcher, disabling cache 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.919+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637681475056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eee0 con 0x56128d620f80 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.920+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94637681475056] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.920+0000 7f3ab4f2d800 20 remove_watcher() i=1 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.920+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637681477776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eee0 con 0x56128d62a470 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.921+0000 7f3ab0b7f640 1 -- 172.21.15.161:0/1792859388 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94637681477776] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aa4064070 con 0x56128d62a470 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.921+0000 7f3ab4f2d800 20 remove_watcher() i=2 2024-05-08T09:22:47.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.921+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637681480112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eee0 con 0x7f3aa4084030 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.922+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94637681480112] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x7f3aa4084030 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.922+0000 7f3ab4f2d800 20 remove_watcher() i=3 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.922+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637681484912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d6311b0 con 0x56128d620f80 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.923+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94637681484912] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3a9c03c040 con 0x56128d620f80 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.923+0000 7f3ab4f2d800 20 remove_watcher() i=4 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.923+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637681485968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eee0 con 0x56128d625840 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.924+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94637681485968] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.924+0000 7f3ab4f2d800 20 remove_watcher() i=5 2024-05-08T09:22:47.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.924+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637681488768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d6311b0 con 0x56128d625840 2024-05-08T09:22:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.925+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94637681488768] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.925+0000 7f3ab4f2d800 20 remove_watcher() i=6 2024-05-08T09:22:47.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.925+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637681493520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56128d62eee0 con 0x56128d625840 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.926+0000 7f3ab1380640 1 -- 172.21.15.161:0/1792859388 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94637681493520] v29'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3aac02a070 con 0x56128d625840 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.926+0000 7f3ab4f2d800 20 remove_watcher() i=7 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d625840 msgr2=0x56128d627c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d625840 0x56128d627c30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d620f80 msgr2=0x56128d623440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d620f80 0x56128d623440 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f3aa4084030 msgr2=0x7f3aa40783f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f3aa4084030 0x7f3aa40783f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56128d62a470 msgr2=0x56128d62c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56128d62a470 0x56128d62c930 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f397c036950 msgr2=0x7f397c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f397c036950 0x7f397c038e10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x56128d5f1dc0 tx=0x7f3aa407e000 comp rx=0 tx=0).stop 2024-05-08T09:22:47.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3aabfff640 1 -- 172.21.15.161:0/1792859388 reap_dead start 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 msgr2=0x56128d6152c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3aac04c930 tx=0x7f3aac04c960 comp rx=0 tx=0).stop 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 shutdown_connections 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/1792859388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d60ddd0 0x56128d6152c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 >> 172.21.15.161:0/1792859388 conn(0x56128d60a0e0 msgr2=0x56128d607790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 shutdown_connections 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/1792859388 wait complete. 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 msgr2=0x7f3988038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 0x7f3988038dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4052a50 tx=0x7f3aa408c3f0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 msgr2=0x56128d600f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x56128d5ecf60 tx=0x7f3aac018830 comp rx=0 tx=0).stop 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 shutdown_connections 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3988036900 0x7f3988038dc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/2599105805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d600af0 0x56128d600f10 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 >> 172.21.15.161:0/2599105805 conn(0x56128d5f4b90 msgr2=0x56128d5f4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 shutdown_connections 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.927+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/2599105805 wait complete. 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 msgr2=0x56128d5f12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 0x56128d5f12d0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 msgr2=0x56128d5ec640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 0x56128d5ec640 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 msgr2=0x7f3998038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 0x7f3998038dc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c000f60 tx=0x7f3a9c0013f0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 msgr2=0x56128d5e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40057e0 tx=0x7f3aa4002fb0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 shutdown_connections 2024-05-08T09:22:47.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56128d5eeee0 0x56128d5f12d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56128d4e9380 0x56128d5ec640 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f3998036900 0x7f3998038dc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 --2- 172.21.15.161:0/4136768267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56128d4e8a20 0x56128d5e5400 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 >> 172.21.15.161:0/4136768267 conn(0x56128d4e45c0 msgr2=0x56128d5d7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 shutdown_connections 2024-05-08T09:22:47.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.928+0000 7f3ab4f2d800 1 -- 172.21.15.161:0/4136768267 wait complete. 2024-05-08T09:22:47.937 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-05-08T09:00:00.000000Z","epoch":1715158800,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-05-08T09:22:47.937 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-05-08T09:22:47.938 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T09:22:47.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-05-08T09:22:47.938 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-05-08T09:22:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:47.991 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04f234800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55978bee9560 0x55978bef2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04f234800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55978be5c960 con 0x55978bee7a20 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04f234800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55978bd7a050 con 0x55978bee9560 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff043fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55978bee9560 0x55978bef2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff043fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55978bee9560 0x55978bef2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33376/0 (socket says 172.21.15.161:33376) 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff04a5c0640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55978bee7a20 0x55978bee7e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55492/0 (socket says 172.21.15.161:55492) 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.993+0000 7ff043fff640 1 -- 172.21.15.161:0/816978421 learned_addr learned my addr 172.21.15.161:0/816978421 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.994+0000 7ff043fff640 1 -- 172.21.15.161:0/816978421 >> v1:172.21.15.45:6789/0 conn(0x55978bee7a20 legacy=0x55978bee7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.994+0000 7ff043fff640 1 -- 172.21.15.161:0/816978421 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978bef35b0 con 0x55978bee9560 2024-05-08T09:22:47.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.995+0000 7ff043fff640 1 --2- 172.21.15.161:0/816978421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee9560 0x55978bef2060 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff03400a520 tx=0x7ff03401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98f322baa14745f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:47.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff049dbf640 1 -- 172.21.15.161:0/816978421 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff034057070 con 0x55978bee9560 2024-05-08T09:22:47.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff049dbf640 1 -- 172.21.15.161:0/816978421 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff034052570 con 0x55978bee9560 2024-05-08T09:22:47.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff049dbf640 1 -- 172.21.15.161:0/816978421 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff034052870 con 0x55978bee9560 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 -- 172.21.15.161:0/816978421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee9560 msgr2=0x55978bef2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 --2- 172.21.15.161:0/816978421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee9560 0x55978bef2060 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff03400a520 tx=0x7ff03401d010 comp rx=0 tx=0).stop 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 -- 172.21.15.161:0/816978421 shutdown_connections 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 --2- 172.21.15.161:0/816978421 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee9560 0x55978bef2060 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 -- 172.21.15.161:0/816978421 >> 172.21.15.161:0/816978421 conn(0x55978bee35e0 msgr2=0x55978bee5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 -- 172.21.15.161:0/816978421 shutdown_connections 2024-05-08T09:22:47.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:47.996+0000 7ff04f234800 1 -- 172.21.15.161:0/816978421 wait complete. 2024-05-08T09:22:48.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.010+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:48.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.010+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:48.010 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.010+0000 7ff04f234800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.010+0000 7ff04f234800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55978be341f0 con 0x55978bee7a20 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7ff04a5c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7ff04a5c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33386/0 (socket says 172.21.15.161:33386) 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7ff04a5c0640 1 -- 172.21.15.161:0/1057555314 learned_addr learned my addr 172.21.15.161:0/1057555314 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7ff04a5c0640 1 -- 172.21.15.161:0/1057555314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978bfdd220 con 0x55978bee7a20 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/1057555314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff03c001eb0 tx=0x7ff03c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16113fa934938fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7fef38608640 1 -- 172.21.15.161:0/1057555314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03c00e5c0 con 0x55978bee7a20 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7fef38608640 1 -- 172.21.15.161:0/1057555314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c006070 con 0x55978bee7a20 2024-05-08T09:22:48.011 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.011+0000 7fef38608640 1 -- 172.21.15.161:0/1057555314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03c00e8b0 con 0x55978bee7a20 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- 172.21.15.161:0/1057555314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 msgr2=0x55978bfdcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 --2- 172.21.15.161:0/1057555314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff03c001eb0 tx=0x7ff03c00b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- 172.21.15.161:0/1057555314 shutdown_connections 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 --2- 172.21.15.161:0/1057555314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfdcc50 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- 172.21.15.161:0/1057555314 >> 172.21.15.161:0/1057555314 conn(0x55978bee35e0 msgr2=0x55978bfd84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- 172.21.15.161:0/1057555314 shutdown_connections 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- 172.21.15.161:0/1057555314 wait complete. 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.012+0000 7ff04f234800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55978bef2870 con 0x55978bee7a20 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04a5c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04a5c0640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33402/0 (socket says 172.21.15.161:33402) 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04a5c0640 1 -- 172.21.15.161:0/2138921471 learned_addr learned my addr 172.21.15.161:0/2138921471 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04a5c0640 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978bfe4d00 con 0x55978bee7a20 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00c010 tx=0x7ff03c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7fef36e05640 1 -- 172.21.15.161:0/2138921471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03c01a7c0 con 0x55978bee7a20 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7fef36e05640 1 -- 172.21.15.161:0/2138921471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff03c01a980 con 0x55978bee7a20 2024-05-08T09:22:48.014 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978bfe4f90 con 0x55978bee7a20 2024-05-08T09:22:48.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.013+0000 7fef36e05640 1 -- 172.21.15.161:0/2138921471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff03c01ace0 con 0x55978bee7a20 2024-05-08T09:22:48.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.014+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978bfe7c40 con 0x55978bee7a20 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.014+0000 7fef36e05640 1 -- 172.21.15.161:0/2138921471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff03c017070 con 0x55978bee7a20 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.014+0000 7fef36e05640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 0x7fef30038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7fef36e05640 1 -- 172.21.15.161:0/2138921471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff03c015020 con 0x55978bee7a20 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff043fff640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 0x7fef30038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 0x55978bfebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978bfec370 con 0x55978bfe99f0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04adc1640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 0x55978bfebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff043fff640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 0x7fef30038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff034054000 tx=0x7ff03404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04adc1640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 0x55978bfebde0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04adc1640 1 -- 172.21.15.161:0/2138921471 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff04400a4a0 con 0x55978bfe99f0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.015+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978bfe8fd0 con 0x55978bfe99f0 2024-05-08T09:22:48.019 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04adc1640 1 -- 172.21.15.161:0/2138921471 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff04400a4a0 con 0x55978bfe99f0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 0x55978bff0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978bff11a0 con 0x55978bfee6c0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 0x55978bff0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 0x55978bff0ab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.016+0000 7ff04a5c0640 1 -- 172.21.15.161:0/2138921471 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff03c02e070 con 0x55978bfee6c0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978bfed670 con 0x55978bfe99f0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04adc1640 1 -- 172.21.15.161:0/2138921471 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff04400a4a0 con 0x55978bfe99f0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978bfedb50 con 0x55978bfe99f0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04adc1640 1 -- 172.21.15.161:0/2138921471 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff04400a4a0 con 0x55978bfe99f0 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.017+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04f234800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.020 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04f234800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55978bddacf0 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33410/0 (socket says 172.21.15.161:33410) 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04adc1640 1 -- 172.21.15.161:0/4199602199 learned_addr learned my addr 172.21.15.161:0/4199602199 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04adc1640 1 -- 172.21.15.161:0/4199602199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978c000c70 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04adc1640 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55978bfec770 tx=0x7ff044018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7fef2ffff640 1 -- 172.21.15.161:0/4199602199 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044014450 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7fef2ffff640 1 -- 172.21.15.161:0/4199602199 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044014610 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978c0016e0 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7fef2ffff640 1 -- 172.21.15.161:0/4199602199 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044014930 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.018+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978c001be0 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.019+0000 7fef2ffff640 1 -- 172.21.15.161:0/4199602199 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff044011040 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.019+0000 7fef2ffff640 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 0x7fef24038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.019+0000 7fef2ffff640 1 -- 172.21.15.161:0/4199602199 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff04401e070 con 0x55978c000310 2024-05-08T09:22:48.021 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.019+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 0x7fef24038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.020+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:48.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.020+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:48.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.020+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 0x7fef24038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55978bfec810 tx=0x7ff03c04b320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.020+0000 7ff04f234800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.020+0000 7ff04f234800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55978bfdd5a0 con 0x55978beea000 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33416/0 (socket says 172.21.15.161:33416) 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7ff04adc1640 1 -- 172.21.15.161:0/809875781 learned_addr learned my addr 172.21.15.161:0/809875781 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7ff04adc1640 1 -- 172.21.15.161:0/809875781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978beea9b0 con 0x55978beea000 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7ff04adc1640 1 --2- 172.21.15.161:0/809875781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff04404c8b0 tx=0x7ff044011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d769b6655cf1110 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7fef2dffb640 1 -- 172.21.15.161:0/809875781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044028070 con 0x55978beea000 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7fef2dffb640 1 -- 172.21.15.161:0/809875781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044022d90 con 0x55978beea000 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.021+0000 7fef2dffb640 1 -- 172.21.15.161:0/809875781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044016ab0 con 0x55978beea000 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- 172.21.15.161:0/809875781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 msgr2=0x55978beea3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 --2- 172.21.15.161:0/809875781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff04404c8b0 tx=0x7ff044011a80 comp rx=0 tx=0).stop 2024-05-08T09:22:48.031 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- 172.21.15.161:0/809875781 shutdown_connections 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 --2- 172.21.15.161:0/809875781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978beea3e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- 172.21.15.161:0/809875781 >> 172.21.15.161:0/809875781 conn(0x55978c009950 msgr2=0x55978c0079b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- 172.21.15.161:0/809875781 shutdown_connections 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- 172.21.15.161:0/809875781 wait complete. 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 Processor -- start 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- start start 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04f234800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55978beeb1b0 con 0x55978beea000 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04adc1640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33432/0 (socket says 172.21.15.161:33432) 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.022+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 learned_addr learned my addr 172.21.15.161:0/3998581613 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.032 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978c0194b0 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7ff04adc1640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff04404c8b0 tx=0x7ff04404c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7fef1bfff640 1 -- 172.21.15.161:0/3998581613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044032070 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7fef1bfff640 1 -- 172.21.15.161:0/3998581613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff044046070 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7fef1bfff640 1 -- 172.21.15.161:0/3998581613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff044028050 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55978c019740 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.023+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978c01c3f0 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.024+0000 7fef1bfff640 1 -- 172.21.15.161:0/3998581613 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7ff044035070 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.024+0000 7fef1bfff640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef14036950 0x7fef14038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.024+0000 7fef1bfff640 1 -- 172.21.15.161:0/3998581613 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7ff04400e040 con 0x55978beea000 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.024+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef14036950 0x7fef14038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978c024c50 0x55978c027110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c027860 con 0x55978c024c50 2024-05-08T09:22:48.033 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef14036950 0x7fef14038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff03c04b6b0 tx=0x7ff03c034000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff043fff640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978c024c50 0x55978c027110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff043fff640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978c024c50 0x55978c027110 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 20 realm 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.025+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c027c30 con 0x55978c024c50 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c028050 con 0x55978c024c50 2024-05-08T09:22:48.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c0288f0 con 0x55978c024c50 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978c029310 0x55978c02b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c02bda0 con 0x55978c029310 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.026+0000 7ff04adc1640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978c029310 0x55978c02b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04adc1640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978c029310 0x55978c02b700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04f234800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04f234800 20 searching for the correct realm 2024-05-08T09:22:48.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55978c02dd70 0x55978c030230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.027+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55978c02dd70 0x55978c030230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.028+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55978c02dd70 0x55978c030230 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.028+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.028+0000 7ff04a5c0640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7ff03c00f070 0x7ff03c019800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.028+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.028+0000 7ff043fff640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7ff03c00f070 0x7ff03c019800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.029+0000 7ff043fff640 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7ff03c00f070 0x7ff03c019800 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.029+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.029+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.029+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.030+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.037 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.031+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.032+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.033+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.034+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.035+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c029310 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c02dd70 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.036+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x55978c024c50 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55978c030900 con 0x7ff03c00f070 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:48.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c02c760 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.037+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c02d000 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c02c3a0 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:48.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 zone default found 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 4 Realm: () 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 zonegroup default 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c031230 con 0x55978c029310 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.038+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c032fb0 con 0x55978c02dd70 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c033440 con 0x55978c02dd70 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 20 started sync module instance, tier type = 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.039+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032450 con 0x7ff03c00f070 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.040+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.040+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94109377440080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032450 con 0x7ff03c00f070 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.040+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c033f20 con 0x55978c024c50 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.041+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94109377440080] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.041+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.041+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94109377444368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032450 con 0x55978c024c50 2024-05-08T09:22:48.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.041+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0349a0 con 0x55978c02dd70 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.042+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.042+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94109377447088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c035240 con 0x55978c02dd70 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.042+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c035d00 con 0x7ff03c00f070 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.042+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94109377444368] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.043+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94109377447088] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.043+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.043+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94109377449360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c031fa0 con 0x7ff03c00f070 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.043+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0365a0 con 0x55978c024c50 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.044+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.044+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94109377454160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0369d0 con 0x55978c024c50 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.044+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0374c0 con 0x55978c029310 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.044+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94109377449360] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.045+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94109377454160] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.046+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.046+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94109377455216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0357d0 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.046+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c037d60 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.047+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94109377455216] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.047+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.047+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94109377458064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c037d60 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.047+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c0387a0 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94109377458064] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94109377462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c038980 con 0x55978c029310 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=0 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=1 2024-05-08T09:22:48.056 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=2 2024-05-08T09:22:48.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=3 2024-05-08T09:22:48.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=4 2024-05-08T09:22:48.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=5 2024-05-08T09:22:48.057 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.048+0000 7ff04f234800 20 add_watcher() i=6 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.049+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94109377462896] v29'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.049+0000 7ff04f234800 20 add_watcher() i=7 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.049+0000 7ff04f234800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.049+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c03bd50 con 0x55978c024c50 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.050+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.050+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94109377464432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c039140 con 0x55978c024c50 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94109377464432] v29'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7fef00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff04f234800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff04f234800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff04f234800 5 note: GC not initialized 2024-05-08T09:22:48.062 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7fee7b7fe640 20 reqs_thread_entry: start 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff04f234800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7ff04f234800 20 Filter name: none 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.051+0000 7fee797fa640 20 reqs_thread_entry: start 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c06f150 con 0x55978c029310 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c06d8f0 con 0x55978c024c50 2024-05-08T09:22:48.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.052+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c06e1c0 con 0x55978c029310 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.053+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.053+0000 7ff04f234800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.053+0000 7ff04f234800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.053+0000 7ff04f234800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.053+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94109377682704 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c0725e0 con 0x55978c029310 2024-05-08T09:22:48.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== watch-notify(notify (1) cookie 94109377462896 notify 124554051604 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55978c06d9d0 con 0x55978c029310 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7fef2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94109377462896 notifier 4715 bl.length()=556 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7fef2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7fef2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(65 notify.7 [notify cookie 94109377682704 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7fef2dffb640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fef10003ea0 con 0x55978c029310 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify_complete (2) cookie 94109377682704 notify 124554051604 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55978c019740 con 0x55978c029310 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.054+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c06e1c0 con 0x55978c024c50 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.055+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.055+0000 7ff04f234800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.055+0000 7ff04f234800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.055+0000 7ff04f234800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T09:22:48.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.055+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94109377682704 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55978c072560 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== watch-notify(notify (1) cookie 94109377455216 notify 124554051605 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55978c019740 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7fef2d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94109377455216 notifier 4715 bl.length()=177 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7fef2d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7fef2d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7fef2d7fa640 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fee80003400 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(68 notify.5 [notify cookie 94109377682704 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== watch-notify(notify_complete (2) cookie 94109377682704 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55978c0194b0 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.056+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.066 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T09:22:48.053588Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:22:48.053572Z","tags":[],"group_ids":[]} 2024-05-08T09:22:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.057+0000 7fef00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:48.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.057+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94109377464432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c06e330 con 0x55978c024c50 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.058+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94109377464432] v29'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.058+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94109377440080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c038870 con 0x7ff03c00f070 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.059+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94109377440080] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.059+0000 7ff04f234800 20 remove_watcher() i=0 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.059+0000 7ff04f234800 2 removed watcher, disabling cache 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.059+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94109377444368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c038870 con 0x55978c024c50 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.060+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94109377444368] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.060+0000 7ff04f234800 20 remove_watcher() i=1 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.060+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94109377447088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c038870 con 0x55978c02dd70 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.062+0000 7ff04a5c0640 1 -- 172.21.15.161:0/3998581613 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94109377447088] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03c02e070 con 0x55978c02dd70 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.062+0000 7ff04f234800 20 remove_watcher() i=2 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.062+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94109377449360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032950 con 0x7ff03c00f070 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.063+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94109377449360] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x7ff03c00f070 2024-05-08T09:22:48.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.063+0000 7ff04f234800 20 remove_watcher() i=3 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.063+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94109377454160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032950 con 0x55978c024c50 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.064+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94109377454160] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff03405a040 con 0x55978c024c50 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.064+0000 7ff04f234800 20 remove_watcher() i=4 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.064+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94109377455216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032950 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.065+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94109377455216] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.065+0000 7ff04f234800 20 remove_watcher() i=5 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.065+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94109377458064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032950 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.066+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94109377458064] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.066+0000 7ff04f234800 20 remove_watcher() i=6 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.066+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94109377462896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55978c032950 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04adc1640 1 -- 172.21.15.161:0/3998581613 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94109377462896] v29'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff044034030 con 0x55978c029310 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 20 remove_watcher() i=7 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978c029310 msgr2=0x55978c02b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978c029310 0x55978c02b700 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978c024c50 msgr2=0x55978c027110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978c024c50 0x55978c027110 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7ff03c00f070 msgr2=0x7ff03c019800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7ff03c00f070 0x7ff03c019800 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55978c02dd70 msgr2=0x55978c030230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55978c02dd70 0x55978c030230 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef14036950 msgr2=0x7fef14038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef14036950 0x7fef14038e10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff03c04b6b0 tx=0x7ff03c034000 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 msgr2=0x55978c018f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff043fff640 1 -- 172.21.15.161:0/3998581613 reap_dead start 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff04404c8b0 tx=0x7ff04404c840 comp rx=0 tx=0).stop 2024-05-08T09:22:48.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 shutdown_connections 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/3998581613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978beea000 0x55978c018f70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 >> 172.21.15.161:0/3998581613 conn(0x55978c009950 msgr2=0x55978c006fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 shutdown_connections 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/3998581613 wait complete. 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 msgr2=0x7fef24038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 0x7fef24038dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55978bfec810 tx=0x7ff03c04b320 comp rx=0 tx=0).stop 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 msgr2=0x55978c000730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x55978bfec770 tx=0x7ff044018830 comp rx=0 tx=0).stop 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 shutdown_connections 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef24036900 0x7fef24038dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 --2- 172.21.15.161:0/4199602199 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978c000310 0x55978c000730 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 >> 172.21.15.161:0/4199602199 conn(0x55978bff43b0 msgr2=0x55978bff47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 shutdown_connections 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.068+0000 7ff04f234800 1 -- 172.21.15.161:0/4199602199 wait complete. 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 msgr2=0x55978bff0ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 0x55978bff0ab0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 msgr2=0x55978bfebde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 0x55978bfebde0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 msgr2=0x7fef30038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 0x7fef30038e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff034054000 tx=0x7ff03404e000 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 msgr2=0x55978bfe47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00c010 tx=0x7ff03c000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 shutdown_connections 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55978bfee6c0 0x55978bff0ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55978bfe99f0 0x55978bfebde0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fef30036950 0x7fef30038e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 --2- 172.21.15.161:0/2138921471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55978bee7a20 0x55978bfe47c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 >> 172.21.15.161:0/2138921471 conn(0x55978bee35e0 msgr2=0x55978bfd6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 shutdown_connections 2024-05-08T09:22:48.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.069+0000 7ff04f234800 1 -- 172.21.15.161:0/2138921471 wait complete. 2024-05-08T09:22:48.078 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T09:22:48.053588Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:22:48.053572Z', 'tags': [], 'group_ids': []} 2024-05-08T09:22:48.094 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:48.099 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-05-08T09:22:48.099 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T09:22:48.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-05-08T09:22:48.099 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-05-08T09:22:48.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:48.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.146+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.146+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.146+0000 7f8c1bd31800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b4e5b65550 0x55b4e5b6e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.146+0000 7f8c1bd31800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b4e5ad8910 con 0x55b4e5b63a10 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.146+0000 7f8c1bd31800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55b4e59f6050 con 0x55b4e5b65550 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c1722e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b4e5b65550 0x55b4e5b6e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c17a2f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55b4e5b63a10 0x55b4e5b63e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55508/0 (socket says 172.21.15.161:55508) 2024-05-08T09:22:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c1722e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55b4e5b65550 0x55b4e5b6e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33436/0 (socket says 172.21.15.161:33436) 2024-05-08T09:22:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c17a2f640 1 -- 172.21.15.161:0/1297186835 learned_addr learned my addr 172.21.15.161:0/1297186835 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c1722e640 1 -- 172.21.15.161:0/1297186835 >> v1:172.21.15.45:6789/0 conn(0x55b4e5b63a10 legacy=0x55b4e5b63e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.147+0000 7f8c1722e640 1 -- 172.21.15.161:0/1297186835 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5ad8ae0 con 0x55b4e5b65550 2024-05-08T09:22:48.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1722e640 1 --2- 172.21.15.161:0/1297186835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b65550 0x55b4e5b6e050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00a470 tx=0x7f8c0c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25513bb1db07bf62 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c16a2d640 1 -- 172.21.15.161:0/1297186835 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c057070 con 0x55b4e5b65550 2024-05-08T09:22:48.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c16a2d640 1 -- 172.21.15.161:0/1297186835 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0c052570 con 0x55b4e5b65550 2024-05-08T09:22:48.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c16a2d640 1 -- 172.21.15.161:0/1297186835 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0c052870 con 0x55b4e5b65550 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1297186835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b65550 msgr2=0x55b4e5b6e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1297186835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b65550 0x55b4e5b6e050 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c00a470 tx=0x7f8c0c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1297186835 shutdown_connections 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1297186835 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b65550 0x55b4e5b6e050 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1297186835 >> 172.21.15.161:0/1297186835 conn(0x55b4e5b5f5b0 msgr2=0x55b4e5b619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1297186835 shutdown_connections 2024-05-08T09:22:48.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.149+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1297186835 wait complete. 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.163+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.163+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.163+0000 7f8c1bd31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.163+0000 7f8c1bd31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4e5ab01c0 con 0x55b4e5b63a10 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8c17a2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8c17a2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33450/0 (socket says 172.21.15.161:33450) 2024-05-08T09:22:48.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8c17a2f640 1 -- 172.21.15.161:0/1828103843 learned_addr learned my addr 172.21.15.161:0/1828103843 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8c17a2f640 1 -- 172.21.15.161:0/1828103843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5c58ec0 con 0x55b4e5b63a10 2024-05-08T09:22:48.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/1828103843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001de0 tx=0x7f8c0800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d177016c7223915 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8b05e0b640 1 -- 172.21.15.161:0/1828103843 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c08012020 con 0x55b4e5b63a10 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8b05e0b640 1 -- 172.21.15.161:0/1828103843 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0800e5a0 con 0x55b4e5b63a10 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.164+0000 7f8b05e0b640 1 -- 172.21.15.161:0/1828103843 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0800e8c0 con 0x55b4e5b63a10 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1828103843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 msgr2=0x55b4e5c588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1828103843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8c08001de0 tx=0x7f8c0800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1828103843 shutdown_connections 2024-05-08T09:22:48.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1828103843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c588f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1828103843 >> 172.21.15.161:0/1828103843 conn(0x55b4e5b5f5b0 msgr2=0x55b4e5c54210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1828103843 shutdown_connections 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1828103843 wait complete. 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.165+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c1bd31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c1bd31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4e5b6e860 con 0x55b4e5b63a10 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c17a2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c17a2f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33454/0 (socket says 172.21.15.161:33454) 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3688343826 learned_addr learned my addr 172.21.15.161:0/3688343826 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5c609a0 con 0x55b4e5b63a10 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c010 tx=0x7f8c08000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8afffff640 1 -- 172.21.15.161:0/3688343826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c08012070 con 0x55b4e5b63a10 2024-05-08T09:22:48.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8afffff640 1 -- 172.21.15.161:0/3688343826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0801a7a0 con 0x55b4e5b63a10 2024-05-08T09:22:48.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.166+0000 7f8afffff640 1 -- 172.21.15.161:0/3688343826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c0801aa80 con 0x55b4e5b63a10 2024-05-08T09:22:48.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.167+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4e5c60c30 con 0x55b4e5b63a10 2024-05-08T09:22:48.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.167+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e5c638e0 con 0x55b4e5b63a10 2024-05-08T09:22:48.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.167+0000 7f8afffff640 1 -- 172.21.15.161:0/3688343826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8c08015020 con 0x55b4e5b63a10 2024-05-08T09:22:48.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.167+0000 7f8afffff640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 0x7f8b00038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8afffff640 1 -- 172.21.15.161:0/3688343826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8c08020070 con 0x55b4e5b63a10 2024-05-08T09:22:48.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 0x7f8b00038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 0x55b4e5c676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c67be0 con 0x55b4e5b65550 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c18230640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 0x55b4e5c676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 0x7f8b00038e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c054000 tx=0x7f8c0c04e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c18230640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 0x55b4e5c676a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c18230640 1 -- 172.21.15.161:0/3688343826 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c1000a4a0 con 0x55b4e5b65550 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.168+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c64c70 con 0x55b4e5b65550 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.169+0000 7f8c18230640 1 -- 172.21.15.161:0/3688343826 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c1000a4a0 con 0x55b4e5b65550 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.169+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 0x55b4e5c6c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.169+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c6ca20 con 0x55b4e5c69f60 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.169+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 0x55b4e5c6c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.169+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 0x55b4e5c6c350 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.170+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3688343826 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5c69f60 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.170+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c68f10 con 0x55b4e5b65550 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.170+0000 7f8c18230640 1 -- 172.21.15.161:0/3688343826 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c1000a4a0 con 0x55b4e5b65550 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.170+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c693b0 con 0x55b4e5b65550 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.170+0000 7f8c18230640 1 -- 172.21.15.161:0/3688343826 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8c1000a4a0 con 0x55b4e5b65550 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c1bd31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c1bd31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4e5a56cf0 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33466/0 (socket says 172.21.15.161:33466) 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.171+0000 7f8c18230640 1 -- 172.21.15.161:0/4125544620 learned_addr learned my addr 172.21.15.161:0/4125544620 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8c18230640 1 -- 172.21.15.161:0/4125544620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5c7c510 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8c18230640 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55b4e5c67fc0 tx=0x7f8c10018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8afd7fa640 1 -- 172.21.15.161:0/4125544620 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10014450 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8afd7fa640 1 -- 172.21.15.161:0/4125544620 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c100145f0 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4e5c7cf80 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8afd7fa640 1 -- 172.21.15.161:0/4125544620 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c100148f0 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.172+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e5c7d480 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8afd7fa640 1 -- 172.21.15.161:0/4125544620 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8c10011040 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8afd7fa640 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 0x7f8af0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8afd7fa640 1 -- 172.21.15.161:0/4125544620 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8c1001e070 con 0x55b4e5c7bbb0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 0x7f8af0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 0x7f8af0038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b4e5c680b0 tx=0x7f8c0800b6c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c1bd31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.173+0000 7f8c1bd31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4e5c59240 con 0x55b4e5c88f90 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33482/0 (socket says 172.21.15.161:33482) 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8c18230640 1 -- 172.21.15.161:0/1150726252 learned_addr learned my addr 172.21.15.161:0/1150726252 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8c18230640 1 -- 172.21.15.161:0/1150726252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5c89980 con 0x55b4e5c88f90 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8c18230640 1 --2- 172.21.15.161:0/1150726252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8c10011f80 tx=0x7f8c100118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b649b9126b12cc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8af6ffd640 1 -- 172.21.15.161:0/1150726252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1004e2e0 con 0x55b4e5c88f90 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8af6ffd640 1 -- 172.21.15.161:0/1150726252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1004b200 con 0x55b4e5c88f90 2024-05-08T09:22:48.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.174+0000 7f8af6ffd640 1 -- 172.21.15.161:0/1150726252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1004b4e0 con 0x55b4e5c88f90 2024-05-08T09:22:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1150726252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 msgr2=0x55b4e5c893b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1150726252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8c10011f80 tx=0x7f8c100118e0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.187 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1150726252 shutdown_connections 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/1150726252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c893b0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1150726252 >> 172.21.15.161:0/1150726252 conn(0x55b4e5c85210 msgr2=0x55b4e5c83270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1150726252 shutdown_connections 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- 172.21.15.161:0/1150726252 wait complete. 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 Processor -- start 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- start start 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c1bd31800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55b4e5c8a050 con 0x55b4e5c88f90 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c18230640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33496/0 (socket says 172.21.15.161:33496) 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.175+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 learned_addr learned my addr 172.21.15.161:0/3484756914 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:48.188 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b4e5c90950 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8c18230640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8c10011fd0 tx=0x7f8c1004c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8af57fa640 1 -- 172.21.15.161:0/3484756914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c10022dc0 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8af57fa640 1 -- 172.21.15.161:0/3484756914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c1004c9d0 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b4e5c90be0 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8af57fa640 1 -- 172.21.15.161:0/3484756914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8c1004ccf0 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.176+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4e5c93890 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.177+0000 7f8af57fa640 1 -- 172.21.15.161:0/3484756914 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8c1003b2a0 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.177+0000 7f8af57fa640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ae0036950 0x7f8ae0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.177+0000 7f8af57fa640 1 -- 172.21.15.161:0/3484756914 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8c1000e040 con 0x55b4e5c88f90 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.177+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ae0036950 0x7f8ae0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.177+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ae0036950 0x7f8ae0038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c0804aa30 tx=0x7f8c08031040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5c9bf10 0x55b4e5c9e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.189 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c9eb20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5c9bf10 0x55b4e5c9e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5c9bf10 0x55b4e5c9e3d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 20 realm 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.178+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c9eef0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c9f7c0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.190 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5c9fb60 con 0x55b4e5c9bf10 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5ca08c0 0x55b4e5ca2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca3270 con 0x55b4e5ca08c0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.179+0000 7f8c18230640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5ca08c0 0x55b4e5ca2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c18230640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5ca08c0 0x55b4e5ca2cb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:48.191 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c1bd31800 20 searching for the correct realm 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4e5ca5240 0x55b4e5ca7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.180+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4e5ca5240 0x55b4e5ca7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.181+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4e5ca5240 0x55b4e5ca7700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.181+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.181+0000 7f8c17a2f640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8c08017050 0x7f8c0804c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.181+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.181+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8c08017050 0x7f8c0804c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.182+0000 7f8c1722e640 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8c08017050 0x7f8c0804c780 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.182+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.182+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.182+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.182+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.183+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.183+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.183+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.183+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.184+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.185+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.186+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.187+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.187+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.187+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.187+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.187+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.188+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.189+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.205 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.190+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca7dd0 con 0x7f8c08017050 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:48.206 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca3c60 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca4500 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca38a0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 zone default found 2024-05-08T09:22:48.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 4 Realm: () 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 zonegroup default 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.191+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca82c0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5caa590 con 0x55b4e5ca5240 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.192+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5caa930 con 0x55b4e5ca5240 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.193+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.193+0000 7f8c1bd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.193+0000 7f8c1bd31800 20 started sync module instance, tier type = 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.193+0000 7f8c1bd31800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.193+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca9a20 con 0x7f8c08017050 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.194+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.194+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94235437735760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca9a20 con 0x7f8c08017050 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.194+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cab380 con 0x55b4e5c9bf10 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.195+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94235437735760] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.195+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.195+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94235437739664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca9a20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.195+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cabdd0 con 0x55b4e5ca5240 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.196+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94235437739664] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.196+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.196+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94235437733232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ca9990 con 0x55b4e5ca5240 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.196+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cacc90 con 0x7f8c08017050 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.197+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94235437733232] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.197+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.197+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94235437746144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cad0b0 con 0x7f8c08017050 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.197+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cada70 con 0x55b4e5c9bf10 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.198+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94235437746144] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.198+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.198+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94235437747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cada70 con 0x55b4e5c9bf10 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.198+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cae430 con 0x55b4e5ca08c0 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.199+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94235437747680] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.199+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.199+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94235437749696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cad9e0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.199+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5caf1b0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.200+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94235437749696] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.200+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.200+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94235437754320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5caf170 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.200+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cafc20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94235437754320] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94235437755376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cafbe0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=0 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=1 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=2 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=3 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=4 2024-05-08T09:22:48.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=5 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.201+0000 7f8c1bd31800 20 add_watcher() i=6 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.202+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94235437755376] v29'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.202+0000 7f8c1bd31800 20 add_watcher() i=7 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.202+0000 7f8c1bd31800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.202+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cb3070 con 0x55b4e5c9bf10 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.203+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.203+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94235437758720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cb0590 con 0x55b4e5c9bf10 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94235437758720] v29'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1bd31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1bd31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1bd31800 5 note: GC not initialized 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8accfe1640 20 reqs_thread_entry: start 2024-05-08T09:22:48.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1bd31800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8c1bd31800 20 Filter name: none 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.204+0000 7f8a467fc640 20 reqs_thread_entry: start 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ce6520 con 0x55b4e5ca08c0 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:48.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.205+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cea5e0 con 0x7f8c08017050 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.206+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.206+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.206+0000 7f8c1bd31800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.206+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.206+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94235437994176 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb0b0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== watch-notify(notify (1) cookie 94235437749696 notify 124554051607 ret 0) ==== 424+0+0 (crc 0 0 0) 0x55b4e5c90be0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8af6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94235437749696 notifier 4722 bl.length()=382 2024-05-08T09:22:48.225 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8af6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8af6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8af6ffd640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8adc003ea0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(64 notify.5 [notify cookie 94235437994176 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== watch-notify(notify_complete (2) cookie 94235437994176 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5c90950 con 0x55b4e5ca08c0 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.207+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceaf70 con 0x55b4e5c9bf10 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 : miss 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 20 rados->read ofs=0 len=0 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 8.4 8:2388ba04:root::.bucket.meta.myfoo6%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ce8770 con 0x7f8c08017050 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(67 .bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+662 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.208+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 8.4 8:2388ba04:root::.bucket.meta.myfoo6%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf2190 con 0x7f8c08017050 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(68 .bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1bd31800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1bd31800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9, ofs0, ns] 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.209+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify cookie 94235437993456 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf0e60 con 0x55b4e5ca08c0 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== watch-notify(notify (1) cookie 94235437749696 notify 124554051608 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55b4e5c90950 con 0x55b4e5ca08c0 2024-05-08T09:22:48.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8af67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94235437749696 notifier 4722 bl.length()=748 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8af67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8af67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8af67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8af67fc640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8a4c003530 con 0x55b4e5ca08c0 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(69 notify.5 [notify cookie 94235437993456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(70 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== watch-notify(notify_complete (2) cookie 94235437993456 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5c89980 con 0x55b4e5ca08c0 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): orig_sources= new_sources= 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): potential sources added=[] removed=[] 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): orig_dests= new_dests= 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): potential dests added=[] removed=[] 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.210+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf09b0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.211+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(71 bud.buckets [call] v29'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.211+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf09b0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.212+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(72 bud.buckets [call] v29'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.212+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf19c0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.213+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v29'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.213+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.213+0000 7f8c1bd31800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.213+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94235437993456 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x7f8c08017050 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== watch-notify(notify (1) cookie 94235437746144 notify 124554051599 ret 0) ==== 358+0+0 (crc 0 0 0) 0x55b4e5cef520 con 0x7f8c08017050 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8af6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051599 cookie 94235437746144 notifier 4722 bl.length()=316 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8af6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8af6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T09:22:48.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8af6ffd640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8adc003ea0 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(74 notify.3 [notify cookie 94235437993456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== watch-notify(notify_complete (2) cookie 94235437993456 notify 124554051599 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5ce8b60 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1bd31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 : hit (requested=0x17, cached=0x17) 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1bd31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.214+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:76 8.4 8:2388ba04:root::.bucket.meta.myfoo6%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~380 in=380b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf16e0 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(76 .bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [delete,create,call,call,writefull 0~380,setxattr (117)] v29'4 uv4 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1bd31800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1bd31800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9, ofs0, ns] 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.215+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 94235438026688 in=760b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cec4f0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== watch-notify(notify (1) cookie 94235437749696 notify 124554051609 ret 0) ==== 790+0+0 (crc 0 0 0) 0x55b4e5c89980 con 0x55b4e5ca08c0 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8af67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94235437749696 notifier 4722 bl.length()=748 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8af67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8af67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8af67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8af67fc640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8a4c003510 con 0x55b4e5ca08c0 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(77 notify.5 [notify cookie 94235438026688 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.216+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== watch-notify(notify_complete (2) cookie 94235438026688 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f8c1004b030 con 0x55b4e5ca08c0 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): orig_sources= new_sources= 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): potential sources added=[] removed=[] 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): orig_dests= new_dests= 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 20 handle_bi_update(): bucket=:myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]): potential dests added=[] removed=[] 2024-05-08T09:22:48.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 4.5 4:a0556b93:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5cf0fc0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(79 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:80 4.3a 4:5fb69b80:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(80 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1 [call out=85b] v0'0 uv23 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.217+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:81 4.5 4:a26d714c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(81 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 4.39 4:9df52790:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(82 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0802b070 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:83 4.3a 4:5f5f40ed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(83 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4 [call out=85b] v0'0 uv24 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0805f040 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.218+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 4.5 4:a2e775b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(84 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0805f040 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 4.3a 4:5fb9df83:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5ca5240 2024-05-08T09:22:48.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(85 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6 [call out=85b] v0'0 uv25 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0805f040 con 0x55b4e5ca5240 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:86 4.32 4:4f03989e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(86 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.219+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:87 4.22 4:44998eed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(87 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:88 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(88 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [call out=377b] v0'0 uv7 ondisk = 0) ==== 194+0+377 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1bd31800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:89 4.31 4:8d044ee4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(89 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1bd31800 20 get_obj_state: octx=0x7f8c10013db0 obj=myfoo6:thirteen state=0x55b4e5ce7288 s->prefetch_data=0 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.220+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:90 3.34s0 3:2e7484b7:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceb4e0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(90 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen [getxattrs out=854b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 238+0+870 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 10 manifest: total_size = 8 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.8995030377421356190 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.acl 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.content_type 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.etag 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.idtag 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.manifest 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 get_obj_state: octx=0x7f8c10013db0 obj=myfoo6:thirteen state=0x55b4e5ce7288 s->prefetch_data=0 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 : hit (requested=0x17, cached=0x17) 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 2024-05-08T09:22:48.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.221+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:91 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ce99b0 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.222+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(91 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [stat,call,call] v29'8 uv8 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.222+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:92 3.34s0 3:2e7484b7:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen:head [cmpxattr user.rgw.idtag (62) op 1 mode 1 in=76b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb40 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.223+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(92 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen [cmpxattr (62) op 1 mode 1,setxattr (117),setxattr (33)] v29'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.223+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:93 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=267b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb40 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:1 objects processed in :myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9]). Next marker thirteen 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.223+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x7f8c08017050 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.224+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(93 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [stat,call,call] v29'9 uv9 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8af6ffd640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1bd31800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T09:22:48.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94235437994976 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== watch-notify(notify (1) cookie 94235437749696 notify 124554051610 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7f8c1004b030 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8af67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94235437749696 notifier 4722 bl.length()=556 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8af67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8af67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(95 notify.5 [notify cookie 94235437994976 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8af67fc640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8a4c003570 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== watch-notify(notify_complete (2) cookie 94235437994976 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5c7d480 con 0x55b4e5ca08c0 2024-05-08T09:22:48.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.225+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.226+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v29'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.226+0000 7f8c1bd31800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.226+0000 7f8c1bd31800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.226+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.226+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94235437993456 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== watch-notify(notify (1) cookie 94235437749696 notify 124554051611 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b4e5c7d480 con 0x55b4e5ca08c0 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8af6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94235437749696 notifier 4722 bl.length()=177 2024-05-08T09:22:48.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8af6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8af6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8af6ffd640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8adc003ea0 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(98 notify.5 [notify cookie 94235437993456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== watch-notify(notify_complete (2) cookie 94235437993456 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5c7cf80 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c1bd31800 10 removing user index: bar 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.227+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(100 bar [delete] v29'6 uv6 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c1bd31800 10 removing default.rgw.meta+users.uid+bar from cache 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c1bd31800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94235437993456 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== watch-notify(notify (1) cookie 94235437755376 notify 124554051612 ret 0) ==== 194+0+0 (crc 0 0 0) 0x55b4e5c7cf80 con 0x55b4e5ca08c0 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8af67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94235437755376 notifier 4722 bl.length()=152 2024-05-08T09:22:48.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8af67fc640 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f8a4c003570 con 0x55b4e5ca08c0 2024-05-08T09:22:48.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.228+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(101 notify.7 [notify cookie 94235437993456 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.229+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.229+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== watch-notify(notify_complete (2) cookie 94235437993456 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55b4e5c7c510 con 0x55b4e5ca08c0 2024-05-08T09:22:48.241 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-05-08T09:22:48.053588Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:22:48.053572Z","tags":[],"group_ids":[]} 2024-05-08T09:22:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.230+0000 7f8acdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.230+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94235437758720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.231+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94235437758720] v29'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.231+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94235437735760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x7f8c08017050 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.232+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94235437735760] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.232+0000 7f8c1bd31800 20 remove_watcher() i=0 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.232+0000 7f8c1bd31800 2 removed watcher, disabling cache 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.232+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94235437739664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.233+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94235437739664] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.233+0000 7f8c1bd31800 20 remove_watcher() i=1 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.233+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94235437733232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca5240 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.234+0000 7f8c17a2f640 1 -- 172.21.15.161:0/3484756914 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94235437733232] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0805f040 con 0x55b4e5ca5240 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.234+0000 7f8c1bd31800 20 remove_watcher() i=2 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.234+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94235437746144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x7f8c08017050 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.235+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94235437746144] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x7f8c08017050 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.235+0000 7f8c1bd31800 20 remove_watcher() i=3 2024-05-08T09:22:48.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.235+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94235437747680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5c9bf10 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.236+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94235437747680] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c0c05a040 con 0x55b4e5c9bf10 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.236+0000 7f8c1bd31800 20 remove_watcher() i=4 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.236+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94235437749696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.237+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94235437749696] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.237+0000 7f8c1bd31800 20 remove_watcher() i=5 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.237+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94235437754320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.238+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94235437754320] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.238+0000 7f8c1bd31800 20 remove_watcher() i=6 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.238+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94235437755376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55b4e5ceeb20 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c18230640 1 -- 172.21.15.161:0/3484756914 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94235437755376] v29'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8c1002a070 con 0x55b4e5ca08c0 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 20 remove_watcher() i=7 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5ca08c0 msgr2=0x55b4e5ca2cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5ca08c0 0x55b4e5ca2cb0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5c9bf10 msgr2=0x55b4e5c9e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5c9bf10 0x55b4e5c9e3d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8c08017050 msgr2=0x7f8c0804c780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f8c08017050 0x7f8c0804c780 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4e5ca5240 msgr2=0x55b4e5ca7700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55b4e5ca5240 0x55b4e5ca7700 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ae0036950 msgr2=0x7f8ae0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8ae0036950 0x7f8ae0038e10 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8c0804aa30 tx=0x7f8c08031040 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 msgr2=0x55b4e5c90410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1722e640 1 -- 172.21.15.161:0/3484756914 reap_dead start 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8c10011fd0 tx=0x7f8c1004c820 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 shutdown_connections 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3484756914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c88f90 0x55b4e5c90410 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 >> 172.21.15.161:0/3484756914 conn(0x55b4e5c85210 msgr2=0x55b4e5c82870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 shutdown_connections 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.239+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3484756914 wait complete. 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 msgr2=0x7f8af0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 0x7f8af0038dc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55b4e5c680b0 tx=0x7f8c0800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 msgr2=0x55b4e5c7bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x55b4e5c67fc0 tx=0x7f8c10018830 comp rx=0 tx=0).stop 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 shutdown_connections 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8af0036900 0x7f8af0038dc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/4125544620 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5c7bbb0 0x55b4e5c7bfd0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 >> 172.21.15.161:0/4125544620 conn(0x55b4e5c6fc50 msgr2=0x55b4e5c70050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 shutdown_connections 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/4125544620 wait complete. 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 msgr2=0x55b4e5c6c350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 0x55b4e5c6c350 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 msgr2=0x55b4e5c676a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 0x55b4e5c676a0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 msgr2=0x7f8b00038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 0x7f8b00038e10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c054000 tx=0x7f8c0c04e000 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 msgr2=0x55b4e5c60460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c010 tx=0x7f8c08000ed0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 shutdown_connections 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55b4e5c69f60 0x55b4e5c6c350 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55b4e5b65550 0x55b4e5c676a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8b00036950 0x7f8b00038e10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 --2- 172.21.15.161:0/3688343826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b4e5b63a10 0x55b4e5c60460 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 >> 172.21.15.161:0/3688343826 conn(0x55b4e5b5f5b0 msgr2=0x55b4e5c52a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 shutdown_connections 2024-05-08T09:22:48.251 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:48.240+0000 7f8c1bd31800 1 -- 172.21.15.161:0/3688343826 wait complete. 2024-05-08T09:22:48.252 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-05-08T09:22:48.053588Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:22:48.053572Z', 'tags': [], 'group_ids': []} 2024-05-08T09:22:53.260 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:53.260 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T09:22:53.260 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T09:22:53.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-05-08T09:22:53.260 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-05-08T09:22:53.320 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:53.320 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.321+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.321+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcffcc16800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56475161aa70 0x56475161ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcffcc16800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56475158f1d0 con 0x56475161b3d0 2024-05-08T09:22:53.321 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcffcc16800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5647514ad050 con 0x56475161aa70 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff8284640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56475161aa70 0x56475161ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff8284640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56475161aa70 0x56475161ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33506/0 (socket says 172.21.15.161:33506) 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff8284640 1 -- 172.21.15.161:0/3513754376 learned_addr learned my addr 172.21.15.161:0/3513754376 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff7a83640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x56475161b3d0 0x56475161b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:55524/0 (socket says 172.21.15.161:55524) 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff8284640 1 -- 172.21.15.161:0/3513754376 >> v1:172.21.15.45:6789/0 conn(0x56475161b3d0 legacy=0x56475161b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.322 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.322+0000 7fcff8284640 1 -- 172.21.15.161:0/3513754376 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475161bf90 con 0x56475161aa70 2024-05-08T09:22:53.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.324+0000 7fcff8284640 1 --2- 172.21.15.161:0/3513754376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475161ae90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800a520 tx=0x7fcfe801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e559c336badb0ea5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.324+0000 7fcff7282640 1 -- 172.21.15.161:0/3513754376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe8057070 con 0x56475161aa70 2024-05-08T09:22:53.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcff7282640 1 -- 172.21.15.161:0/3513754376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe8052570 con 0x56475161aa70 2024-05-08T09:22:53.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcff7282640 1 -- 172.21.15.161:0/3513754376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe804ae60 con 0x56475161aa70 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 -- 172.21.15.161:0/3513754376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 msgr2=0x56475161ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3513754376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475161ae90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800a520 tx=0x7fcfe801d010 comp rx=0 tx=0).stop 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 -- 172.21.15.161:0/3513754376 shutdown_connections 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3513754376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475161ae90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 -- 172.21.15.161:0/3513754376 >> 172.21.15.161:0/3513754376 conn(0x5647516165f0 msgr2=0x564751618a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 -- 172.21.15.161:0/3513754376 shutdown_connections 2024-05-08T09:22:53.325 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.325+0000 7fcffcc16800 1 -- 172.21.15.161:0/3513754376 wait complete. 2024-05-08T09:22:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.341+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.341+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.341+0000 7fcffcc16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.341+0000 7fcffcc16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5647515671f0 con 0x56475161aa70 2024-05-08T09:22:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.342+0000 7fcff8284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.342+0000 7fcff8284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33520/0 (socket says 172.21.15.161:33520) 2024-05-08T09:22:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.342+0000 7fcff8284640 1 -- 172.21.15.161:0/696695380 learned_addr learned my addr 172.21.15.161:0/696695380 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.342+0000 7fcff8284640 1 -- 172.21.15.161:0/696695380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647517102c0 con 0x56475161aa70 2024-05-08T09:22:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.342+0000 7fcff8284640 1 --2- 172.21.15.161:0/696695380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8055040 tx=0x7fcfe804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40189c651f6334e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcee660c640 1 -- 172.21.15.161:0/696695380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe8057040 con 0x56475161aa70 2024-05-08T09:22:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcee660c640 1 -- 172.21.15.161:0/696695380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe8052720 con 0x56475161aa70 2024-05-08T09:22:53.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcee660c640 1 -- 172.21.15.161:0/696695380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe8052a40 con 0x56475161aa70 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 -- 172.21.15.161:0/696695380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 msgr2=0x56475170fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 --2- 172.21.15.161:0/696695380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8055040 tx=0x7fcfe804c000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 -- 172.21.15.161:0/696695380 shutdown_connections 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 --2- 172.21.15.161:0/696695380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x56475170fcf0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 -- 172.21.15.161:0/696695380 >> 172.21.15.161:0/696695380 conn(0x5647516165f0 msgr2=0x56475170b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 -- 172.21.15.161:0/696695380 shutdown_connections 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.343+0000 7fcffcc16800 1 -- 172.21.15.161:0/696695380 wait complete. 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcffcc16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcffcc16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56475161c460 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcff8284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcff8284640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33522/0 (socket says 172.21.15.161:33522) 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.344+0000 7fcff8284640 1 -- 172.21.15.161:0/3217395646 learned_addr learned my addr 172.21.15.161:0/3217395646 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcff8284640 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564751717da0 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcff8284640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8052540 tx=0x7fcfe8003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcee4e09640 1 -- 172.21.15.161:0/3217395646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe8073070 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcee4e09640 1 -- 172.21.15.161:0/3217395646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe805d440 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcee4e09640 1 -- 172.21.15.161:0/3217395646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcfe8057070 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564751718030 con 0x56475161aa70 2024-05-08T09:22:53.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.345+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475171ace0 con 0x56475161aa70 2024-05-08T09:22:53.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcee4e09640 1 -- 172.21.15.161:0/3217395646 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcfe8076070 con 0x56475161aa70 2024-05-08T09:22:53.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcee4e09640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 0x7fcee0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcee4e09640 1 -- 172.21.15.161:0/3217395646 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcfe808dc80 con 0x56475161aa70 2024-05-08T09:22:53.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcff7a83640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 0x7fcee0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 0x56475171eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.346+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475171efe0 con 0x56475161b3d0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.347+0000 7fcff8a85640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 0x56475171eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.347+0000 7fcff7a83640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 0x7fcee0038dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfec000f60 tx=0x7fcfec001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.347+0000 7fcff8a85640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 0x56475171eaa0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.347+0000 7fcff8a85640 1 -- 172.21.15.161:0/3217395646 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcff000a4a0 con 0x56475161b3d0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.347+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475171c070 con 0x56475161b3d0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.348+0000 7fcff8a85640 1 -- 172.21.15.161:0/3217395646 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcff000a4a0 con 0x56475161b3d0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.348+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 0x564751723770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.348+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751723e10 con 0x564751721380 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.348+0000 7fcff8284640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 0x564751723770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.348+0000 7fcff8284640 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 0x564751723770 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.349+0000 7fcff8284640 1 -- 172.21.15.161:0/3217395646 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fcfe8075030 con 0x564751721380 2024-05-08T09:22:53.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.349+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751720300 con 0x56475161b3d0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.349+0000 7fcff8a85640 1 -- 172.21.15.161:0/3217395646 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcff000a4a0 con 0x56475161b3d0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.349+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647517207e0 con 0x56475161b3d0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.349+0000 7fcff8a85640 1 -- 172.21.15.161:0/3217395646 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fcff000a4a0 con 0x56475161b3d0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcffcc16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcffcc16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56475150dcf0 con 0x564751732ee0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33532/0 (socket says 172.21.15.161:33532) 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcff8a85640 1 -- 172.21.15.161:0/3130840252 learned_addr learned my addr 172.21.15.161:0/3130840252 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.350+0000 7fcff8a85640 1 -- 172.21.15.161:0/3130840252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564751733840 con 0x564751732ee0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fcff8a85640 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x56475171f3e0 tx=0x7fcff0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fceddffb640 1 -- 172.21.15.161:0/3130840252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff0014450 con 0x564751732ee0 2024-05-08T09:22:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fceddffb640 1 -- 172.21.15.161:0/3130840252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff00145f0 con 0x564751732ee0 2024-05-08T09:22:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fceddffb640 1 -- 172.21.15.161:0/3130840252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff00148d0 con 0x564751732ee0 2024-05-08T09:22:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5647517342b0 con 0x564751732ee0 2024-05-08T09:22:53.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.351+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5647517347b0 con 0x564751732ee0 2024-05-08T09:22:53.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fceddffb640 1 -- 172.21.15.161:0/3130840252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcff0011040 con 0x564751732ee0 2024-05-08T09:22:53.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fceddffb640 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 0x7fced0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fceddffb640 1 -- 172.21.15.161:0/3130840252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcff001e070 con 0x564751732ee0 2024-05-08T09:22:53.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fcff8284640 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 0x7fced0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.361 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.352+0000 7fcff8284640 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 0x7fced0038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8052a30 tx=0x7fcfe8077d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcffcc16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcffcc16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564751710580 con 0x564751740220 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33548/0 (socket says 172.21.15.161:33548) 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcff8a85640 1 -- 172.21.15.161:0/2659783053 learned_addr learned my addr 172.21.15.161:0/2659783053 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcff8a85640 1 -- 172.21.15.161:0/2659783053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564751740c10 con 0x564751740220 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcff8a85640 1 --2- 172.21.15.161:0/2659783053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcff004c9f0 tx=0x7fcff0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df634e3263bbe7ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.353+0000 7fcecf7fe640 1 -- 172.21.15.161:0/2659783053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff0013c90 con 0x564751740220 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcecf7fe640 1 -- 172.21.15.161:0/2659783053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff0013e30 con 0x564751740220 2024-05-08T09:22:53.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcecf7fe640 1 -- 172.21.15.161:0/2659783053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff002bb90 con 0x564751740220 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- 172.21.15.161:0/2659783053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 msgr2=0x564751740640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 --2- 172.21.15.161:0/2659783053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fcff004c9f0 tx=0x7fcff0011700 comp rx=0 tx=0).stop 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- 172.21.15.161:0/2659783053 shutdown_connections 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 --2- 172.21.15.161:0/2659783053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751740640 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- 172.21.15.161:0/2659783053 >> 172.21.15.161:0/2659783053 conn(0x56475173c4a0 msgr2=0x56475173a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- 172.21.15.161:0/2659783053 shutdown_connections 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- 172.21.15.161:0/2659783053 wait complete. 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 Processor -- start 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.354+0000 7fcffcc16800 1 -- start start 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcffcc16800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcffcc16800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564751741340 con 0x564751740220 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcff8a85640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:33550/0 (socket says 172.21.15.161:33550) 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 learned_addr learned my addr 172.21.15.161:0/1417149197 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564751747c60 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcff8a85640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcff0011be0 tx=0x7fcff004c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcecdffb640 1 -- 172.21.15.161:0/1417149197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff0013c90 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcecdffb640 1 -- 172.21.15.161:0/1417149197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff004b460 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcecdffb640 1 -- 172.21.15.161:0/1417149197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcff004e0d0 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.355+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564751747ef0 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.356+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475174aba0 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.356+0000 7fcecdffb640 1 -- 172.21.15.161:0/1417149197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fcff004e270 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcecdffb640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcec0036950 0x7fcec0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcecdffb640 1 -- 172.21.15.161:0/1417149197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fcff004ce00 con 0x564751740220 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcff8284640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcec0036950 0x7fcec0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcff8284640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcec0036950 0x7fcec0038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8076450 tx=0x7fcfe8087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5647517533d0 0x564751755890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751755fe0 con 0x5647517533d0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.357+0000 7fcff7a83640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5647517533d0 0x564751755890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcff7a83640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5647517533d0 0x564751755890 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfec00f610 con 0x5647517533d0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 realm 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751752820 con 0x5647517533d0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfec00f610 con 0x5647517533d0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:53.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751756ad0 con 0x5647517533d0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfec00f610 con 0x5647517533d0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.358+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647517573a0 con 0x5647517533d0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fcfec00f610 con 0x5647517533d0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcffcc16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751757dc0 0x56475175a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475175a8a0 con 0x564751757dc0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcff8a85640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751757dc0 0x56475175a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.359+0000 7fcff8a85640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751757dc0 0x56475175a1b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcffcc16800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcffcc16800 20 searching for the correct realm 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56475175c870 0x56475175ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcff8284640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56475175c870 0x56475175ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.360+0000 7fcff8284640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56475175c870 0x56475175ed30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff8284640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfe8098040 0x7fcfe8066760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff7a83640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfe8098040 0x7fcfe8066760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff7a83640 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfe8098040 0x7fcfe8066760 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec00f610 con 0x7fcfe8098040 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.361+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec00f610 con 0x5647517533d0 2024-05-08T09:22:53.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.362+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x7fcfe8098040 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.363+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.364+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fcfec02b040 con 0x7fcfe8098040 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.365+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.366+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x7fcfe8098040 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.367+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.368+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x564751757dc0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x7fcfe8098040 2024-05-08T09:22:53.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x56475175c870 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec02b040 con 0x7fcfe8098040 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.369+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x5647517533d0 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fcfec02b040 con 0x5647517533d0 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56475175f400 con 0x7fcfe8098040 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:53.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475175b260 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475175bb00 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.370+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475175aea0 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 zone default found 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 4 Realm: () 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 zonegroup default 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475175f8c0 con 0x564751757dc0 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751761b90 con 0x56475175c870 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.371+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564751761f30 con 0x56475175c870 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.372+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.372+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.372+0000 7fcffcc16800 20 started sync module instance, tier type = 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.372+0000 7fcffcc16800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.372+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751761020 con 0x7fcfe8098040 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.373+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.373+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864309359984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751761020 con 0x7fcfe8098040 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.373+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751762940 con 0x5647517533d0 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.374+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864309359984] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.374+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.374+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864309357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751762940 con 0x5647517533d0 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.374+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751763360 con 0x56475175c870 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.376+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.376+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864309357904] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.376+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864309363856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751763750 con 0x56475175c870 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.376+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751764150 con 0x7fcfe8098040 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.377+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.377+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864309369952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647517649f0 con 0x7fcfe8098040 2024-05-08T09:22:53.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.377+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751765490 con 0x5647517533d0 2024-05-08T09:22:53.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.377+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864309363856] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.378+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864309369952] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.378+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.378+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864309374816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647517644f0 con 0x5647517533d0 2024-05-08T09:22:53.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.378+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751765d30 con 0x564751757dc0 2024-05-08T09:22:53.392 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.379+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864309374816] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.379+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.379+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864309377152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647517644a0 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.379+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647517666f0 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.381+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864309377152] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.381+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.381+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864309366352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5647517666f0 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.381+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767150 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864309366352] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864309382192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767330 con 0x564751757dc0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=0 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=1 2024-05-08T09:22:53.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=2 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=3 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=4 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=5 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.382+0000 7fcffcc16800 20 add_watcher() i=6 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.383+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864309382192] v29'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.383+0000 7fcffcc16800 20 add_watcher() i=7 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.383+0000 7fcffcc16800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.383+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475176a700 con 0x5647517533d0 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.384+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.384+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864309383712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767af0 con 0x5647517533d0 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864309383712] v29'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fceaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcffcc16800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcffcc16800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcffcc16800 5 note: GC not initialized 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fceadfdb640 20 reqs_thread_entry: start 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcffcc16800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.385+0000 7fcffcc16800 20 Filter name: none 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fce1f7fe640 20 reqs_thread_entry: start 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475179dbc0 con 0x564751757dc0 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-05-08T09:22:53.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475179c360 con 0x564751757dc0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.386+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56475179cc50 con 0x564751757dc0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v29'7 uv7 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcffcc16800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T09:22:53.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcffcc16800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcffcc16800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94864309602208 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5647517a1050 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== watch-notify(notify (1) cookie 94864309377152 notify 124554051613 ret 0) ==== 598+0+0 (crc 0 0 0) 0x56475179c460 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcecf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 94864309377152 notifier 4729 bl.length()=556 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(65 notify.5 [notify cookie 94864309602208 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcecf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcecf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcecf7fe640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcec4003ea0 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.388+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.389+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== watch-notify(notify_complete (2) cookie 94864309602208 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564751747ef0 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.389+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56475179cc00 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v29'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcffcc16800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:22:53.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcffcc16800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcffcc16800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94864309602128 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56475179cb70 con 0x56475175c870 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 94864309363856 notify 124554051605 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7fcfe80ab040 con 0x56475175c870 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcecf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94864309363856 notifier 4729 bl.length()=177 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcecf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcecf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 notify.2 [notify cookie 94864309602128 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcecf7fe640 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcec4003ea0 con 0x56475175c870 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== watch-notify(notify_complete (2) cookie 94864309602128 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56475171ace0 con 0x56475175c870 2024-05-08T09:22:53.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.390+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.399 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-05-08T09:22:53.387681Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:22:53.387662Z","tags":[],"group_ids":[]} 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.391+0000 7fceaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.391+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864309383712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751750240 con 0x5647517533d0 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.392+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94864309383712] v29'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.392+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864309359984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767220 con 0x7fcfe8098040 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.393+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94864309359984] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.393+0000 7fcffcc16800 20 remove_watcher() i=0 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.393+0000 7fcffcc16800 2 removed watcher, disabling cache 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.393+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864309357904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767220 con 0x5647517533d0 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.395+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94864309357904] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.395+0000 7fcffcc16800 20 remove_watcher() i=1 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.395+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864309363856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767220 con 0x56475175c870 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.396+0000 7fcff8284640 1 -- 172.21.15.161:0/1417149197 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94864309363856] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfe8075030 con 0x56475175c870 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.396+0000 7fcffcc16800 20 remove_watcher() i=2 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.396+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864309369952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751762490 con 0x7fcfe8098040 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.397+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94864309369952] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x7fcfe8098040 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.397+0000 7fcffcc16800 20 remove_watcher() i=3 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.397+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864309374816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767220 con 0x5647517533d0 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.398+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94864309374816] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcfec03d040 con 0x5647517533d0 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.398+0000 7fcffcc16800 20 remove_watcher() i=4 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.398+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864309377152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751764f60 con 0x564751757dc0 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.399+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94864309377152] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.399+0000 7fcffcc16800 20 remove_watcher() i=5 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.399+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864309366352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751767220 con 0x564751757dc0 2024-05-08T09:22:53.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.400+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94864309366352] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.400+0000 7fcffcc16800 20 remove_watcher() i=6 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.400+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864309382192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564751764f60 con 0x564751757dc0 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.401+0000 7fcff8a85640 1 -- 172.21.15.161:0/1417149197 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94864309382192] v29'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fcff002a070 con 0x564751757dc0 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.401+0000 7fcffcc16800 20 remove_watcher() i=7 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751757dc0 msgr2=0x56475175a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751757dc0 0x56475175a1b0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5647517533d0 msgr2=0x564751755890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5647517533d0 0x564751755890 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfe8098040 msgr2=0x7fcfe8066760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fcfe8098040 0x7fcfe8066760 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56475175c870 msgr2=0x56475175ed30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56475175c870 0x56475175ed30 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcec0036950 msgr2=0x7fcec0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcec0036950 0x7fcec0038e10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8076450 tx=0x7fcfe8087000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 msgr2=0x564751747720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcff0011be0 tx=0x7fcff004c980 comp rx=0 tx=0).stop 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcff7a83640 1 -- 172.21.15.161:0/1417149197 reap_dead start 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 shutdown_connections 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/1417149197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751740220 0x564751747720 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 >> 172.21.15.161:0/1417149197 conn(0x56475173c4a0 msgr2=0x56475173a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 shutdown_connections 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/1417149197 wait complete. 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 msgr2=0x7fced0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 0x7fced0038dc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8052a30 tx=0x7fcfe8077d30 comp rx=0 tx=0).stop 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 msgr2=0x564751733300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x56475171f3e0 tx=0x7fcff0018830 comp rx=0 tx=0).stop 2024-05-08T09:22:53.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 shutdown_connections 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fced0036900 0x7fced0038dc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3130840252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564751732ee0 0x564751733300 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 >> 172.21.15.161:0/3130840252 conn(0x564751726ff0 msgr2=0x5647517273f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 shutdown_connections 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.402+0000 7fcffcc16800 1 -- 172.21.15.161:0/3130840252 wait complete. 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 msgr2=0x564751723770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 0x564751723770 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 msgr2=0x56475171eaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 0x56475171eaa0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 msgr2=0x7fcee0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 0x7fcee0038dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcfec000f60 tx=0x7fcfec001370 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 msgr2=0x564751717860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8052540 tx=0x7fcfe8003020 comp rx=0 tx=0).stop 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 shutdown_connections 2024-05-08T09:22:53.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564751721380 0x564751723770 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56475161b3d0 0x56475171eaa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcee0036900 0x7fcee0038dc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 --2- 172.21.15.161:0/3217395646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56475161aa70 0x564751717860 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 >> 172.21.15.161:0/3217395646 conn(0x5647516165f0 msgr2=0x564751709e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 shutdown_connections 2024-05-08T09:22:53.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.403+0000 7fcffcc16800 1 -- 172.21.15.161:0/3217395646 wait complete. 2024-05-08T09:22:53.411 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-05-08T09:22:53.387681Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:22:53.387662Z', 'tags': [], 'group_ids': []} 2024-05-08T09:22:53.423 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:53.428 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-05-08T09:22:53.428 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T09:22:53.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-05-08T09:22:53.428 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-05-08T09:22:53.474 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:53.474 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.475+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c40c98800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e0b92e1fe0 0x55e0b92e2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c40c98800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e0b92e2a80 con 0x55e0b92e3240 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c40c98800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e0b9174050 con 0x55e0b92e1fe0 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c3e797640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e0b92e1fe0 0x55e0b92e2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c3e797640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e0b92e1fe0 0x55e0b92e2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37638/0 (socket says 172.21.15.161:37638) 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c3e797640 1 -- 172.21.15.161:0/3620616403 learned_addr learned my addr 172.21.15.161:0/3620616403 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c3e797640 1 -- 172.21.15.161:0/3620616403 >> v1:172.21.15.45:6789/0 conn(0x55e0b92e3240 legacy=0x55e0b92e36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.476 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.476+0000 7f9c3e797640 1 -- 172.21.15.161:0/3620616403 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b92e3e00 con 0x55e0b92e1fe0 2024-05-08T09:22:53.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.478+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3620616403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b92e2400 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a520 tx=0x7f9c3801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7ca997bcd438f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.478+0000 7f9c3d795640 1 -- 172.21.15.161:0/3620616403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38057070 con 0x55e0b92e1fe0 2024-05-08T09:22:53.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.478+0000 7f9c3d795640 1 -- 172.21.15.161:0/3620616403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38052570 con 0x55e0b92e1fe0 2024-05-08T09:22:53.478 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.478+0000 7f9c3d795640 1 -- 172.21.15.161:0/3620616403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38052870 con 0x55e0b92e1fe0 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 -- 172.21.15.161:0/3620616403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 msgr2=0x55e0b92e2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3620616403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b92e2400 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a520 tx=0x7f9c3801d010 comp rx=0 tx=0).stop 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 -- 172.21.15.161:0/3620616403 shutdown_connections 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3620616403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b92e2400 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 -- 172.21.15.161:0/3620616403 >> 172.21.15.161:0/3620616403 conn(0x55e0b92dd5c0 msgr2=0x55e0b92df9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 -- 172.21.15.161:0/3620616403 shutdown_connections 2024-05-08T09:22:53.479 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.479+0000 7f9c40c98800 1 -- 172.21.15.161:0/3620616403 wait complete. 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.493+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.493+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.493+0000 7f9c40c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.493+0000 7f9c40c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e0b922e1c0 con 0x55e0b92e1fe0 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9c3e797640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9c3e797640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37650/0 (socket says 172.21.15.161:37650) 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9c3e797640 1 -- 172.21.15.161:0/3578080136 learned_addr learned my addr 172.21.15.161:0/3578080136 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9c3e797640 1 -- 172.21.15.161:0/3578080136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b93d7570 con 0x55e0b92e1fe0 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3578080136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9c38055040 tx=0x7f9c3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e3ae6dac248d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9b2c608640 1 -- 172.21.15.161:0/3578080136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38057040 con 0x55e0b92e1fe0 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9b2c608640 1 -- 172.21.15.161:0/3578080136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38052850 con 0x55e0b92e1fe0 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.494+0000 7f9b2c608640 1 -- 172.21.15.161:0/3578080136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38052b50 con 0x55e0b92e1fe0 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 -- 172.21.15.161:0/3578080136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 msgr2=0x55e0b9255e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3578080136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9c38055040 tx=0x7f9c3804c000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 -- 172.21.15.161:0/3578080136 shutdown_connections 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3578080136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b9255e50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 -- 172.21.15.161:0/3578080136 >> 172.21.15.161:0/3578080136 conn(0x55e0b92dd5c0 msgr2=0x55e0b93cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 -- 172.21.15.161:0/3578080136 shutdown_connections 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 -- 172.21.15.161:0/3578080136 wait complete. 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.495+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c40c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c40c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e0b92eb710 con 0x55e0b92e1fe0 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c3e797640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c3e797640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37658/0 (socket says 172.21.15.161:37658) 2024-05-08T09:22:53.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c3e797640 1 -- 172.21.15.161:0/4250958960 learned_addr learned my addr 172.21.15.161:0/4250958960 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.496+0000 7f9c3e797640 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b93dc800 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9c3e797640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a520 tx=0x7f9c38003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9b2ae05640 1 -- 172.21.15.161:0/4250958960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38073070 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9b2ae05640 1 -- 172.21.15.161:0/4250958960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3805d570 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9b2ae05640 1 -- 172.21.15.161:0/4250958960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c38057070 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0b93dca90 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.497+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0b93df740 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9b2ae05640 1 -- 172.21.15.161:0/4250958960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9c38076070 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9b2ae05640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 0x7f9b24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9b2ae05640 1 -- 172.21.15.161:0/4250958960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9c3808de60 con 0x55e0b92e1fe0 2024-05-08T09:22:53.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c3df96640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 0x7f9b24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 0x55e0b93e3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b93e3a40 con 0x55e0b92e3240 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 0x55e0b93e3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c3df96640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 0x7f9b24038e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c28001e10 tx=0x7f9c28001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.498+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 0x55e0b93e3500 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c3ef98640 1 -- 172.21.15.161:0/4250958960 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c3000a4a0 con 0x55e0b92e3240 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b93e4330 con 0x55e0b92e3240 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c3ef98640 1 -- 172.21.15.161:0/4250958960 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c3000a4a0 con 0x55e0b92e3240 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 0x55e0b93e8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b93e88a0 con 0x55e0b93e5c80 2024-05-08T09:22:53.500 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.499+0000 7f9c3e797640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 0x55e0b93e8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.500+0000 7f9c3e797640 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 0x55e0b93e8110 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.500+0000 7f9c3e797640 1 -- 172.21.15.161:0/4250958960 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b93e5c80 2024-05-08T09:22:53.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.500+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b93e4bb0 con 0x55e0b92e3240 2024-05-08T09:22:53.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c3ef98640 1 -- 172.21.15.161:0/4250958960 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c3000a4a0 con 0x55e0b92e3240 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b93e5090 con 0x55e0b92e3240 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c3ef98640 1 -- 172.21.15.161:0/4250958960 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9c3000a4a0 con 0x55e0b92e3240 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c40c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.501+0000 7f9c40c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e0b91d4cf0 con 0x55e0b93f7a10 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37670/0 (socket says 172.21.15.161:37670) 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c3ef98640 1 -- 172.21.15.161:0/685962360 learned_addr learned my addr 172.21.15.161:0/685962360 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c3ef98640 1 -- 172.21.15.161:0/685962360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b93f8370 con 0x55e0b93f7a10 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e3e00 tx=0x7f9c30018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9b23fff640 1 -- 172.21.15.161:0/685962360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30014450 con 0x55e0b93f7a10 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9b23fff640 1 -- 172.21.15.161:0/685962360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c30014610 con 0x55e0b93f7a10 2024-05-08T09:22:53.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9b23fff640 1 -- 172.21.15.161:0/685962360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30014930 con 0x55e0b93f7a10 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0b93f8de0 con 0x55e0b93f7a10 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.502+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0b93f92e0 con 0x55e0b93f7a10 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.503+0000 7f9b23fff640 1 -- 172.21.15.161:0/685962360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9c30011040 con 0x55e0b93f7a10 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.503+0000 7f9b23fff640 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 0x7f9b18038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.503+0000 7f9b23fff640 1 -- 172.21.15.161:0/685962360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9c3001e070 con 0x55e0b93f7a10 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.503+0000 7f9c3e797640 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 0x7f9b18038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3e797640 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 0x7f9b18038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e0c00 tx=0x7f9c3808c330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c40c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c40c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e0b93d7800 con 0x55e0b93d4b50 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37686/0 (socket says 172.21.15.161:37686) 2024-05-08T09:22:53.508 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3ef98640 1 -- 172.21.15.161:0/101340978 learned_addr learned my addr 172.21.15.161:0/101340978 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3ef98640 1 -- 172.21.15.161:0/101340978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b93d3350 con 0x55e0b93d4b50 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.504+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/101340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9c3004c9d0 tx=0x7f9c30011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb8c4b9a4177fb0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9b21ffb640 1 -- 172.21.15.161:0/101340978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c30016940 con 0x55e0b93d4b50 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9b21ffb640 1 -- 172.21.15.161:0/101340978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3002ba60 con 0x55e0b93d4b50 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9b21ffb640 1 -- 172.21.15.161:0/101340978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3002bd80 con 0x55e0b93d4b50 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 -- 172.21.15.161:0/101340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 msgr2=0x55e0b93d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 --2- 172.21.15.161:0/101340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f9c3004c9d0 tx=0x7f9c30011700 comp rx=0 tx=0).stop 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 -- 172.21.15.161:0/101340978 shutdown_connections 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 --2- 172.21.15.161:0/101340978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b93d4f70 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 -- 172.21.15.161:0/101340978 >> 172.21.15.161:0/101340978 conn(0x55e0b9401050 msgr2=0x55e0b93ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 -- 172.21.15.161:0/101340978 shutdown_connections 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 -- 172.21.15.161:0/101340978 wait complete. 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.505+0000 7f9c40c98800 1 Processor -- start 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c40c98800 1 -- start start 2024-05-08T09:22:53.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c40c98800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b940e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c40c98800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e0b93d37c0 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b940e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c3ef98640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b940e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37698/0 (socket says 172.21.15.161:37698) 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 learned_addr learned my addr 172.21.15.161:0/3627323219 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0b940e960 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b940e420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9c3004b850 tx=0x7f9c3004c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.506+0000 7f9b0ffff640 1 -- 172.21.15.161:0/3627323219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3004e2e0 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.507+0000 7f9b0ffff640 1 -- 172.21.15.161:0/3627323219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3004e480 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.507+0000 7f9b0ffff640 1 -- 172.21.15.161:0/3627323219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c3004b320 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.507+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e0b940ebf0 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.507+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0b94118a0 con 0x55e0b93d4b50 2024-05-08T09:22:53.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.507+0000 7f9b0ffff640 1 -- 172.21.15.161:0/3627323219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9c3004b4c0 con 0x55e0b93d4b50 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9b0ffff640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b08036950 0x7f9b08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9b0ffff640 1 -- 172.21.15.161:0/3627323219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9c3000e040 con 0x55e0b93d4b50 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b08036950 0x7f9b08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b08036950 0x7f9b08038e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e8ca0 tx=0x7f9c38091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b941a190 0x55e0b941c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b941cda0 con 0x55e0b941a190 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.508+0000 7f9c3df96640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b941a190 0x55e0b941c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c3df96640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b941a190 0x55e0b941c650 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2800bdb0 con 0x55e0b941a190 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 realm 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94195e0 con 0x55e0b941a190 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2800bdb0 con 0x55e0b941a190 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b941d890 con 0x55e0b941a190 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2800bdb0 con 0x55e0b941a190 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.509+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b941e160 con 0x55e0b941a190 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9c2800bdb0 con 0x55e0b941a190 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c40c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b941eaa0 0x55e0b9420ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9421660 con 0x55e0b941eaa0 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b941eaa0 0x55e0b9420ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.510+0000 7f9c3ef98640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b941eaa0 0x55e0b9420ed0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c40c98800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c40c98800 20 searching for the correct realm 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e0b9423630 0x55e0b9425af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e0b9423630 0x55e0b9425af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e0b9423630 0x55e0b9425af0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3e797640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9c380a5040 0x7f9c3805d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.511+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.512+0000 7f9c3df96640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9c380a5040 0x7f9c3805d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.512+0000 7f9c3df96640 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9c380a5040 0x7f9c3805d850 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.512+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2800bdb0 con 0x7f9c380a5040 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.512+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2800bdb0 con 0x55e0b941a190 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.513+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x7f9c380a5040 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.514+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9c2802a040 con 0x7f9c380a5040 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.515+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.516+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.517+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x7f9c380a5040 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.518+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941eaa0 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x7f9c380a5040 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.519+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b9423630 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2802a040 con 0x7f9c380a5040 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x55e0b941a190 2024-05-08T09:22:53.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9c2802a040 con 0x55e0b941a190 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94261c0 con 0x7f9c380a5040 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9422050 con 0x55e0b941a190 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.520+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9421c90 con 0x55e0b941a190 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94229f0 con 0x55e0b941a190 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 zone default found 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 4 Realm: () 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 zonegroup default 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.533 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94266a0 con 0x55e0b941eaa0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.521+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9428970 con 0x55e0b9423630 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9428d10 con 0x55e0b9423630 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 20 started sync module instance, tier type = 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:53.534 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.522+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427db0 con 0x7f9c380a5040 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.523+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.523+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94423669179056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427db0 con 0x7f9c380a5040 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.523+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9429730 con 0x55e0b941a190 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.524+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94423669179056] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.525+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.525+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94423669183008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427db0 con 0x55e0b941a190 2024-05-08T09:22:53.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.525+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942a1c0 con 0x55e0b9423630 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.526+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94423669183008] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.526+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.526+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94423669176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427d20 con 0x55e0b9423630 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.526+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942af80 con 0x7f9c380a5040 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.527+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.527+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94423669189216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942b820 con 0x7f9c380a5040 2024-05-08T09:22:53.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.527+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942c2c0 con 0x55e0b941a190 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.527+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94423669176576] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.528+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94423669189216] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.528+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.528+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94423669194128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942b320 con 0x55e0b941a190 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.528+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942cb60 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.529+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94423669194128] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.529+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.529+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94423669191264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942a5b0 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.529+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942d520 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.530+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94423669191264] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.530+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.530+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94423669196464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942d520 con 0x55e0b941eaa0 2024-05-08T09:22:53.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.531+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942df20 con 0x55e0b941eaa0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94423669196464] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94423669201456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942d520 con 0x55e0b941eaa0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=1 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=2 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=3 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=4 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=5 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.532+0000 7f9c40c98800 20 add_watcher() i=6 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94423669201456] v29'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c40c98800 20 add_watcher() i=7 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c40c98800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:53.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9431370 con 0x55e0b941a190 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.533+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94423669199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942e890 con 0x55e0b941a190 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.534+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94423669199424] v29'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.534+0000 7f9af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.534+0000 7f9c40c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.534+0000 7f9c40c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.534+0000 7f9c40c98800 5 note: GC not initialized 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9a6f7fe640 20 reqs_thread_entry: start 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 20 Filter name: none 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9a6d7fa640 20 reqs_thread_entry: start 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T09:22:53.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9464890 con 0x7f9c380a5040 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.535+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9468970 con 0x55e0b941eaa0 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.537+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v29'8 uv7 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.537+0000 7f9af4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.537+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94423669199424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9430f70 con 0x55e0b941a190 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.538+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94423669199424] v29'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.538+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94423669179056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942d210 con 0x7f9c380a5040 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.539+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94423669179056] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.539+0000 7f9c40c98800 20 remove_watcher() i=0 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.539+0000 7f9c40c98800 2 removed watcher, disabling cache 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.539+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94423669183008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94282b0 con 0x55e0b941a190 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.541+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94423669183008] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.541+0000 7f9c40c98800 20 remove_watcher() i=1 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.541+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94423669176576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b94282b0 con 0x55e0b9423630 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.542+0000 7f9c3e797640 1 -- 172.21.15.161:0/3627323219 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94423669176576] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c38075030 con 0x55e0b9423630 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.542+0000 7f9c40c98800 20 remove_watcher() i=2 2024-05-08T09:22:53.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.542+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94423669189216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427900 con 0x7f9c380a5040 2024-05-08T09:22:53.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.543+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94423669189216] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x7f9c380a5040 2024-05-08T09:22:53.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.543+0000 7f9c40c98800 20 remove_watcher() i=3 2024-05-08T09:22:53.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.543+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94423669194128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427900 con 0x55e0b941a190 2024-05-08T09:22:53.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.544+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94423669194128] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c2803c040 con 0x55e0b941a190 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.544+0000 7f9c40c98800 20 remove_watcher() i=4 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.544+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94423669191264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427900 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.545+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94423669191264] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.545+0000 7f9c40c98800 20 remove_watcher() i=5 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.545+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94423669196464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b9427900 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.546+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94423669196464] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.546+0000 7f9c40c98800 20 remove_watcher() i=6 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.546+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94423669201456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e0b942c6b0 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c3ef98640 1 -- 172.21.15.161:0/3627323219 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94423669201456] v29'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9c3002a070 con 0x55e0b941eaa0 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 20 remove_watcher() i=7 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b941eaa0 msgr2=0x55e0b9420ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b941eaa0 0x55e0b9420ed0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b941a190 msgr2=0x55e0b941c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b941a190 0x55e0b941c650 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9c380a5040 msgr2=0x7f9c3805d850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9c380a5040 0x7f9c3805d850 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e0b9423630 msgr2=0x55e0b9425af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e0b9423630 0x55e0b9425af0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b08036950 msgr2=0x7f9b08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b08036950 0x7f9b08038e10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e8ca0 tx=0x7f9c38091000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 msgr2=0x55e0b940e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 --2- 172.21.15.161:0/3627323219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93d4b50 0x55e0b940e420 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9c3004b850 tx=0x7f9c3004c960 comp rx=0 tx=0).stop 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 reap_dead start 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c3df96640 1 -- 172.21.15.161:0/3627323219 reap_dead start 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 shutdown_connections 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 >> 172.21.15.161:0/3627323219 conn(0x55e0b9401050 msgr2=0x55e0b93fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 shutdown_connections 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.547+0000 7f9c40c98800 1 -- 172.21.15.161:0/3627323219 wait complete. 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 msgr2=0x7f9b18038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 0x7f9b18038dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e0c00 tx=0x7f9c3808c330 comp rx=0 tx=0).stop 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 msgr2=0x55e0b93f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x55e0b93e3e00 tx=0x7f9c30018830 comp rx=0 tx=0).stop 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 shutdown_connections 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b18036900 0x7f9b18038dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/685962360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b93f7a10 0x55e0b93f7e30 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 >> 172.21.15.161:0/685962360 conn(0x55e0b93ebab0 msgr2=0x55e0b93ebeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 shutdown_connections 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/685962360 wait complete. 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 msgr2=0x55e0b93e8110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 0x55e0b93e8110 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 msgr2=0x55e0b93e3500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 0x55e0b93e3500 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 msgr2=0x7f9b24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 0x7f9b24038e10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c28001e10 tx=0x7f9c28001390 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 msgr2=0x55e0b93dc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800a520 tx=0x7f9c38003020 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 shutdown_connections 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e0b93e5c80 0x55e0b93e8110 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e0b92e3240 0x55e0b93e3500 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9b24036950 0x7f9b24038e10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 --2- 172.21.15.161:0/4250958960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e0b92e1fe0 0x55e0b93dc2c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 >> 172.21.15.161:0/4250958960 conn(0x55e0b92dd5c0 msgr2=0x55e0b93cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 shutdown_connections 2024-05-08T09:22:53.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.548+0000 7f9c40c98800 1 -- 172.21.15.161:0/4250958960 wait complete. 2024-05-08T09:22:53.556 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-05-08T09:22:53.602 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:53.603 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-05-08T09:22:53.608 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-05-08T09:22:53.608 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-05-08T09:22:53.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T09:22:53.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-05-08T09:22:53.608 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-05-08T09:22:53.655 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:53.656 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e70a0e800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cd0e54f3e0 0x55cd0e5518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e70a0e800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd0e551f50 con 0x55cd0e4be8b0 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e70a0e800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55cd0e3dc050 con 0x55cd0e54f3e0 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.657+0000 7f7e6dd0c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cd0e54f3e0 0x55cd0e5518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.658+0000 7f7e6e50d640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55cd0e4be8b0 0x55cd0e54dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:33000/0 (socket says 172.21.15.161:33000) 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.658+0000 7f7e6e50d640 1 -- 172.21.15.161:0/293110971 learned_addr learned my addr 172.21.15.161:0/293110971 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:53.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.658+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/293110971 >> v1:172.21.15.45:6789/0 conn(0x55cd0e4be8b0 legacy=0x55cd0e54dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.658+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/293110971 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e553180 con 0x55cd0e54f3e0 2024-05-08T09:22:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/293110971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e54f3e0 0x55cd0e5518a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400a470 tx=0x7f7e6401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad8c2538e1a3a02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e6d50b640 1 -- 172.21.15.161:0/293110971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e64057070 con 0x55cd0e54f3e0 2024-05-08T09:22:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e6d50b640 1 -- 172.21.15.161:0/293110971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e64052570 con 0x55cd0e54f3e0 2024-05-08T09:22:53.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e6d50b640 1 -- 172.21.15.161:0/293110971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e64052870 con 0x55cd0e54f3e0 2024-05-08T09:22:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 -- 172.21.15.161:0/293110971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e54f3e0 msgr2=0x55cd0e5518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/293110971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e54f3e0 0x55cd0e5518a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400a470 tx=0x7f7e6401ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:53.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 -- 172.21.15.161:0/293110971 shutdown_connections 2024-05-08T09:22:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/293110971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e54f3e0 0x55cd0e5518a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 -- 172.21.15.161:0/293110971 >> 172.21.15.161:0/293110971 conn(0x55cd0e5455b0 msgr2=0x55cd0e5479d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.660+0000 7f7e70a0e800 1 -- 172.21.15.161:0/293110971 shutdown_connections 2024-05-08T09:22:53.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.661+0000 7f7e70a0e800 1 -- 172.21.15.161:0/293110971 wait complete. 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.674+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e70a0e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e70a0e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e4961c0 con 0x55cd0e4be8b0 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e6e50d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e6e50d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37712/0 (socket says 172.21.15.161:37712) 2024-05-08T09:22:53.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e6e50d640 1 -- 172.21.15.161:0/4039215195 learned_addr learned my addr 172.21.15.161:0/4039215195 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.675+0000 7f7e6e50d640 1 -- 172.21.15.161:0/4039215195 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e549b80 con 0x55cd0e4be8b0 2024-05-08T09:22:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/4039215195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e60001d50 tx=0x7f7e6000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0801f45750d115c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7d5c608640 1 -- 172.21.15.161:0/4039215195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60013030 con 0x55cd0e4be8b0 2024-05-08T09:22:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7d5c608640 1 -- 172.21.15.161:0/4039215195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6000e470 con 0x55cd0e4be8b0 2024-05-08T09:22:53.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7d5c608640 1 -- 172.21.15.161:0/4039215195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e6000e810 con 0x55cd0e4be8b0 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 -- 172.21.15.161:0/4039215195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 msgr2=0x55cd0e54b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/4039215195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f7e60001d50 tx=0x7f7e6000b6c0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 -- 172.21.15.161:0/4039215195 shutdown_connections 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/4039215195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e54b5c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 -- 172.21.15.161:0/4039215195 >> 172.21.15.161:0/4039215195 conn(0x55cd0e5455b0 msgr2=0x55cd0e637fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 -- 172.21.15.161:0/4039215195 shutdown_connections 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.676+0000 7f7e70a0e800 1 -- 172.21.15.161:0/4039215195 wait complete. 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e70a0e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e70a0e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e552420 con 0x55cd0e4be8b0 2024-05-08T09:22:53.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e6e50d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e6e50d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37716/0 (socket says 172.21.15.161:37716) 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e6e50d640 1 -- 172.21.15.161:0/3743845288 learned_addr learned my addr 172.21.15.161:0/3743845288 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.677+0000 7f7e6e50d640 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e646950 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7e60004000 tx=0x7f7e60000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7d5ae05640 1 -- 172.21.15.161:0/3743845288 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60027070 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7d5ae05640 1 -- 172.21.15.161:0/3743845288 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e600013d0 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0e646be0 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7d5ae05640 1 -- 172.21.15.161:0/3743845288 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e60019ac0 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.678+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0e649890 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7d5ae05640 1 -- 172.21.15.161:0/3743845288 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e6002a070 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7d5ae05640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 0x7f7d54038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7d5ae05640 1 -- 172.21.15.161:0/3743845288 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7e6001f070 con 0x55cd0e4be8b0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 0x7f7d54038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 0x55cd0e64d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e64db90 con 0x55cd0e54f3e0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.679+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 0x55cd0e64d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 0x7f7d54038e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e64054000 tx=0x7f7e6404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 0x55cd0e64d650 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3743845288 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6800a4a0 con 0x55cd0e54f3e0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e64ac20 con 0x55cd0e54f3e0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3743845288 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e6800a4a0 con 0x55cd0e54f3e0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 0x55cd0e6522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.680+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6529c0 con 0x55cd0e64fee0 2024-05-08T09:22:53.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.681+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 0x55cd0e6522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.681+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 0x55cd0e6522d0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.681+0000 7f7e6e50d640 1 -- 172.21.15.161:0/3743845288 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e64fee0 2024-05-08T09:22:53.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.681+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e64ee90 con 0x55cd0e54f3e0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3743845288 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e6800a4a0 con 0x55cd0e54f3e0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e64f370 con 0x55cd0e54f3e0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3743845288 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7e6800a4a0 con 0x55cd0e54f3e0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e70a0e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.682+0000 7f7e70a0e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e43ccf0 con 0x55cd0e661b70 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37730/0 (socket says 172.21.15.161:37730) 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/2142999294 learned_addr learned my addr 172.21.15.161:0/2142999294 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/2142999294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e6624d0 con 0x55cd0e661b70 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55cd0e64df90 tx=0x7f7e68018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7d53fff640 1 -- 172.21.15.161:0/2142999294 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e68014450 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7d53fff640 1 -- 172.21.15.161:0/2142999294 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e68014610 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0e662f40 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7d53fff640 1 -- 172.21.15.161:0/2142999294 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e68014930 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.683+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0e663440 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.684+0000 7f7d53fff640 1 -- 172.21.15.161:0/2142999294 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e68011040 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.684+0000 7f7d53fff640 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 0x7f7d48038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.684+0000 7f7d53fff640 1 -- 172.21.15.161:0/2142999294 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7e6801e070 con 0x55cd0e661b70 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.684+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 0x7f7d48038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 0x7f7d48038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cd0e64e030 tx=0x7f7e60019e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e70a0e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e70a0e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e549f00 con 0x55cd0e66edf0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37746/0 (socket says 172.21.15.161:37746) 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3211321477 learned_addr learned my addr 172.21.15.161:0/3211321477 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.685+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/3211321477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e66f7e0 con 0x55cd0e66edf0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/3211321477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7e6804c890 tx=0x7f7e68011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4bfff0e7f0fe60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7d51ffb640 1 -- 172.21.15.161:0/3211321477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e68014ad0 con 0x55cd0e66edf0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7d51ffb640 1 -- 172.21.15.161:0/3211321477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e68014c70 con 0x55cd0e66edf0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7d51ffb640 1 -- 172.21.15.161:0/3211321477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e6804b200 con 0x55cd0e66edf0 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3211321477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 msgr2=0x55cd0e66f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3211321477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f7e6804c890 tx=0x7f7e68011f20 comp rx=0 tx=0).stop 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3211321477 shutdown_connections 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3211321477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e66f210 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3211321477 >> 172.21.15.161:0/3211321477 conn(0x55cd0e66b150 msgr2=0x55cd0e6691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3211321477 shutdown_connections 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.686+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3211321477 wait complete. 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e70a0e800 1 Processor -- start 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e70a0e800 1 -- start start 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e70a0e800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e6763b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e70a0e800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cd0e66ff50 con 0x55cd0e66edf0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e6763b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e6ed0e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e6763b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37750/0 (socket says 172.21.15.161:37750) 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 learned_addr learned my addr 172.21.15.161:0/1315522661 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd0e6768f0 con 0x55cd0e66edf0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.687+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e6763b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7e68011f60 tx=0x7f7e6804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7d3ffff640 1 -- 172.21.15.161:0/1315522661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e68031020 con 0x55cd0e66edf0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7d3ffff640 1 -- 172.21.15.161:0/1315522661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6803bcf0 con 0x55cd0e66edf0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7d3ffff640 1 -- 172.21.15.161:0/1315522661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e680133b0 con 0x55cd0e66edf0 2024-05-08T09:22:53.696 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd0e676b80 con 0x55cd0e66edf0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd0e679830 con 0x55cd0e66edf0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.688+0000 7f7d3ffff640 1 -- 172.21.15.161:0/1315522661 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7e68034020 con 0x55cd0e66edf0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7d3ffff640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d38036900 0x7f7d38038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7d3ffff640 1 -- 172.21.15.161:0/1315522661 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7e6800e040 con 0x55cd0e66edf0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d38036900 0x7f7d38038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d38036900 0x7f7d38038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55cd0e652dc0 tx=0x7f7e60038000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e681f00 0x55cd0e6843c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e684b10 con 0x55cd0e681f00 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.689+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e681f00 0x55cd0e6843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e681f00 0x55cd0e6843c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.697 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 realm 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e684ee0 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6857b0 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.690+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e685b50 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.698 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e6868b0 0x55cd0e688ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e689260 con 0x55cd0e6868b0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e6868b0 0x55cd0e688ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.691+0000 7f7e6ed0e640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e6868b0 0x55cd0e688ca0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e70a0e800 20 searching for the correct realm 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cd0e68b230 0x55cd0e68d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cd0e68b230 0x55cd0e68d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cd0e68b230 0x55cd0e68d6f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.699 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6e50d640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e60036030 0x7f7e600447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.692+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.693+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e60036030 0x7f7e600447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.693+0000 7f7e6dd0c640 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e60036030 0x7f7e600447c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.693+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.700 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.693+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.694+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.711 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.695+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.712 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.696+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.697+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.713 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.698+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.699+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.714 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e68b230 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.700+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x55cd0e681f00 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68ddc0 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.715 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e689c50 con 0x55cd0e681f00 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.701+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68a4f0 con 0x55cd0e681f00 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.716 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e689890 con 0x55cd0e681f00 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 zone default found 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 4 Realm: () 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 zonegroup default 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68e2a0 con 0x55cd0e6868b0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.717 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.702+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e690570 con 0x55cd0e68b230 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e690910 con 0x55cd0e68b230 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 20 started sync module instance, tier type = 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.703+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68fa00 con 0x7f7e60036030 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.704+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.704+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94339198418768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e68fa00 con 0x7f7e60036030 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.704+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e691340 con 0x55cd0e681f00 2024-05-08T09:22:53.718 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.705+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94339198418768] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.705+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.705+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94339198416208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e691340 con 0x55cd0e681f00 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.705+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e691dc0 con 0x55cd0e68b230 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.707+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94339198416208] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.707+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.707+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94339198422672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6912b0 con 0x55cd0e68b230 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.707+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e692cb0 con 0x7f7e60036030 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.708+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94339198422672] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.708+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.708+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94339198429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6930d0 con 0x7f7e60036030 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.708+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e693a90 con 0x55cd0e681f00 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.709+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94339198429184] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.709+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.709+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94339198430720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e693a90 con 0x55cd0e681f00 2024-05-08T09:22:53.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.709+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e694450 con 0x55cd0e6868b0 2024-05-08T09:22:53.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.711+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94339198430720] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.712+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.712+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94339198432736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e693a00 con 0x55cd0e6868b0 2024-05-08T09:22:53.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.712+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e695150 con 0x55cd0e6868b0 2024-05-08T09:22:53.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.713+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(56 notify.6 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.713+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94339198438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e695610 con 0x55cd0e6868b0 2024-05-08T09:22:53.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.713+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e695610 con 0x55cd0e6868b0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.713+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94339198432736] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94339198438560] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94339198439616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6947f0 con 0x55cd0e6868b0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=0 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=1 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=2 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=3 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=4 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=5 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.714+0000 7f7e70a0e800 20 add_watcher() i=6 2024-05-08T09:22:53.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94339198439616] v29'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e70a0e800 20 add_watcher() i=7 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e70a0e800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e699120 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.715+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94339198442496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6965a0 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.716+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94339198442496] v29'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.716+0000 7f7d24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.716+0000 7f7e70a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.716+0000 7f7e70a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.717+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a1940 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.718+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.718+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a2010 con 0x55cd0e6868b0 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.719+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.725 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.719+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a2010 con 0x55cd0e68b230 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.720+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.720+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a2ab0 con 0x55cd0e681f00 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.721+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'219 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.721+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69f7f0 con 0x7f7e60036030 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.722+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.722+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69f7f0 con 0x55cd0e68b230 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.723+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'46 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.723+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3440 con 0x55cd0e681f00 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.724+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.726 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.724+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3440 con 0x55cd0e6868b0 2024-05-08T09:22:53.727 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.725+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'45 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.725+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3440 con 0x7f7e60036030 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.726+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.726+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3440 con 0x55cd0e68b230 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.727+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.727+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39d0 con 0x7f7e60036030 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.728+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.728 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.728+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39b0 con 0x55cd0e6868b0 2024-05-08T09:22:53.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.730+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.729 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.730+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x7f7e60036030 2024-05-08T09:22:53.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.730+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.730 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.731+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e6868b0 2024-05-08T09:22:53.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.732+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.731 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.732+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e681f00 2024-05-08T09:22:53.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.733+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'220 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.732 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.733+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.734+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.733 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.734+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x7f7e60036030 2024-05-08T09:22:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.735+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.734 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.735+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.736+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'27 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.735 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.736+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e681f00 2024-05-08T09:22:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.737+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.736 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.737+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e681f00 2024-05-08T09:22:53.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.738+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'221 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.737 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.738+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.739+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.739+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x7f7e60036030 2024-05-08T09:22:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.740+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.740+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.741+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'30 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.741+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.742+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.742+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.743+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.743+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e68b230 2024-05-08T09:22:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.744+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'47 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.744+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a3980 con 0x55cd0e6868b0 2024-05-08T09:22:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.745+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.745+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39a0 con 0x55cd0e68b230 2024-05-08T09:22:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.746+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.746+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39a0 con 0x55cd0e6868b0 2024-05-08T09:22:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.747+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'46 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.747+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39a0 con 0x55cd0e68b230 2024-05-08T09:22:53.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.748+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.748+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39a0 con 0x55cd0e6868b0 2024-05-08T09:22:53.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.750+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.749 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.750+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6a39a0 con 0x7f7e60036030 2024-05-08T09:22:53.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.751+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.752 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.751+0000 7f7c9f7fe640 20 reqs_thread_entry: start 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.751+0000 7f7e70a0e800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.751+0000 7f7e70a0e800 20 Filter name: none 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7c9d7fa640 20 reqs_thread_entry: start 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6cea60 con 0x7f7e60036030 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6d1370 con 0x55cd0e681f00 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.753 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 : miss 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.752+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:96 8.4 8:2388ba04:root::.bucket.meta.myfoo6%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6d1080 con 0x7f7e60036030 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(96 .bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [call out=48b,stat out=16b,read 0~380 out=380b,getxattrs out=212b] v0'0 uv4 ondisk = 0) ==== 333+0+656 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x17 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:97 4.5 4:a0556b93:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e560 con 0x55cd0e68b230 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(97 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.754 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.753+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 4.3a 4:5fb69b80:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e5a0 con 0x55cd0e68b230 2024-05-08T09:22:53.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(98 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1 [call out=85b] v0'0 uv23 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 4.5 4:a26d714c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e5a0 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(99 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:100 4.39 4:9df52790:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e5a0 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(100 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60029030 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.754+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:101 4.3a 4:5f5f40ed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e5a0 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(101 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4 [call out=85b] v0'0 uv24 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:102 4.5 4:a2e775b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e540 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(102 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:103 4.3a 4:5fb9df83:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e540 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(103 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6 [call out=85b] v0'0 uv25 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.755+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:104 4.32 4:4f03989e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e4e0 con 0x55cd0e681f00 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(104 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 4.22 4:44998eed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e4e0 con 0x55cd0e681f00 2024-05-08T09:22:53.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(105 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:106 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e4e0 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(106 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [call out=289b] v0'0 uv9 ondisk = 0) ==== 194+0+289 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 10 cls_bucket_list_unordered: got thirteen 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:107 4.31 4:8d044ee4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74e4e0 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(107 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 20 get_obj_state: octx=0x7f7e68035dd0 obj=myfoo6:thirteen state=0x55cd0e74c5e8 s->prefetch_data=0 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.756+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:108 3.34s0 3:2e7484b7:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74d410 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(108 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen [getxattrs out=819b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 238+0+835 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 10 manifest: total_size = 8 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 20 get_obj_state: setting s->obj_tag to _RbKwe9ssqMgecWGzJoQ4efcYGWavMYf 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 20 get_obj_state: octx=0x7f7e68035dd0 obj=myfoo6:thirteen state=0x55cd0e74c5e8 s->prefetch_data=0 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 20 prepare_atomic_modification: state is not atomic. state=0x55cd0e74c5e8 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 2024-05-08T09:22:53.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.757+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:109 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dca0 con 0x55cd0e681f00 2024-05-08T09:22:53.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.758+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(109 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [stat,call,call] v29'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.758+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:110 3.34s0 3:2e7484b7:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dca0 con 0x55cd0e681f00 2024-05-08T09:22:53.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.759+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(110 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9_thirteen [call] v29'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.759+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:111 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6d5780 con 0x55cd0e681f00 2024-05-08T09:22:53.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.759+0000 7f7e70a0e800 20 list_objects_ordered: starting attempt 1 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:112 4.5 4:a0556b93:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6d8070 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:113 4.3a 4:5fb69b80:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da930 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:114 4.5 4:a26d714c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6dd2d0 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:115 4.39 4:9df52790:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e0000 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:116 4.3a 4:5f5f40ed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da970 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:117 4.5 4:a2e775b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e53a0 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:118 4.3a 4:5fb9df83:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e81d0 con 0x55cd0e68b230 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:119 4.32 4:4f03989e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6eb000 con 0x55cd0e681f00 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:120 4.22 4:44998eed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6edd30 con 0x55cd0e681f00 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:121 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e0000 con 0x55cd0e681f00 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.760+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:122 4.31 4:8d044ee4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6f2d10 con 0x55cd0e681f00 2024-05-08T09:22:53.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(112 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(113 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1 [call out=85b] v0'0 uv23 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(114 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(115 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(116 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4 [call out=85b] v0'0 uv24 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(117 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(119 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(120 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(118 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6 [call out=85b] v0'0 uv25 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(122 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(111 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [stat,call,call] v29'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7d517fa640 20 handle_completion(): completion ok for obj=thirteen 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(121 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9])"; uploads.size()=0; is_truncated=0 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:123 4.5 4:a0556b93:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da9d0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:124 4.3a 4:5fb69b80:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e81d0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:125 4.5 4:a26d714c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6ea9b0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:126 4.39 4:9df52790:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e4d50 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:127 4.3a 4:5f5f40ed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da9d0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:128 4.5 4:a2e775b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e81d0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:129 4.3a 4:5fb9df83:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6ea9b0 con 0x55cd0e68b230 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.761+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:130 4.32 4:4f03989e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e4d50 con 0x55cd0e681f00 2024-05-08T09:22:53.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(123 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(124 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1 [call out=85b] v0'0 uv23 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:131 4.22 4:44998eed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da9d0 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(126 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:132 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e4d50 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:133 4.31 4:8d044ee4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6ea9b0 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(125 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(130 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(127 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4 [call out=85b] v0'0 uv24 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(133 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(131 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(128 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5 [call out=85b] v0'0 uv5 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(129 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6 [call out=85b] v0'0 uv25 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(132 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [call out=124b] v0'0 uv11 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.762+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e81d0 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.763+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(134 bud.buckets [call] v29'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.763+0000 7f7e70a0e800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.763+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.763+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e81d0 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.763+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 20 rados_obj.operate() r=0 bl.length=166 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6da970 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== osd_op_reply(136 myfoo6 [call,call,delete] v29'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-05-08T09:22:53.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.764+0000 7f7e70a0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94339199196096 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6eadd0 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== watch-notify(notify (1) cookie 94339198429184 notify 124554051602 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55cd0e6d05f0 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7d517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051602 cookie 94339198429184 notifier 4743 bl.length()=150 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7d517fa640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7ca40032c0 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(137 notify.3 [notify cookie 94339199196096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== watch-notify(notify_complete (2) cookie 94339199196096 notify 124554051602 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0e69f170 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.765+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:139 8.4 8:2388ba04:root::.bucket.meta.myfoo6%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.766+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(139 .bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [call,call,delete] v29'6 uv6 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.766+0000 7f7e70a0e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 from cache 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.766+0000 7f7e70a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9, ofs0, ns] 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.766+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:140 7.3 7:c609908c:::notify.5:head [notify cookie 94339199196096 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e6868b0 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== watch-notify(notify (1) cookie 94339198432736 notify 124554051614 ret 0) ==== 249+0+0 (crc 0 0 0) 0x55cd0e69f6e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7d51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94339198432736 notifier 4743 bl.length()=207 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7d51ffb640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:141 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7d34003d60 con 0x55cd0e6868b0 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(140 notify.5 [notify cookie 94339199196096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(141 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== watch-notify(notify_complete (2) cookie 94339199196096 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0e6768f0 con 0x55cd0e6868b0 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:142 4.5 4:a0556b93:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:143 4.3a 4:5fb69b80:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6eadd0 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:144 4.5 4:a26d714c:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e7b90 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:145 4.39 4:9df52790:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6cf9b0 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:146 4.3a 4:5f5f40ed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:147 4.5 4:a2e775b0:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6eadd0 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:148 4.3a 4:5fb9df83:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e7b90 con 0x55cd0e68b230 2024-05-08T09:22:53.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:149 4.32 4:4f03989e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e681f00 2024-05-08T09:22:53.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:150 4.22 4:44998eed:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6cf9b0 con 0x55cd0e681f00 2024-05-08T09:22:53.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:151 4.27 4:e77c02e6:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6eadd0 con 0x55cd0e681f00 2024-05-08T09:22:53.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.767+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:152 4.31 4:8d044ee4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e7b90 con 0x55cd0e681f00 2024-05-08T09:22:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.769+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(149 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.7 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.771+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 49 ==== osd_op_reply(151 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.9 [delete] v29'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.771+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 50 ==== osd_op_reply(152 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.10 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.771+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 51 ==== osd_op_reply(150 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.8 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.771+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(143 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.1 [delete] v29'27 uv27 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(142 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.0 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(145 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.3 [delete] v29'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(146 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.4 [delete] v29'28 uv28 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== osd_op_reply(144 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.2 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(148 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.6 [delete] v29'29 uv29 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(147 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9.5 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 : miss 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:153 6.e 6:7390426a:::pubsub..bucket.myfoo6%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e681f00 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 52 ==== osd_op_reply(153 pubsub..bucket.myfoo6/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 info.flags=0x0 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 10 adding default.rgw.log++pubsub..bucket.myfoo6/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 to cache LRU end 2024-05-08T09:22:53.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.774+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:154 6.e 6:7390426a:::pubsub..bucket.myfoo6%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e5170 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.775+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 53 ==== osd_op_reply(154 pubsub..bucket.myfoo6/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.9 [delete] v29'29 uv23 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.775+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dbc0 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.776+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 54 ==== osd_op_reply(155 bud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.776+0000 7f7e70a0e800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.776+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dbc0 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.777+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 55 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v29'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.777+0000 7f7e70a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.777+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94339198767472 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e4b90 con 0x55cd0e6868b0 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== watch-notify(notify (1) cookie 94339198432736 notify 124554051615 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55cd0e6768f0 con 0x55cd0e6868b0 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7d51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94339198432736 notifier 4743 bl.length()=170 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7d51ffb640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7d34003d60 con 0x55cd0e6868b0 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(157 notify.5 [notify cookie 94339198767472 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== watch-notify(notify_complete (2) cookie 94339198767472 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0e66f7e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e70a0e800 10 removing email index: 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e70a0e800 10 removing user buckets index 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.778+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dbc0 con 0x55cd0e681f00 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 56 ==== osd_op_reply(159 bud.buckets [delete] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7e70a0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94339198767472 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6e4b40 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== watch-notify(notify (1) cookie 94339198438560 notify 124554051616 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55cd0e66f7e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7d517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051616 cookie 94339198438560 notifier 4743 bl.length()=160 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7d517fa640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7ca40032c0 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.779+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(160 notify.6 [notify cookie 94339198767472 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.780+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.780+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== watch-notify(notify_complete (2) cookie 94339198767472 notify 124554051616 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7e6804b030 con 0x55cd0e6868b0 2024-05-08T09:22:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.780+0000 7f7e70a0e800 10 removing user index: bud 2024-05-08T09:22:53.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.780+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e74dbc0 con 0x7f7e60036030 2024-05-08T09:22:53.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.781+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(162 bud [call,call,delete] v29'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.781+0000 7f7e70a0e800 10 removing default.rgw.meta+users.uid+bud from cache 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.781+0000 7f7e70a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.781+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94339199196096 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e6d0fc0 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== watch-notify(notify (1) cookie 94339198432736 notify 124554051617 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7f7e6804b030 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7d51ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 94339198432736 notifier 4743 bl.length()=152 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7d51ffb640 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f7d34003d60 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(163 notify.5 [notify cookie 94339199196096 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.782+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== watch-notify(notify_complete (2) cookie 94339199196096 notify 124554051617 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cd0e663440 con 0x55cd0e6868b0 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.783+0000 7f7d24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.783+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94339198442496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e681f00 2024-05-08T09:22:53.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.784+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 57 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94339198442496] v29'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.784+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94339198418768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x7f7e60036030 2024-05-08T09:22:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.785+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94339198418768] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.785+0000 7f7e70a0e800 20 remove_watcher() i=0 2024-05-08T09:22:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.785+0000 7f7e70a0e800 2 removed watcher, disabling cache 2024-05-08T09:22:53.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.785+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94339198416208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e681f00 2024-05-08T09:22:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.786+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 58 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94339198416208] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.786+0000 7f7e70a0e800 20 remove_watcher() i=1 2024-05-08T09:22:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.786+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94339198422672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e68b230 2024-05-08T09:22:53.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.787+0000 7f7e6e50d640 1 -- 172.21.15.161:0/1315522661 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94339198422672] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e60061060 con 0x55cd0e68b230 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.787+0000 7f7e70a0e800 20 remove_watcher() i=2 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.787+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94339198429184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x7f7e60036030 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.788+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94339198429184] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x7f7e60036030 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.788+0000 7f7e70a0e800 20 remove_watcher() i=3 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.788+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94339198430720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e681f00 2024-05-08T09:22:53.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.789+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 <== osd.1 v2:172.21.15.161:6801/4188235102 59 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94339198430720] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e6405a040 con 0x55cd0e681f00 2024-05-08T09:22:53.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.789+0000 7f7e70a0e800 20 remove_watcher() i=4 2024-05-08T09:22:53.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.789+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94339198432736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.791+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94339198432736] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.791+0000 7f7e70a0e800 20 remove_watcher() i=5 2024-05-08T09:22:53.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.791+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94339198438560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.792+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94339198438560] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.792+0000 7f7e70a0e800 20 remove_watcher() i=6 2024-05-08T09:22:53.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.792+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94339198439616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cd0e69b5e0 con 0x55cd0e6868b0 2024-05-08T09:22:53.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e6ed0e640 1 -- 172.21.15.161:0/1315522661 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94339198439616] v29'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7e68057040 con 0x55cd0e6868b0 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 20 remove_watcher() i=7 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e6868b0 msgr2=0x55cd0e688ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e6868b0 0x55cd0e688ca0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e681f00 msgr2=0x55cd0e6843c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e681f00 0x55cd0e6843c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e60036030 msgr2=0x7f7e600447c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f7e60036030 0x7f7e600447c0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cd0e68b230 msgr2=0x55cd0e68d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cd0e68b230 0x55cd0e68d6f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d38036900 msgr2=0x7f7d38038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d38036900 0x7f7d38038dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55cd0e652dc0 tx=0x7f7e60038000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 msgr2=0x55cd0e6763b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/1315522661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e66edf0 0x55cd0e6763b0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f7e68011f60 tx=0x7f7e6804c820 comp rx=0 tx=0).stop 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 reap_dead start 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e6dd0c640 1 -- 172.21.15.161:0/1315522661 reap_dead start 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 shutdown_connections 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 >> 172.21.15.161:0/1315522661 conn(0x55cd0e66b150 msgr2=0x55cd0e6687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 shutdown_connections 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/1315522661 wait complete. 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 msgr2=0x7f7d48038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 0x7f7d48038dc0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x55cd0e64e030 tx=0x7f7e60019e40 comp rx=0 tx=0).stop 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 msgr2=0x55cd0e661f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.793+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x55cd0e64df90 tx=0x7f7e68018830 comp rx=0 tx=0).stop 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 shutdown_connections 2024-05-08T09:22:53.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d48036900 0x7f7d48038dc0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/2142999294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e661b70 0x55cd0e661f90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 >> 172.21.15.161:0/2142999294 conn(0x55cd0e655c10 msgr2=0x55cd0e656010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 shutdown_connections 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/2142999294 wait complete. 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 msgr2=0x55cd0e6522d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 0x55cd0e6522d0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 msgr2=0x55cd0e64d650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 0x55cd0e64d650 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 msgr2=0x7f7d54038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 0x7f7d54038e10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7e64054000 tx=0x7f7e6404e000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 msgr2=0x55cd0e646410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f7e60004000 tx=0x7f7e60000bc0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 shutdown_connections 2024-05-08T09:22:53.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cd0e64fee0 0x55cd0e6522d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cd0e54f3e0 0x55cd0e64d650 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7d54036950 0x7f7d54038e10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 --2- 172.21.15.161:0/3743845288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd0e4be8b0 0x55cd0e646410 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 >> 172.21.15.161:0/3743845288 conn(0x55cd0e5455b0 msgr2=0x55cd0e54a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 shutdown_connections 2024-05-08T09:22:53.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.794+0000 7f7e70a0e800 1 -- 172.21.15.161:0/3743845288 wait complete. 2024-05-08T09:22:53.802 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T09:22:53.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-05-08T09:22:53.802 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-05-08T09:22:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:22:53.847 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:22:53.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9261b800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e543836150 0x55e543836570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9261b800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e543836bf0 con 0x55e543837360 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9261b800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e5436c7050 con 0x55e543836150 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9011a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e543836150 0x55e543836570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe87fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e543837360 0x55e5438377e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:33004/0 (socket says 172.21.15.161:33004) 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9011a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e543836150 0x55e543836570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37764/0 (socket says 172.21.15.161:37764) 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe87fff640 1 -- 172.21.15.161:0/4136016516 learned_addr learned my addr 172.21.15.161:0/4136016516 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9011a640 1 -- 172.21.15.161:0/4136016516 >> v1:172.21.15.45:6789/0 conn(0x55e543837360 legacy=0x55e5438377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.849+0000 7fbe9011a640 1 -- 172.21.15.161:0/4136016516 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e543837f20 con 0x55e543836150 2024-05-08T09:22:53.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.851+0000 7fbe9011a640 1 --2- 172.21.15.161:0/4136016516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e543836570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a470 tx=0x7fbe8001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7907de5e04db61 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe8f919640 1 -- 172.21.15.161:0/4136016516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80057070 con 0x55e543836150 2024-05-08T09:22:53.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe8f919640 1 -- 172.21.15.161:0/4136016516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8004adc0 con 0x55e543836150 2024-05-08T09:22:53.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe8f919640 1 -- 172.21.15.161:0/4136016516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80052590 con 0x55e543836150 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 -- 172.21.15.161:0/4136016516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 msgr2=0x55e543836570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 --2- 172.21.15.161:0/4136016516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e543836570 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a470 tx=0x7fbe8001ce90 comp rx=0 tx=0).stop 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 -- 172.21.15.161:0/4136016516 shutdown_connections 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 --2- 172.21.15.161:0/4136016516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e543836570 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 -- 172.21.15.161:0/4136016516 >> 172.21.15.161:0/4136016516 conn(0x55e543831790 msgr2=0x55e543833bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 -- 172.21.15.161:0/4136016516 shutdown_connections 2024-05-08T09:22:53.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.852+0000 7fbe9261b800 1 -- 172.21.15.161:0/4136016516 wait complete. 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9261b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9261b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e5437811c0 con 0x55e543836150 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9011a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9011a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37768/0 (socket says 172.21.15.161:37768) 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9011a640 1 -- 172.21.15.161:0/2333184402 learned_addr learned my addr 172.21.15.161:0/2333184402 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.866+0000 7fbe9011a640 1 -- 172.21.15.161:0/2333184402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e543927db0 con 0x55e543836150 2024-05-08T09:22:53.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.867+0000 7fbe9011a640 1 --2- 172.21.15.161:0/2333184402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbe80055040 tx=0x7fbe8004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ba25fc0b41407b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.867+0000 7fbd7e60c640 1 -- 172.21.15.161:0/2333184402 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80057040 con 0x55e543836150 2024-05-08T09:22:53.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.867+0000 7fbd7e60c640 1 -- 172.21.15.161:0/2333184402 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80063070 con 0x55e543836150 2024-05-08T09:22:53.867 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.867+0000 7fbd7e60c640 1 -- 172.21.15.161:0/2333184402 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe8005d790 con 0x55e543836150 2024-05-08T09:22:53.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- 172.21.15.161:0/2333184402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 msgr2=0x55e5439277e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.870 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 --2- 172.21.15.161:0/2333184402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbe80055040 tx=0x7fbe8004c000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- 172.21.15.161:0/2333184402 shutdown_connections 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 --2- 172.21.15.161:0/2333184402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e5439277e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- 172.21.15.161:0/2333184402 >> 172.21.15.161:0/2333184402 conn(0x55e543831790 msgr2=0x55e543923100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- 172.21.15.161:0/2333184402 shutdown_connections 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- 172.21.15.161:0/2333184402 wait complete. 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9261b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e54383f830 con 0x55e543836150 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9011a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9011a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37784/0 (socket says 172.21.15.161:37784) 2024-05-08T09:22:53.871 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.868+0000 7fbe9011a640 1 -- 172.21.15.161:0/1029838876 learned_addr learned my addr 172.21.15.161:0/1029838876 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbe9011a640 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54392f7b0 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a470 tx=0x7fbe80002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbd7ce09640 1 -- 172.21.15.161:0/1029838876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80057050 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbd7ce09640 1 -- 172.21.15.161:0/1029838876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8005dc90 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbd7ce09640 1 -- 172.21.15.161:0/1029838876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe80052440 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e54392fa40 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.869+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5439326f0 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbd7ce09640 1 -- 172.21.15.161:0/1029838876 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe800525e0 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbd7ce09640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 0x7fbd78038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbd7ce09640 1 -- 172.21.15.161:0/1029838876 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbe8008dc40 con 0x55e543836150 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 0x7fbd78038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 0x55e5439364b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.872 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543936a30 con 0x55e543837360 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 0x55e5439364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.870+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 0x7fbd78038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe780012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 0x55e5439364b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9091b640 1 -- 172.21.15.161:0/1029838876 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55e543837360 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543933a80 con 0x55e543837360 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9091b640 1 -- 172.21.15.161:0/1029838876 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55e543837360 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 0x55e54393b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e54393b820 con 0x55e543938d40 2024-05-08T09:22:53.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.871+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 0x55e54393b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.872+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 0x55e54393b130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.872+0000 7fbe9011a640 1 -- 172.21.15.161:0/1029838876 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe80078070 con 0x55e543938d40 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.872+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543937cf0 con 0x55e543837360 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.872+0000 7fbe9091b640 1 -- 172.21.15.161:0/1029838876 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55e543837360 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.872+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439381d0 con 0x55e543837360 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9091b640 1 -- 172.21.15.161:0/1029838876 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe8800a4a0 con 0x55e543837360 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9261b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9261b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e543727cf0 con 0x55e5437aba60 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37786/0 (socket says 172.21.15.161:37786) 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.873+0000 7fbe9091b640 1 -- 172.21.15.161:0/1999144641 learned_addr learned my addr 172.21.15.161:0/1999144641 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbe9091b640 1 -- 172.21.15.161:0/1999144641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5437aa410 con 0x55e5437aba60 2024-05-08T09:22:53.884 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55e543936df0 tx=0x7fbe88018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbd75ffb640 1 -- 172.21.15.161:0/1999144641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88014450 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbd75ffb640 1 -- 172.21.15.161:0/1999144641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88014610 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbd75ffb640 1 -- 172.21.15.161:0/1999144641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88014930 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e5437aa6a0 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.874+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5437aaba0 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbd75ffb640 1 -- 172.21.15.161:0/1999144641 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe88011040 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbd75ffb640 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbd75ffb640 1 -- 172.21.15.161:0/1999144641 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbe8801e070 con 0x55e5437aba60 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 0x7fbd68038dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55e543936e90 tx=0x7fbe8008bf20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.875+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9261b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.885 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9261b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e543928070 con 0x55e543959ed0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37802/0 (socket says 172.21.15.161:37802) 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9091b640 1 -- 172.21.15.161:0/2669749960 learned_addr learned my addr 172.21.15.161:0/2669749960 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9091b640 1 -- 172.21.15.161:0/2669749960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e54395a8c0 con 0x55e543959ed0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbe9091b640 1 --2- 172.21.15.161:0/2669749960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbe8804c8b0 tx=0x7fbe88011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ca8875d26298b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbd677fe640 1 -- 172.21.15.161:0/2669749960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88028070 con 0x55e543959ed0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbd677fe640 1 -- 172.21.15.161:0/2669749960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe88022d90 con 0x55e543959ed0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.876+0000 7fbd677fe640 1 -- 172.21.15.161:0/2669749960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88016ab0 con 0x55e543959ed0 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- 172.21.15.161:0/2669749960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 msgr2=0x55e54395a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 --2- 172.21.15.161:0/2669749960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbe8804c8b0 tx=0x7fbe88011a80 comp rx=0 tx=0).stop 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- 172.21.15.161:0/2669749960 shutdown_connections 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 --2- 172.21.15.161:0/2669749960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e54395a2f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.886 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- 172.21.15.161:0/2669749960 >> 172.21.15.161:0/2669749960 conn(0x55e5439561a0 msgr2=0x55e543954200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- 172.21.15.161:0/2669749960 shutdown_connections 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- 172.21.15.161:0/2669749960 wait complete. 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 Processor -- start 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- start start 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.877+0000 7fbe9261b800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e54395b010 con 0x55e543959ed0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9091b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:37814/0 (socket says 172.21.15.161:37814) 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 learned_addr learned my addr 172.21.15.161:0/1419775522 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5439618e0 con 0x55e543959ed0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbe8804c8b0 tx=0x7fbe8800a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbd65ffb640 1 -- 172.21.15.161:0/1419775522 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88033070 con 0x55e543959ed0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbd65ffb640 1 -- 172.21.15.161:0/1419775522 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe8804e0d0 con 0x55e543959ed0 2024-05-08T09:22:53.887 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e543961b70 con 0x55e543959ed0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbd65ffb640 1 -- 172.21.15.161:0/1419775522 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe88028050 con 0x55e543959ed0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.878+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e543964820 con 0x55e543959ed0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.879+0000 7fbd65ffb640 1 -- 172.21.15.161:0/1419775522 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbe8803bb00 con 0x55e543959ed0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.879+0000 7fbd65ffb640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd580368b0 0x7fbd58038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.879+0000 7fbd65ffb640 1 -- 172.21.15.161:0/1419775522 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbe8800e040 con 0x55e543959ed0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.879+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd580368b0 0x7fbd58038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd580368b0 0x7fbd58038d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe8005d040 tx=0x7fbe80087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e54396d080 0x55e54396f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e54396fc90 con 0x55e54396d080 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e54396d080 0x55e54396f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.880+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e54396d080 0x55e54396f540 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe78009050 con 0x55e54396d080 2024-05-08T09:22:53.888 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 realm 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e54396c4d0 con 0x55e54396d080 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe78009050 con 0x55e54396d080 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543970780 con 0x55e54396d080 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe78009050 con 0x55e54396d080 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543971050 con 0x55e54396d080 2024-05-08T09:22:53.889 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe78009050 con 0x55e54396d080 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543971990 0x55e543973d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.881+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543974510 con 0x55e543971990 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543971990 0x55e543973d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9091b640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543971990 0x55e543973d80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe8802a070 con 0x55e543971990 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9261b800 20 searching for the correct realm 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e5439764e0 0x55e5439789a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.882+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e5439764e0 0x55e5439789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e5439764e0 0x55e5439789a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe9011a640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbe8009b040 0x7fbe8005e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbe8009b040 0x7fbe8005e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.883+0000 7fbe87fff640 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbe8009b040 0x7fbe8005e760 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78009050 con 0x7fbe8009b040 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe8802a070 con 0x55e543971990 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78009050 con 0x55e54396d080 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.884+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.885+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.886+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.887+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.888+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.889+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.890+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.890+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.890+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.890+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e543971990 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e5439764e0 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.891+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x55e54396d080 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e543979070 con 0x7fbe8009b040 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543974ed0 con 0x55e54396d080 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.892+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543975770 con 0x55e54396d080 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543974b10 con 0x55e54396d080 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 zone default found 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 4 Realm: () 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 zonegroup default 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.908 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543979560 con 0x55e543971990 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.893+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e54397b830 con 0x55e5439764e0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e54397bbd0 con 0x55e5439764e0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 20 started sync module instance, tier type = 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.894+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397acc0 con 0x7fbe8009b040 2024-05-08T09:22:53.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.895+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.895+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94443169886704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397acc0 con 0x7fbe8009b040 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.895+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397c5e0 con 0x55e54396d080 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.896+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94443169886704] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.896+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.896+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94443169891088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397acc0 con 0x55e54396d080 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.896+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397d060 con 0x55e5439764e0 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.897+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.897+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94443169893232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397d900 con 0x55e5439764e0 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.897+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397e380 con 0x7fbe8009b040 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.898+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94443169891088] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.898+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94443169893232] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.898+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.898+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94443169895504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397de60 con 0x7fbe8009b040 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.898+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397ec50 con 0x55e54396d080 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.899+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94443169895504] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.900+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.900+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94443169884176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397ec00 con 0x55e54396d080 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.900+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397f5c0 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.901+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94443169884176] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.901+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.901+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94443169900368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397eb70 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.901+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439804b0 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.902+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94443169900368] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.902+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.902+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94443169905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439804b0 con 0x55e543971990 2024-05-08T09:22:53.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.902+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e543980e70 con 0x55e543971990 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94443169905120] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94443169909664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439804b0 con 0x55e543971990 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=0 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=1 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=2 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=3 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=4 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=5 2024-05-08T09:22:53.912 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.903+0000 7fbe9261b800 20 add_watcher() i=6 2024-05-08T09:22:53.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.904+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94443169909664] v29'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.904+0000 7fbe9261b800 20 add_watcher() i=7 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.904+0000 7fbe9261b800 2 all 8 watchers are set, enabling cache 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.904+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439842c0 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.905+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.905+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94443169907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e543981770 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.906+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94443169907152] v29'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.906+0000 7fbd467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.906+0000 7fbe9261b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.906+0000 7fbe9261b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.906+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398cc30 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.907+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.907+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398d280 con 0x55e543971990 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.909+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.909+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398d280 con 0x55e5439764e0 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.910+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.910+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398db50 con 0x55e54396d080 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.911+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'224 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.911+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ab30 con 0x7fbe8009b040 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.912+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.912+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ab00 con 0x55e5439764e0 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.913+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'48 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.913+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ab00 con 0x55e54396d080 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.914+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.914+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ac40 con 0x55e543971990 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.915+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'47 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.915+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x7fbe8009b040 2024-05-08T09:22:53.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.916+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.916+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x55e5439764e0 2024-05-08T09:22:53.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.917+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.917+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x7fbe8009b040 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.918+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.918+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x55e543971990 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.919+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.919+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x7fbe8009b040 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.920+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.920+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x55e543971990 2024-05-08T09:22:53.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.921+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.922+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x55e54396d080 2024-05-08T09:22:53.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.922+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'225 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.923+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398e840 con 0x55e5439764e0 2024-05-08T09:22:53.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.924+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.924+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x7fbe8009b040 2024-05-08T09:22:53.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.925+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.925+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.926+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'28 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.926+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e54396d080 2024-05-08T09:22:53.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.927+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.927+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e54396d080 2024-05-08T09:22:53.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.928+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'226 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.928+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.929+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.929+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x7fbe8009b040 2024-05-08T09:22:53.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.930+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.930+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.931+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'31 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.931+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.932+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.932+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.933+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.933+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.934+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'49 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.934+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e543971990 2024-05-08T09:22:53.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.935+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.935+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.936+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.936+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e543971990 2024-05-08T09:22:53.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.937+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'48 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.937+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e5439764e0 2024-05-08T09:22:53.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.938+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.938+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x55e543971990 2024-05-08T09:22:53.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.940+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.940+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54398ec40 con 0x7fbe8009b040 2024-05-08T09:22:53.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbd457e2640 20 reqs_thread_entry: start 2024-05-08T09:22:53.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe9261b800 20 init_complete bucket index max shards: 11 2024-05-08T09:22:53.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe9261b800 20 Filter name: none 2024-05-08T09:22:53.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbcbeffd640 20 reqs_thread_entry: start 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe9261b800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.941+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439b9b00 con 0x55e543971990 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=380 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9261b800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9261b800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9261b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:53.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439bc430 con 0x55e543971990 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.942+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 : miss 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:96 8.12 8:4de6e7c3:root::.bucket.meta.myfoo7%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439bc1d0 con 0x55e5439764e0 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(96 .bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 [call out=48b,stat out=16b,read 0~382 out=382b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+664 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=382 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 info.flags=0x17 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 to cache LRU end 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:22:53.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:97 4.26 4:64c66725:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396d0 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.943+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(97 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 4.7 4:e0293a7f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396d0 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(98 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 4.3a 4:5c748426:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396d0 con 0x55e5439764e0 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(99 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2 [call out=85b] v0'0 uv26 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:100 4.30 4:0d9b26e7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e5439764e0 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(100 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.944+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:101 4.3c 4:3c0bd243:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e54396d080 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.945+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(101 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.945+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.945+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(102 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [call out=378b] v0'0 uv15 ondisk = 0) ==== 195+0+378 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.945+0000 7fbe9261b800 10 cls_bucket_list_unordered: got fourteen 2024-05-08T09:22:53.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.945+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 4.4 4:212f14d1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e543971990 2024-05-08T09:22:53.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(103 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 4.1a 4:5b395f3a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x7fbe8009b040 2024-05-08T09:22:53.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(104 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:105 4.2e 4:771d305d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e5439764e0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(105 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.946+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:106 4.f 4:f0cee5df:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e54396d080 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(106 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:107 4.15 4:a8c1f262:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a396f0 con 0x55e5439764e0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(107 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 20 get_obj_state: octx=0x7fbe8802bd90 obj=myfoo7:fourteen state=0x55e543a37738 s->prefetch_data=0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:108 3.38s0 3:1f0687d4:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a38560 con 0x55e543971990 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(108 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 239+0+874 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 10 manifest: total_size = 8 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.13500983425053720210 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 20 get_obj_state: octx=0x7fbe8802bd90 obj=myfoo7:fourteen state=0x55e543a37738 s->prefetch_data=0 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 20 prepare_atomic_modification: state is not atomic. state=0x55e543a37738 2024-05-08T09:22:53.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.947+0000 7fbe9261b800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 2024-05-08T09:22:53.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.948+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:109 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e543a38e20 con 0x55e543971990 2024-05-08T09:22:53.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.949+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(109 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [stat,call,call] v29'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.949+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:110 3.38s0 3:1f0687d4:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e543a38e20 con 0x55e543971990 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(110 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10_fourteen [call] v29'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c08d0 con 0x55e543971990 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 20 list_objects_ordered: starting attempt 1 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:112 4.26 4:64c66725:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c31f0 con 0x55e543971990 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:113 4.7 4:e0293a7f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5aa0 con 0x55e543971990 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.950+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:114 4.3a 4:5c748426:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c31f0 con 0x55e5439764e0 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:115 4.30 4:0d9b26e7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5aa0 con 0x55e5439764e0 2024-05-08T09:22:53.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:116 4.3c 4:3c0bd243:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cd0d0 con 0x55e54396d080 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:117 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cd110 con 0x55e543971990 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:118 4.4 4:212f14d1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d2050 con 0x55e543971990 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 4.1a 4:5b395f3a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d4eb0 con 0x7fbe8009b040 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:120 4.2e 4:771d305d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d7b40 con 0x55e5439764e0 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:121 4.f 4:f0cee5df:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d4eb0 con 0x55e54396d080 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(114 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2 [call out=85b] v0'0 uv26 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(115 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(112 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(113 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:122 4.15 4:a8c1f262:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5f30 con 0x55e5439764e0 2024-05-08T09:22:53.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(118 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(116 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(119 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(120 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(121 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.951+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(122 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(111 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [stat,call,call] v29'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbd66ffd640 20 handle_completion(): completion ok for obj=fourteen 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(117 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T09:22:53.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10])"; uploads.size()=0; is_truncated=0 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:123 4.26 4:64c66725:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5b00 con 0x55e543971990 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:124 4.7 4:e0293a7f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5f30 con 0x55e543971990 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:125 4.3a 4:5c748426:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d4d70 con 0x55e5439764e0 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:126 4.30 4:0d9b26e7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d0b10 con 0x55e5439764e0 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:127 4.3c 4:3c0bd243:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439ce8a0 con 0x55e54396d080 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:128 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5b00 con 0x55e543971990 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:129 4.4 4:212f14d1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439d4d70 con 0x55e543971990 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:130 4.1a 4:5b395f3a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5f30 con 0x7fbe8009b040 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:131 4.2e 4:771d305d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5b00 con 0x55e5439764e0 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:132 4.f 4:f0cee5df:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439ce8a0 con 0x55e54396d080 2024-05-08T09:22:53.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.952+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:133 4.15 4:a8c1f262:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5f30 con 0x55e5439764e0 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(123 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(124 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(130 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(129 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6 [call out=85b] v0'0 uv7 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(128 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [call out=124b] v0'0 uv17 ondisk = 0) ==== 195+0+124 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(125 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2 [call out=85b] v0'0 uv26 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(126 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(127 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(131 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(133 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10 [call out=85b] v0'0 uv1 ondisk = 0) ==== 196+0+85 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(132 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7fbe78029040 con 0x55e54396d080 2024-05-08T09:22:53.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.953+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439c5b00 con 0x55e543971990 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.954+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(134 fud.buckets [call] v29'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.954+0000 7fbe9261b800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.954+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.954+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cf350 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.955+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.955+0000 7fbe9261b800 20 rados_obj.operate() r=0 bl.length=168 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.955+0000 7fbe9261b800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.955+0000 7fbe9261b800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.955+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cee50 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(136 myfoo7 [call,call,delete] v29'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe9261b800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe9261b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94443170231120 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a38d40 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== watch-notify(notify (1) cookie 94443169895504 notify 124554051603 ret 0) ==== 192+0+0 (crc 0 0 0) 0x55e54398ada0 con 0x7fbe8009b040 2024-05-08T09:22:53.961 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbd66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051603 cookie 94443169895504 notifier 4750 bl.length()=150 2024-05-08T09:22:53.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(137 notify.3 [notify cookie 94443170231120 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe78029040 con 0x7fbe8009b040 2024-05-08T09:22:53.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbd66ffd640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbcc40032c0 con 0x7fbe8009b040 2024-05-08T09:22:53.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== watch-notify(notify_complete (2) cookie 94443170231120 notify 124554051603 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e54398a3f0 con 0x7fbe8009b040 2024-05-08T09:22:53.962 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.956+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:139 8.12 8:4de6e7c3:root::.bucket.meta.myfoo7%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cee50 con 0x55e5439764e0 2024-05-08T09:22:53.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.957+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(139 .bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 [call,call,delete] v29'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.957+0000 7fbe9261b800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 from cache 2024-05-08T09:22:53.969 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.957+0000 7fbe9261b800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10, ofs0, ns] 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.957+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:140 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94443170229712 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e543a38ef0 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== watch-notify(notify (1) cookie 94443169886704 notify 124554051604 ret 0) ==== 250+0+0 (crc 0 0 0) 0x55e54398a3f0 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbd677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94443169886704 notifier 4750 bl.length()=208 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbd677fe640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:141 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbd54003d60 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(140 notify.0 [notify cookie 94443170229712 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(141 notify.0 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== watch-notify(notify_complete (2) cookie 94443170229712 notify 124554051604 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e54398c7b0 con 0x7fbe8009b040 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:142 4.26 4:64c66725:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cedd0 con 0x55e543971990 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:143 4.7 4:e0293a7f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc970 con 0x55e543971990 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:144 4.3a 4:5c748426:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cb920 con 0x55e5439764e0 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:145 4.30 4:0d9b26e7:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc1f0 con 0x55e5439764e0 2024-05-08T09:22:53.970 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:146 4.3c 4:3c0bd243:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cedd0 con 0x55e54396d080 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:147 4.33 4:ccd8ec68:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc970 con 0x55e543971990 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:148 4.4 4:212f14d1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cb920 con 0x55e543971990 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:149 4.1a 4:5b395f3a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc1f0 con 0x7fbe8009b040 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:150 4.2e 4:771d305d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439baf70 con 0x55e5439764e0 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.958+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:151 4.f 4:f0cee5df:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc970 con 0x55e54396d080 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.959+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:152 4.15 4:a8c1f262:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439baf70 con 0x55e5439764e0 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(146 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.4 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(143 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.1 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(145 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.3 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(144 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.2 [delete] v29'30 uv30 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(142 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.0 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(147 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.5 [delete] v29'18 uv18 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.971 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(148 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.6 [delete] v29'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(149 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.7 [delete] v29'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(152 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.10 [delete] v29'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.960+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(151 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.9 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(150 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10.8 [delete] v29'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 : miss 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 20 rados->read ofs=0 len=0 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:153 6.17 6:e85faa61:::pubsub..bucket.myfoo7%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cc1f0 con 0x55e54396d080 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(153 pubsub..bucket.myfoo7/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 info.flags=0x0 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 10 adding default.rgw.log++pubsub..bucket.myfoo7/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 to cache LRU end 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.961+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:154 6.17 6:e85faa61:::pubsub..bucket.myfoo7%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cb920 con 0x55e54396d080 2024-05-08T09:22:53.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.962+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(154 pubsub..bucket.myfoo7/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.10 [delete] v29'7 uv6 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.962+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cedd0 con 0x55e543971990 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.963+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(155 fud.buckets [call] v29'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.963+0000 7fbe9261b800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.963+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cf320 con 0x55e543971990 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v29'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbe9261b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 94443170252576 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439bc140 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== watch-notify(notify (1) cookie 94443169893232 notify 124554051606 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55e5439bb720 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbd677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94443169893232 notifier 4750 bl.length()=170 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbd677fe640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbd54003d60 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.964+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(157 notify.2 [notify cookie 94443170252576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.965+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.965+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== watch-notify(notify_complete (2) cookie 94443170252576 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe800a2040 con 0x55e5439764e0 2024-05-08T09:22:53.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.965+0000 7fbe9261b800 10 removing email index: 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.965+0000 7fbe9261b800 10 removing user buckets index 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.965+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cf320 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 49 ==== osd_op_reply(159 fud.buckets [delete] v29'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9261b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94443170252576 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439bc140 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 50 ==== watch-notify(notify (1) cookie 94443169905120 notify 124554051618 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55e54398b180 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbd66ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051618 cookie 94443169905120 notifier 4750 bl.length()=160 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 51 ==== osd_op_reply(160 notify.6 [notify cookie 94443170252576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbd66ffd640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbcc40032c0 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 52 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 53 ==== watch-notify(notify_complete (2) cookie 94443170252576 notify 124554051618 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbe88064040 con 0x55e543971990 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9261b800 10 removing user index: fud 2024-05-08T09:22:53.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.966+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439cf320 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 54 ==== osd_op_reply(162 fud [call,call,delete] v29'9 uv9 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9261b800 10 removing default.rgw.meta+users.uid+fud from cache 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9261b800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94443170252576 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e5439bc140 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 55 ==== watch-notify(notify (1) cookie 94443169900368 notify 124554051619 ret 0) ==== 194+0+0 (crc 0 0 0) 0x7fbe88064040 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbd677fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051619 cookie 94443169900368 notifier 4750 bl.length()=152 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 56 ==== osd_op_reply(163 notify.5 [notify cookie 94443170252576 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbd677fe640 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fbd54003d60 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 57 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.968+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 58 ==== watch-notify(notify_complete (2) cookie 94443170252576 notify 124554051619 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e543961b70 con 0x55e543971990 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.969+0000 7fbd467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.969+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94443169907152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e543989780 con 0x55e54396d080 2024-05-08T09:22:53.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.970+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94443169907152] v29'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.970+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94443169886704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439801a0 con 0x7fbe8009b040 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.971+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94443169886704] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.971+0000 7fbe9261b800 20 remove_watcher() i=0 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.971+0000 7fbe9261b800 2 removed watcher, disabling cache 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.971+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94443169891088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397b1f0 con 0x55e54396d080 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.972+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94443169891088] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.972+0000 7fbe9261b800 20 remove_watcher() i=1 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.972+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94443169893232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e5439801a0 con 0x55e5439764e0 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.973+0000 7fbe9011a640 1 -- 172.21.15.161:0/1419775522 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94443169893232] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe80078070 con 0x55e5439764e0 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.973+0000 7fbe9261b800 20 remove_watcher() i=2 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.973+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94443169895504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397cb70 con 0x7fbe8009b040 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.974+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94443169895504] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x7fbe8009b040 2024-05-08T09:22:53.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.974+0000 7fbe9261b800 20 remove_watcher() i=3 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.974+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94443169884176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397cb70 con 0x55e54396d080 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.975+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94443169884176] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe78052040 con 0x55e54396d080 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.975+0000 7fbe9261b800 20 remove_watcher() i=4 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.975+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94443169900368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397a810 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.976+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 59 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94443169900368] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.976+0000 7fbe9261b800 20 remove_watcher() i=5 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.976+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94443169905120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397cb70 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.977+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 60 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94443169905120] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.977+0000 7fbe9261b800 20 remove_watcher() i=6 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.977+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94443169909664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e54397e750 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9091b640 1 -- 172.21.15.161:0/1419775522 <== osd.0 v2:172.21.15.45:6800/2579517728 61 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94443169909664] v29'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe88058040 con 0x55e543971990 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 20 remove_watcher() i=7 2024-05-08T09:22:53.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543971990 msgr2=0x55e543973d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543971990 0x55e543973d80 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e54396d080 msgr2=0x55e54396f540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e54396d080 0x55e54396f540 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbe8009b040 msgr2=0x7fbe8005e760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fbe8009b040 0x7fbe8005e760 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e5439764e0 msgr2=0x55e5439789a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e5439764e0 0x55e5439789a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd580368b0 msgr2=0x7fbd58038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd580368b0 0x7fbd58038d70 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fbe8005d040 tx=0x7fbe80087000 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 msgr2=0x55e5439613a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe87fff640 1 -- 172.21.15.161:0/1419775522 reap_dead start 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbe8804c8b0 tx=0x7fbe8800a9b0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 shutdown_connections 2024-05-08T09:22:53.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1419775522 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543959ed0 0x55e5439613a0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 >> 172.21.15.161:0/1419775522 conn(0x55e5439561a0 msgr2=0x55e543953800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 shutdown_connections 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1419775522 wait complete. 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 msgr2=0x7fbd68038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 0x7fbd68038dc0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x55e543936e90 tx=0x7fbe8008bf20 comp rx=0 tx=0).stop 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 msgr2=0x55e5437a9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.979+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55e543936df0 tx=0x7fbe88018830 comp rx=0 tx=0).stop 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 shutdown_connections 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd68036900 0x7fbd68038dc0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1999144641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e5437aba60 0x55e5437a9ed0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 >> 172.21.15.161:0/1999144641 conn(0x55e54393ea30 msgr2=0x55e54393ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 shutdown_connections 2024-05-08T09:22:53.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1999144641 wait complete. 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 msgr2=0x55e54393b130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 0x55e54393b130 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 msgr2=0x55e5439364b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 0x55e5439364b0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 msgr2=0x7fbd78038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 0x7fbd78038e10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe780012b0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 msgr2=0x55e54392f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a470 tx=0x7fbe80002fb0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 shutdown_connections 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e543938d40 0x55e54393b130 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e543837360 0x55e5439364b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbd78036950 0x7fbd78038e10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 --2- 172.21.15.161:0/1029838876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e543836150 0x55e54392f270 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:22:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 >> 172.21.15.161:0/1029838876 conn(0x55e543831790 msgr2=0x55e543921900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:22:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 shutdown_connections 2024-05-08T09:22:53.986 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:22:53.980+0000 7fbe9261b800 1 -- 172.21.15.161:0/1029838876 wait complete. 2024-05-08T09:23:33.989 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-05-08T09:23:33.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-05-08T09:23:33.990 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-05-08T09:23:34.042 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.042 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.044+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.044+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.044+0000 7f0a79b27800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ccc49bbfd0 0x55ccc49bc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.044+0000 7f0a79b27800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ccc49bca70 con 0x55ccc49bd230 2024-05-08T09:23:34.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.044+0000 7f0a79b27800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55ccc484e050 con 0x55ccc49bbfd0 2024-05-08T09:23:34.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.045+0000 7f0a757a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ccc49bbfd0 0x55ccc49bc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.045+0000 7f0a757a7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ccc49bbfd0 0x55ccc49bc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56750/0 (socket says 172.21.15.161:56750) 2024-05-08T09:23:34.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.045+0000 7f0a757a7640 1 -- 172.21.15.161:0/723384935 learned_addr learned my addr 172.21.15.161:0/723384935 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.044 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.045+0000 7f0a757a7640 1 -- 172.21.15.161:0/723384935 >> v1:172.21.15.45:6789/0 conn(0x55ccc49bd230 legacy=0x55ccc49bd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.045+0000 7f0a757a7640 1 -- 172.21.15.161:0/723384935 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc49bddf0 con 0x55ccc49bbfd0 2024-05-08T09:23:34.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.047+0000 7f0a757a7640 1 --2- 172.21.15.161:0/723384935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc49bc3f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a6801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195e28b6040d4248 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.047+0000 7f0a74fa6640 1 -- 172.21.15.161:0/723384935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68057070 con 0x55ccc49bbfd0 2024-05-08T09:23:34.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.047+0000 7f0a74fa6640 1 -- 172.21.15.161:0/723384935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a68052570 con 0x55ccc49bbfd0 2024-05-08T09:23:34.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.047+0000 7f0a74fa6640 1 -- 172.21.15.161:0/723384935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68052870 con 0x55ccc49bbfd0 2024-05-08T09:23:34.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 -- 172.21.15.161:0/723384935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 msgr2=0x55ccc49bc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 --2- 172.21.15.161:0/723384935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc49bc3f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a6801d010 comp rx=0 tx=0).stop 2024-05-08T09:23:34.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 -- 172.21.15.161:0/723384935 shutdown_connections 2024-05-08T09:23:34.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 --2- 172.21.15.161:0/723384935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc49bc3f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 -- 172.21.15.161:0/723384935 >> 172.21.15.161:0/723384935 conn(0x55ccc49b75b0 msgr2=0x55ccc49b99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 -- 172.21.15.161:0/723384935 shutdown_connections 2024-05-08T09:23:34.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.048+0000 7f0a79b27800 1 -- 172.21.15.161:0/723384935 wait complete. 2024-05-08T09:23:34.063 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a79b27800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a79b27800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ccc49081d0 con 0x55ccc49bbfd0 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a757a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.064+0000 7f0a757a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56752/0 (socket says 172.21.15.161:56752) 2024-05-08T09:23:34.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0a757a7640 1 -- 172.21.15.161:0/2596153494 learned_addr learned my addr 172.21.15.161:0/2596153494 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0a757a7640 1 -- 172.21.15.161:0/2596153494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc4ab1560 con 0x55ccc49bbfd0 2024-05-08T09:23:34.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2596153494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0a68055040 tx=0x7f0a6804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30102c40ab5280be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0963606640 1 -- 172.21.15.161:0/2596153494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68057040 con 0x55ccc49bbfd0 2024-05-08T09:23:34.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0963606640 1 -- 172.21.15.161:0/2596153494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a68052850 con 0x55ccc49bbfd0 2024-05-08T09:23:34.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.065+0000 7f0963606640 1 -- 172.21.15.161:0/2596153494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68052b50 con 0x55ccc49bbfd0 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- 172.21.15.161:0/2596153494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 msgr2=0x55ccc492fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2596153494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0a68055040 tx=0x7f0a6804c000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- 172.21.15.161:0/2596153494 shutdown_connections 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2596153494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc492fe40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- 172.21.15.161:0/2596153494 >> 172.21.15.161:0/2596153494 conn(0x55ccc49b75b0 msgr2=0x55ccc4aa9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- 172.21.15.161:0/2596153494 shutdown_connections 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- 172.21.15.161:0/2596153494 wait complete. 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.066+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a79b27800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a79b27800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ccc49c5700 con 0x55ccc49bbfd0 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a757a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a757a7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56758/0 (socket says 172.21.15.161:56758) 2024-05-08T09:23:34.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a757a7640 1 -- 172.21.15.161:0/26615933 learned_addr learned my addr 172.21.15.161:0/26615933 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a757a7640 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc4ab6770 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.067+0000 7f0a757a7640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a68003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.068+0000 7f0961e03640 1 -- 172.21.15.161:0/26615933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68073070 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.068+0000 7f0961e03640 1 -- 172.21.15.161:0/26615933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6805d650 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.068+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccc4ab6a00 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.068+0000 7f0961e03640 1 -- 172.21.15.161:0/26615933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68057070 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.068+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccc4ab96b0 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0961e03640 1 -- 172.21.15.161:0/26615933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a68076070 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0961e03640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 0x7f095c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0961e03640 1 -- 172.21.15.161:0/26615933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0a6808e030 con 0x55ccc49bbfd0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 0x7f095c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 0x55ccc4abd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4abda40 con 0x55ccc49bd230 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 0x55ccc4abd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.069+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 0x7f095c038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001e10 tx=0x7f0a60001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 0x55ccc4abd470 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a75fa8640 1 -- 172.21.15.161:0/26615933 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4a0 con 0x55ccc49bd230 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4abe2e0 con 0x55ccc49bd230 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a75fa8640 1 -- 172.21.15.161:0/26615933 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7000a4a0 con 0x55ccc49bd230 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 0x55ccc4ac2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4ac2810 con 0x55ccc4abfbf0 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.070+0000 7f0a757a7640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 0x55ccc4ac2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.071+0000 7f0a757a7640 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 0x55ccc4ac2080 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.071+0000 7f0a757a7640 1 -- 172.21.15.161:0/26615933 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4abfbf0 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.071+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4abeb60 con 0x55ccc49bd230 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.072+0000 7f0a75fa8640 1 -- 172.21.15.161:0/26615933 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a7000a4a0 con 0x55ccc49bd230 2024-05-08T09:23:34.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.072+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4abf040 con 0x55ccc49bd230 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.072+0000 7f0a75fa8640 1 -- 172.21.15.161:0/26615933 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a7000a4a0 con 0x55ccc49bd230 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.072+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.072+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a79b27800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a79b27800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ccc48aecf0 con 0x55ccc4aaf110 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56770/0 (socket says 172.21.15.161:56770) 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a75fa8640 1 -- 172.21.15.161:0/206919693 learned_addr learned my addr 172.21.15.161:0/206919693 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.075 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a75fa8640 1 -- 172.21.15.161:0/206919693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc4aadac0 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55ccc4ab7100 tx=0x7f0a700188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.073+0000 7f095affd640 1 -- 172.21.15.161:0/206919693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70014450 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.074+0000 7f095affd640 1 -- 172.21.15.161:0/206919693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a700145f0 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.074+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccc4aadd50 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.074+0000 7f095affd640 1 -- 172.21.15.161:0/206919693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a700148d0 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.074+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccc4aae250 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.074+0000 7f095affd640 1 -- 172.21.15.161:0/206919693 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a70011040 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f095affd640 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 0x7f094c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f095affd640 1 -- 172.21.15.161:0/206919693 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0a7001e070 con 0x55ccc4aaf110 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a757a7640 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 0x7f094c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a757a7640 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 0x7f094c038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55ccc4abab40 tx=0x7f0a6804acb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.076 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a79b27800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.075+0000 7f0a79b27800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ccc4ab17f0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56778/0 (socket says 172.21.15.161:56778) 2024-05-08T09:23:34.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0a75fa8640 1 -- 172.21.15.161:0/1604262297 learned_addr learned my addr 172.21.15.161:0/1604262297 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.077 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0a75fa8640 1 -- 172.21.15.161:0/1604262297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc4ae18c0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/1604262297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0a7004c8a0 tx=0x7f0a70011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b59480577aaf5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0958ff9640 1 -- 172.21.15.161:0/1604262297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7004e200 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0958ff9640 1 -- 172.21.15.161:0/1604262297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a7004b1d0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.076+0000 7f0958ff9640 1 -- 172.21.15.161:0/1604262297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7004b4f0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 -- 172.21.15.161:0/1604262297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 msgr2=0x55ccc4ae12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 --2- 172.21.15.161:0/1604262297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0a7004c8a0 tx=0x7f0a70011700 comp rx=0 tx=0).stop 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 -- 172.21.15.161:0/1604262297 shutdown_connections 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 --2- 172.21.15.161:0/1604262297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae12f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 -- 172.21.15.161:0/1604262297 >> 172.21.15.161:0/1604262297 conn(0x55ccc4add230 msgr2=0x55ccc4adb290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 -- 172.21.15.161:0/1604262297 shutdown_connections 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 -- 172.21.15.161:0/1604262297 wait complete. 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.077+0000 7f0a79b27800 1 Processor -- start 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a79b27800 1 -- start start 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a79b27800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a79b27800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ccc4ae2030 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a75fa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56788/0 (socket says 172.21.15.161:56788) 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 learned_addr learned my addr 172.21.15.161:0/2789191380 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc4ae89b0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.078+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0a7004c800 tx=0x7f0a7004c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.079+0000 7f094affd640 1 -- 172.21.15.161:0/2789191380 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a70022bb0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.079+0000 7f094affd640 1 -- 172.21.15.161:0/2789191380 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a70022d50 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.079+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ccc4ae8c40 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.079+0000 7f094affd640 1 -- 172.21.15.161:0/2789191380 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a7004cb10 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.079+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccc4aeb8f0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.080+0000 7f094affd640 1 -- 172.21.15.161:0/2789191380 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0a7004ccb0 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.080+0000 7f094affd640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0940036900 0x7f0940038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.080+0000 7f094affd640 1 -- 172.21.15.161:0/2789191380 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0a7000e040 con 0x55ccc4ae0ed0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.080+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0940036900 0x7f0940038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0940036900 0x7f0940038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a68066ac0 tx=0x7f0a68089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc4af4190 0x55ccc4af6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4af6da0 con 0x55ccc4af4190 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc4af4190 0x55ccc4af6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc4af4190 0x55ccc4af6650 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a6000bdb0 con 0x55ccc4af4190 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 20 realm 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.081+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4af35e0 con 0x55ccc4af4190 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a6000bdb0 con 0x55ccc4af4190 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4af7890 con 0x55ccc4af4190 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a6000bdb0 con 0x55ccc4af4190 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.085 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4af8160 con 0x55ccc4af4190 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a6000bdb0 con 0x55ccc4af4190 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4af8aa0 0x55ccc4afaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4afb660 con 0x55ccc4af8aa0 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.082+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4af8aa0 0x55ccc4afaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.086 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a75fa8640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4af8aa0 0x55ccc4afaed0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a79b27800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a79b27800 20 searching for the correct realm 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ccc4afd630 0x55ccc4affaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.083+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ccc4afd630 0x55ccc4affaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.084+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ccc4afd630 0x55ccc4affaf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.084+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.084+0000 7f0a757a7640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0a6809d040 0x7f0a6805b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.084+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.084+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0a6809d040 0x7f0a6805b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.085+0000 7f0a6ffff640 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0a6809d040 0x7f0a6805b570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.085+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6000bdb0 con 0x7f0a6809d040 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.085+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.085+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.085+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6000bdb0 con 0x55ccc4af4190 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.086+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x7f0a6809d040 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.087+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a6002a040 con 0x7f0a6809d040 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.088+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.089+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.090+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x7f0a6809d040 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.091+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.092+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.092+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.092+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.092+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.092+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x7f0a6809d040 2024-05-08T09:23:34.101 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4afd630 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6002a040 con 0x7f0a6809d040 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.093+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x55ccc4af4190 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a6002a040 con 0x55ccc4af4190 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b001c0 con 0x7f0a6809d040 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:34.102 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4afc020 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4afc8c0 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.094+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4afbc60 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 zone default found 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 4 Realm: () 2024-05-08T09:23:34.103 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 zonegroup default 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b006f0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b029c0 con 0x55ccc4afd630 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.095+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b02d60 con 0x55ccc4afd630 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.096+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.104 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.096+0000 7f0a79b27800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.096+0000 7f0a79b27800 20 started sync module instance, tier type = 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.096+0000 7f0a79b27800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.096+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b01e50 con 0x7f0a6809d040 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.097+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.097+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94337961567056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b01e50 con 0x7f0a6809d040 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.097+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b03770 con 0x55ccc4af4190 2024-05-08T09:23:34.105 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.098+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94337961567056] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.099+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.099+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94337961571488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b01e50 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.099+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b041e0 con 0x55ccc4afd630 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.100+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94337961571488] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.100+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.100+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94337961564576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b01dc0 con 0x55ccc4afd630 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.100+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b04fa0 con 0x7f0a6809d040 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.101+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.101+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94337961577088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b05840 con 0x7f0a6809d040 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.101+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b062c0 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.101+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94337961564576] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.102+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.102+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94337961582000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b06280 con 0x55ccc4af4190 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.102+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b06d00 con 0x55ccc4af8aa0 2024-05-08T09:23:34.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.102+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94337961577088] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.104+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.104+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94337961584720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b070a0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.104+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b07ac0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.104+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94337961582000] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.105+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94337961584720] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.105+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.105+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94337961579408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b045d0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.105+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b080a0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94337961579408] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94337961588144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b080a0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=0 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=1 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=2 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=3 2024-05-08T09:23:34.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=4 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=5 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.106+0000 7f0a79b27800 20 add_watcher() i=6 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.107+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94337961588144] v29'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.107+0000 7f0a79b27800 20 add_watcher() i=7 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.107+0000 7f0a79b27800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.107+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b0b370 con 0x55ccc4af4190 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.108+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.108+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94337961590112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b08630 con 0x55ccc4af4190 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94337961590112] v29'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f092bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a79b27800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a79b27800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a79b27800 5 note: GC not initialized 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f092afe5640 20 reqs_thread_entry: start 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a79b27800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0a79b27800 20 Filter name: none 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.109+0000 7f0928fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b3e910 con 0x55ccc4af4190 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:34.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.110+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b41240 con 0x55ccc4af8aa0 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.111+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call] v29'32 uv32 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.111+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b41240 con 0x55ccc4af8aa0 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.112+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 usage.10 [call] v29'33 uv32 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.113+0000 7f092bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.113+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94337961590112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b0aa30 con 0x55ccc4af4190 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.114+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94337961590112] v29'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.114+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94337961567056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b07d60 con 0x7f0a6809d040 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.115+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94337961567056] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.115+0000 7f0a79b27800 20 remove_watcher() i=0 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.115+0000 7f0a79b27800 2 removed watcher, disabling cache 2024-05-08T09:23:34.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.115+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94337961571488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b3e4b0 con 0x55ccc4af4190 2024-05-08T09:23:34.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.117+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94337961571488] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.117+0000 7f0a79b27800 20 remove_watcher() i=1 2024-05-08T09:23:34.116 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.117+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94337961564576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b3e4b0 con 0x55ccc4afd630 2024-05-08T09:23:34.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.118+0000 7f0a757a7640 1 -- 172.21.15.161:0/2789191380 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94337961564576] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a68075030 con 0x55ccc4afd630 2024-05-08T09:23:34.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.118+0000 7f0a79b27800 20 remove_watcher() i=2 2024-05-08T09:23:34.117 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.118+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94337961577088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b019a0 con 0x7f0a6809d040 2024-05-08T09:23:34.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.119+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94337961577088] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x7f0a6809d040 2024-05-08T09:23:34.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.119+0000 7f0a79b27800 20 remove_watcher() i=3 2024-05-08T09:23:34.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.119+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94337961582000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b019a0 con 0x55ccc4af4190 2024-05-08T09:23:34.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.120+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94337961582000] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6003c040 con 0x55ccc4af4190 2024-05-08T09:23:34.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.120+0000 7f0a79b27800 20 remove_watcher() i=4 2024-05-08T09:23:34.120 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.120+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94337961584720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b05db0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.122+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94337961584720] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.122+0000 7f0a79b27800 20 remove_watcher() i=5 2024-05-08T09:23:34.121 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.122+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94337961579408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b019a0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.123+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94337961579408] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.123+0000 7f0a79b27800 20 remove_watcher() i=6 2024-05-08T09:23:34.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.123+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94337961588144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ccc4b019a0 con 0x55ccc4af8aa0 2024-05-08T09:23:34.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a75fa8640 1 -- 172.21.15.161:0/2789191380 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94337961588144] v29'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7003c020 con 0x55ccc4af8aa0 2024-05-08T09:23:34.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 20 remove_watcher() i=7 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4af8aa0 msgr2=0x55ccc4afaed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4af8aa0 0x55ccc4afaed0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc4af4190 msgr2=0x55ccc4af6650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc4af4190 0x55ccc4af6650 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0a6809d040 msgr2=0x7f0a6805b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f0a6809d040 0x7f0a6805b570 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ccc4afd630 msgr2=0x55ccc4affaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ccc4afd630 0x55ccc4affaf0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0940036900 msgr2=0x7f0940038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0940036900 0x7f0940038dc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0a68066ac0 tx=0x7f0a68089000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 msgr2=0x55ccc4ae8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a6ffff640 1 -- 172.21.15.161:0/2789191380 reap_dead start 2024-05-08T09:23:34.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0a7004c800 tx=0x7f0a7004c830 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 shutdown_connections 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 --2- 172.21.15.161:0/2789191380 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4ae0ed0 0x55ccc4ae8470 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 >> 172.21.15.161:0/2789191380 conn(0x55ccc4add230 msgr2=0x55ccc4ada890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 shutdown_connections 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.124+0000 7f0a79b27800 1 -- 172.21.15.161:0/2789191380 wait complete. 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 msgr2=0x7f094c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 0x7f094c038dc0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55ccc4abab40 tx=0x7f0a6804acb0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 msgr2=0x55ccc4aad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x55ccc4ab7100 tx=0x7f0a700188f0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 shutdown_connections 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f094c036900 0x7f094c038dc0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/206919693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc4aaf110 0x55ccc4aad580 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 >> 172.21.15.161:0/206919693 conn(0x55ccc4ac5a60 msgr2=0x55ccc4ac5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 shutdown_connections 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/206919693 wait complete. 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 msgr2=0x55ccc4ac2080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 0x55ccc4ac2080 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 msgr2=0x55ccc4abd470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 0x55ccc4abd470 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 msgr2=0x7f095c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 0x7f095c038dc0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001e10 tx=0x7f0a60001390 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 msgr2=0x55ccc4ab6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a68003020 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 shutdown_connections 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ccc4abfbf0 0x55ccc4ac2080 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ccc49bd230 0x55ccc4abd470 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f095c036900 0x7f095c038dc0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 --2- 172.21.15.161:0/26615933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ccc49bbfd0 0x55ccc4ab6230 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 >> 172.21.15.161:0/26615933 conn(0x55ccc49b75b0 msgr2=0x55ccc4aa7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 shutdown_connections 2024-05-08T09:23:34.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.125+0000 7f0a79b27800 1 -- 172.21.15.161:0/26615933 wait complete. 2024-05-08T09:23:34.133 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-05-08T09:23:34.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-05-08T09:23:34.134 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-05-08T09:23:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.178 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.179+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.179 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.179+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26ec630800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cced853fd0 0x55cced8543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26ec630800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cced854a70 con 0x55cced855230 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26ec630800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55cced6e6050 con 0x55cced853fd0 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7855640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cced853fd0 0x55cced8543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7054640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55cced855230 0x55cced8556b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51030/0 (socket says 172.21.15.161:51030) 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7054640 1 -- 172.21.15.161:0/3856053854 learned_addr learned my addr 172.21.15.161:0/3856053854 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7855640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cced853fd0 0x55cced8543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56790/0 (socket says 172.21.15.161:56790) 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7855640 1 -- 172.21.15.161:0/3856053854 >> v1:172.21.15.45:6789/0 conn(0x55cced855230 legacy=0x55cced8556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.180 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.180+0000 7f26e7855640 1 -- 172.21.15.161:0/3856053854 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced855df0 con 0x55cced853fd0 2024-05-08T09:23:34.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.182+0000 7f26e7855640 1 --2- 172.21.15.161:0/3856053854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced8543f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730064bb71aacee8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.182+0000 7f26e6853640 1 -- 172.21.15.161:0/3856053854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d804e6c0 con 0x55cced853fd0 2024-05-08T09:23:34.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.182+0000 7f26e6853640 1 -- 172.21.15.161:0/3856053854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d804e860 con 0x55cced853fd0 2024-05-08T09:23:34.182 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.182+0000 7f26e6853640 1 -- 172.21.15.161:0/3856053854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d804ebc0 con 0x55cced853fd0 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 -- 172.21.15.161:0/3856053854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 msgr2=0x55cced8543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 --2- 172.21.15.161:0/3856053854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced8543f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d801f390 comp rx=0 tx=0).stop 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 -- 172.21.15.161:0/3856053854 shutdown_connections 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 --2- 172.21.15.161:0/3856053854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced8543f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 -- 172.21.15.161:0/3856053854 >> 172.21.15.161:0/3856053854 conn(0x55cced84f5b0 msgr2=0x55cced8519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 -- 172.21.15.161:0/3856053854 shutdown_connections 2024-05-08T09:23:34.183 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.183+0000 7f26ec630800 1 -- 172.21.15.161:0/3856053854 wait complete. 2024-05-08T09:23:34.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.196+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.196+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.196+0000 7f26ec630800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.196+0000 7f26ec630800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cced7a01d0 con 0x55cced853fd0 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.196+0000 7f26e7855640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f26e7855640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56804/0 (socket says 172.21.15.161:56804) 2024-05-08T09:23:34.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f26e7855640 1 -- 172.21.15.161:0/947923059 learned_addr learned my addr 172.21.15.161:0/947923059 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f26e7855640 1 -- 172.21.15.161:0/947923059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced944ce0 con 0x55cced853fd0 2024-05-08T09:23:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f26e7855640 1 --2- 172.21.15.161:0/947923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebbabf07b3bfd29a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f25d5e0b640 1 -- 172.21.15.161:0/947923059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d804ec00 con 0x55cced853fd0 2024-05-08T09:23:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f25d5e0b640 1 -- 172.21.15.161:0/947923059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d804eda0 con 0x55cced853fd0 2024-05-08T09:23:34.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.197+0000 7f25d5e0b640 1 -- 172.21.15.161:0/947923059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8056590 con 0x55cced853fd0 2024-05-08T09:23:34.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- 172.21.15.161:0/947923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 msgr2=0x55cced944710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 --2- 172.21.15.161:0/947923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d8050000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- 172.21.15.161:0/947923059 shutdown_connections 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 --2- 172.21.15.161:0/947923059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced944710 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- 172.21.15.161:0/947923059 >> 172.21.15.161:0/947923059 conn(0x55cced84f5b0 msgr2=0x55cced940030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- 172.21.15.161:0/947923059 shutdown_connections 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- 172.21.15.161:0/947923059 wait complete. 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.198+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26ec630800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26ec630800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cced7c7540 con 0x55cced853fd0 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26e7855640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26e7855640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56808/0 (socket says 172.21.15.161:56808) 2024-05-08T09:23:34.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26e7855640 1 -- 172.21.15.161:0/1933993382 learned_addr learned my addr 172.21.15.161:0/1933993382 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26e7855640 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced950a00 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.199+0000 7f26e7855640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.200+0000 7f25cffff640 1 -- 172.21.15.161:0/1933993382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8063540 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.200+0000 7f25cffff640 1 -- 172.21.15.161:0/1933993382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26d8071070 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.200+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cced950c90 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.200+0000 7f25cffff640 1 -- 172.21.15.161:0/1933993382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26d8063810 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.200+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cced953940 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f25cffff640 1 -- 172.21.15.161:0/1933993382 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f26d8061030 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f25cffff640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 0x7f25d0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f25cffff640 1 -- 172.21.15.161:0/1933993382 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f26d8069040 con 0x55cced853fd0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26e7054640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 0x7f25d0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 0x55cced957700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced957cd0 con 0x55cced855230 2024-05-08T09:23:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26e8056640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 0x55cced957700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26e7054640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 0x7f25d0038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26dc000f60 tx=0x7f26dc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.201+0000 7f26e8056640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 0x55cced957700 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26e8056640 1 -- 172.21.15.161:0/1933993382 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced855230 2024-05-08T09:23:34.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced954cb0 con 0x55cced855230 2024-05-08T09:23:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26e8056640 1 -- 172.21.15.161:0/1933993382 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced855230 2024-05-08T09:23:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 0x55cced95c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced95cac0 con 0x55cced959fe0 2024-05-08T09:23:34.207 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.202+0000 7f26e7855640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 0x55cced95c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.203+0000 7f26e7855640 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 0x55cced95c3d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.203+0000 7f26e7855640 1 -- 172.21.15.161:0/1933993382 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f26d8076980 con 0x55cced959fe0 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.203+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced958f90 con 0x55cced855230 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26e8056640 1 -- 172.21.15.161:0/1933993382 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced855230 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced959450 con 0x55cced855230 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26e8056640 1 -- 172.21.15.161:0/1933993382 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced855230 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26ec630800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.204+0000 7f26ec630800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cced746cf0 con 0x55cced96bc70 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56816/0 (socket says 172.21.15.161:56816) 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26e8056640 1 -- 172.21.15.161:0/563405239 learned_addr learned my addr 172.21.15.161:0/563405239 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26e8056640 1 -- 172.21.15.161:0/563405239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced96c5d0 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26e8056640 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55cced9518c0 tx=0x7f26e000aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f25cd7fa640 1 -- 172.21.15.161:0/563405239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0007d00 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f25cd7fa640 1 -- 172.21.15.161:0/563405239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e001e020 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cced96d040 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.205+0000 7f25cd7fa640 1 -- 172.21.15.161:0/563405239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0019420 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.206+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cced96d540 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.206+0000 7f25cd7fa640 1 -- 172.21.15.161:0/563405239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f26e0016040 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f25cd7fa640 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 0x7f25c0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f25cd7fa640 1 -- 172.21.15.161:0/563405239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f26e001f030 con 0x55cced96bc70 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26e7855640 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 0x7f25c0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26e7855640 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 0x7f25c0038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55cced958150 tx=0x7f26d8084040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26ec630800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.207+0000 7f26ec630800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cced944fa0 con 0x55cced978f80 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56822/0 (socket says 172.21.15.161:56822) 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26e8056640 1 -- 172.21.15.161:0/1352386549 learned_addr learned my addr 172.21.15.161:0/1352386549 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26e8056640 1 -- 172.21.15.161:0/1352386549 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced979970 con 0x55cced978f80 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26e8056640 1 --2- 172.21.15.161:0/1352386549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005700 tx=0x7f26e004cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b30dffcdebf93ad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f25c6ffd640 1 -- 172.21.15.161:0/1352386549 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e001d070 con 0x55cced978f80 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f25c6ffd640 1 -- 172.21.15.161:0/1352386549 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e00183b0 con 0x55cced978f80 2024-05-08T09:23:34.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f25c6ffd640 1 -- 172.21.15.161:0/1352386549 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0014340 con 0x55cced978f80 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.208+0000 7f26ec630800 1 -- 172.21.15.161:0/1352386549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 msgr2=0x55cced9793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 --2- 172.21.15.161:0/1352386549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005700 tx=0x7f26e004cba0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- 172.21.15.161:0/1352386549 shutdown_connections 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 --2- 172.21.15.161:0/1352386549 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9793a0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- 172.21.15.161:0/1352386549 >> 172.21.15.161:0/1352386549 conn(0x55cced975290 msgr2=0x55cced9732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.226 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- 172.21.15.161:0/1352386549 shutdown_connections 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- 172.21.15.161:0/1352386549 wait complete. 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 Processor -- start 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- start start 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26ec630800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cced97a0c0 con 0x55cced978f80 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26e8056640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56824/0 (socket says 172.21.15.161:56824) 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.209+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 learned_addr learned my addr 172.21.15.161:0/2719798573 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cced980a20 con 0x55cced978f80 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f26e8056640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26e0015fb0 tx=0x7f26e0005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f25c57fa640 1 -- 172.21.15.161:0/2719798573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e0032070 con 0x55cced978f80 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f25c57fa640 1 -- 172.21.15.161:0/2719798573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26e003bd30 con 0x55cced978f80 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f25c57fa640 1 -- 172.21.15.161:0/2719798573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f26e004e220 con 0x55cced978f80 2024-05-08T09:23:34.227 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cced980cb0 con 0x55cced978f80 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.210+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cced983960 con 0x55cced978f80 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f25c57fa640 1 -- 172.21.15.161:0/2719798573 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f26e0017740 con 0x55cced978f80 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f25c57fa640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25b0036900 0x7f25b0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f25c57fa640 1 -- 172.21.15.161:0/2719798573 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f26e0037d10 con 0x55cced978f80 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f26e7855640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25b0036900 0x7f25b0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced98bf90 0x55cced98e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced98eb80 con 0x55cced98bf90 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.211+0000 7f26e7054640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced98bf90 0x55cced98e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26e7855640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25b0036900 0x7f25b0038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26d8076c90 tx=0x7f26d808b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26e7054640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced98bf90 0x55cced98e430 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc009050 con 0x55cced98bf90 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 realm 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced98b460 con 0x55cced98bf90 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc009050 con 0x55cced98bf90 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced98f660 con 0x55cced98bf90 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc009050 con 0x55cced98bf90 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.212+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced98ff30 con 0x55cced98bf90 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f26dc009050 con 0x55cced98bf90 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26ec630800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced9907e0 0x55cced992bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced993310 con 0x55cced9907e0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26e8056640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced9907e0 0x55cced992bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.213+0000 7f26e8056640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced9907e0 0x55cced992bd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26ec630800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26ec630800 20 searching for the correct realm 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cced9953c0 0x55cced997880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.230 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26e7855640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cced9953c0 0x55cced997880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.214+0000 7f26e7855640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cced9953c0 0x55cced997880 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7855640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f26d80a5040 0x7f26d80625e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7054640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f26d80a5040 0x7f26d80625e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7054640 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f26d80a5040 0x7f26d80625e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc009050 con 0x7f26d80a5040 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.215+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc009050 con 0x55cced98bf90 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.216+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.217+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.218+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.219+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.220+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.221+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.234 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9907e0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.222+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced9953c0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x55cced98bf90 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.235 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cced997f50 con 0x7f26d80a5040 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.223+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced993df0 con 0x55cced98bf90 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.236 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced994270 con 0x55cced98bf90 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced994750 con 0x55cced98bf90 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 zone default found 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 4 Realm: () 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 zonegroup default 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.224+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced9983d0 con 0x55cced9907e0 2024-05-08T09:23:34.237 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced99a600 con 0x55cced9953c0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced99a9a0 con 0x55cced9953c0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 started sync module instance, tier type = 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:34.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.225+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced999a40 con 0x7f26d80a5040 2024-05-08T09:23:34.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.226+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.226+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338647957312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced999a40 con 0x7f26d80a5040 2024-05-08T09:23:34.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.226+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99b360 con 0x55cced98bf90 2024-05-08T09:23:34.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.227+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338647957312] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.227+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.228+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338647961744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced999a40 con 0x55cced98bf90 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.228+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99bdf0 con 0x55cced9953c0 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.229+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.229+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338647963840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99c690 con 0x55cced9953c0 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.229+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99d130 con 0x7f26d80a5040 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.229+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338647961744] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.230+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.230+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338647968768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99d520 con 0x7f26d80a5040 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.230+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99df20 con 0x55cced98bf90 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.230+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338647963840] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.231+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338647968768] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.231+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.245 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.231+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338647954832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99da30 con 0x55cced98bf90 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.231+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99e7c0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.232+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.232+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338647974672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99da30 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.232+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f330 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.232+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338647954832] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.233+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338647974672] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.233+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.233+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338647975728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99c1e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.233+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f910 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338647975728] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338647977472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f910 con 0x55cced9907e0 2024-05-08T09:23:34.246 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=0 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=1 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=2 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=3 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=4 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=5 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.235+0000 7f26ec630800 20 add_watcher() i=6 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338647977472] v29'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26ec630800 20 add_watcher() i=7 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26ec630800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced9a2bb0 con 0x55cced98bf90 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.247 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.236+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338647979472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99fea0 con 0x55cced98bf90 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338647979472] v29'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f259dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f26ec630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f26ec630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f26ec630800 5 note: GC not initialized 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f259cfe1640 20 reqs_thread_entry: start 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.237+0000 7f26ec630800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26ec630800 20 Filter name: none 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f25167fc640 20 reqs_thread_entry: start 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26ec630800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced9d5c60 con 0x55cced98bf90 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26ec630800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:23:34.248 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.238+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cced9d7050 con 0x55cced9907e0 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.239+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv32 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.240+0000 7f259dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.240+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338647979472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced9a1b80 con 0x55cced98bf90 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.241+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94338647979472] v29'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.241+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338647957312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f5d0 con 0x7f26d80a5040 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.242+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94338647957312] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.242+0000 7f26ec630800 20 remove_watcher() i=0 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.242+0000 7f26ec630800 2 removed watcher, disabling cache 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.242+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338647961744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f5d0 con 0x55cced98bf90 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.243+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94338647961744] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.243+0000 7f26ec630800 20 remove_watcher() i=1 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.243+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338647963840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99f5d0 con 0x55cced9953c0 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.244+0000 7f26e7855640 1 -- 172.21.15.161:0/2719798573 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94338647963840] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26d8076980 con 0x55cced9953c0 2024-05-08T09:23:34.249 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.244+0000 7f26ec630800 20 remove_watcher() i=2 2024-05-08T09:23:34.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.244+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338647968768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99b8c0 con 0x7f26d80a5040 2024-05-08T09:23:34.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.245+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94338647968768] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x7f26d80a5040 2024-05-08T09:23:34.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.245+0000 7f26ec630800 20 remove_watcher() i=3 2024-05-08T09:23:34.250 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.245+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338647954832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99cc00 con 0x55cced98bf90 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.246+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94338647954832] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26dc029040 con 0x55cced98bf90 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.247+0000 7f26ec630800 20 remove_watcher() i=4 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.247+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338647974672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99b8c0 con 0x55cced9907e0 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.248+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94338647974672] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.248+0000 7f26ec630800 20 remove_watcher() i=5 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.248+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338647975728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced999590 con 0x55cced9907e0 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.249+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94338647975728] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.249+0000 7f26ec630800 20 remove_watcher() i=6 2024-05-08T09:23:34.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.249+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338647977472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cced99b8c0 con 0x55cced9907e0 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26e8056640 1 -- 172.21.15.161:0/2719798573 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94338647977472] v29'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f26e00083e0 con 0x55cced9907e0 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 20 remove_watcher() i=7 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced9907e0 msgr2=0x55cced992bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced9907e0 0x55cced992bd0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced98bf90 msgr2=0x55cced98e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced98bf90 0x55cced98e430 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f26d80a5040 msgr2=0x7f26d80625e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f26d80a5040 0x7f26d80625e0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cced9953c0 msgr2=0x55cced997880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cced9953c0 0x55cced997880 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25b0036900 msgr2=0x7f25b0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25b0036900 0x7f25b0038dc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f26d8076c90 tx=0x7f26d808b000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 msgr2=0x55cced9804e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26e7054640 1 -- 172.21.15.161:0/2719798573 reap_dead start 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f26e0015fb0 tx=0x7f26e0005670 comp rx=0 tx=0).stop 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 shutdown_connections 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/2719798573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced978f80 0x55cced9804e0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 >> 172.21.15.161:0/2719798573 conn(0x55cced975290 msgr2=0x55cced9728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 shutdown_connections 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/2719798573 wait complete. 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 msgr2=0x7f25c0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 0x7f25c0038dc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55cced958150 tx=0x7f26d8084040 comp rx=0 tx=0).stop 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 msgr2=0x55cced96c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.250+0000 7f26ec630800 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x55cced9518c0 tx=0x7f26e000aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 shutdown_connections 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25c0036900 0x7f25c0038dc0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/563405239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced96bc70 0x55cced96c090 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 >> 172.21.15.161:0/563405239 conn(0x55cced95fd10 msgr2=0x55cced960110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 shutdown_connections 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/563405239 wait complete. 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 msgr2=0x55cced95c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 0x55cced95c3d0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 msgr2=0x55cced957700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 0x55cced957700 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 msgr2=0x7f25d0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 0x7f25d0038dc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f26dc000f60 tx=0x7f26dc0012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 msgr2=0x55cced9504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f26d800c6b0 tx=0x7f26d8003330 comp rx=0 tx=0).stop 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 shutdown_connections 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cced959fe0 0x55cced95c3d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cced855230 0x55cced957700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f25d0036900 0x7f25d0038dc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 --2- 172.21.15.161:0/1933993382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cced853fd0 0x55cced9504c0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 >> 172.21.15.161:0/1933993382 conn(0x55cced84f5b0 msgr2=0x55cced93e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 shutdown_connections 2024-05-08T09:23:34.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.251+0000 7f26ec630800 1 -- 172.21.15.161:0/1933993382 wait complete. 2024-05-08T09:23:34.259 INFO:teuthology.orchestra.run.smithi161.stdout:{"entries":[],"summary":[]} 2024-05-08T09:23:34.259 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-05-08T09:23:34.259 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T09:23:34.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-05-08T09:23:34.260 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-05-08T09:23:34.305 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.305 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.306+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.306 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3f816800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56199d00a6f0 0x56199d00cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3f816800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56199d00d020 con 0x56199d006be0 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3f816800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x56199ce97050 con 0x56199d00a6f0 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3a75b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56199d00a6f0 0x56199d00cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3a75b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56199d00a6f0 0x56199d00cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56838/0 (socket says 172.21.15.161:56838) 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3a75b640 1 -- 172.21.15.161:0/3584670738 learned_addr learned my addr 172.21.15.161:0/3584670738 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3a75b640 1 -- 172.21.15.161:0/3584670738 >> v1:172.21.15.45:6789/0 conn(0x56199d006be0 legacy=0x56199d008fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.307 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.307+0000 7f6d3a75b640 1 -- 172.21.15.161:0/3584670738 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d00e200 con 0x56199d00a6f0 2024-05-08T09:23:34.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.309+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/3584670738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d00a6f0 0x56199d00cae0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000a520 tx=0x7f6d3001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f518a87b775bb3be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.308 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.309+0000 7f6d39f5a640 1 -- 172.21.15.161:0/3584670738 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d30057070 con 0x56199d00a6f0 2024-05-08T09:23:34.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.309+0000 7f6d39f5a640 1 -- 172.21.15.161:0/3584670738 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d30052570 con 0x56199d00a6f0 2024-05-08T09:23:34.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.309+0000 7f6d39f5a640 1 -- 172.21.15.161:0/3584670738 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d3004ae60 con 0x56199d00a6f0 2024-05-08T09:23:34.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 -- 172.21.15.161:0/3584670738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d00a6f0 msgr2=0x56199d00cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 --2- 172.21.15.161:0/3584670738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d00a6f0 0x56199d00cae0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000a520 tx=0x7f6d3001d010 comp rx=0 tx=0).stop 2024-05-08T09:23:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 -- 172.21.15.161:0/3584670738 shutdown_connections 2024-05-08T09:23:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 --2- 172.21.15.161:0/3584670738 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d00a6f0 0x56199d00cae0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 -- 172.21.15.161:0/3584670738 >> 172.21.15.161:0/3584670738 conn(0x56199d0005b0 msgr2=0x56199d0029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 -- 172.21.15.161:0/3584670738 shutdown_connections 2024-05-08T09:23:34.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.310+0000 7f6d3f816800 1 -- 172.21.15.161:0/3584670738 wait complete. 2024-05-08T09:23:34.323 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3f816800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3f816800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199cf511c0 con 0x56199d006be0 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3af5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3af5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56848/0 (socket says 172.21.15.161:56848) 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.324+0000 7f6d3af5c640 1 -- 172.21.15.161:0/3469297857 learned_addr learned my addr 172.21.15.161:0/3469297857 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.324 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.325+0000 7f6d3af5c640 1 -- 172.21.15.161:0/3469297857 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d0f7cc0 con 0x56199d006be0 2024-05-08T09:23:34.326 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.325+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/3469297857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c001d20 tx=0x7f6d2c00b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9613eb231317469a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.325+0000 7f6c28e09640 1 -- 172.21.15.161:0/3469297857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c00f400 con 0x56199d006be0 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.325+0000 7f6c28e09640 1 -- 172.21.15.161:0/3469297857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c00f5a0 con 0x56199d006be0 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.325+0000 7f6c28e09640 1 -- 172.21.15.161:0/3469297857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c00f7d0 con 0x56199d006be0 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- 172.21.15.161:0/3469297857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 msgr2=0x56199d0f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 --2- 172.21.15.161:0/3469297857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c001d20 tx=0x7f6d2c00b5b0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- 172.21.15.161:0/3469297857 shutdown_connections 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 --2- 172.21.15.161:0/3469297857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0f76f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- 172.21.15.161:0/3469297857 >> 172.21.15.161:0/3469297857 conn(0x56199d0005b0 msgr2=0x56199d0f3010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- 172.21.15.161:0/3469297857 shutdown_connections 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- 172.21.15.161:0/3469297857 wait complete. 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.326+0000 7f6d3f816800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199d00d4f0 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3af5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3af5c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56864/0 (socket says 172.21.15.161:56864) 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3af5c640 1 -- 172.21.15.161:0/1636827814 learned_addr learned my addr 172.21.15.161:0/1636827814 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3af5c640 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d0ff7d0 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c002000 tx=0x7f6d2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6c27606640 1 -- 172.21.15.161:0/1636827814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c01a7c0 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6c27606640 1 -- 172.21.15.161:0/1636827814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c01a960 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56199d0ffa60 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6c27606640 1 -- 172.21.15.161:0/1636827814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d2c01ac40 con 0x56199d006be0 2024-05-08T09:23:34.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.327+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199d102710 con 0x56199d006be0 2024-05-08T09:23:34.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.328+0000 7f6c27606640 1 -- 172.21.15.161:0/1636827814 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d2c017070 con 0x56199d006be0 2024-05-08T09:23:34.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.328+0000 7f6c27606640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 0x7f6c20038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.328+0000 7f6c27606640 1 -- 172.21.15.161:0/1636827814 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d2c015020 con 0x56199d006be0 2024-05-08T09:23:34.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 0x7f6c20038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 0x56199d1064d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d106a60 con 0x56199d00a6f0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 0x56199d1064d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 0x7f6c20038dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6d30054000 tx=0x7f6d3004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 0x56199d1064d0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3b75d640 1 -- 172.21.15.161:0/1636827814 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3400a4a0 con 0x56199d00a6f0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.329+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d103aa0 con 0x56199d00a6f0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3b75d640 1 -- 172.21.15.161:0/1636827814 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d3400a4a0 con 0x56199d00a6f0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 0x56199d10b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d10b890 con 0x56199d108db0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 0x56199d10b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 0x56199d10b1a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3af5c640 1 -- 172.21.15.161:0/1636827814 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d108db0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.330+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d107d60 con 0x56199d00a6f0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3b75d640 1 -- 172.21.15.161:0/1636827814 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d3400a4a0 con 0x56199d00a6f0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d108240 con 0x56199d00a6f0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3b75d640 1 -- 172.21.15.161:0/1636827814 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d3400a4a0 con 0x56199d00a6f0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3f816800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.331+0000 7f6d3f816800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199cef7cf0 con 0x56199d11aa00 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56868/0 (socket says 172.21.15.161:56868) 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3b75d640 1 -- 172.21.15.161:0/2666380093 learned_addr learned my addr 172.21.15.161:0/2666380093 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3b75d640 1 -- 172.21.15.161:0/2666380093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d11b360 con 0x56199d11aa00 2024-05-08T09:23:34.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x56199d106e60 tx=0x7f6d34018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6c24e01640 1 -- 172.21.15.161:0/2666380093 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34014450 con 0x56199d11aa00 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6c24e01640 1 -- 172.21.15.161:0/2666380093 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34014610 con 0x56199d11aa00 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6c24e01640 1 -- 172.21.15.161:0/2666380093 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34014930 con 0x56199d11aa00 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.332+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56199d11bdd0 con 0x56199d11aa00 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.333+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199d11c2d0 con 0x56199d11aa00 2024-05-08T09:23:34.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.333+0000 7f6c24e01640 1 -- 172.21.15.161:0/2666380093 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d34011040 con 0x56199d11aa00 2024-05-08T09:23:34.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6c24e01640 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 0x7f6c14038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6c24e01640 1 -- 172.21.15.161:0/2666380093 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d3401e070 con 0x56199d11aa00 2024-05-08T09:23:34.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 0x7f6c14038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 0x7f6c14038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56199d106f00 tx=0x7f6d2c01aeb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3f816800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3f816800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199d0f8040 con 0x56199d127ce0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56872/0 (socket says 172.21.15.161:56872) 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.334+0000 7f6d3b75d640 1 -- 172.21.15.161:0/2145060631 learned_addr learned my addr 172.21.15.161:0/2145060631 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6d3b75d640 1 -- 172.21.15.161:0/2145060631 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d1286d0 con 0x56199d127ce0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/2145060631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6d3404c8b0 tx=0x7f6d34011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18df88041337b852 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6c1e7fc640 1 -- 172.21.15.161:0/2145060631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34028070 con 0x56199d127ce0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6c1e7fc640 1 -- 172.21.15.161:0/2145060631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d34022d90 con 0x56199d127ce0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6c1e7fc640 1 -- 172.21.15.161:0/2145060631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34016ab0 con 0x56199d127ce0 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6d3f816800 1 -- 172.21.15.161:0/2145060631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 msgr2=0x56199d128100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.335+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2145060631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6d3404c8b0 tx=0x7f6d34011a80 comp rx=0 tx=0).stop 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- 172.21.15.161:0/2145060631 shutdown_connections 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2145060631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d128100 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- 172.21.15.161:0/2145060631 >> 172.21.15.161:0/2145060631 conn(0x56199d124040 msgr2=0x56199d1220a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- 172.21.15.161:0/2145060631 shutdown_connections 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- 172.21.15.161:0/2145060631 wait complete. 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 Processor -- start 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- start start 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3f816800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56199d128e40 con 0x56199d127ce0 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3b75d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56880/0 (socket says 172.21.15.161:56880) 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.336+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 learned_addr learned my addr 172.21.15.161:0/4182912276 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.347 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56199d12f7d0 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6d3404c8b0 tx=0x7f6d3400a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6c1cff9640 1 -- 172.21.15.161:0/4182912276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34033070 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6c1cff9640 1 -- 172.21.15.161:0/4182912276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3404e0d0 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56199d12fa60 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6c1cff9640 1 -- 172.21.15.161:0/4182912276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d34028050 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.337+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56199d132710 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.338+0000 7f6c1cff9640 1 -- 172.21.15.161:0/4182912276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d3403bb00 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.338+0000 7f6c1cff9640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036900 0x7f6c04038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.338+0000 7f6c1cff9640 1 -- 172.21.15.161:0/4182912276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d3400e040 con 0x56199d127ce0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.338+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036900 0x7f6c04038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.338+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036900 0x7f6c04038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c01b7c0 tx=0x7f6d2c033000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d13af20 0x56199d13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d13db30 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d13af20 0x56199d13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d13af20 0x56199d13d3e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 realm 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d13df00 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.339+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d13e7d0 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d13eb70 con 0x56199d13af20 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d13f8d0 0x56199d141cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1422d0 con 0x56199d13f8d0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.340+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d13f8d0 0x56199d141cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3b75d640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d13f8d0 0x56199d141cc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d3402a070 con 0x56199d13f8d0 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3f816800 20 searching for the correct realm 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56199d144280 0x56199d146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56199d144280 0x56199d146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.341+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56199d144280 0x56199d146740 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.342+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.342+0000 7f6d3af5c640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d2c0050c0 0x7f6d2c044790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.342+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.342+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d2c0050c0 0x7f6d2c044790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.342+0000 7f6d3a75b640 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d2c0050c0 0x7f6d2c044790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3402a070 con 0x56199d13f8d0 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.343+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.344+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.345+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.346+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.362 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.347+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.348+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13f8d0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.349+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d144280 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x56199d13af20 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.350+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56199d146e10 con 0x7f6d2c0050c0 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d142c90 con 0x56199d13af20 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.365 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1428d0 con 0x56199d13af20 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d143670 con 0x56199d13af20 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 zone default found 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 4 Realm: () 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:34.366 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 zonegroup default 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.351+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1472f0 con 0x56199d13f8d0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1495c0 con 0x56199d144280 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.352+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d149960 con 0x56199d144280 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.353+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.353+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.353+0000 7f6d3f816800 20 started sync module instance, tier type = 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.353+0000 7f6d3f816800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.353+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d148a50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.354+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.354+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94668009541456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d148a50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.354+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14a380 con 0x56199d13af20 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.355+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94668009541456] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.355+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.355+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94668009545328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d148a50 con 0x56199d13af20 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.355+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14ae10 con 0x56199d144280 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.356+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.356+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94668009548000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14b6b0 con 0x56199d144280 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.356+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94668009545328] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.356+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1485e0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.357+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.357+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94668009552960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14c510 con 0x7f6d2c0050c0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.357+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14cf40 con 0x56199d13af20 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.357+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94668009548000] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.358+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94668009552960] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.358+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.358+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94668009550336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14ca50 con 0x56199d13af20 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.358+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14d410 con 0x56199d13f8d0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.359+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.359+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94668009557856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14dcb0 con 0x56199d13f8d0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.359+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14e770 con 0x56199d13f8d0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.359+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94668009550336] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.360+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94668009557856] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.360+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.360+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94668009562688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14d840 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.360+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14ee00 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94668009562688] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94668009554016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14ee00 con 0x56199d13f8d0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=0 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=1 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=2 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=3 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=4 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=5 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.362+0000 7f6d3f816800 20 add_watcher() i=6 2024-05-08T09:23:34.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94668009554016] v29'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3f816800 20 add_watcher() i=7 2024-05-08T09:23:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3f816800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d152010 con 0x56199d13af20 2024-05-08T09:23:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.371 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.363+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94668009564864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d14f390 con 0x56199d13af20 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.364+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94668009564864] v29'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.364+0000 7f6bf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.364+0000 7f6d3f816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.364+0000 7f6d3f816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.364+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1518f0 con 0x56199d13af20 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.365+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.365+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15b0d0 con 0x56199d13f8d0 2024-05-08T09:23:34.373 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.366+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.366+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15b0d0 con 0x56199d144280 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.368+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.368+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15b920 con 0x56199d13af20 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.369+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'233 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.369+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15a760 con 0x7f6d2c0050c0 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.370+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.370+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15a760 con 0x56199d144280 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.371+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'50 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.371+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15c480 con 0x56199d13af20 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.372+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.372+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15c480 con 0x56199d13f8d0 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.373+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'49 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.374 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.373+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15c5b0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.374+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.375 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.374+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15c5b0 con 0x56199d144280 2024-05-08T09:23:34.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.375+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.375+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.376+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.376 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.376+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13f8d0 2024-05-08T09:23:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.377+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.377 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.378+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.379+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.378 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.379+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13f8d0 2024-05-08T09:23:34.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.380+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.379 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.380+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13af20 2024-05-08T09:23:34.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.381+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'234 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.380 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.381+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.382+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.382+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.383+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.383+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.384+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'29 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.384+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13af20 2024-05-08T09:23:34.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.385+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.385+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13af20 2024-05-08T09:23:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.386+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'235 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.386+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.387+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.388+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.388+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.388+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.389+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'32 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.389+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.390+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.390+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.391+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.390 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.391+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.392+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'51 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.391 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.392+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13f8d0 2024-05-08T09:23:34.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.394+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.393 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.394+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.395+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.394 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.395+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13f8d0 2024-05-08T09:23:34.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.396+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'50 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.395 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.396+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d144280 2024-05-08T09:23:34.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.397+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.396 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.397+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x56199d13f8d0 2024-05-08T09:23:34.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.398+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.397 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.398+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d15ca50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.398 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.399+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6b6bfff640 20 reqs_thread_entry: start 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 20 Filter name: none 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6b69ffb640 20 reqs_thread_entry: start 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-05-08T09:23:34.401 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d187920 con 0x56199d13af20 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=391 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.400+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1873b0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 : miss 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 8.c 8:37a0ecec:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d189d00 con 0x56199d13af20 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(96 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 [call out=48b,stat out=16b,read 0~379 out=379b,getxattrs out=218b] v0'0 uv4 ondisk = 0) ==== 332+0+661 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=379 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 info.flags=0x17 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 to cache LRU end 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 4.f 4:f0cfa160:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d2074d0 con 0x56199d13af20 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(97 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.401+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:98 4.3b 4:de8c9e6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x56199d144280 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(98 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 4.1d 4:b9ece447:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x56199d144280 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(99 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:100 4.f 4:f1ebc22d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x56199d13af20 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(100 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.402+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:101 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x7f6d2c0050c0 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(101 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [call out=425b] v0'0 uv4 ondisk = 0) ==== 194+0+425 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3f816800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:102 4.3d 4:bc739e1a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x56199d144280 2024-05-08T09:23:34.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(102 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:103 4.14 4:28b5225a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x56199d144280 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(103 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.403+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 4.3f 4:fe51abd4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207510 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(104 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 4.28 4:15ed54b1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207550 con 0x56199d13af20 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(105 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:106 4.1b 4:da0cc765:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207550 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(106 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.404+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:107 4.0 4:035ce53e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d207550 con 0x56199d144280 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(107 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 20 get_obj_state: octx=0x7f6d3402bd90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56199d18aec8 s->prefetch_data=0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:108 3.5s0 3:a1b3097c:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d18bdb0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(108 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 262+0+893 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 10 manifest: total_size = 6 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 20 get_obj_state: setting s->obj_tag to 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.2478827229827860642 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 20 get_obj_state: octx=0x7f6d3402bd90 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x56199d18aec8 s->prefetch_data=0 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 20 prepare_atomic_modification: state is not atomic. state=0x56199d18aec8 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 20 bucket index object: :.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.405+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:109 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d190830 con 0x7f6d2c0050c0 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.406+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(109 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [stat,call,call] v29'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.406+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:110 3.5s0 3:a1b3097c:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d190830 con 0x7f6d2c0050c0 2024-05-08T09:23:34.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.407+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(110 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7_15f6f8dc036519d7fe15b39338f6e5db [call] v29'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:111 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d191160 con 0x7f6d2c0050c0 2024-05-08T09:23:34.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 20 list_objects_ordered: starting attempt 1 2024-05-08T09:23:34.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-05-08T09:23:34.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:112 4.f 4:f0cfa160:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d191160 con 0x56199d13af20 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:113 4.3b 4:de8c9e6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d195430 con 0x56199d144280 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:114 4.1d 4:b9ece447:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d191160 con 0x56199d144280 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:115 4.f 4:f1ebc22d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d19a260 con 0x56199d13af20 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:116 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d19cb70 con 0x7f6d2c0050c0 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:117 4.3d 4:bc739e1a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d19f4d0 con 0x56199d144280 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:118 4.14 4:28b5225a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a22c0 con 0x56199d144280 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 4.3f 4:fe51abd4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a50f0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:120 4.28 4:15ed54b1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13af20 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:121 4.1b 4:da0cc765:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1aa910 con 0x7f6d2c0050c0 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:122 4.0 4:035ce53e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1ad790 con 0x56199d144280 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(112 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.417 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.408+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(115 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(119 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(121 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(120 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(113 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(114 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(117 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(118 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(122 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(111 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [stat,call,call] v29'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.418 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.409+0000 7f6c1dffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(116 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7])"; uploads.size()=0; is_truncated=0 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:123 4.f 4:f0cfa160:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13af20 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:124 4.3b 4:de8c9e6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a22c0 con 0x56199d144280 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:125 4.1d 4:b9ece447:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1aa910 con 0x56199d144280 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:126 4.f 4:f1ebc22d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13af20 2024-05-08T09:23:34.419 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:127 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1aa910 con 0x7f6d2c0050c0 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:128 4.3d 4:bc739e1a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d144280 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(123 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(127 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [call out=124b] v0'0 uv6 ondisk = 0) ==== 194+0+124 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(124 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:129 4.14 4:28b5225a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1aa910 con 0x56199d144280 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:130 4.3f 4:fe51abd4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(125 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(126 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3 [call out=85b] v0'0 uv4 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:131 4.28 4:15ed54b1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a22c0 con 0x56199d13af20 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(128 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:132 4.1b 4:da0cc765:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7580 con 0x7f6d2c0050c0 2024-05-08T09:23:34.420 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.410+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:133 4.0 4:035ce53e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d144280 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(132 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9 [call out=85b] v0'0 uv2 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(129 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(130 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7 [call out=85b] v0'0 uv3 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(131 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8 [call out=85b] v0'0 uv1 ondisk = 0) ==== 194+0+85 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(133 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10 [call out=85b] v0'0 uv5 ondisk = 0) ==== 195+0+85 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.411+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(134 foo.buckets [call] v29'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.421 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 20 rados_obj.operate() r=0 bl.length=165 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.412+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 35 ==== osd_op_reply(136 myfoo [call,call,delete] v29'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3f816800 10 removing default.rgw.meta+root+myfoo from cache 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94668009939376 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13f8d0 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== watch-notify(notify (1) cookie 94668009562688 notify 124554051620 ret 0) ==== 191+0+0 (crc 0 0 0) 0x56199d15c5b0 con 0x56199d13f8d0 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6c1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051620 cookie 94668009562688 notifier 4771 bl.length()=149 2024-05-08T09:23:34.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(137 notify.6 [notify cookie 94668009939376 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.413+0000 7f6c1dffb640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b700032c0 con 0x56199d13f8d0 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.414+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.414+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== watch-notify(notify_complete (2) cookie 94668009939376 notify 124554051620 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d34064040 con 0x56199d13f8d0 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.414+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:139 8.c 8:37a0ecec:root::.bucket.meta.myfoo%3a7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13af20 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(139 .bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 [call,call,delete] v29'5 uv5 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3f816800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 from cache 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7, ofs0, ns] 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:140 7.15 7:a93a5511:::notify.2:head [notify cookie 94668009939376 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d144280 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== watch-notify(notify (1) cookie 94668009548000 notify 124554051607 ret 0) ==== 248+0+0 (crc 0 0 0) 0x56199d132710 con 0x56199d144280 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6c1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94668009548000 notifier 4771 bl.length()=206 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(140 notify.2 [notify cookie 94668009939376 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6c1dffb640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:141 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b700032c0 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.415+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(141 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== watch-notify(notify_complete (2) cookie 94668009939376 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56199d102710 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:142 4.f 4:f0cfa160:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d13af20 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:143 4.3b 4:de8c9e6f:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a4ba0 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:144 4.1d 4:b9ece447:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d190c20 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:145 4.f 4:f1ebc22d:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1883e0 con 0x56199d13af20 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:146 4.1b 4:dae1cd36:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d188cf0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:147 4.3d 4:bc739e1a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a83e0 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:148 4.14 4:28b5225a:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1a7ab0 con 0x56199d144280 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:149 4.3f 4:fe51abd4:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1ab2e0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:150 4.28 4:15ed54b1:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:151 4.1b 4:da0cc765:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1ac8c0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.416+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:152 4.0 4:035ce53e:::.dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1883e0 con 0x56199d144280 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.417+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(150 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.8 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(144 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.2 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(147 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.5 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 36 ==== osd_op_reply(146 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.4 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(142 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.0 [delete] v29'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(143 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.1 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 37 ==== osd_op_reply(151 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.9 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 38 ==== osd_op_reply(149 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.7 [delete] v29'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(145 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.3 [delete] v29'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(148 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.6 [delete] v29'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.433 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(152 .dir.7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7.10 [delete] v29'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 : miss 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:153 6.19 6:9919cd5f:::pubsub..bucket.myfoo%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(153 pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 info.flags=0x0 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 10 adding default.rgw.log++pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 to cache LRU end 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.418+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:154 6.19 6:9919cd5f:::pubsub..bucket.myfoo%2f7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.419+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(154 pubsub..bucket.myfoo/7cebcda8-1953-4641-9d19-b10f40cc5883.4223.7 [delete] v29'35 uv27 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.419+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.434 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.420+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 39 ==== osd_op_reply(155 foo.buckets [call] v29'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.420+0000 7f6d3f816800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.420+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13f8d0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.421+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v29'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.421+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.421+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94668009929264 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 40 ==== watch-notify(notify (1) cookie 94668009552960 notify 124554051605 ret 0) ==== 212+0+0 (crc 0 0 0) 0x56199d1893f0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6c1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 94668009552960 notifier 4771 bl.length()=170 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 41 ==== osd_op_reply(157 notify.3 [notify cookie 94668009929264 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6c1dffb640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b700032c0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 42 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 43 ==== watch-notify(notify_complete (2) cookie 94668009929264 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56199d15a0c0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.435 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3f816800 10 removing email index: foo@foo.com 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.422+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(159 foo@foo.com [delete] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94668009929264 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 44 ==== watch-notify(notify (1) cookie 94668009552960 notify 124554051606 ret 0) ==== 204+0+0 (crc 0 0 0) 0x56199d15a0c0 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6c1e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051606 cookie 94668009552960 notifier 4771 bl.length()=162 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6c1e7fc640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6c00003d60 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 45 ==== osd_op_reply(160 notify.3 [notify cookie 94668009929264 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.423+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 46 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.424+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 47 ==== watch-notify(notify_complete (2) cookie 94668009929264 notify 124554051606 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56199d151740 con 0x7f6d2c0050c0 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.424+0000 7f6d3f816800 10 removing user buckets index 2024-05-08T09:23:34.436 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.424+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 48 ==== osd_op_reply(162 foo.buckets [delete] v29'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94668009929264 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== watch-notify(notify (1) cookie 94668009557856 notify 124554051621 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7f6d34064040 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(163 notify.5 [notify cookie 94668009929264 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6c1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051621 cookie 94668009557856 notifier 4771 bl.length()=160 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6c1dffb640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b700032c0 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== watch-notify(notify_complete (2) cookie 94668009929264 notify 124554051621 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56199d12fa60 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3f816800 10 removing user index: foo 2024-05-08T09:23:34.437 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.425+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.426+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(165 foo [call,call,delete] v29'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.426+0000 7f6d3f816800 10 removing default.rgw.meta+users.uid+foo from cache 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.426+0000 7f6d3f816800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.426+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94668009803632 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.426+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== watch-notify(notify (1) cookie 94668009550336 notify 124554051604 ret 0) ==== 194+0+0 (crc 0 0 0) 0x56199d151740 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.427+0000 7f6c1dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051604 cookie 94668009550336 notifier 4771 bl.length()=152 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.427+0000 7f6c1dffb640 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b700032c0 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.427+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(166 notify.4 [notify cookie 94668009803632 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.427+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 49 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.427+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 50 ==== watch-notify(notify_complete (2) cookie 94668009803632 notify 124554051604 ret 0) ==== 42+0+48 (crc 0 0 0) 0x56199d151570 con 0x56199d13af20 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.428+0000 7f6bf17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.438 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.428+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94668009564864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.429+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 51 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94668009564864] v29'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.429+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94668009541456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.430+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 49 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94668009541456] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.430+0000 7f6d3f816800 20 remove_watcher() i=0 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.430+0000 7f6d3f816800 2 removed watcher, disabling cache 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.430+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94668009545328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.431+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 52 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94668009545328] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.431+0000 7f6d3f816800 20 remove_watcher() i=1 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.431+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94668009548000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d144280 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.432+0000 7f6d3af5c640 1 -- 172.21.15.161:0/4182912276 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94668009548000] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d2c02e070 con 0x56199d144280 2024-05-08T09:23:34.439 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.432+0000 7f6d3f816800 20 remove_watcher() i=2 2024-05-08T09:23:34.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.432+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94668009552960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x7f6d2c0050c0 2024-05-08T09:23:34.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.433+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.2 v2:172.21.15.161:6800/1967789976 50 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94668009552960] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x7f6d2c0050c0 2024-05-08T09:23:34.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.433+0000 7f6d3f816800 20 remove_watcher() i=3 2024-05-08T09:23:34.440 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.433+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94668009550336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13af20 2024-05-08T09:23:34.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.434+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 <== osd.1 v2:172.21.15.161:6801/4188235102 53 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94668009550336] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d3005a040 con 0x56199d13af20 2024-05-08T09:23:34.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.434+0000 7f6d3f816800 20 remove_watcher() i=4 2024-05-08T09:23:34.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.434+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94668009557856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13f8d0 2024-05-08T09:23:34.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.435+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94668009557856] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.444 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.435+0000 7f6d3f816800 20 remove_watcher() i=5 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.435+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94668009562688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13f8d0 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.436+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94668009562688] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.436+0000 7f6d3f816800 20 remove_watcher() i=6 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.436+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94668009554016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56199d1abf50 con 0x56199d13f8d0 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.437+0000 7f6d3b75d640 1 -- 172.21.15.161:0/4182912276 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94668009554016] v29'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d34058040 con 0x56199d13f8d0 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.437+0000 7f6d3f816800 20 remove_watcher() i=7 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.437+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d13f8d0 msgr2=0x56199d141cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d13f8d0 0x56199d141cc0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d13af20 msgr2=0x56199d13d3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d13af20 0x56199d13d3e0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.445 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d2c0050c0 msgr2=0x7f6d2c044790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d2c0050c0 0x7f6d2c044790 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56199d144280 msgr2=0x56199d146740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56199d144280 0x56199d146740 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036900 msgr2=0x7f6c04038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036900 0x7f6c04038dc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c01b7c0 tx=0x7f6d2c033000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3a75b640 1 -- 172.21.15.161:0/4182912276 reap_dead start 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 msgr2=0x56199d12f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f6d3404c8b0 tx=0x7f6d3400a9b0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 shutdown_connections 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/4182912276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d127ce0 0x56199d12f290 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 >> 172.21.15.161:0/4182912276 conn(0x56199d124040 msgr2=0x56199d1216a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.446 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 shutdown_connections 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/4182912276 wait complete. 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 msgr2=0x7f6c14038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 0x7f6c14038dc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x56199d106f00 tx=0x7f6d2c01aeb0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 msgr2=0x56199d11ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x56199d106e60 tx=0x7f6d34018830 comp rx=0 tx=0).stop 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 shutdown_connections 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c14036900 0x7f6c14038dc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 --2- 172.21.15.161:0/2666380093 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d11aa00 0x56199d11ae20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 >> 172.21.15.161:0/2666380093 conn(0x56199d10eaa0 msgr2=0x56199d10eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 shutdown_connections 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.438+0000 7f6d3f816800 1 -- 172.21.15.161:0/2666380093 wait complete. 2024-05-08T09:23:34.447 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 msgr2=0x56199d10b1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 0x56199d10b1a0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 msgr2=0x56199d1064d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 0x56199d1064d0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 msgr2=0x7f6c20038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 0x7f6c20038dc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6d30054000 tx=0x7f6d3004e000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 msgr2=0x56199d0ff290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c002000 tx=0x7f6d2c000ed0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 shutdown_connections 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56199d108db0 0x56199d10b1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56199d00a6f0 0x56199d1064d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c20036900 0x7f6c20038dc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 --2- 172.21.15.161:0/1636827814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56199d006be0 0x56199d0ff290 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.448 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 >> 172.21.15.161:0/1636827814 conn(0x56199d0005b0 msgr2=0x56199d0f1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 shutdown_connections 2024-05-08T09:23:34.449 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.439+0000 7f6d3f816800 1 -- 172.21.15.161:0/1636827814 wait complete. 2024-05-08T09:23:34.450 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-05-08T09:23:34.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-05-08T09:23:34.450 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-05-08T09:23:34.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.494 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f75a4131800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e9eefc4be0 0x55e9eefc6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f75a4131800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e9eefcb020 con 0x55e9eefc7510 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f75a4131800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e9eee55050 con 0x55e9eefc4be0 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f759fe36640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e9eefc4be0 0x55e9eefc6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f7597fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e9eefc7510 0x55e9eefc9900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51036/0 (socket says 172.21.15.161:51036) 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.496+0000 7f7597fff640 1 -- 172.21.15.161:0/2364294590 learned_addr learned my addr 172.21.15.161:0/2364294590 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.497+0000 7f759fe36640 1 -- 172.21.15.161:0/2364294590 >> v1:172.21.15.45:6789/0 conn(0x55e9eefc7510 legacy=0x55e9eefc9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.496 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.497+0000 7f759fe36640 1 -- 172.21.15.161:0/2364294590 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9eefcc200 con 0x55e9eefc4be0 2024-05-08T09:23:34.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.498+0000 7f759fe36640 1 --2- 172.21.15.161:0/2364294590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9eefc6fd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f759000a470 tx=0x7f759001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8ace76fbca5a38 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f759f635640 1 -- 172.21.15.161:0/2364294590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590057070 con 0x55e9eefc4be0 2024-05-08T09:23:34.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f759f635640 1 -- 172.21.15.161:0/2364294590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7590052570 con 0x55e9eefc4be0 2024-05-08T09:23:34.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f759f635640 1 -- 172.21.15.161:0/2364294590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590052870 con 0x55e9eefc4be0 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 -- 172.21.15.161:0/2364294590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 msgr2=0x55e9eefc6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 --2- 172.21.15.161:0/2364294590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9eefc6fd0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f759000a470 tx=0x7f759001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 -- 172.21.15.161:0/2364294590 shutdown_connections 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 --2- 172.21.15.161:0/2364294590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9eefc6fd0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 -- 172.21.15.161:0/2364294590 >> 172.21.15.161:0/2364294590 conn(0x55e9eefbe5b0 msgr2=0x55e9eefc09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 -- 172.21.15.161:0/2364294590 shutdown_connections 2024-05-08T09:23:34.499 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.499+0000 7f75a4131800 1 -- 172.21.15.161:0/2364294590 wait complete. 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.512+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.512+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f75a4131800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f75a4131800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e9eef0f1d0 con 0x55e9eefc4be0 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f759fe36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.512 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f759fe36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56902/0 (socket says 172.21.15.161:56902) 2024-05-08T09:23:34.513 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f759fe36640 1 -- 172.21.15.161:0/2032021760 learned_addr learned my addr 172.21.15.161:0/2032021760 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.513+0000 7f759fe36640 1 -- 172.21.15.161:0/2032021760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef0b5c60 con 0x55e9eefc4be0 2024-05-08T09:23:34.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f759fe36640 1 --2- 172.21.15.161:0/2032021760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f759001ced0 tx=0x7f759004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96d79a29ee7641b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.517 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f748de0b640 1 -- 172.21.15.161:0/2032021760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590057040 con 0x55e9eefc4be0 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f748de0b640 1 -- 172.21.15.161:0/2032021760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75900529a0 con 0x55e9eefc4be0 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f748de0b640 1 -- 172.21.15.161:0/2032021760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590052cc0 con 0x55e9eefc4be0 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f75a4131800 1 -- 172.21.15.161:0/2032021760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 msgr2=0x55e9ef0b5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f75a4131800 1 --2- 172.21.15.161:0/2032021760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f759001ced0 tx=0x7f759004c000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f75a4131800 1 -- 172.21.15.161:0/2032021760 shutdown_connections 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f75a4131800 1 --2- 172.21.15.161:0/2032021760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0b5690 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.514+0000 7f75a4131800 1 -- 172.21.15.161:0/2032021760 >> 172.21.15.161:0/2032021760 conn(0x55e9eefbe5b0 msgr2=0x55e9ef0b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 -- 172.21.15.161:0/2032021760 shutdown_connections 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 -- 172.21.15.161:0/2032021760 wait complete. 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f75a4131800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e9eefcb490 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f759fe36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f759fe36640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56912/0 (socket says 172.21.15.161:56912) 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f759fe36640 1 -- 172.21.15.161:0/2921565471 learned_addr learned my addr 172.21.15.161:0/2921565471 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.515+0000 7f759fe36640 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef0bd650 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f759fe36640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7590000c00 tx=0x7f7590003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f7487fff640 1 -- 172.21.15.161:0/2921565471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590073070 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f7487fff640 1 -- 172.21.15.161:0/2921565471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759005d780 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9ef0bd8e0 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f7487fff640 1 -- 172.21.15.161:0/2921565471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7590057070 con 0x55e9eefc4be0 2024-05-08T09:23:34.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.516+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ef0c0590 con 0x55e9eefc4be0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f7487fff640 1 -- 172.21.15.161:0/2921565471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7590076070 con 0x55e9eefc4be0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f7487fff640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 0x7f7488038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f7487fff640 1 -- 172.21.15.161:0/2921565471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f759008e080 con 0x55e9eefc4be0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f7597fff640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 0x7f7488038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 0x55e9ef0c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0c4930 con 0x55e9eefc7510 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f75a0637640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 0x55e9ef0c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f7597fff640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 0x7f7488038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7588000f60 tx=0x7f75880012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.517+0000 7f75a0637640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 0x55e9ef0c4350 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f75a0637640 1 -- 172.21.15.161:0/2921565471 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f759800a4a0 con 0x55e9eefc7510 2024-05-08T09:23:34.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0c1920 con 0x55e9eefc7510 2024-05-08T09:23:34.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f75a0637640 1 -- 172.21.15.161:0/2921565471 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f759800a4a0 con 0x55e9eefc7510 2024-05-08T09:23:34.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 0x55e9ef0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0c9710 con 0x55e9ef0c6c80 2024-05-08T09:23:34.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.518+0000 7f759fe36640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 0x55e9ef0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f759fe36640 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 0x55e9ef0c9070 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f759fe36640 1 -- 172.21.15.161:0/2921565471 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef0c6c80 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0c5c30 con 0x55e9eefc7510 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f75a0637640 1 -- 172.21.15.161:0/2921565471 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f759800a4a0 con 0x55e9eefc7510 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0c6110 con 0x55e9eefc7510 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.519+0000 7f75a0637640 1 -- 172.21.15.161:0/2921565471 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f759800a4a0 con 0x55e9eefc7510 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a4131800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a4131800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e9eeeb5cf0 con 0x55e9ef0d88c0 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56926/0 (socket says 172.21.15.161:56926) 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a0637640 1 -- 172.21.15.161:0/2802791033 learned_addr learned my addr 172.21.15.161:0/2802791033 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.520+0000 7f75a0637640 1 -- 172.21.15.161:0/2802791033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef0d9220 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f75a0637640 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0bdfe0 tx=0x7f75980188f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f74857fa640 1 -- 172.21.15.161:0/2802791033 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598014450 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f74857fa640 1 -- 172.21.15.161:0/2802791033 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75980145f0 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9ef0d9c90 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f74857fa640 1 -- 172.21.15.161:0/2802791033 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f75980148d0 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.521+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ef0da190 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f74857fa640 1 -- 172.21.15.161:0/2802791033 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7598011040 con 0x55e9ef0d88c0 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f74857fa640 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 0x7f7478038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f74857fa640 1 -- 172.21.15.161:0/2802791033 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f759801e070 con 0x55e9ef0d88c0 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f759fe36640 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 0x7f7478038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f759fe36640 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 0x7f7478038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0c4da0 tx=0x7f7590052f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f75a4131800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.522+0000 7f75a4131800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef0b5f20 con 0x55e9ef0e5c30 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56928/0 (socket says 172.21.15.161:56928) 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f75a0637640 1 -- 172.21.15.161:0/2675931601 learned_addr learned my addr 172.21.15.161:0/2675931601 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f75a0637640 1 -- 172.21.15.161:0/2675931601 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef0e6620 con 0x55e9ef0e5c30 2024-05-08T09:23:34.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f75a0637640 1 --2- 172.21.15.161:0/2675931601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f759804c8a0 tx=0x7f7598011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee68be8083c69954 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f747effd640 1 -- 172.21.15.161:0/2675931601 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759804e200 con 0x55e9ef0e5c30 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f747effd640 1 -- 172.21.15.161:0/2675931601 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f759804b1d0 con 0x55e9ef0e5c30 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.523+0000 7f747effd640 1 -- 172.21.15.161:0/2675931601 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759804b4f0 con 0x55e9ef0e5c30 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- 172.21.15.161:0/2675931601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 msgr2=0x55e9ef0e6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 --2- 172.21.15.161:0/2675931601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f759804c8a0 tx=0x7f7598011700 comp rx=0 tx=0).stop 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- 172.21.15.161:0/2675931601 shutdown_connections 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 --2- 172.21.15.161:0/2675931601 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0e6050 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- 172.21.15.161:0/2675931601 >> 172.21.15.161:0/2675931601 conn(0x55e9ef0e1f40 msgr2=0x55e9ef0dffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- 172.21.15.161:0/2675931601 shutdown_connections 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- 172.21.15.161:0/2675931601 wait complete. 2024-05-08T09:23:34.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 Processor -- start 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- start start 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a4131800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e9ef0e6d70 con 0x55e9ef0e5c30 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a0637640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56932/0 (socket says 172.21.15.161:56932) 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.524+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 learned_addr learned my addr 172.21.15.161:0/3222585947 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9ef0ed6d0 con 0x55e9ef0e5c30 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f75a0637640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7598011740 tx=0x7f759804c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f747d7fa640 1 -- 172.21.15.161:0/3222585947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7598022c90 con 0x55e9ef0e5c30 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f747d7fa640 1 -- 172.21.15.161:0/3222585947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7598022e30 con 0x55e9ef0e5c30 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e9ef0ed960 con 0x55e9ef0e5c30 2024-05-08T09:23:34.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f747d7fa640 1 -- 172.21.15.161:0/3222585947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f759804cb30 con 0x55e9ef0e5c30 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.525+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9ef0f0610 con 0x55e9ef0e5c30 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f747d7fa640 1 -- 172.21.15.161:0/3222585947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f759802b350 con 0x55e9ef0e5c30 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f747d7fa640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7468036900 0x7f7468038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f747d7fa640 1 -- 172.21.15.161:0/3222585947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7598046040 con 0x55e9ef0e5c30 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f759fe36640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7468036900 0x7f7468038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f759fe36640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7468036900 0x7f7468038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0c9b10 tx=0x7f7590089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.526+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9ef0f8df0 0x55e9ef0fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0fba00 con 0x55e9ef0f8df0 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f7597fff640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9ef0f8df0 0x55e9ef0fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f7597fff640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9ef0f8df0 0x55e9ef0fb2b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7588009050 con 0x55e9ef0f8df0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 20 realm 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0f8240 con 0x55e9ef0f8df0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7588009050 con 0x55e9ef0f8df0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.527+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0fc4e0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7588009050 con 0x55e9ef0f8df0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef0fcdb0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7588009050 con 0x55e9ef0f8df0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0fd660 0x55e9ef0ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef100190 con 0x55e9ef0fd660 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a0637640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0fd660 0x55e9ef0ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.528+0000 7f75a0637640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0fd660 0x55e9ef0ffa50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f75a4131800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f75a4131800 20 searching for the correct realm 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e9ef102240 0x55e9ef104700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f759fe36640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e9ef102240 0x55e9ef104700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.529+0000 7f759fe36640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e9ef102240 0x55e9ef104700 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f759fe36640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f759009d040 0x7f7590076360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f7597fff640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f759009d040 0x7f7590076360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f7597fff640 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f759009d040 0x7f7590076360 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588009050 con 0x7f759009d040 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.530+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588009050 con 0x55e9ef0f8df0 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.531+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.551 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.532+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.533+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.534+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.552 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.534+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.534+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.534+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.534+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.553 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.535+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.536+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.536+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.536+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.536+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.554 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.537+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0fd660 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef102240 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.538+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef104dd0 con 0x7f759009d040 2024-05-08T09:23:34.555 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef100c70 con 0x55e9ef0f8df0 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1010f0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.539+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1015d0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 zone default found 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 4 Realm: () 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:34.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 zonegroup default 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef105250 con 0x55e9ef0fd660 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107480 con 0x55e9ef102240 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.540+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107820 con 0x55e9ef102240 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.541+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.541+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.541+0000 7f75a4131800 20 started sync module instance, tier type = 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.541+0000 7f75a4131800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.541+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1068c0 con 0x7f759009d040 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.542+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.542+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94463226572304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1068c0 con 0x7f759009d040 2024-05-08T09:23:34.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.542+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1081e0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.570 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.543+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94463226572304] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.543+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.543+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94463226570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef1081e0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.543+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef108ba0 con 0x55e9ef102240 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.544+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94463226570224] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.545+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.545+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94463226576176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef108150 con 0x55e9ef102240 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.545+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef109a60 con 0x7f759009d040 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.546+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.546+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94463226582960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10a240 con 0x7f759009d040 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.546+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10ad60 con 0x55e9ef0f8df0 2024-05-08T09:23:34.571 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.546+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94463226576176] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.547+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.547+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94463226587184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10ad20 con 0x55e9ef0f8df0 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.547+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10b770 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.547+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94463226582960] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.548+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.548+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94463226589888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10bb10 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.548+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10c510 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.548+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94463226587184] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.549+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94463226589888] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.549+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.549+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94463226584208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.572 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.549+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10c9e0 con 0x55e9ef0fd660 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.550+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94463226584208] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94463226580880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10c9e0 con 0x55e9ef0fd660 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=0 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=1 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=2 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=3 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=4 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=5 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.551+0000 7f75a4131800 20 add_watcher() i=6 2024-05-08T09:23:34.573 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94463226580880] v29'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f75a4131800 20 add_watcher() i=7 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f75a4131800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10fe40 con 0x55e9ef0f8df0 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.552+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94463226595072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10d390 con 0x55e9ef0f8df0 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94463226595072] v29'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f7455fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f75a4131800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f75a4131800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f75a4131800 5 note: GC not initialized 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.553+0000 7f7454fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:34.574 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f75a4131800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f75a4131800 20 Filter name: none 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f73ce7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f75a4131800 20 rados->read ofs=0 len=0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef142eb0 con 0x55e9ef0f8df0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.554+0000 7f75a4131800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:could not fetch user info: no user info saved 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.555+0000 7f7455fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.555+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94463226595072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef142e70 con 0x55e9ef0f8df0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.556+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94463226595072] v29'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.556+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94463226572304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef142e70 con 0x7f759009d040 2024-05-08T09:23:34.575 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.557+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94463226572304] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.557+0000 7f75a4131800 20 remove_watcher() i=0 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.557+0000 7f75a4131800 2 removed watcher, disabling cache 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.557+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94463226570224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef142e70 con 0x55e9ef0f8df0 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.558+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94463226570224] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.558+0000 7f75a4131800 20 remove_watcher() i=1 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.558+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94463226576176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef142e70 con 0x55e9ef102240 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.559+0000 7f759fe36640 1 -- 172.21.15.161:0/3222585947 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94463226576176] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7590075030 con 0x55e9ef102240 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.559+0000 7f75a4131800 20 remove_watcher() i=2 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.559+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94463226582960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107d30 con 0x7f759009d040 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.560+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94463226582960] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x7f759009d040 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.560+0000 7f75a4131800 20 remove_watcher() i=3 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.560+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94463226587184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107d30 con 0x55e9ef0f8df0 2024-05-08T09:23:34.576 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.561+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94463226587184] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7588029040 con 0x55e9ef0f8df0 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.561+0000 7f75a4131800 20 remove_watcher() i=4 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.561+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94463226589888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107d30 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.562+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94463226589888] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.562+0000 7f75a4131800 20 remove_watcher() i=5 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.562+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94463226584208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef10b2c0 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.563+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94463226584208] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.563+0000 7f75a4131800 20 remove_watcher() i=6 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.563+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94463226580880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e9ef107d30 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.564+0000 7f75a0637640 1 -- 172.21.15.161:0/3222585947 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94463226580880] v29'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f759803c020 con 0x55e9ef0fd660 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.564+0000 7f75a4131800 20 remove_watcher() i=7 2024-05-08T09:23:34.577 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0fd660 msgr2=0x55e9ef0ffa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0fd660 0x55e9ef0ffa50 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9ef0f8df0 msgr2=0x55e9ef0fb2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9ef0f8df0 0x55e9ef0fb2b0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f759009d040 msgr2=0x7f7590076360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f759009d040 0x7f7590076360 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e9ef102240 msgr2=0x55e9ef104700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e9ef102240 0x55e9ef104700 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7468036900 msgr2=0x7f7468038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7468036900 0x7f7468038dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0c9b10 tx=0x7f7590089000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f7597fff640 1 -- 172.21.15.161:0/3222585947 reap_dead start 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 msgr2=0x55e9ef0ed190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.578 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7598011740 tx=0x7f759804c830 comp rx=0 tx=0).stop 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 shutdown_connections 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/3222585947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0e5c30 0x55e9ef0ed190 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 >> 172.21.15.161:0/3222585947 conn(0x55e9ef0e1f40 msgr2=0x55e9ef0df5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 shutdown_connections 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/3222585947 wait complete. 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 msgr2=0x7f7478038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 0x7f7478038dc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0c4da0 tx=0x7f7590052f90 comp rx=0 tx=0).stop 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 msgr2=0x55e9ef0d8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55e9ef0bdfe0 tx=0x7f75980188f0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 shutdown_connections 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7478036900 0x7f7478038dc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.579 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 --2- 172.21.15.161:0/2802791033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9ef0d88c0 0x55e9ef0d8ce0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 >> 172.21.15.161:0/2802791033 conn(0x55e9ef0cc960 msgr2=0x55e9ef0ccd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 shutdown_connections 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.565+0000 7f75a4131800 1 -- 172.21.15.161:0/2802791033 wait complete. 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 msgr2=0x55e9ef0c9070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 0x55e9ef0c9070 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 msgr2=0x55e9ef0c4350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 0x55e9ef0c4350 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 msgr2=0x7f7488038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 0x7f7488038dc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7588000f60 tx=0x7f75880012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 msgr2=0x55e9ef0bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.580 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7590000c00 tx=0x7f7590003020 comp rx=0 tx=0).stop 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 shutdown_connections 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e9ef0c6c80 0x55e9ef0c9070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e9eefc7510 0x55e9ef0c4350 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7488036900 0x7f7488038dc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 --2- 172.21.15.161:0/2921565471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e9eefc4be0 0x55e9ef0bd110 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 >> 172.21.15.161:0/2921565471 conn(0x55e9eefbe5b0 msgr2=0x55e9ef0af7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 shutdown_connections 2024-05-08T09:23:34.581 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.566+0000 7f75a4131800 1 -- 172.21.15.161:0/2921565471 wait complete. 2024-05-08T09:23:34.582 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-05-08T09:23:34.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-05-08T09:23:34.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-05-08T09:23:34.582 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-05-08T09:23:34.625 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.626 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.627+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.627+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.627+0000 7f8b0d336800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5592b7e41c90 0x5592b7e44080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.627+0000 7f8b0d336800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5592b7e480d0 con 0x5592b7e445c0 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.627+0000 7f8b0d336800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5592b7cd2050 con 0x5592b7e41c90 2024-05-08T09:23:34.627 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b090cc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5592b7e41c90 0x5592b7e44080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b088cb640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5592b7e445c0 0x5592b7e469b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51048/0 (socket says 172.21.15.161:51048) 2024-05-08T09:23:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b090cc640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5592b7e41c90 0x5592b7e44080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56940/0 (socket says 172.21.15.161:56940) 2024-05-08T09:23:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b088cb640 1 -- 172.21.15.161:0/279858298 learned_addr learned my addr 172.21.15.161:0/279858298 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b090cc640 1 -- 172.21.15.161:0/279858298 >> v1:172.21.15.45:6789/0 conn(0x5592b7e445c0 legacy=0x5592b7e469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.628 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.628+0000 7f8b090cc640 1 -- 172.21.15.161:0/279858298 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7e492b0 con 0x5592b7e41c90 2024-05-08T09:23:34.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.630+0000 7f8b090cc640 1 --2- 172.21.15.161:0/279858298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e44080 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a470 tx=0x7f8b0401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942c405579b8398 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.630+0000 7f8b03fff640 1 -- 172.21.15.161:0/279858298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04057070 con 0x5592b7e41c90 2024-05-08T09:23:34.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.630+0000 7f8b03fff640 1 -- 172.21.15.161:0/279858298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04052570 con 0x5592b7e41c90 2024-05-08T09:23:34.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.630+0000 7f8b03fff640 1 -- 172.21.15.161:0/279858298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04052870 con 0x5592b7e41c90 2024-05-08T09:23:34.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 -- 172.21.15.161:0/279858298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 msgr2=0x5592b7e44080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 --2- 172.21.15.161:0/279858298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e44080 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a470 tx=0x7f8b0401ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:34.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 -- 172.21.15.161:0/279858298 shutdown_connections 2024-05-08T09:23:34.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 --2- 172.21.15.161:0/279858298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e44080 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 -- 172.21.15.161:0/279858298 >> 172.21.15.161:0/279858298 conn(0x5592b7e3b660 msgr2=0x5592b7e3da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 -- 172.21.15.161:0/279858298 shutdown_connections 2024-05-08T09:23:34.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.631+0000 7f8b0d336800 1 -- 172.21.15.161:0/279858298 wait complete. 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b0d336800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b0d336800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5592b7d8c1d0 con 0x5592b7e41c90 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56950/0 (socket says 172.21.15.161:56950) 2024-05-08T09:23:34.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b090cc640 1 -- 172.21.15.161:0/2634526785 learned_addr learned my addr 172.21.15.161:0/2634526785 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.645+0000 7f8b090cc640 1 -- 172.21.15.161:0/2634526785 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7e3fb90 con 0x5592b7e41c90 2024-05-08T09:23:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.646+0000 7f8b090cc640 1 --2- 172.21.15.161:0/2634526785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8b04055040 tx=0x7f8b0404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3ded1bf03f3f0f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.646+0000 7f89f7606640 1 -- 172.21.15.161:0/2634526785 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04057040 con 0x5592b7e41c90 2024-05-08T09:23:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.646+0000 7f89f7606640 1 -- 172.21.15.161:0/2634526785 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04052990 con 0x5592b7e41c90 2024-05-08T09:23:34.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.646+0000 7f89f7606640 1 -- 172.21.15.161:0/2634526785 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04052c70 con 0x5592b7e41c90 2024-05-08T09:23:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- 172.21.15.161:0/2634526785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 msgr2=0x5592b7e415d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2634526785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8b04055040 tx=0x7f8b0404c000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- 172.21.15.161:0/2634526785 shutdown_connections 2024-05-08T09:23:34.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2634526785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7e415d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- 172.21.15.161:0/2634526785 >> 172.21.15.161:0/2634526785 conn(0x5592b7e3b660 msgr2=0x5592b7f2e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- 172.21.15.161:0/2634526785 shutdown_connections 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- 172.21.15.161:0/2634526785 wait complete. 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b0d336800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5592b7e48540 con 0x5592b7e41c90 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56962/0 (socket says 172.21.15.161:56962) 2024-05-08T09:23:34.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.647+0000 7f8b090cc640 1 -- 172.21.15.161:0/1883966369 learned_addr learned my addr 172.21.15.161:0/1883966369 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f8b090cc640 1 -- 172.21.15.161:0/1883966369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7f3c970 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f8b090cc640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a470 tx=0x7f8b04003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f89f5e03640 1 -- 172.21.15.161:0/1883966369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04073070 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f89f5e03640 1 -- 172.21.15.161:0/1883966369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b0405d650 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592b7f3cc00 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f89f5e03640 1 -- 172.21.15.161:0/1883966369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04057070 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.648+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b7f3f8b0 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f89f5e03640 1 -- 172.21.15.161:0/1883966369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b04076070 con 0x5592b7e41c90 2024-05-08T09:23:34.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b0d336800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b0d336800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5592b7d32cf0 con 0x5592b7f49ce0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f89f5e03640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 0x7f89f0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f89f5e03640 1 -- 172.21.15.161:0/1883966369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8b0408dfe0 con 0x5592b7e41c90 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b098cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b098cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56976/0 (socket says 172.21.15.161:56976) 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b098cd640 1 -- 172.21.15.161:0/1973047915 learned_addr learned my addr 172.21.15.161:0/1973047915 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b090cc640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 0x7f89f0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.649+0000 7f8b098cd640 1 -- 172.21.15.161:0/1973047915 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7f4a640 con 0x5592b7f49ce0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b090cc640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 0x7f89f0038e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b04055040 tx=0x7f8b04006ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b098cd640 1 --2- 172.21.15.161:0/1973047915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00a430 tx=0x7f8afc00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cb71b7fc00613f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f89ef7fe640 1 -- 172.21.15.161:0/1973047915 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8afc015070 con 0x5592b7f49ce0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f89ef7fe640 1 -- 172.21.15.161:0/1973047915 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc001670 con 0x5592b7f49ce0 2024-05-08T09:23:34.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f89ef7fe640 1 -- 172.21.15.161:0/1973047915 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8afc001990 con 0x5592b7f49ce0 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 -- 172.21.15.161:0/1973047915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 msgr2=0x5592b7f4a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1973047915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00a430 tx=0x7f8afc00a8f0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 -- 172.21.15.161:0/1973047915 shutdown_connections 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1973047915 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f4a100 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 -- 172.21.15.161:0/1973047915 >> 172.21.15.161:0/1973047915 conn(0x5592b7e445c0 msgr2=0x5592b7f46780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 -- 172.21.15.161:0/1973047915 shutdown_connections 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.650+0000 7f8b0d336800 1 -- 172.21.15.161:0/1973047915 wait complete. 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b0d336800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b0d336800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5592b7f4afd0 con 0x5592b7f49ce0 2024-05-08T09:23:34.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b098cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b098cd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56978/0 (socket says 172.21.15.161:56978) 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b098cd640 1 -- 172.21.15.161:0/2021510157 learned_addr learned my addr 172.21.15.161:0/2021510157 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b098cd640 1 -- 172.21.15.161:0/2021510157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7f51700 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.651+0000 7f8b098cd640 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8afc013040 tx=0x7f8afc003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f89edffb640 1 -- 172.21.15.161:0/2021510157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8afc020020 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f89edffb640 1 -- 172.21.15.161:0/2021510157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc0108e0 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f89edffb640 1 -- 172.21.15.161:0/2021510157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8afc015040 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592b7f51990 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b7f54640 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.652+0000 7f89edffb640 1 -- 172.21.15.161:0/2021510157 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8afc023020 con 0x5592b7f49ce0 2024-05-08T09:23:34.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f89edffb640 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 0x7f89e0038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f89edffb640 1 -- 172.21.15.161:0/2021510157 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8afc04c0e0 con 0x5592b7f49ce0 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b088cb640 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 0x7f89e0038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 1 Processor -- start 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b088cb640 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 0x7f89e0038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5592b7f45c00 tx=0x7f8af4001270 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 1 -- start start 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.653+0000 7f8b0d336800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5592b7e3fe50 con 0x5592b7f6b8d0 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b090cc640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:56980/0 (socket says 172.21.15.161:56980) 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b090cc640 1 -- 172.21.15.161:0/4272003321 learned_addr learned my addr 172.21.15.161:0/4272003321 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b090cc640 1 -- 172.21.15.161:0/4272003321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5592b7f6c230 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b090cc640 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8b0408c370 tx=0x7f8b04076f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f89cefdd640 1 -- 172.21.15.161:0/4272003321 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b04087040 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f89cefdd640 1 -- 172.21.15.161:0/4272003321 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b04077ea0 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5592b7f6cca0 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f89cefdd640 1 -- 172.21.15.161:0/4272003321 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b0405cc40 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.654+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5592b7f6d1a0 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.655+0000 7f89cefdd640 1 -- 172.21.15.161:0/4272003321 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8b0408d8c0 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.655+0000 7f89cefdd640 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 0x7f8940038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.655+0000 7f89cefdd640 1 -- 172.21.15.161:0/4272003321 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8b040940c0 con 0x5592b7f6b8d0 2024-05-08T09:23:34.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.655+0000 7f8b088cb640 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 0x7f8940038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f89ccfd9640 20 reqs_thread_entry: start 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 0x5592b7f7b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b088cb640 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 0x7f8940038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8af4004170 tx=0x7f8af400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592b7f7be90 con 0x5592b7f79320 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b098cd640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 0x5592b7f7b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b098cd640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 0x5592b7f7b7c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b098cd640 1 -- 172.21.15.161:0/1883966369 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8afc00e070 con 0x5592b7f79320 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 0x5592b7f80050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.656+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:2 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5592b7f80750 con 0x5592b7f7dc60 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.657+0000 7f8b090cc640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 0x5592b7f80050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.657+0000 7f8b090cc640 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 0x5592b7f80050 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.657+0000 7f8b090cc640 1 -- 172.21.15.161:0/1883966369 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(2 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8b04075030 con 0x5592b7f7dc60 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 msgr2=0x7f89e0038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 0x7f89e0038dc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5592b7f45c00 tx=0x7f8af4001270 comp rx=0 tx=0).stop 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 msgr2=0x5592b7f511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f8afc013040 tx=0x7f8afc003370 comp rx=0 tx=0).stop 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 shutdown_connections 2024-05-08T09:23:34.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89e0036900 0x7f89e0038dc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/2021510157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f49ce0 0x5592b7f511c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 >> 172.21.15.161:0/2021510157 conn(0x5592b7e445c0 msgr2=0x5592b7f43dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 shutdown_connections 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/2021510157 wait complete. 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 msgr2=0x7f8940038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 0x7f8940038dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8af4004170 tx=0x7f8af400f000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 msgr2=0x5592b7f6bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8b0408c370 tx=0x7f8b04076f50 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.658+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 shutdown_connections 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8940036900 0x7f8940038dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/4272003321 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7f6b8d0 0x5592b7f6bcf0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 >> 172.21.15.161:0/4272003321 conn(0x5592b7f60360 msgr2=0x5592b7f60d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 shutdown_connections 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/4272003321 wait complete. 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 msgr2=0x5592b7f80050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 0x5592b7f80050 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 msgr2=0x5592b7f7b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 0x5592b7f7b7c0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 msgr2=0x7f89f0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 0x7f89f0038e10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8b04055040 tx=0x7f8b04006ed0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 msgr2=0x5592b7f3c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400a470 tx=0x7f8b04003020 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 shutdown_connections 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5592b7f7dc60 0x5592b7f80050 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5592b7f79320 0x5592b7f7b7c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f89f0036950 0x7f89f0038e10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 --2- 172.21.15.161:0/1883966369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5592b7e41c90 0x5592b7f3c430 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 >> 172.21.15.161:0/1883966369 conn(0x5592b7e3b660 msgr2=0x5592b7e403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 shutdown_connections 2024-05-08T09:23:34.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.659+0000 7f8b0d336800 1 -- 172.21.15.161:0/1883966369 wait complete. 2024-05-08T09:23:34.670 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T09:23:34.671 DEBUG:tasks.util.rgw: json result: {'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T09:23:34.671 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-05-08T09:23:34.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-05-08T09:23:34.672 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-05-08T09:23:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.755 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.757+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.757+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.757+0000 7f512011f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d06fea8b40 0x55d06feaaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.757+0000 7f512011f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d06feaef80 con 0x55d06feab470 2024-05-08T09:23:34.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.757+0000 7f512011f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55d06fd39050 con 0x55d06fea8b40 2024-05-08T09:23:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.758+0000 7f511bde7640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d06fea8b40 0x55d06feaaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.758+0000 7f5113fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55d06feab470 0x55d06fead860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51064/0 (socket says 172.21.15.161:51064) 2024-05-08T09:23:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.758+0000 7f5113fff640 1 -- 172.21.15.161:0/2081644950 learned_addr learned my addr 172.21.15.161:0/2081644950 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.758+0000 7f511bde7640 1 -- 172.21.15.161:0/2081644950 >> v1:172.21.15.45:6789/0 conn(0x55d06feab470 legacy=0x55d06fead860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.758+0000 7f511bde7640 1 -- 172.21.15.161:0/2081644950 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06feb0160 con 0x55d06fea8b40 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f511bde7640 1 --2- 172.21.15.161:0/2081644950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06feaaf30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f510c00a470 tx=0x7f510c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6895f848796891fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f511b5e6640 1 -- 172.21.15.161:0/2081644950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c057070 con 0x55d06fea8b40 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f511b5e6640 1 -- 172.21.15.161:0/2081644950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c052570 con 0x55d06fea8b40 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f511b5e6640 1 -- 172.21.15.161:0/2081644950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c052870 con 0x55d06fea8b40 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f512011f800 1 -- 172.21.15.161:0/2081644950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 msgr2=0x55d06feaaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f512011f800 1 --2- 172.21.15.161:0/2081644950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06feaaf30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f510c00a470 tx=0x7f510c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.760+0000 7f512011f800 1 -- 172.21.15.161:0/2081644950 shutdown_connections 2024-05-08T09:23:34.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.761+0000 7f512011f800 1 --2- 172.21.15.161:0/2081644950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06feaaf30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.761+0000 7f512011f800 1 -- 172.21.15.161:0/2081644950 >> 172.21.15.161:0/2081644950 conn(0x55d06fea2590 msgr2=0x55d06fea49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.761+0000 7f512011f800 1 -- 172.21.15.161:0/2081644950 shutdown_connections 2024-05-08T09:23:34.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.761+0000 7f512011f800 1 -- 172.21.15.161:0/2081644950 wait complete. 2024-05-08T09:23:34.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.774+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.774+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.774+0000 7f512011f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f512011f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d06fdf31c0 con 0x55d06fea8b40 2024-05-08T09:23:34.775 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57006/0 (socket says 172.21.15.161:57006) 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f511bde7640 1 -- 172.21.15.161:0/1351203559 learned_addr learned my addr 172.21.15.161:0/1351203559 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f511bde7640 1 -- 172.21.15.161:0/1351203559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06ff99c80 con 0x55d06fea8b40 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.775+0000 7f511bde7640 1 --2- 172.21.15.161:0/1351203559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f510c055040 tx=0x7f510c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9de4b225acdac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f5009e0b640 1 -- 172.21.15.161:0/1351203559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c057040 con 0x55d06fea8b40 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f5009e0b640 1 -- 172.21.15.161:0/1351203559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c052990 con 0x55d06fea8b40 2024-05-08T09:23:34.776 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f5009e0b640 1 -- 172.21.15.161:0/1351203559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c052c70 con 0x55d06fea8b40 2024-05-08T09:23:34.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 -- 172.21.15.161:0/1351203559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 msgr2=0x55d06ff996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 --2- 172.21.15.161:0/1351203559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f510c055040 tx=0x7f510c04c000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 -- 172.21.15.161:0/1351203559 shutdown_connections 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 --2- 172.21.15.161:0/1351203559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ff996b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 -- 172.21.15.161:0/1351203559 >> 172.21.15.161:0/1351203559 conn(0x55d06fea2590 msgr2=0x55d06ff94fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 -- 172.21.15.161:0/1351203559 shutdown_connections 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.776+0000 7f512011f800 1 -- 172.21.15.161:0/1351203559 wait complete. 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f512011f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ffa1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f512011f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d06feaf3f0 con 0x55d06fea8b40 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ffa1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ffa1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57012/0 (socket says 172.21.15.161:57012) 2024-05-08T09:23:34.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 learned_addr learned my addr 172.21.15.161:0/81733117 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.777+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06ffa1680 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f511bde7640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ffa1140 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f510c00a470 tx=0x7f510c003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f5003fff640 1 -- 172.21.15.161:0/81733117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c073070 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f5003fff640 1 -- 172.21.15.161:0/81733117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c05d650 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06ffa1910 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f5003fff640 1 -- 172.21.15.161:0/81733117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c057070 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06ffa45c0 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.778+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f512011f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f512011f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d06fd99cf0 con 0x55d06fea85d0 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f5003fff640 1 -- 172.21.15.161:0/81733117 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f510c076070 con 0x55d06fea8b40 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f5003fff640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5004036900 0x7f5004038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511c5e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f5003fff640 1 -- 172.21.15.161:0/81733117 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f510c08dff0 con 0x55d06fea8b40 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511c5e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57020/0 (socket says 172.21.15.161:57020) 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511c5e8640 1 -- 172.21.15.161:0/868316649 learned_addr learned my addr 172.21.15.161:0/868316649 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511bde7640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5004036900 0x7f5004038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511c5e8640 1 -- 172.21.15.161:0/868316649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06fea7060 con 0x55d06fea85d0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511bde7640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5004036900 0x7f5004038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f510c076c60 tx=0x7f510c077ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.779+0000 7f511c5e8640 1 --2- 172.21.15.161:0/868316649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f511400a430 tx=0x7f511400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d0d8e22f5dafa6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f5001ffb640 1 -- 172.21.15.161:0/868316649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114015070 con 0x55d06fea85d0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f5001ffb640 1 -- 172.21.15.161:0/868316649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114001670 con 0x55d06fea85d0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f5001ffb640 1 -- 172.21.15.161:0/868316649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114001990 con 0x55d06fea85d0 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 -- 172.21.15.161:0/868316649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 msgr2=0x55d06fea6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 --2- 172.21.15.161:0/868316649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f511400a430 tx=0x7f511400a8f0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 -- 172.21.15.161:0/868316649 shutdown_connections 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 --2- 172.21.15.161:0/868316649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06fea6b20 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 -- 172.21.15.161:0/868316649 >> 172.21.15.161:0/868316649 conn(0x55d06feab470 msgr2=0x55d06ffab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 -- 172.21.15.161:0/868316649 shutdown_connections 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 -- 172.21.15.161:0/868316649 wait complete. 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.780+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f512011f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f512011f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d06fea7350 con 0x55d06fea85d0 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f511c5e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f511c5e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57024/0 (socket says 172.21.15.161:57024) 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f511c5e8640 1 -- 172.21.15.161:0/3916464580 learned_addr learned my addr 172.21.15.161:0/3916464580 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f511c5e8640 1 -- 172.21.15.161:0/3916464580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06ffb85f0 con 0x55d06fea85d0 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f511c5e8640 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5114013040 tx=0x7f5114003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.781+0000 7f4ffbfff640 1 -- 172.21.15.161:0/3916464580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114020020 con 0x55d06fea85d0 2024-05-08T09:23:34.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.782+0000 7f4ffbfff640 1 -- 172.21.15.161:0/3916464580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51140108e0 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.782+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06ffb8880 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.782+0000 7f4ffbfff640 1 -- 172.21.15.161:0/3916464580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5114015040 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.782+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06ffbb530 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.782+0000 7f4ffbfff640 1 -- 172.21.15.161:0/3916464580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5114023020 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f4ffbfff640 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 0x7f4ff4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f4ffbfff640 1 -- 172.21.15.161:0/3916464580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f511404c0e0 con 0x55d06fea85d0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f5113fff640 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 0x7f4ff4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f512011f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f512011f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f5113fff640 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 0x7f4ff4038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5104000f60 tx=0x7f5104001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f512011f800 1 Processor -- start 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.783+0000 7f512011f800 1 -- start start 2024-05-08T09:23:34.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f512011f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f512011f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d06ff99f40 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f511bde7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57030/0 (socket says 172.21.15.161:57030) 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f511bde7640 1 -- 172.21.15.161:0/1078585816 learned_addr learned my addr 172.21.15.161:0/1078585816 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f511bde7640 1 -- 172.21.15.161:0/1078585816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06ffd3100 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f511bde7640 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f510c08c390 tx=0x7f510c05ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f4fe0fe1640 1 -- 172.21.15.161:0/1078585816 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c094020 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f4fe0fe1640 1 -- 172.21.15.161:0/1078585816 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f510c08b040 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d06ffd3b70 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.784+0000 7f4fe0fe1640 1 -- 172.21.15.161:0/1078585816 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f510c08a050 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.785+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d06ffd4070 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.785+0000 7f4fe0fe1640 1 -- 172.21.15.161:0/1078585816 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f510c097020 con 0x55d06ffd27a0 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.785+0000 7f4fe0fe1640 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 0x7f4f54038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.785+0000 7f4fe0fe1640 1 -- 172.21.15.161:0/1078585816 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f510c09ad20 con 0x55d06ffd27a0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.785+0000 7f5113fff640 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 0x7f4f54038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f4fda7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f5113fff640 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 0x7f4f54038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5104001ed0 tx=0x7f510400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d06ffe0260 0x55d06ffe26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffe2d60 con 0x55d06ffe0260 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f511c5e8640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d06ffe0260 0x55d06ffe26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f511c5e8640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d06ffe0260 0x55d06ffe26b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.786+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffe3640 con 0x55d06ffe0260 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.787+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.787+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d06ffe4f00 0x55d06ffe7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.787+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffe7b00 con 0x55d06ffe4f00 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.787+0000 7f511bde7640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d06ffe4f00 0x55d06ffe7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.800 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.787+0000 7f511bde7640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d06ffe4f00 0x55d06ffe7370 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06fff4c40 con 0x55d06ffe0260 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:NOTICE: set zone's realm_id= 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d06ffec000 0x55d06ffeef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f5113fff640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d06ffec000 0x55d06ffeef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.788+0000 7f5113fff640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d06ffec000 0x55d06ffeef30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(5 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5104009050 con 0x55d06ffec000 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f5113fff640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f510401d040 0x7f510401c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f511c5e8640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f510401d040 0x7f510401c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f511c5e8640 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f510401d040 0x7f510401c980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.789+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.790+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(11 [pgnls start_epoch 29 out=107b] v27'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(12 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.791+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5104009050 con 0x55d06ffec000 2024-05-08T09:23:34.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(16 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.792+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(17 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.793+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.793+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.793+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.793+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.793+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=74b] v20'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.794+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(25 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.795+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe4f00 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.796+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffec000 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f510402a040 con 0x55d06ffec000 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f5113fff640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x55d06ffe0260 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(35 [pgnls start_epoch 29 out=115b] v20'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.797+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffeeab0 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(36 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f511400e070 con 0x7f510401d040 2024-05-08T09:23:34.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06fff2b10 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:38 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffe4260 con 0x55d06ffe4f00 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(38 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.798+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:39 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffee340 con 0x55d06ffe4f00 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.800+0000 7f511bde7640 1 -- 172.21.15.161:0/81733117 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(39 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [create,call,writefull 0~1155] v29'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f510c075030 con 0x55d06ffe4f00 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.800+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d06fff00e0 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.801+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v29'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.801+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d06ffed600 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.802+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v29'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f511400e070 con 0x55d06ffe0260 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 msgr2=0x7f4ff4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 0x7f4ff4038dc0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5104000f60 tx=0x7f5104001230 comp rx=0 tx=0).stop 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 msgr2=0x55d06ffb80b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5114013040 tx=0x7f5114003370 comp rx=0 tx=0).stop 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 shutdown_connections 2024-05-08T09:23:34.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4ff4036900 0x7f4ff4038dc0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/3916464580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea85d0 0x55d06ffb80b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 >> 172.21.15.161:0/3916464580 conn(0x55d06feab470 msgr2=0x55d06ffa8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 shutdown_connections 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/3916464580 wait complete. 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 msgr2=0x7f4f54038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 0x7f4f54038dc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5104001ed0 tx=0x7f510400f000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 msgr2=0x55d06ffd2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f510c08c390 tx=0x7f510c05ee40 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 shutdown_connections 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4f54036900 0x7f4f54038dc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/1078585816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06ffd27a0 0x55d06ffd2bc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 >> 172.21.15.161:0/1078585816 conn(0x55d06ffc7250 msgr2=0x55d06ffc7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 shutdown_connections 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/1078585816 wait complete. 2024-05-08T09:23:34.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d06ffe4f00 msgr2=0x55d06ffe7370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d06ffe4f00 0x55d06ffe7370 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d06ffe0260 msgr2=0x55d06ffe26b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d06ffe0260 0x55d06ffe26b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f510401d040 msgr2=0x7f510401c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f510401d040 0x7f510401c980 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d06ffec000 msgr2=0x55d06ffeef30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.803+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d06ffec000 0x55d06ffeef30 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5004036900 msgr2=0x7f5004038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5004036900 0x7f5004038dc0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f510c076c60 tx=0x7f510c077ed0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 msgr2=0x55d06ffa1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 --2- 172.21.15.161:0/81733117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d06fea8b40 0x55d06ffa1140 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f510c00a470 tx=0x7f510c003020 comp rx=0 tx=0).stop 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 reap_dead start 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f511c5e8640 1 -- 172.21.15.161:0/81733117 reap_dead start 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 shutdown_connections 2024-05-08T09:23:34.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 >> 172.21.15.161:0/81733117 conn(0x55d06fea2590 msgr2=0x55d06ff937d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 shutdown_connections 2024-05-08T09:23:34.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.804+0000 7f512011f800 1 -- 172.21.15.161:0/81733117 wait complete. 2024-05-08T09:23:34.814 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T09:23:34.815 DEBUG:tasks.util.rgw: json result: {'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T09:23:34.815 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-05-08T09:23:34.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-05-08T09:23:34.815 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-05-08T09:23:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:34.897 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.898+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.898 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.898+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.898+0000 7f79d512f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5598946f7450 0x5598946f9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.898+0000 7f79d512f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598946f9e10 con 0x5598946f2fc0 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.898+0000 7f79d512f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x559894585050 con 0x5598946f7450 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.899+0000 7f79d05b4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5598946f7450 0x5598946f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.899+0000 7f79d0db5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5598946f2fc0 0x5598946f33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51072/0 (socket says 172.21.15.161:51072) 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.899+0000 7f79d0db5640 1 -- 172.21.15.161:0/1544512920 learned_addr learned my addr 172.21.15.161:0/1544512920 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.899+0000 7f79d05b4640 1 -- 172.21.15.161:0/1544512920 >> v1:172.21.15.45:6789/0 conn(0x5598946f2fc0 legacy=0x5598946f33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.899 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.899+0000 7f79d05b4640 1 -- 172.21.15.161:0/1544512920 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598946fb040 con 0x5598946f7450 2024-05-08T09:23:34.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.901+0000 7f79d05b4640 1 --2- 172.21.15.161:0/1544512920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f7450 0x5598946f9840 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79c400a470 tx=0x7f79c401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbdc1e107105f028 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.901+0000 7f79cfdb3640 1 -- 172.21.15.161:0/1544512920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4057070 con 0x5598946f7450 2024-05-08T09:23:34.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.901+0000 7f79cfdb3640 1 -- 172.21.15.161:0/1544512920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4052570 con 0x5598946f7450 2024-05-08T09:23:34.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.901+0000 7f79cfdb3640 1 -- 172.21.15.161:0/1544512920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c4052870 con 0x5598946f7450 2024-05-08T09:23:34.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 -- 172.21.15.161:0/1544512920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f7450 msgr2=0x5598946f9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 --2- 172.21.15.161:0/1544512920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f7450 0x5598946f9840 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f79c400a470 tx=0x7f79c401ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 -- 172.21.15.161:0/1544512920 shutdown_connections 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 --2- 172.21.15.161:0/1544512920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f7450 0x5598946f9840 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 -- 172.21.15.161:0/1544512920 >> 172.21.15.161:0/1544512920 conn(0x5598946ee5a0 msgr2=0x5598946f09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 -- 172.21.15.161:0/1544512920 shutdown_connections 2024-05-08T09:23:34.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.902+0000 7f79d512f800 1 -- 172.21.15.161:0/1544512920 wait complete. 2024-05-08T09:23:34.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.915+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d512f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d512f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55989463f1c0 con 0x5598946f2fc0 2024-05-08T09:23:34.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57040/0 (socket says 172.21.15.161:57040) 2024-05-08T09:23:34.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.916+0000 7f79d0db5640 1 -- 172.21.15.161:0/1659929639 learned_addr learned my addr 172.21.15.161:0/1659929639 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.917+0000 7f79d0db5640 1 -- 172.21.15.161:0/1659929639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598947e6210 con 0x5598946f2fc0 2024-05-08T09:23:34.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.917+0000 7f79d0db5640 1 --2- 172.21.15.161:0/1659929639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f79c00017a0 tx=0x7f79c0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2cb764c2c5cd0bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.917+0000 7f78bee0d640 1 -- 172.21.15.161:0/1659929639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0016070 con 0x5598946f2fc0 2024-05-08T09:23:34.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.917+0000 7f78bee0d640 1 -- 172.21.15.161:0/1659929639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c0004520 con 0x5598946f2fc0 2024-05-08T09:23:34.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.917+0000 7f78bee0d640 1 -- 172.21.15.161:0/1659929639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0004820 con 0x5598946f2fc0 2024-05-08T09:23:34.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- 172.21.15.161:0/1659929639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 msgr2=0x559894666e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 --2- 172.21.15.161:0/1659929639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f79c00017a0 tx=0x7f79c0001c60 comp rx=0 tx=0).stop 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- 172.21.15.161:0/1659929639 shutdown_connections 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 --2- 172.21.15.161:0/1659929639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x559894666e30 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- 172.21.15.161:0/1659929639 >> 172.21.15.161:0/1659929639 conn(0x5598946ee5a0 msgr2=0x5598947dff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- 172.21.15.161:0/1659929639 shutdown_connections 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- 172.21.15.161:0/1659929639 wait complete. 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.918+0000 7f79d512f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5598946fa2e0 con 0x5598946f2fc0 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.919+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.919+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57052/0 (socket says 172.21.15.161:57052) 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.919+0000 7f79d0db5640 1 -- 172.21.15.161:0/2451625261 learned_addr learned my addr 172.21.15.161:0/2451625261 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.919+0000 7f79d0db5640 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598947efa50 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.919+0000 7f79d0db5640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000f80 tx=0x7f79c0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f78bd60a640 1 -- 172.21.15.161:0/2451625261 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0016040 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f78bd60a640 1 -- 172.21.15.161:0/2451625261 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c0011530 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f78bd60a640 1 -- 172.21.15.161:0/2451625261 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0011890 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598947efce0 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598947f2940 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.920+0000 7f79d512f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5598945e5cf0 con 0x5598947fcd00 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f78bd60a640 1 -- 172.21.15.161:0/2451625261 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79c001c3f0 con 0x5598946f2fc0 2024-05-08T09:23:34.925 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d15b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f78bd60a640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 0x7f78b8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d15b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57066/0 (socket says 172.21.15.161:57066) 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d15b6640 1 -- 172.21.15.161:0/1315159185 learned_addr learned my addr 172.21.15.161:0/1315159185 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f78bd60a640 1 -- 172.21.15.161:0/2451625261 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f79c004b970 con 0x5598946f2fc0 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d0db5640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 0x7f78b8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d0db5640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 0x7f78b8038e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f79c0023ff0 tx=0x7f79c0023f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.921+0000 7f79d15b6640 1 -- 172.21.15.161:0/1315159185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598947fd660 con 0x5598947fcd00 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.922+0000 7f79d15b6640 1 --2- 172.21.15.161:0/1315159185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f79c800a400 tx=0x7f79c800a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3224283901aa68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.922+0000 7f78b77fe640 1 -- 172.21.15.161:0/1315159185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c80087e0 con 0x5598947fcd00 2024-05-08T09:23:34.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.922+0000 7f78b77fe640 1 -- 172.21.15.161:0/1315159185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c80089a0 con 0x5598947fcd00 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.922+0000 7f78b77fe640 1 -- 172.21.15.161:0/1315159185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c8008d00 con 0x5598947fcd00 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- 172.21.15.161:0/1315159185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 msgr2=0x5598947fd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 --2- 172.21.15.161:0/1315159185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f79c800a400 tx=0x7f79c800a8c0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- 172.21.15.161:0/1315159185 shutdown_connections 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 --2- 172.21.15.161:0/1315159185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598947fd120 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- 172.21.15.161:0/1315159185 >> 172.21.15.161:0/1315159185 conn(0x5598946f7450 msgr2=0x5598947f97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- 172.21.15.161:0/1315159185 shutdown_connections 2024-05-08T09:23:34.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- 172.21.15.161:0/1315159185 wait complete. 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.923+0000 7f79d512f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5598947fdff0 con 0x5598947fcd00 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d15b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d15b6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57082/0 (socket says 172.21.15.161:57082) 2024-05-08T09:23:34.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d15b6640 1 -- 172.21.15.161:0/2595173154 learned_addr learned my addr 172.21.15.161:0/2595173154 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d15b6640 1 -- 172.21.15.161:0/2595173154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598948046e0 con 0x5598947fcd00 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d15b6640 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c010 tx=0x7f79c8002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f78b5ffb640 1 -- 172.21.15.161:0/2595173154 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c8022020 con 0x5598947fcd00 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f78b5ffb640 1 -- 172.21.15.161:0/2595173154 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c8019040 con 0x5598947fcd00 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559894804970 con 0x5598947fcd00 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f78b5ffb640 1 -- 172.21.15.161:0/2595173154 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c8013a70 con 0x5598947fcd00 2024-05-08T09:23:34.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.924+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559894807620 con 0x5598947fcd00 2024-05-08T09:23:34.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.925+0000 7f78b5ffb640 1 -- 172.21.15.161:0/2595173154 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79c8025020 con 0x5598947fcd00 2024-05-08T09:23:34.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.925+0000 7f78b5ffb640 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 0x7f78a8038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.925+0000 7f78b5ffb640 1 -- 172.21.15.161:0/2595173154 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f79c804c520 con 0x5598947fcd00 2024-05-08T09:23:34.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.925+0000 7f79d05b4640 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 0x7f78a8038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d05b4640 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 0x7f78a8038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f79c4054000 tx=0x7f79c404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 1 Processor -- start 2024-05-08T09:23:34.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 1 -- start start 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.926+0000 7f79d512f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5598947ea9a0 con 0x55989481e840 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d0db5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57086/0 (socket says 172.21.15.161:57086) 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d0db5640 1 -- 172.21.15.161:0/3439401379 learned_addr learned my addr 172.21.15.161:0/3439401379 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:34.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d0db5640 1 -- 172.21.15.161:0/3439401379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55989481f1a0 con 0x55989481e840 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d0db5640 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f79c0049cf0 tx=0x7f79c000f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f7894fe9640 1 -- 172.21.15.161:0/3439401379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c0023520 con 0x55989481e840 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f7894fe9640 1 -- 172.21.15.161:0/3439401379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c003c070 con 0x55989481e840 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55989481fc10 con 0x55989481e840 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.927+0000 7f7894fe9640 1 -- 172.21.15.161:0/3439401379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79c001c810 con 0x55989481e840 2024-05-08T09:23:34.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.928+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559894820110 con 0x55989481e840 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.928+0000 7f7894fe9640 1 -- 172.21.15.161:0/3439401379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f79c0016820 con 0x55989481e840 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.928+0000 7f7894fe9640 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 0x7f7808038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.928+0000 7f7894fe9640 1 -- 172.21.15.161:0/3439401379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f79c0003450 con 0x55989481e840 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.928+0000 7f79d05b4640 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 0x7f7808038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f782e7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:34.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d05b4640 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 0x7f7808038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f79c401ced0 tx=0x7f79c4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 0x55989482e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55989482ed50 con 0x55989482c300 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d15b6640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 0x55989482e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d15b6640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 0x55989482e6f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d15b6640 1 -- 172.21.15.161:0/2451625261 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f79c801ecc0 con 0x55989482c300 2024-05-08T09:23:34.947 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.929+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55989482f610 con 0x55989482c300 2024-05-08T09:23:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.930+0000 7f79d15b6640 1 -- 172.21.15.161:0/2451625261 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f79c801ecc0 con 0x55989482c300 2024-05-08T09:23:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.930+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 0x559894833390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.930+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559894833b20 con 0x559894830f20 2024-05-08T09:23:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.930+0000 7f79d0db5640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 0x559894833390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:34.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.930+0000 7f79d0db5640 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 0x559894833390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d0db5640 1 -- 172.21.15.161:0/2451625261 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f79c0019050 con 0x559894830f20 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 msgr2=0x7f78a8038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 0x7f78a8038dc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f79c4054000 tx=0x7f79c404e000 comp rx=0 tx=0).stop 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 msgr2=0x5598948041a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f79c800c010 tx=0x7f79c8002ff0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 shutdown_connections 2024-05-08T09:23:34.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78a8036900 0x7f78a8038dc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 --2- 172.21.15.161:0/2595173154 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598947fcd00 0x5598948041a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 >> 172.21.15.161:0/2595173154 conn(0x5598946f7450 msgr2=0x5598947f6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 shutdown_connections 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.931+0000 7f79d512f800 1 -- 172.21.15.161:0/2595173154 wait complete. 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 msgr2=0x7f7808038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 0x7f7808038dc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f79c401ced0 tx=0x7f79c4005a00 comp rx=0 tx=0).stop 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 msgr2=0x55989481ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f79c0049cf0 tx=0x7f79c000f3c0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 shutdown_connections 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7808036900 0x7f7808038dc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/3439401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55989481e840 0x55989481ec60 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 >> 172.21.15.161:0/3439401379 conn(0x5598948132d0 msgr2=0x559894813cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 shutdown_connections 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/3439401379 wait complete. 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 msgr2=0x559894833390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 0x559894833390 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 msgr2=0x55989482e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 0x55989482e6f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 msgr2=0x7f78b8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 0x7f78b8038e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f79c0023ff0 tx=0x7f79c0023f00 comp rx=0 tx=0).stop 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 msgr2=0x5598947ef510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f79c0000f80 tx=0x7f79c0001250 comp rx=0 tx=0).stop 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 shutdown_connections 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559894830f20 0x559894833390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55989482c300 0x55989482e6f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f78b8036950 0x7f78b8038e10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 --2- 172.21.15.161:0/2451625261 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598946f2fc0 0x5598947ef510 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 >> 172.21.15.161:0/2451625261 conn(0x5598946ee5a0 msgr2=0x5598947de710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 shutdown_connections 2024-05-08T09:23:34.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:34.932+0000 7f79d512f800 1 -- 172.21.15.161:0/2451625261 wait complete. 2024-05-08T09:23:34.954 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-05-08T09:23:34.955 DEBUG:tasks.util.rgw: json result: {'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-05-08T09:23:34.955 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T09:23:34.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-05-08T09:23:34.955 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-05-08T09:23:35.041 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.041 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fefa2800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ceef7f050 0x564ceef7f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fefa2800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564ceef7faf0 con 0x564ceef802b0 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fefa2800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564ceee11050 con 0x564ceef7f050 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fcaa8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ceef7f050 0x564ceef7f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66f7fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x564ceef802b0 0x564ceef80730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51078/0 (socket says 172.21.15.161:51078) 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fcaa8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x564ceef7f050 0x564ceef7f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57096/0 (socket says 172.21.15.161:57096) 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66f7fff640 1 -- 172.21.15.161:0/1145288259 learned_addr learned my addr 172.21.15.161:0/1145288259 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1145288259 >> v1:172.21.15.45:6789/0 conn(0x564ceef802b0 legacy=0x564ceef80730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.043 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.043+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1145288259 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ceef80e70 con 0x564ceef7f050 2024-05-08T09:23:35.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.045+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1145288259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceef7f470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f66f000a470 tx=0x7f66f001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fd9f59d1dc881a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66f77fe640 1 -- 172.21.15.161:0/1145288259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0057070 con 0x564ceef7f050 2024-05-08T09:23:35.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66f77fe640 1 -- 172.21.15.161:0/1145288259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f004adc0 con 0x564ceef7f050 2024-05-08T09:23:35.045 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66f77fe640 1 -- 172.21.15.161:0/1145288259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0052590 con 0x564ceef7f050 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 -- 172.21.15.161:0/1145288259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 msgr2=0x564ceef7f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1145288259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceef7f470 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f66f000a470 tx=0x7f66f001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 -- 172.21.15.161:0/1145288259 shutdown_connections 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1145288259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceef7f470 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 -- 172.21.15.161:0/1145288259 >> 172.21.15.161:0/1145288259 conn(0x564ceef7a610 msgr2=0x564ceef7ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 -- 172.21.15.161:0/1145288259 shutdown_connections 2024-05-08T09:23:35.046 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.046+0000 7f66fefa2800 1 -- 172.21.15.161:0/1145288259 wait complete. 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.060+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.060+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fefa2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fefa2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ceeecb1f0 con 0x564ceef7f050 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57110/0 (socket says 172.21.15.161:57110) 2024-05-08T09:23:35.060 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fcaa8640 1 -- 172.21.15.161:0/3085231821 learned_addr learned my addr 172.21.15.161:0/3085231821 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.061+0000 7f66fcaa8640 1 -- 172.21.15.161:0/3085231821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cef0745f0 con 0x564ceef7f050 2024-05-08T09:23:35.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.062+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/3085231821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f66f0055040 tx=0x7f66f004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13d846016891ced server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.062+0000 7f65eae05640 1 -- 172.21.15.161:0/3085231821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0057040 con 0x564ceef7f050 2024-05-08T09:23:35.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.062+0000 7f65eae05640 1 -- 172.21.15.161:0/3085231821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f0063070 con 0x564ceef7f050 2024-05-08T09:23:35.061 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.062+0000 7f65eae05640 1 -- 172.21.15.161:0/3085231821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f005d790 con 0x564ceef7f050 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- 172.21.15.161:0/3085231821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 msgr2=0x564ceeef37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 --2- 172.21.15.161:0/3085231821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f66f0055040 tx=0x7f66f004c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- 172.21.15.161:0/3085231821 shutdown_connections 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 --2- 172.21.15.161:0/3085231821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564ceeef37e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- 172.21.15.161:0/3085231821 >> 172.21.15.161:0/3085231821 conn(0x564ceef7a610 msgr2=0x564cef06c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- 172.21.15.161:0/3085231821 shutdown_connections 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- 172.21.15.161:0/3085231821 wait complete. 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fefa2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ceef88780 con 0x564ceef7f050 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.063+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.064 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57120/0 (socket says 172.21.15.161:57120) 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1855075467 learned_addr learned my addr 172.21.15.161:0/1855075467 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cef079890 con 0x564ceef7f050 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f66f000a470 tx=0x7f66f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f65e9602640 1 -- 172.21.15.161:0/1855075467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0057050 con 0x564ceef7f050 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f65e9602640 1 -- 172.21.15.161:0/1855075467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f005dc90 con 0x564ceef7f050 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.064+0000 7f65e9602640 1 -- 172.21.15.161:0/1855075467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0052440 con 0x564ceef7f050 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.065+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cef079b20 con 0x564ceef7f050 2024-05-08T09:23:35.065 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.065+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cef07c7d0 con 0x564ceef7f050 2024-05-08T09:23:35.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.065+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f65e9602640 1 -- 172.21.15.161:0/1855075467 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f66f0052670 con 0x564ceef7f050 2024-05-08T09:23:35.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fefa2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fefa2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564ceee71cf0 con 0x564cef072070 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f65e9602640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 0x7f65e4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f65e9602640 1 -- 172.21.15.161:0/1855075467 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f66f008dd10 con 0x564ceef7f050 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fd2a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fd2a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57128/0 (socket says 172.21.15.161:57128) 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 0x7f65e4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fd2a9640 1 -- 172.21.15.161:0/1898891116 learned_addr learned my addr 172.21.15.161:0/1898891116 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fd2a9640 1 -- 172.21.15.161:0/1898891116 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cef070b00 con 0x564cef072070 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 0x7f65e4038dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f66f004c040 tx=0x7f66f0073040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.066+0000 7f66fd2a9640 1 --2- 172.21.15.161:0/1898891116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f66f800a430 tx=0x7f66f800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de54c34b24738adf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f65e2ffd640 1 -- 172.21.15.161:0/1898891116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8015070 con 0x564cef072070 2024-05-08T09:23:35.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f65e2ffd640 1 -- 172.21.15.161:0/1898891116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8001670 con 0x564cef072070 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f65e2ffd640 1 -- 172.21.15.161:0/1898891116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8001990 con 0x564cef072070 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- 172.21.15.161:0/1898891116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 msgr2=0x564cef0705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1898891116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f66f800a430 tx=0x7f66f800a8f0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- 172.21.15.161:0/1898891116 shutdown_connections 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1898891116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef0705c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- 172.21.15.161:0/1898891116 >> 172.21.15.161:0/1898891116 conn(0x564ceef802b0 msgr2=0x564cef0836f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- 172.21.15.161:0/1898891116 shutdown_connections 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- 172.21.15.161:0/1898891116 wait complete. 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.067+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fefa2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fefa2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cef070d30 con 0x564cef072070 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fd2a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fd2a9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57132/0 (socket says 172.21.15.161:57132) 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fd2a9640 1 -- 172.21.15.161:0/2591599748 learned_addr learned my addr 172.21.15.161:0/2591599748 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fd2a9640 1 -- 172.21.15.161:0/2591599748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cef090780 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.068+0000 7f66fd2a9640 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f66f8013040 tx=0x7f66f8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.069+0000 7f65e17fa640 1 -- 172.21.15.161:0/2591599748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8020020 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.069+0000 7f65e17fa640 1 -- 172.21.15.161:0/2591599748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f80108e0 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.069+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cef090a10 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.069+0000 7f65e17fa640 1 -- 172.21.15.161:0/2591599748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f8015040 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.069+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cef0936c0 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f65e17fa640 1 -- 172.21.15.161:0/2591599748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f66f8023020 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f65e17fa640 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 0x7f65d4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f65e17fa640 1 -- 172.21.15.161:0/2591599748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f66f804c0e0 con 0x564cef072070 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66f7fff640 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 0x7f65d4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66fefa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66fefa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66f7fff640 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 0x7f65d4038dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f60 tx=0x7f66e8001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66fefa2800 1 Processor -- start 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.070+0000 7f66fefa2800 1 -- start start 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fefa2800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fefa2800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564cef074880 con 0x564cef0aa910 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fcaa8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57134/0 (socket says 172.21.15.161:57134) 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fcaa8640 1 -- 172.21.15.161:0/2741152018 learned_addr learned my addr 172.21.15.161:0/2741152018 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fcaa8640 1 -- 172.21.15.161:0/2741152018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564cef0ab270 con 0x564cef0aa910 2024-05-08T09:23:35.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.071+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f66f008c090 tx=0x7f66f0059810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f65c17e2640 1 -- 172.21.15.161:0/2741152018 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f008b030 con 0x564cef0aa910 2024-05-08T09:23:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f65c17e2640 1 -- 172.21.15.161:0/2741152018 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f0066810 con 0x564cef0aa910 2024-05-08T09:23:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564cef0abce0 con 0x564cef0aa910 2024-05-08T09:23:35.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f65c17e2640 1 -- 172.21.15.161:0/2741152018 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66f0059c20 con 0x564cef0aa910 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564cef0abce0 con 0x564cef0aa910 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.072+0000 7f65c17e2640 1 -- 172.21.15.161:0/2741152018 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f66f0085040 con 0x564cef0aa910 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f65c17e2640 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 0x7f6538038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f65c17e2640 1 -- 172.21.15.161:0/2741152018 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f66f009bac0 con 0x564cef0aa910 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66f7fff640 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 0x7f6538038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f6542ffd640 20 reqs_thread_entry: start 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 0x564cef0ba620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66f7fff640 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 0x7f6538038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001ed0 tx=0x7f66e800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564cef0bacf0 con 0x564cef0b8180 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66fd2a9640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 0x564cef0ba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.073+0000 7f66fd2a9640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 0x564cef0ba620 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.074+0000 7f66fd2a9640 1 -- 172.21.15.161:0/1855075467 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66f800e070 con 0x564cef0b8180 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.074+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 0x564cef0beeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.074+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:2 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564cef0bf580 con 0x564cef0bcac0 2024-05-08T09:23:35.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.074+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 0x564cef0beeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.074+0000 7f66fcaa8640 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 0x564cef0beeb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.075+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1855075467 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(2 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f66f0078070 con 0x564cef0bcac0 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.075+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564cef0bc160 con 0x564cef0bcac0 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.076+0000 7f66fcaa8640 1 -- 172.21.15.161:0/1855075467 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [stat,call,call,writefull 0~993] v29'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f66f0078070 con 0x564cef0bcac0 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 msgr2=0x7f65d4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 0x7f65d4038dc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f66e8000f60 tx=0x7f66e8001230 comp rx=0 tx=0).stop 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 msgr2=0x564cef090240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f66f8013040 tx=0x7f66f8003370 comp rx=0 tx=0).stop 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 shutdown_connections 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65d4036900 0x7f65d4038dc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2591599748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef072070 0x564cef090240 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 >> 172.21.15.161:0/2591599748 conn(0x564ceef802b0 msgr2=0x564cef080d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 shutdown_connections 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2591599748 wait complete. 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 msgr2=0x7f6538038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 0x7f6538038dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f66e8001ed0 tx=0x7f66e800f000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 msgr2=0x564cef0aad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f66f008c090 tx=0x7f66f0059810 comp rx=0 tx=0).stop 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 shutdown_connections 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6538036900 0x7f6538038dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 --2- 172.21.15.161:0/2741152018 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564cef0aa910 0x564cef0aad30 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 >> 172.21.15.161:0/2741152018 conn(0x564cef09f390 msgr2=0x564cef09fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 shutdown_connections 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.077+0000 7f66fefa2800 1 -- 172.21.15.161:0/2741152018 wait complete. 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 msgr2=0x564cef0beeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 0x564cef0beeb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 msgr2=0x564cef0ba620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 0x564cef0ba620 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 msgr2=0x7f65e4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 0x7f65e4038dc0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f66f004c040 tx=0x7f66f0073040 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 msgr2=0x564cef079350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f66f000a470 tx=0x7f66f0002fb0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 shutdown_connections 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564cef0bcac0 0x564cef0beeb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564cef0b8180 0x564cef0ba620 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f65e4036900 0x7f65e4038dc0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 --2- 172.21.15.161:0/1855075467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564ceef7f050 0x564cef079350 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 >> 172.21.15.161:0/1855075467 conn(0x564ceef7a610 msgr2=0x564cef06a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.083 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 shutdown_connections 2024-05-08T09:23:35.084 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.078+0000 7f66fefa2800 1 -- 172.21.15.161:0/1855075467 wait complete. 2024-05-08T09:23:35.087 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-05-08T09:23:35.087 DEBUG:tasks.util.rgw: json result: {'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-05-08T09:23:35.087 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-05-08T09:23:35.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-05-08T09:23:35.088 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-05-08T09:23:35.131 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.131 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.132+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.132+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f517441f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55768227ac30 0x55768227d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f517441f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557682281070 con 0x55768227d560 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f517441f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55768210b050 con 0x55768227ac30 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f5171f1e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55768227ac30 0x55768227d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f516bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55768227d560 0x55768227f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51084/0 (socket says 172.21.15.161:51084) 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f516bfff640 1 -- 172.21.15.161:0/1415296119 learned_addr learned my addr 172.21.15.161:0/1415296119 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f5171f1e640 1 -- 172.21.15.161:0/1415296119 >> v1:172.21.15.45:6789/0 conn(0x55768227d560 legacy=0x55768227f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.133+0000 7f5171f1e640 1 -- 172.21.15.161:0/1415296119 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557682282250 con 0x55768227ac30 2024-05-08T09:23:35.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.135+0000 7f5171f1e640 1 --2- 172.21.15.161:0/1415296119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768227d020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f516400a470 tx=0x7f516401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4544111dda709a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.135+0000 7f517171d640 1 -- 172.21.15.161:0/1415296119 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164057070 con 0x55768227ac30 2024-05-08T09:23:35.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.135+0000 7f517171d640 1 -- 172.21.15.161:0/1415296119 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5164052570 con 0x55768227ac30 2024-05-08T09:23:35.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.135+0000 7f517171d640 1 -- 172.21.15.161:0/1415296119 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164052870 con 0x55768227ac30 2024-05-08T09:23:35.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 -- 172.21.15.161:0/1415296119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 msgr2=0x55768227d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 --2- 172.21.15.161:0/1415296119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768227d020 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f516400a470 tx=0x7f516401ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 -- 172.21.15.161:0/1415296119 shutdown_connections 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 --2- 172.21.15.161:0/1415296119 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768227d020 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 -- 172.21.15.161:0/1415296119 >> 172.21.15.161:0/1415296119 conn(0x5576822745a0 msgr2=0x5576822769c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 -- 172.21.15.161:0/1415296119 shutdown_connections 2024-05-08T09:23:35.136 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.136+0000 7f517441f800 1 -- 172.21.15.161:0/1415296119 wait complete. 2024-05-08T09:23:35.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f517441f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f517441f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5576821c51c0 con 0x55768227ac30 2024-05-08T09:23:35.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57148/0 (socket says 172.21.15.161:57148) 2024-05-08T09:23:35.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f5171f1e640 1 -- 172.21.15.161:0/2524379705 learned_addr learned my addr 172.21.15.161:0/2524379705 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.150+0000 7f5171f1e640 1 -- 172.21.15.161:0/2524379705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55768236bcb0 con 0x55768227ac30 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.151+0000 7f5171f1e640 1 --2- 172.21.15.161:0/2524379705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5164055040 tx=0x7f516404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09ad39e270ebe32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.151+0000 7f505fe07640 1 -- 172.21.15.161:0/2524379705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164057040 con 0x55768227ac30 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.151+0000 7f505fe07640 1 -- 172.21.15.161:0/2524379705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5164052990 con 0x55768227ac30 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.151+0000 7f505fe07640 1 -- 172.21.15.161:0/2524379705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164052c70 con 0x55768227ac30 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- 172.21.15.161:0/2524379705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 msgr2=0x55768236b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 --2- 172.21.15.161:0/2524379705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f5164055040 tx=0x7f516404c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- 172.21.15.161:0/2524379705 shutdown_connections 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 --2- 172.21.15.161:0/2524379705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x55768236b6e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- 172.21.15.161:0/2524379705 >> 172.21.15.161:0/2524379705 conn(0x5576822745a0 msgr2=0x557682367000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- 172.21.15.161:0/2524379705 shutdown_connections 2024-05-08T09:23:35.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- 172.21.15.161:0/2524379705 wait complete. 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f517441f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557682281480 con 0x55768227ac30 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57152/0 (socket says 172.21.15.161:57152) 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.152+0000 7f5171f1e640 1 -- 172.21.15.161:0/2758495000 learned_addr learned my addr 172.21.15.161:0/2758495000 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f5171f1e640 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557682373690 con 0x55768227ac30 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f5171f1e640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f516400a470 tx=0x7f5164003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f505e604640 1 -- 172.21.15.161:0/2758495000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164073070 con 0x55768227ac30 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f505e604640 1 -- 172.21.15.161:0/2758495000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516405d650 con 0x55768227ac30 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557682373920 con 0x55768227ac30 2024-05-08T09:23:35.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f505e604640 1 -- 172.21.15.161:0/2758495000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164057070 con 0x55768227ac30 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.153+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576823765d0 con 0x55768227ac30 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517441f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517441f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55768216bcf0 con 0x557682380a00 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f505e604640 1 -- 172.21.15.161:0/2758495000 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5164076070 con 0x55768227ac30 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57168/0 (socket says 172.21.15.161:57168) 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517271f640 1 -- 172.21.15.161:0/4110945887 learned_addr learned my addr 172.21.15.161:0/4110945887 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f505e604640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 0x7f5058038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f505e604640 1 -- 172.21.15.161:0/2758495000 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f516408dff0 con 0x55768227ac30 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f5171f1e640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 0x7f5058038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.154+0000 7f517271f640 1 -- 172.21.15.161:0/4110945887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557682381360 con 0x557682380a00 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517271f640 1 --2- 172.21.15.161:0/4110945887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a430 tx=0x7f516c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a5c76e7ef9efdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f5171f1e640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 0x7f5058038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f516405b500 tx=0x7f5164077ed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f5057fff640 1 -- 172.21.15.161:0/4110945887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516c015070 con 0x557682380a00 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f5057fff640 1 -- 172.21.15.161:0/4110945887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516c001670 con 0x557682380a00 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f5057fff640 1 -- 172.21.15.161:0/4110945887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516c001990 con 0x557682380a00 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 -- 172.21.15.161:0/4110945887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 msgr2=0x557682380e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 --2- 172.21.15.161:0/4110945887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f516c00a430 tx=0x7f516c00a8f0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 -- 172.21.15.161:0/4110945887 shutdown_connections 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 --2- 172.21.15.161:0/4110945887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682380e20 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 -- 172.21.15.161:0/4110945887 >> 172.21.15.161:0/4110945887 conn(0x55768227d560 msgr2=0x55768237d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 -- 172.21.15.161:0/4110945887 shutdown_connections 2024-05-08T09:23:35.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.155+0000 7f517441f800 1 -- 172.21.15.161:0/4110945887 wait complete. 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517441f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517441f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557682381cf0 con 0x557682380a00 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517271f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57176/0 (socket says 172.21.15.161:57176) 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.156+0000 7f517271f640 1 -- 172.21.15.161:0/871272326 learned_addr learned my addr 172.21.15.161:0/871272326 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f517271f640 1 -- 172.21.15.161:0/871272326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576823883e0 con 0x557682380a00 2024-05-08T09:23:35.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f517271f640 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f516c013040 tx=0x7f516c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f50567fc640 1 -- 172.21.15.161:0/871272326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516c020020 con 0x557682380a00 2024-05-08T09:23:35.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f50567fc640 1 -- 172.21.15.161:0/871272326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f516c0108e0 con 0x557682380a00 2024-05-08T09:23:35.166 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557682388670 con 0x557682380a00 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f50567fc640 1 -- 172.21.15.161:0/871272326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f516c015040 con 0x557682380a00 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.157+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55768238b320 con 0x557682380a00 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.158+0000 7f50567fc640 1 -- 172.21.15.161:0/871272326 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f516c023020 con 0x557682380a00 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.158+0000 7f50567fc640 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 0x7f504c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f50567fc640 1 -- 172.21.15.161:0/871272326 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f516c04c120 con 0x557682380a00 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f516bfff640 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 0x7f504c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f516bfff640 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 0x7f504c038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f515c000f60 tx=0x7f515c001230 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 1 Processor -- start 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 1 -- start start 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.167 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.159+0000 7f517441f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55768236bf70 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5171f1e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57180/0 (socket says 172.21.15.161:57180) 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5171f1e640 1 -- 172.21.15.161:0/1779876153 learned_addr learned my addr 172.21.15.161:0/1779876153 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5171f1e640 1 -- 172.21.15.161:0/1779876153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576823a50c0 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5171f1e640 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f516405cfd0 tx=0x7f516404f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5036fe5640 1 -- 172.21.15.161:0/1779876153 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164094020 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5036fe5640 1 -- 172.21.15.161:0/1779876153 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5164086030 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5576823a5b30 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f5036fe5640 1 -- 172.21.15.161:0/1779876153 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5164066520 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.160+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576823a5b30 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.161+0000 7f5036fe5640 1 -- 172.21.15.161:0/1779876153 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5164097020 con 0x5576823a4760 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.161+0000 7f5036fe5640 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 0x7f4fb0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.168 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.161+0000 7f5036fe5640 1 -- 172.21.15.161:0/1779876153 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f516409ad20 con 0x5576823a4760 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.161+0000 7f516bfff640 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 0x7f4fb0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f5034fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f516bfff640 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 0x7f4fb0038d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f515c001ed0 tx=0x7f515c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 0x5576823b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576823b4a20 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f517271f640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 0x5576823b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f517271f640 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 0x5576823b43c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.162+0000 7f517271f640 1 -- 172.21.15.161:0/2758495000 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f516c00e070 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.163+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576823b4f80 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.163+0000 7f517271f640 1 -- 172.21.15.161:0/2758495000 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f516c00e070 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.163+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5576823b6510 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.163+0000 7f517271f640 1 -- 172.21.15.161:0/2758495000 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f516c00e070 con 0x5576823b1fd0 2024-05-08T09:23:35.169 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 msgr2=0x7f504c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 0x7f504c038e10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f515c000f60 tx=0x7f515c001230 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 msgr2=0x557682387ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f516c013040 tx=0x7f516c003370 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 shutdown_connections 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f504c036950 0x7f504c038e10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/871272326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557682380a00 0x557682387ea0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 >> 172.21.15.161:0/871272326 conn(0x55768227d560 msgr2=0x55768237aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 shutdown_connections 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/871272326 wait complete. 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 msgr2=0x7f4fb0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 0x7f4fb0038d70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f515c001ed0 tx=0x7f515c00f000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 msgr2=0x5576823a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f516405cfd0 tx=0x7f516404f8b0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.170 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 shutdown_connections 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4fb00368b0 0x7f4fb0038d70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 --2- 172.21.15.161:0/1779876153 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5576823a4760 0x5576823a4b80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 >> 172.21.15.161:0/1779876153 conn(0x557682399240 msgr2=0x557682399c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 shutdown_connections 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.164+0000 7f517441f800 1 -- 172.21.15.161:0/1779876153 wait complete. 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 msgr2=0x5576823b43c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 0x5576823b43c0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 msgr2=0x7f5058038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 0x7f5058038dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f516405b500 tx=0x7f5164077ed0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 msgr2=0x557682373150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f516400a470 tx=0x7f5164003020 comp rx=0 tx=0).stop 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 shutdown_connections 2024-05-08T09:23:35.171 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5576823b1fd0 0x5576823b43c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5058036900 0x7f5058038dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 --2- 172.21.15.161:0/2758495000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55768227ac30 0x557682373150 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 >> 172.21.15.161:0/2758495000 conn(0x5576822745a0 msgr2=0x557682365800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 shutdown_connections 2024-05-08T09:23:35.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.165+0000 7f517441f800 1 -- 172.21.15.161:0/2758495000 wait complete. 2024-05-08T09:23:35.173 INFO:teuthology.orchestra.run.smithi161.stdout:{"id":"05c85a99-f6a8-405d-b310-d83661265ff5","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"7cebcda8-1953-4641-9d19-b10f40cc5883","zones":[{"id":"7cebcda8-1953-4641-9d19-b10f40cc5883","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-05-08T09:23:35.173 DEBUG:tasks.util.rgw: json result: {'id': '05c85a99-f6a8-405d-b310-d83661265ff5', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'zones': [{'id': '7cebcda8-1953-4641-9d19-b10f40cc5883', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-05-08T09:23:35.175 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-05-08T09:23:35.206 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T09:23:35.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-05-08T09:23:35.206 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-05-08T09:23:35.267 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.267 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.269+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.269+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.269+0000 7f04d832d800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5560e10dd980 0x5560e10ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.269+0000 7f04d832d800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5560e1052a00 con 0x5560e10de2e0 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.269+0000 7f04d832d800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5560e0f70050 con 0x5560e10dd980 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.270+0000 7f04d3fae640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5560e10dd980 0x5560e10ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.270+0000 7f04d37ad640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5560e10de2e0 0x5560e10de790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51092/0 (socket says 172.21.15.161:51092) 2024-05-08T09:23:35.269 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.270+0000 7f04d37ad640 1 -- 172.21.15.161:0/3161565191 learned_addr learned my addr 172.21.15.161:0/3161565191 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.270+0000 7f04d3fae640 1 -- 172.21.15.161:0/3161565191 >> v1:172.21.15.45:6789/0 conn(0x5560e10de2e0 legacy=0x5560e10de790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.270 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.270+0000 7f04d3fae640 1 -- 172.21.15.161:0/3161565191 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e10deea0 con 0x5560e10dd980 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.272+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3161565191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e10ddda0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04c4005fd0 tx=0x7f04c401ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1c7dfb92b451a06 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.272+0000 7f04d2fac640 1 -- 172.21.15.161:0/3161565191 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4052560 con 0x5560e10dd980 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.272+0000 7f04d2fac640 1 -- 172.21.15.161:0/3161565191 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4052700 con 0x5560e10dd980 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.272+0000 7f04d2fac640 1 -- 172.21.15.161:0/3161565191 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4052a60 con 0x5560e10dd980 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 -- 172.21.15.161:0/3161565191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 msgr2=0x5560e10ddda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 --2- 172.21.15.161:0/3161565191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e10ddda0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f04c4005fd0 tx=0x7f04c401ccc0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 -- 172.21.15.161:0/3161565191 shutdown_connections 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 --2- 172.21.15.161:0/3161565191 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e10ddda0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 -- 172.21.15.161:0/3161565191 >> 172.21.15.161:0/3161565191 conn(0x5560e10d9540 msgr2=0x5560e10db960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 -- 172.21.15.161:0/3161565191 shutdown_connections 2024-05-08T09:23:35.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.273+0000 7f04d832d800 1 -- 172.21.15.161:0/3161565191 wait complete. 2024-05-08T09:23:35.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d832d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d832d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560e102a170 con 0x5560e10dd980 2024-05-08T09:23:35.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d3fae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d3fae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57188/0 (socket says 172.21.15.161:57188) 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.287+0000 7f04d3fae640 1 -- 172.21.15.161:0/445994250 learned_addr learned my addr 172.21.15.161:0/445994250 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.288+0000 7f04d3fae640 1 -- 172.21.15.161:0/445994250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e11d3180 con 0x5560e10dd980 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.288+0000 7f04d3fae640 1 --2- 172.21.15.161:0/445994250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007000 tx=0x7f04c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a08fbd33f777900 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.288+0000 7f03c1e0b640 1 -- 172.21.15.161:0/445994250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c40529e0 con 0x5560e10dd980 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.288+0000 7f03c1e0b640 1 -- 172.21.15.161:0/445994250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4052b80 con 0x5560e10dd980 2024-05-08T09:23:35.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.288+0000 7f03c1e0b640 1 -- 172.21.15.161:0/445994250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c405c430 con 0x5560e10dd980 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- 172.21.15.161:0/445994250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 msgr2=0x5560e11d2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 --2- 172.21.15.161:0/445994250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f04c4007000 tx=0x7f04c404c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- 172.21.15.161:0/445994250 shutdown_connections 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 --2- 172.21.15.161:0/445994250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11d2bb0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- 172.21.15.161:0/445994250 >> 172.21.15.161:0/445994250 conn(0x5560e10d9540 msgr2=0x5560e11ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- 172.21.15.161:0/445994250 shutdown_connections 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- 172.21.15.161:0/445994250 wait complete. 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.289+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d832d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d832d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560e10df3d0 con 0x5560e10dd980 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d3fae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d3fae640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57198/0 (socket says 172.21.15.161:57198) 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d3fae640 1 -- 172.21.15.161:0/4285959174 learned_addr learned my addr 172.21.15.161:0/4285959174 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d3fae640 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e11dac50 con 0x5560e10dd980 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.290+0000 7f04d3fae640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f04c40526d0 tx=0x7f04c4003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f03bbfff640 1 -- 172.21.15.161:0/4285959174 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4075070 con 0x5560e10dd980 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f03bbfff640 1 -- 172.21.15.161:0/4285959174 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c4070410 con 0x5560e10dd980 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560e11daee0 con 0x5560e10dd980 2024-05-08T09:23:35.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f03bbfff640 1 -- 172.21.15.161:0/4285959174 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c40529e0 con 0x5560e10dd980 2024-05-08T09:23:35.292 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e11ddaf0 con 0x5560e10dd980 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.291+0000 7f03bbfff640 1 -- 172.21.15.161:0/4285959174 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04c4078070 con 0x5560e10dd980 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f03bbfff640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f03bbfff640 1 -- 172.21.15.161:0/4285959174 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f04c406d070 con 0x5560e10dd980 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d37ad640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 0x5560e11e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e11e1e30 con 0x5560e10de2e0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d47af640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 0x5560e11e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d37ad640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 0x7f03bc038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04c8000f60 tx=0x7f04c80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.292+0000 7f04d47af640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 0x5560e11e18b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d47af640 1 -- 172.21.15.161:0/4285959174 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e10de2e0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e11dee60 con 0x5560e10de2e0 2024-05-08T09:23:35.295 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d47af640 1 -- 172.21.15.161:0/4285959174 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e10de2e0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 0x5560e11e6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e11e6c20 con 0x5560e11e4140 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.293+0000 7f04d3fae640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 0x5560e11e6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.294+0000 7f04d3fae640 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 0x5560e11e6530 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.294+0000 7f04d3fae640 1 -- 172.21.15.161:0/4285959174 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04c4077030 con 0x5560e11e4140 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.294+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e11e30f0 con 0x5560e10de2e0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.294+0000 7f04d47af640 1 -- 172.21.15.161:0/4285959174 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e10de2e0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e11e35b0 con 0x5560e10de2e0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d47af640 1 -- 172.21.15.161:0/4285959174 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e10de2e0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d832d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d832d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560e0fd0cf0 con 0x5560e11f5dd0 2024-05-08T09:23:35.296 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57202/0 (socket says 172.21.15.161:57202) 2024-05-08T09:23:35.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.295+0000 7f04d47af640 1 -- 172.21.15.161:0/3355673394 learned_addr learned my addr 172.21.15.161:0/3355673394 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.297 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f04d47af640 1 -- 172.21.15.161:0/3355673394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e11f6730 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f04d47af640 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5560e11dba70 tx=0x7f04cc00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f03b97fa640 1 -- 172.21.15.161:0/3355673394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc007d00 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560e11f71a0 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f03b97fa640 1 -- 172.21.15.161:0/3355673394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc01e020 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f03b97fa640 1 -- 172.21.15.161:0/3355673394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc019420 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.296+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e11f76a0 con 0x5560e11f5dd0 2024-05-08T09:23:35.309 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.297+0000 7f03b97fa640 1 -- 172.21.15.161:0/3355673394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04cc016040 con 0x5560e11f5dd0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.297+0000 7f03b97fa640 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 0x7f03ac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.297+0000 7f03b97fa640 1 -- 172.21.15.161:0/3355673394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f04cc01f030 con 0x5560e11f5dd0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.297+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 0x7f03ac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 0x7f03ac038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5560e11e22b0 tx=0x7f04c408e040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d832d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d832d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560e11d34a0 con 0x5560e12031b0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57216/0 (socket says 172.21.15.161:57216) 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d47af640 1 -- 172.21.15.161:0/1070772851 learned_addr learned my addr 172.21.15.161:0/1070772851 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d47af640 1 -- 172.21.15.161:0/1070772851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e1203ba0 con 0x5560e12031b0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.298+0000 7f04d47af640 1 --2- 172.21.15.161:0/1070772851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f04cc04c8b0 tx=0x7f04cc0157e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bad0b100cc96c2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f03b2ffd640 1 -- 172.21.15.161:0/1070772851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc01d070 con 0x5560e12031b0 2024-05-08T09:23:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f03b2ffd640 1 -- 172.21.15.161:0/1070772851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc0174e0 con 0x5560e12031b0 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f03b2ffd640 1 -- 172.21.15.161:0/1070772851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc017dd0 con 0x5560e12031b0 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- 172.21.15.161:0/1070772851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 msgr2=0x5560e12035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 --2- 172.21.15.161:0/1070772851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f04cc04c8b0 tx=0x7f04cc0157e0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- 172.21.15.161:0/1070772851 shutdown_connections 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 --2- 172.21.15.161:0/1070772851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e12035d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- 172.21.15.161:0/1070772851 >> 172.21.15.161:0/1070772851 conn(0x5560e11ff430 msgr2=0x5560e11fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- 172.21.15.161:0/1070772851 shutdown_connections 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- 172.21.15.161:0/1070772851 wait complete. 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 Processor -- start 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.299+0000 7f04d832d800 1 -- start start 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d832d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d832d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5560e12042d0 con 0x5560e12031b0 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.311 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d47af640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57228/0 (socket says 172.21.15.161:57228) 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 learned_addr learned my addr 172.21.15.161:0/3718826936 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.300+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560e120abe0 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f04d47af640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0186c0 tx=0x7f04cc04c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f03b17fa640 1 -- 172.21.15.161:0/3718826936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc030020 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f03b17fa640 1 -- 172.21.15.161:0/3718826936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc03bce0 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5560e120ae70 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f03b17fa640 1 -- 172.21.15.161:0/3718826936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc017710 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.301+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5560e120db20 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f03b17fa640 1 -- 172.21.15.161:0/3718826936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f04cc033020 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f03b17fa640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f039c036900 0x7f039c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f03b17fa640 1 -- 172.21.15.161:0/3718826936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f04cc036d20 con 0x5560e12031b0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f039c036900 0x7f039c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.312 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f039c036900 0x7f039c038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04c408e010 tx=0x7f04c4089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e12161c0 0x5560e1218680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.302+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1218dd0 con 0x5560e12161c0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d37ad640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e12161c0 0x5560e1218680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d37ad640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e12161c0 0x5560e1218680 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c8009050 con 0x5560e12161c0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 20 realm 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1215610 con 0x5560e12161c0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c8009050 con 0x5560e12161c0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:35.313 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e12198c0 con 0x5560e12161c0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.303+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c8009050 con 0x5560e12161c0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e121a190 con 0x5560e12161c0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04c8009050 con 0x5560e12161c0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e121aad0 0x5560e121cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e121d650 con 0x5560e121aad0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.304+0000 7f04d47af640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e121aad0 0x5560e121cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d47af640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e121aad0 0x5560e121cec0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.314 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d832d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d832d800 20 searching for the correct realm 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5560e121f620 0x5560e1221ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5560e121f620 0x5560e1221ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.305+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5560e121f620 0x5560e1221ae0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d3fae640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f04c409b040 0x7f04c408c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d37ad640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f04c409b040 0x7f04c408c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d37ad640 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f04c409b040 0x7f04c408c460 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.306+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8009050 con 0x7f04c409b040 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.315 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8009050 con 0x5560e12161c0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.307+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.308+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.316 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.309+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.317 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.310+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.327 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.311+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.312+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.328 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121aad0 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.313+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e121f620 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x5560e12161c0 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.329 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5560e12221b0 con 0x7f04c409b040 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.314+0000 7f04d832d800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e121e040 con 0x5560e12161c0 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.330 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e121e8e0 con 0x5560e12161c0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e121dc80 con 0x5560e12161c0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 zone default found 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 4 Realm: () 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 zonegroup default 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.331 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.315+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e12226c0 con 0x5560e121aad0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224990 con 0x5560e121f620 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224d30 con 0x5560e121f620 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 started sync module instance, tier type = 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.316+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1223e20 con 0x7f04c409b040 2024-05-08T09:23:35.332 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.317+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.317+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93874582340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1223e20 con 0x7f04c409b040 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.317+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1225750 con 0x5560e12161c0 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.318+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93874582340384] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.319+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.319+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93874582344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1225710 con 0x5560e12161c0 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.319+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e12261e0 con 0x5560e121f620 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.320+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93874582344256] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.320+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.320+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93874582346960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e12265d0 con 0x5560e121f620 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.320+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1226fd0 con 0x7f04c409b040 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.321+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.321+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93874582346960] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.333 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.321+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93874582350560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e12273c0 con 0x7f04c409b040 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.321+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1227e00 con 0x5560e12161c0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.322+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93874582350560] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.322+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.322+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93874582337904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1227e00 con 0x5560e12161c0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.322+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1228840 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.323+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93874582337904] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.323+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.323+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93874582354176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1228840 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.323+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1229240 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.325+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93874582354176] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.325+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.334 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.325+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93874582356880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1229200 con 0x5560e121aad0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.325+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1229cf0 con 0x5560e121aad0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93874582356880] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93874582359376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1229170 con 0x5560e121aad0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=0 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=1 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=2 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=3 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=4 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=5 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.326+0000 7f04d832d800 20 add_watcher() i=6 2024-05-08T09:23:35.335 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93874582359376] v29'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d832d800 20 add_watcher() i=7 2024-05-08T09:23:35.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d832d800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:35.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e122d190 con 0x5560e12161c0 2024-05-08T09:23:35.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.336 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.327+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93874582363312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e122a6d0 con 0x5560e12161c0 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.328+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93874582363312] v29'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f0389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 5 note: GC not initialized 2024-05-08T09:23:35.340 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f0388fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 20 Filter name: none 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f03027fc640 20 reqs_thread_entry: start 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.329+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1260730 con 0x5560e121aad0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e125eed0 con 0x5560e12161c0 2024-05-08T09:23:35.341 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.330+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e125f7a0 con 0x5560e121aad0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.331+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v29'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.331+0000 7f04d832d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.331+0000 7f04d832d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.331+0000 7f04d832d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.331+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 93874582582000 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e1263c00 con 0x5560e12161c0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== watch-notify(notify (1) cookie 93874582337904 notify 124554051605 ret 0) ==== 691+0+0 (crc 0 0 0) 0x5560e1052a00 con 0x5560e12161c0 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f03b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051605 cookie 93874582337904 notifier 4820 bl.length()=649 2024-05-08T09:23:35.342 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify cookie 93874582582000 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f03b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f03b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f03b2ffd640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0398003ea0 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== watch-notify(notify_complete (2) cookie 93874582582000 notify 124554051605 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f04c803f680 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.332+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e125f2f0 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v29'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d832d800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d832d800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d832d800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93874582583184 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5560e125f2f0 con 0x5560e121f620 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== watch-notify(notify (1) cookie 93874582346960 notify 124554051608 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f04c40a6040 con 0x5560e121f620 2024-05-08T09:23:35.343 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f03b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 93874582346960 notifier 4820 bl.length()=177 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f03b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f03b2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f03b2ffd640 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0398003ea0 con 0x5560e121f620 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.333+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(68 notify.2 [notify cookie 93874582583184 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.334+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== watch-notify(notify_complete (2) cookie 93874582583184 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5560e11ddaf0 con 0x5560e121f620 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.334+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.344 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.335+0000 7f0389fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.335+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93874582363312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e122cd70 con 0x5560e12161c0 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.336+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93874582363312] v29'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.336+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93874582340384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1229cb0 con 0x7f04c409b040 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.337+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93874582340384] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.350 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.337+0000 7f04d832d800 20 remove_watcher() i=0 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.337+0000 7f04d832d800 2 removed watcher, disabling cache 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.337+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93874582344256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224320 con 0x5560e12161c0 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.338+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93874582344256] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.338+0000 7f04d832d800 20 remove_watcher() i=1 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.338+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93874582346960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224320 con 0x5560e121f620 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.339+0000 7f04d3fae640 1 -- 172.21.15.161:0/3718826936 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93874582346960] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4098070 con 0x5560e121f620 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.339+0000 7f04d832d800 20 remove_watcher() i=2 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.339+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93874582350560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1225cd0 con 0x7f04c409b040 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.340+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93874582350560] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x7f04c409b040 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.340+0000 7f04d832d800 20 remove_watcher() i=3 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.340+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93874582337904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224320 con 0x5560e12161c0 2024-05-08T09:23:35.351 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.341+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93874582337904] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c8029040 con 0x5560e12161c0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.341+0000 7f04d832d800 20 remove_watcher() i=4 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.341+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93874582354176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1223970 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.343+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93874582354176] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.343+0000 7f04d832d800 20 remove_watcher() i=5 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.343+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93874582356880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1224320 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.344+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93874582356880] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.344+0000 7f04d832d800 20 remove_watcher() i=6 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.344+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93874582359376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5560e1228390 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d47af640 1 -- 172.21.15.161:0/3718826936 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93874582359376] v29'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc0083e0 con 0x5560e121aad0 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 20 remove_watcher() i=7 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e121aad0 msgr2=0x5560e121cec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.352 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e121aad0 0x5560e121cec0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e12161c0 msgr2=0x5560e1218680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e12161c0 0x5560e1218680 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f04c409b040 msgr2=0x7f04c408c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f04c409b040 0x7f04c408c460 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5560e121f620 msgr2=0x5560e1221ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5560e121f620 0x5560e1221ae0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f039c036900 msgr2=0x7f039c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f039c036900 0x7f039c038dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f04c408e010 tx=0x7f04c4089000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 msgr2=0x5560e120a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0186c0 tx=0x7f04cc04c810 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d37ad640 1 -- 172.21.15.161:0/3718826936 reap_dead start 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 shutdown_connections 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 --2- 172.21.15.161:0/3718826936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e12031b0 0x5560e120a6a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.345+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 >> 172.21.15.161:0/3718826936 conn(0x5560e11ff430 msgr2=0x5560e11fca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.353 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 shutdown_connections 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3718826936 wait complete. 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 msgr2=0x7f03ac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 0x7f03ac038dc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x5560e11e22b0 tx=0x7f04c408e040 comp rx=0 tx=0).stop 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 msgr2=0x5560e11f61f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x5560e11dba70 tx=0x7f04cc00aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 shutdown_connections 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03ac036900 0x7f03ac038dc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/3355673394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e11f5dd0 0x5560e11f61f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 >> 172.21.15.161:0/3355673394 conn(0x5560e11e9e70 msgr2=0x5560e11ea270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 shutdown_connections 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/3355673394 wait complete. 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 msgr2=0x5560e11e6530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 0x5560e11e6530 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.354 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 msgr2=0x5560e11e18b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 0x5560e11e18b0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 msgr2=0x7f03bc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 0x7f03bc038e10 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f04c8000f60 tx=0x7f04c80012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 msgr2=0x5560e11da710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f04c40526d0 tx=0x7f04c4003330 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 shutdown_connections 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5560e11e4140 0x5560e11e6530 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5560e10de2e0 0x5560e11e18b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f03bc036950 0x7f03bc038e10 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 --2- 172.21.15.161:0/4285959174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5560e10dd980 0x5560e11da710 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 >> 172.21.15.161:0/4285959174 conn(0x5560e10d9540 msgr2=0x5560e11cccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 shutdown_connections 2024-05-08T09:23:35.355 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.346+0000 7f04d832d800 1 -- 172.21.15.161:0/4285959174 wait complete. 2024-05-08T09:23:35.356 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.356 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.357 ERROR:root:0 2024-05-08T09:23:35.357 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:35.363 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000cd1a3a783583b18e-00663b4497-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:23:35.364 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-05-08T09:23:35.374 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:35.374 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-05-08T09:23:35.387 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-05-08T09:23:35.387 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-05-08T09:23:35.402 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T09:23:35.402 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-05-08T09:23:35.410 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-05-08T09:23:35.411 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:35.414 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:35.414 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-05-08T09:23:35.418 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:35.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:35.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:35.419 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-05-08T09:23:35.465 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.465 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f583f03a800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d90e5fca30 0x55d90e5fce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f583f03a800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d90e571a30 con 0x55d90e5fd390 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f583f03a800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55d90e48f050 con 0x55d90e5fca30 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f5839cd5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d90e5fca30 0x55d90e5fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f58394d4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55d90e5fd390 0x55d90e5fd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51098/0 (socket says 172.21.15.161:51098) 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f58394d4640 1 -- 172.21.15.161:0/3556540028 learned_addr learned my addr 172.21.15.161:0/3556540028 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.467 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.467+0000 7f5839cd5640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55d90e5fca30 0x55d90e5fce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57238/0 (socket says 172.21.15.161:57238) 2024-05-08T09:23:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.468+0000 7f5839cd5640 1 -- 172.21.15.161:0/3556540028 >> v1:172.21.15.45:6789/0 conn(0x55d90e5fd390 legacy=0x55d90e5fd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.468 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.468+0000 7f5839cd5640 1 -- 172.21.15.161:0/3556540028 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e5fdf50 con 0x55d90e5fca30 2024-05-08T09:23:35.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f5839cd5640 1 --2- 172.21.15.161:0/3556540028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e5fce50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f582c00a470 tx=0x7f582c01ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9246df528cf3491 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f5838cd3640 1 -- 172.21.15.161:0/3556540028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c057070 con 0x55d90e5fca30 2024-05-08T09:23:35.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f5838cd3640 1 -- 172.21.15.161:0/3556540028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c052570 con 0x55d90e5fca30 2024-05-08T09:23:35.469 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f5838cd3640 1 -- 172.21.15.161:0/3556540028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c052870 con 0x55d90e5fca30 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 -- 172.21.15.161:0/3556540028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 msgr2=0x55d90e5fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 --2- 172.21.15.161:0/3556540028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e5fce50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f582c00a470 tx=0x7f582c01ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 -- 172.21.15.161:0/3556540028 shutdown_connections 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 --2- 172.21.15.161:0/3556540028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e5fce50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 -- 172.21.15.161:0/3556540028 >> 172.21.15.161:0/3556540028 conn(0x55d90e5f85b0 msgr2=0x55d90e5fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 -- 172.21.15.161:0/3556540028 shutdown_connections 2024-05-08T09:23:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.470+0000 7f583f03a800 1 -- 172.21.15.161:0/3556540028 wait complete. 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.484+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.484+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.484+0000 7f583f03a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.484+0000 7f583f03a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d90e5491c0 con 0x55d90e5fca30 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5839cd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5839cd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57242/0 (socket says 172.21.15.161:57242) 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5839cd5640 1 -- 172.21.15.161:0/3054564994 learned_addr learned my addr 172.21.15.161:0/3054564994 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5839cd5640 1 -- 172.21.15.161:0/3054564994 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e6f2200 con 0x55d90e5fca30 2024-05-08T09:23:35.485 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5839cd5640 1 --2- 172.21.15.161:0/3054564994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f582c055040 tx=0x7f582c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307f442224a7ccdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5727e07640 1 -- 172.21.15.161:0/3054564994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c057070 con 0x55d90e5fca30 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5727e07640 1 -- 172.21.15.161:0/3054564994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c063070 con 0x55d90e5fca30 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.485+0000 7f5727e07640 1 -- 172.21.15.161:0/3054564994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c052720 con 0x55d90e5fca30 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- 172.21.15.161:0/3054564994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 msgr2=0x55d90e6f1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 --2- 172.21.15.161:0/3054564994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f582c055040 tx=0x7f582c04c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- 172.21.15.161:0/3054564994 shutdown_connections 2024-05-08T09:23:35.487 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 --2- 172.21.15.161:0/3054564994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f1c30 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- 172.21.15.161:0/3054564994 >> 172.21.15.161:0/3054564994 conn(0x55d90e5f85b0 msgr2=0x55d90e6ed550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- 172.21.15.161:0/3054564994 shutdown_connections 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- 172.21.15.161:0/3054564994 wait complete. 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.486+0000 7f583f03a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d90e5fe420 con 0x55d90e5fca30 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.487+0000 7f5839cd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.487+0000 7f5839cd5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57258/0 (socket says 172.21.15.161:57258) 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.487+0000 7f5839cd5640 1 -- 172.21.15.161:0/2984520970 learned_addr learned my addr 172.21.15.161:0/2984520970 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.487+0000 7f5839cd5640 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e6f9bf0 con 0x55d90e5fca30 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f5839cd5640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f582c060040 tx=0x7f582c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f5726604640 1 -- 172.21.15.161:0/2984520970 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c052e30 con 0x55d90e5fca30 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f5726604640 1 -- 172.21.15.161:0/2984520970 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f582c06c070 con 0x55d90e5fca30 2024-05-08T09:23:35.488 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f5726604640 1 -- 172.21.15.161:0/2984520970 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f582c05e5f0 con 0x55d90e5fca30 2024-05-08T09:23:35.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d90e6f9e80 con 0x55d90e5fca30 2024-05-08T09:23:35.489 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.488+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90e6fcb30 con 0x55d90e5fca30 2024-05-08T09:23:35.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f5726604640 1 -- 172.21.15.161:0/2984520970 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f582c05e790 con 0x55d90e5fca30 2024-05-08T09:23:35.492 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f5726604640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 0x7f5720038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f5726604640 1 -- 172.21.15.161:0/2984520970 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f582c08e9f0 con 0x55d90e5fca30 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f58394d4640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 0x7f5720038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 0x55d90e7008f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e700e70 con 0x55d90e5fd390 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f583a4d6640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 0x55d90e7008f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.489+0000 7f58394d4640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 0x7f5720038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5830000f60 tx=0x7f58300012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583a4d6640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 0x55d90e7008f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583a4d6640 1 -- 172.21.15.161:0/2984520970 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f583400a4a0 con 0x55d90e5fd390 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e6fdec0 con 0x55d90e5fd390 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583a4d6640 1 -- 172.21.15.161:0/2984520970 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f583400a4a0 con 0x55d90e5fd390 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 0x55d90e7055b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e705c80 con 0x55d90e7031c0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.490+0000 7f5839cd5640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 0x55d90e7055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.493 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.491+0000 7f5839cd5640 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 0x55d90e7055b0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.491+0000 7f5839cd5640 1 -- 172.21.15.161:0/2984520970 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f582c071990 con 0x55d90e7031c0 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.491+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e702170 con 0x55d90e5fd390 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.491+0000 7f583a4d6640 1 -- 172.21.15.161:0/2984520970 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f583400a4a0 con 0x55d90e5fd390 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.491+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e702610 con 0x55d90e5fd390 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583a4d6640 1 -- 172.21.15.161:0/2984520970 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f583400a4a0 con 0x55d90e5fd390 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583f03a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583f03a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d90e4efcf0 con 0x55d90e714e10 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57268/0 (socket says 172.21.15.161:57268) 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.492+0000 7f583a4d6640 1 -- 172.21.15.161:0/2244115997 learned_addr learned my addr 172.21.15.161:0/2244115997 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f583a4d6640 1 -- 172.21.15.161:0/2244115997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e715770 con 0x55d90e714e10 2024-05-08T09:23:35.494 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f583a4d6640 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55d90e701270 tx=0x7f5834018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f571f7fe640 1 -- 172.21.15.161:0/2244115997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834014450 con 0x55d90e714e10 2024-05-08T09:23:35.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f571f7fe640 1 -- 172.21.15.161:0/2244115997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58340145f0 con 0x55d90e714e10 2024-05-08T09:23:35.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d90e7161e0 con 0x55d90e714e10 2024-05-08T09:23:35.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f571f7fe640 1 -- 172.21.15.161:0/2244115997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834014910 con 0x55d90e714e10 2024-05-08T09:23:35.495 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.493+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90e7166e0 con 0x55d90e714e10 2024-05-08T09:23:35.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.494+0000 7f571f7fe640 1 -- 172.21.15.161:0/2244115997 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5834011040 con 0x55d90e714e10 2024-05-08T09:23:35.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.494+0000 7f571f7fe640 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 0x7f5714038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.494+0000 7f571f7fe640 1 -- 172.21.15.161:0/2244115997 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f583401e070 con 0x55d90e714e10 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.494+0000 7f5839cd5640 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 0x7f5714038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f5839cd5640 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 0x7f5714038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55d90e701310 tx=0x7f582c0051b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583f03a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583f03a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d90e6f24c0 con 0x55d90e7220b0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57274/0 (socket says 172.21.15.161:57274) 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583a4d6640 1 -- 172.21.15.161:0/3579803634 learned_addr learned my addr 172.21.15.161:0/3579803634 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583a4d6640 1 -- 172.21.15.161:0/3579803634 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e722aa0 con 0x55d90e7220b0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.495+0000 7f583a4d6640 1 --2- 172.21.15.161:0/3579803634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f583404c8a0 tx=0x7f5834011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c1888726d29df1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f571d7fa640 1 -- 172.21.15.161:0/3579803634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583404e200 con 0x55d90e7220b0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f571d7fa640 1 -- 172.21.15.161:0/3579803634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583404b1d0 con 0x55d90e7220b0 2024-05-08T09:23:35.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f571d7fa640 1 -- 172.21.15.161:0/3579803634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583404b4f0 con 0x55d90e7220b0 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- 172.21.15.161:0/3579803634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 msgr2=0x55d90e7224d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 --2- 172.21.15.161:0/3579803634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f583404c8a0 tx=0x7f5834011700 comp rx=0 tx=0).stop 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- 172.21.15.161:0/3579803634 shutdown_connections 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 --2- 172.21.15.161:0/3579803634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e7224d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- 172.21.15.161:0/3579803634 >> 172.21.15.161:0/3579803634 conn(0x55d90e71e410 msgr2=0x55d90e71c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- 172.21.15.161:0/3579803634 shutdown_connections 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- 172.21.15.161:0/3579803634 wait complete. 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 Processor -- start 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- start start 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e729670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.496+0000 7f583f03a800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55d90e723210 con 0x55d90e7220b0 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e729670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583a4d6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e729670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57282/0 (socket says 172.21.15.161:57282) 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 learned_addr learned my addr 172.21.15.161:0/421458569 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d90e729bb0 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583a4d6640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e729670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5834011740 tx=0x7f583404c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f570b7fe640 1 -- 172.21.15.161:0/421458569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5834022b80 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f570b7fe640 1 -- 172.21.15.161:0/421458569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5834022d20 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d90e729e40 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f570b7fe640 1 -- 172.21.15.161:0/421458569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583404c9e0 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.497+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d90e72caf0 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.498+0000 7f570b7fe640 1 -- 172.21.15.161:0/421458569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f583404cc30 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f570b7fe640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5704036900 0x7f5704038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f570b7fe640 1 -- 172.21.15.161:0/421458569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5834046040 con 0x55d90e7220b0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f5839cd5640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5704036900 0x7f5704038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e735380 0x55d90e737840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.506 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e737f90 con 0x55d90e735380 2024-05-08T09:23:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f5839cd5640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5704036900 0x7f5704038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f582c08cca0 tx=0x7f582c08b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f58394d4640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e735380 0x55d90e737840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.499+0000 7f58394d4640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e735380 0x55d90e737840 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5830009050 con 0x55d90e735380 2024-05-08T09:23:35.507 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 realm 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7347d0 con 0x55d90e735380 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5830009050 con 0x55d90e735380 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e738a80 con 0x55d90e735380 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5830009050 con 0x55d90e735380 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e739350 con 0x55d90e735380 2024-05-08T09:23:35.509 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5830009050 con 0x55d90e735380 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e739c90 0x55d90e73c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.500+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e73c810 con 0x55d90e739c90 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.501+0000 7f583a4d6640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e739c90 0x55d90e73c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.501+0000 7f583a4d6640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e739c90 0x55d90e73c080 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.501+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.501+0000 7f583f03a800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.501+0000 7f583f03a800 20 searching for the correct realm 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d90e73e7e0 0x55d90e740ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f5839cd5640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d90e73e7e0 0x55d90e740ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f5839cd5640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d90e73e7e0 0x55d90e740ca0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.510 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f5839cd5640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f582c084750 0x7f582c08b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.502+0000 7f58394d4640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f582c084750 0x7f582c08b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.503+0000 7f58394d4640 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f582c084750 0x7f582c08b270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.503+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830009050 con 0x7f582c084750 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.503+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830009050 con 0x55d90e735380 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.511 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.504+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.505+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.506+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.507+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.508+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.509+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e739c90 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e73e7e0 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.510+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x55d90e735380 2024-05-08T09:23:35.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55d90e741370 con 0x7f582c084750 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e73d200 con 0x55d90e735380 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.511+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e73daa0 con 0x55d90e735380 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e73ce40 con 0x55d90e735380 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 zone default found 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 4 Realm: () 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 zonegroup default 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7418a0 con 0x55d90e739c90 2024-05-08T09:23:35.528 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e743b70 con 0x55d90e73e7e0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.512+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e743f10 con 0x55d90e73e7e0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 20 started sync module instance, tier type = 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.513+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e743000 con 0x7f582c084750 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.514+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.529 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.514+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94390738761008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e743000 con 0x7f582c084750 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.514+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e744920 con 0x55d90e735380 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.515+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94390738761008] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.515+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.515+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94390738765392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e743000 con 0x55d90e735380 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.515+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e745370 con 0x55d90e73e7e0 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.516+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.516+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94390738767488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e745c10 con 0x55d90e73e7e0 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.516+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e746690 con 0x7f582c084750 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.517+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94390738765392] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.517+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94390738767488] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.518+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.518+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94390738769760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e742b50 con 0x7f582c084750 2024-05-08T09:23:35.530 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.518+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e746f60 con 0x55d90e735380 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.519+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94390738769760] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.519+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.519+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94390738772384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e746f10 con 0x55d90e735380 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.519+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e747970 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.520+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94390738772384] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.520+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.520+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94390738774624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e746e80 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.520+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e748830 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.521+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94390738774624] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.521+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.521+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94390738779488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e748830 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.521+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7491f0 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94390738779488] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.531 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94390738781056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7493d0 con 0x55d90e739c90 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=0 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=1 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=2 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=3 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=4 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=5 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.522+0000 7f583f03a800 20 add_watcher() i=6 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.523+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94390738781056] v29'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.523+0000 7f583f03a800 20 add_watcher() i=7 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.523+0000 7f583f03a800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.523+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e74c5c0 con 0x55d90e735380 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.523+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.532 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.524+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94390738784128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e749850 con 0x55d90e735380 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94390738784128] v29'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f56eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 5 note: GC not initialized 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f56ea7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 20 Filter name: none 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f565bfff640 20 reqs_thread_entry: start 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:35.535 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.525+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e77fb90 con 0x55d90e739c90 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583f03a800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583f03a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583f03a800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583f03a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.526+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7861c0 con 0x55d90e739c90 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.527+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.527+0000 7f583f03a800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.527+0000 7f583f03a800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.527+0000 7f583f03a800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:35.536 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.527+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94390739033136 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55d90e7819f0 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94390738772384 notify 124554051607 ret 0) ==== 678+0+0 (crc 0 0 0) 0x55d90e571a30 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f571d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051607 cookie 94390738772384 notifier 4827 bl.length()=636 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f571d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f571d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94390739033136 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f571d7fa640 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f56fc003ea0 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.528+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94390739033136 notify 124554051607 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f583003e610 con 0x55d90e735380 2024-05-08T09:23:35.537 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.529+0000 7f56eb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.529+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94390738784128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e74bc60 con 0x55d90e735380 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.530+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94390738784128] v29'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.530+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94390738761008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e748f80 con 0x7f582c084750 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.531+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94390738761008] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.531+0000 7f583f03a800 20 remove_watcher() i=0 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.531+0000 7f583f03a800 2 removed watcher, disabling cache 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.531+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94390738765392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e748f80 con 0x55d90e735380 2024-05-08T09:23:35.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.532+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94390738765392] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.532+0000 7f583f03a800 20 remove_watcher() i=1 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.532+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94390738767488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e748f80 con 0x55d90e73e7e0 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.533+0000 7f5839cd5640 1 -- 172.21.15.161:0/421458569 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94390738767488] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582c071990 con 0x55d90e73e7e0 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.533+0000 7f583f03a800 20 remove_watcher() i=2 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.533+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94390738769760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e744e80 con 0x7f582c084750 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.534+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94390738769760] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x7f582c084750 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.535+0000 7f583f03a800 20 remove_watcher() i=3 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.535+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94390738772384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e745760 con 0x55d90e735380 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.536+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94390738772384] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5830029040 con 0x55d90e735380 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.536+0000 7f583f03a800 20 remove_watcher() i=4 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.536+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94390738774624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e744e80 con 0x55d90e739c90 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.537+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94390738774624] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.537+0000 7f583f03a800 20 remove_watcher() i=5 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.537+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94390738779488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e744e80 con 0x55d90e739c90 2024-05-08T09:23:35.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.538+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94390738779488] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.538+0000 7f583f03a800 20 remove_watcher() i=6 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.538+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94390738781056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55d90e747d60 con 0x55d90e739c90 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583a4d6640 1 -- 172.21.15.161:0/421458569 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94390738781056] v29'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583403c020 con 0x55d90e739c90 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 20 remove_watcher() i=7 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e739c90 msgr2=0x55d90e73c080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e739c90 0x55d90e73c080 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e735380 msgr2=0x55d90e737840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e735380 0x55d90e737840 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f582c084750 msgr2=0x7f582c08b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f582c084750 0x7f582c08b270 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d90e73e7e0 msgr2=0x55d90e740ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55d90e73e7e0 0x55d90e740ca0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5704036900 msgr2=0x7f5704038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5704036900 0x7f5704038dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f582c08cca0 tx=0x7f582c08b000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 msgr2=0x55d90e729670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/421458569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e7220b0 0x55d90e729670 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f5834011740 tx=0x7f583404c830 comp rx=0 tx=0).stop 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 reap_dead start 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f58394d4640 1 -- 172.21.15.161:0/421458569 reap_dead start 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 shutdown_connections 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 >> 172.21.15.161:0/421458569 conn(0x55d90e71e410 msgr2=0x55d90e71ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 shutdown_connections 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/421458569 wait complete. 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 msgr2=0x7f5714038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 0x7f5714038e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55d90e701310 tx=0x7f582c0051b0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 msgr2=0x55d90e715230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.539+0000 7f583f03a800 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x55d90e701270 tx=0x7f5834018830 comp rx=0 tx=0).stop 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 shutdown_connections 2024-05-08T09:23:35.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5714036950 0x7f5714038e10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2244115997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e714e10 0x55d90e715230 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 >> 172.21.15.161:0/2244115997 conn(0x55d90e708eb0 msgr2=0x55d90e7092b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 shutdown_connections 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2244115997 wait complete. 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 msgr2=0x55d90e7055b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 0x55d90e7055b0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 msgr2=0x55d90e7008f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 0x55d90e7008f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 msgr2=0x7f5720038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 0x7f5720038dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5830000f60 tx=0x7f58300012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 msgr2=0x55d90e6f96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f582c060040 tx=0x7f582c002fb0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 shutdown_connections 2024-05-08T09:23:35.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55d90e7031c0 0x55d90e7055b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55d90e5fd390 0x55d90e7008f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5720036900 0x7f5720038dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 --2- 172.21.15.161:0/2984520970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d90e5fca30 0x55d90e6f96b0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 >> 172.21.15.161:0/2984520970 conn(0x55d90e5f85b0 msgr2=0x55d90e6ebd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 shutdown_connections 2024-05-08T09:23:35.548 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.540+0000 7f583f03a800 1 -- 172.21.15.161:0/2984520970 wait complete. 2024-05-08T09:23:35.549 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.549 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.549 ERROR:root:0 2024-05-08T09:23:35.549 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T09:23:35.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-05-08T09:23:35.549 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-05-08T09:23:35.602 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.602 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.604+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.604+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.604+0000 7f294c729800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cc0ee7db70 0x55cc0ee7ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.604 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.604+0000 7f294c729800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cc0ee83fb0 con 0x55cc0ee804a0 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.604+0000 7f294c729800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55cc0ed0e050 con 0x55cc0ee7db70 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f29484be640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cc0ee7db70 0x55cc0ee7ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f29484be640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55cc0ee7db70 0x55cc0ee7ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57286/0 (socket says 172.21.15.161:57286) 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f29484be640 1 -- 172.21.15.161:0/83101094 learned_addr learned my addr 172.21.15.161:0/83101094 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f293ffff640 1 --1- 172.21.15.161:0/83101094 >> v1:172.21.15.45:6789/0 conn(0x55cc0ee804a0 0x55cc0ee82890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51100/0 (socket says 172.21.15.161:51100) 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f29484be640 1 -- 172.21.15.161:0/83101094 >> v1:172.21.15.45:6789/0 conn(0x55cc0ee804a0 legacy=0x55cc0ee82890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.605 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.605+0000 7f29484be640 1 -- 172.21.15.161:0/83101094 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0ee85190 con 0x55cc0ee7db70 2024-05-08T09:23:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.607+0000 7f29484be640 1 --2- 172.21.15.161:0/83101094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7ff60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f293800a520 tx=0x7f293801d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306d2ce5dd896175 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.607+0000 7f2947cbd640 1 -- 172.21.15.161:0/83101094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938057070 con 0x55cc0ee7db70 2024-05-08T09:23:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.607+0000 7f2947cbd640 1 -- 172.21.15.161:0/83101094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2938052570 con 0x55cc0ee7db70 2024-05-08T09:23:35.606 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.607+0000 7f2947cbd640 1 -- 172.21.15.161:0/83101094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f293804ae60 con 0x55cc0ee7db70 2024-05-08T09:23:35.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 -- 172.21.15.161:0/83101094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 msgr2=0x55cc0ee7ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 --2- 172.21.15.161:0/83101094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7ff60 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f293800a520 tx=0x7f293801d010 comp rx=0 tx=0).stop 2024-05-08T09:23:35.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 -- 172.21.15.161:0/83101094 shutdown_connections 2024-05-08T09:23:35.607 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 --2- 172.21.15.161:0/83101094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7ff60 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 -- 172.21.15.161:0/83101094 >> 172.21.15.161:0/83101094 conn(0x55cc0ee77540 msgr2=0x55cc0ee79960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 -- 172.21.15.161:0/83101094 shutdown_connections 2024-05-08T09:23:35.608 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.608+0000 7f294c729800 1 -- 172.21.15.161:0/83101094 wait complete. 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f294c729800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f294c729800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc0edc8170 con 0x55cc0ee7db70 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f29484be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f29484be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57292/0 (socket says 172.21.15.161:57292) 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.621+0000 7f29484be640 1 -- 172.21.15.161:0/2104844728 learned_addr learned my addr 172.21.15.161:0/2104844728 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.621 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.622+0000 7f29484be640 1 -- 172.21.15.161:0/2104844728 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0ee7ba70 con 0x55cc0ee7db70 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.622+0000 7f29484be640 1 --2- 172.21.15.161:0/2104844728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2938055040 tx=0x7f293804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98c4427496f69f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.622+0000 7f283660c640 1 -- 172.21.15.161:0/2104844728 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938057040 con 0x55cc0ee7db70 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.622+0000 7f283660c640 1 -- 172.21.15.161:0/2104844728 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2938052720 con 0x55cc0ee7db70 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.622+0000 7f283660c640 1 -- 172.21.15.161:0/2104844728 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938052a20 con 0x55cc0ee7db70 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- 172.21.15.161:0/2104844728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 msgr2=0x55cc0ee7d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 --2- 172.21.15.161:0/2104844728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2938055040 tx=0x7f293804c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- 172.21.15.161:0/2104844728 shutdown_connections 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 --2- 172.21.15.161:0/2104844728 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee7db70 0x55cc0ee7d4b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- 172.21.15.161:0/2104844728 >> 172.21.15.161:0/2104844728 conn(0x55cc0ee77540 msgr2=0x55cc0ef69fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- 172.21.15.161:0/2104844728 shutdown_connections 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- 172.21.15.161:0/2104844728 wait complete. 2024-05-08T09:23:35.624 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.623+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f294c729800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f294c729800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc0ee84420 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f29484be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f29484be640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57298/0 (socket says 172.21.15.161:57298) 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f29484be640 1 -- 172.21.15.161:0/724400242 learned_addr learned my addr 172.21.15.161:0/724400242 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f29484be640 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0ef78b30 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f29484be640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2938052540 tx=0x7f2938003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.624+0000 7f2834e09640 1 -- 172.21.15.161:0/724400242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938073070 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.625+0000 7f2834e09640 1 -- 172.21.15.161:0/724400242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2938052e20 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.625+0000 7f2834e09640 1 -- 172.21.15.161:0/724400242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2938057070 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.625+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0ef78dc0 con 0x55cc0ee804a0 2024-05-08T09:23:35.625 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.625+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0ef7ba20 con 0x55cc0ee804a0 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.625+0000 7f2834e09640 1 -- 172.21.15.161:0/724400242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2938076070 con 0x55cc0ee804a0 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f2834e09640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 0x7f2830038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f2834e09640 1 -- 172.21.15.161:0/724400242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f293808db00 con 0x55cc0ee804a0 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f293ffff640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 0x7f2830038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 0x55cc0ef7fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.629 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0ef80100 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f2948cbf640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 0x55cc0ef7fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f293ffff640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 0x7f2830038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2930000f60 tx=0x7f2930001370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f2948cbf640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 0x55cc0ef7fbc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.626+0000 7f2948cbf640 1 -- 172.21.15.161:0/724400242 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f294000a4a0 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.627+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0ef7cd80 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.627+0000 7f2948cbf640 1 -- 172.21.15.161:0/724400242 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f294000a4a0 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.627+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 0x55cc0ef84790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.627+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0ef84e80 con 0x55cc0ef823a0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.627+0000 7f29484be640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 0x55cc0ef84790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f29484be640 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 0x55cc0ef84790 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f29484be640 1 -- 172.21.15.161:0/724400242 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2938075030 con 0x55cc0ef823a0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0ef81380 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f2948cbf640 1 -- 172.21.15.161:0/724400242 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f294000a4a0 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.630 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0ef817e0 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.628+0000 7f2948cbf640 1 -- 172.21.15.161:0/724400242 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f294000a4a0 con 0x55cc0ef7d7d0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f294c729800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f294c729800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc0ed6ecf0 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57314/0 (socket says 172.21.15.161:57314) 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f2948cbf640 1 -- 172.21.15.161:0/1451904108 learned_addr learned my addr 172.21.15.161:0/1451904108 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.629+0000 7f2948cbf640 1 -- 172.21.15.161:0/1451904108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0ef94910 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f2948cbf640 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55cc0ef79610 tx=0x7f2940018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f282dffb640 1 -- 172.21.15.161:0/1451904108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2940014450 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f282dffb640 1 -- 172.21.15.161:0/1451904108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2940014610 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0ef95380 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f282dffb640 1 -- 172.21.15.161:0/1451904108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2940014930 con 0x55cc0ef93fb0 2024-05-08T09:23:35.631 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.630+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0ef95880 con 0x55cc0ef93fb0 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f282dffb640 1 -- 172.21.15.161:0/1451904108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2940011040 con 0x55cc0ef93fb0 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f282dffb640 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 0x7f2820038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f282dffb640 1 -- 172.21.15.161:0/1451904108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f294001e070 con 0x55cc0ef93fb0 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f29484be640 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 0x7f2820038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f29484be640 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 0x7f2820038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55cc0ef804e0 tx=0x7f293808bd60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.639 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f294c729800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.631+0000 7f294c729800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc0ee7bd30 con 0x55cc0efa1320 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57316/0 (socket says 172.21.15.161:57316) 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f2948cbf640 1 -- 172.21.15.161:0/3218569326 learned_addr learned my addr 172.21.15.161:0/3218569326 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f2948cbf640 1 -- 172.21.15.161:0/3218569326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0efa1d10 con 0x55cc0efa1320 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f2948cbf640 1 --2- 172.21.15.161:0/3218569326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f294004c8f0 tx=0x7f29400139d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e87aa62df92ab0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f28277fe640 1 -- 172.21.15.161:0/3218569326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2940016a90 con 0x55cc0efa1320 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f28277fe640 1 -- 172.21.15.161:0/3218569326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2940016440 con 0x55cc0efa1320 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.632+0000 7f28277fe640 1 -- 172.21.15.161:0/3218569326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f294002bc50 con 0x55cc0efa1320 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- 172.21.15.161:0/3218569326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 msgr2=0x55cc0efa1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 --2- 172.21.15.161:0/3218569326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f294004c8f0 tx=0x7f29400139d0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- 172.21.15.161:0/3218569326 shutdown_connections 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 --2- 172.21.15.161:0/3218569326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa1740 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.640 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- 172.21.15.161:0/3218569326 >> 172.21.15.161:0/3218569326 conn(0x55cc0ef9d5f0 msgr2=0x55cc0ef9b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- 172.21.15.161:0/3218569326 shutdown_connections 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- 172.21.15.161:0/3218569326 wait complete. 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 Processor -- start 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- start start 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f294c729800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55cc0efa24d0 con 0x55cc0efa1320 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.633+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2948cbf640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57320/0 (socket says 172.21.15.161:57320) 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 learned_addr learned my addr 172.21.15.161:0/2722198360 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0efa8d40 con 0x55cc0efa1320 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2948cbf640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2940013a10 tx=0x7f294004c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2825ffb640 1 -- 172.21.15.161:0/2722198360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2940031070 con 0x55cc0efa1320 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2825ffb640 1 -- 172.21.15.161:0/2722198360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2940014b20 con 0x55cc0efa1320 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cc0efa8fd0 con 0x55cc0efa1320 2024-05-08T09:23:35.641 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f2825ffb640 1 -- 172.21.15.161:0/2722198360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2940014e20 con 0x55cc0efa1320 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.634+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0efabc80 con 0x55cc0efa1320 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.635+0000 7f2825ffb640 1 -- 172.21.15.161:0/2722198360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2940034070 con 0x55cc0efa1320 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.635+0000 7f2825ffb640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.635+0000 7f2825ffb640 1 -- 172.21.15.161:0/2722198360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f294000e040 con 0x55cc0efa1320 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.635+0000 7f29484be640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f29484be640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2938067fd0 tx=0x7f293808e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0efb4310 0x55cc0efb67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efb6f20 con 0x55cc0efb4310 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f293ffff640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0efb4310 0x55cc0efb67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f293ffff640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0efb4310 0x55cc0efb67d0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f293000f610 con 0x55cc0efb4310 2024-05-08T09:23:35.642 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 20 realm 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.636+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efb3760 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f293000f610 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efb7a10 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f293000f610 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efb82e0 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f293000f610 con 0x55cc0efb4310 2024-05-08T09:23:35.643 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0efb8d00 0x55cc0efbb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.637+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efbb7e0 con 0x55cc0efb8d00 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f2948cbf640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0efb8d00 0x55cc0efbb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f2948cbf640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0efb8d00 0x55cc0efbb0f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f294c729800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f294c729800 20 searching for the correct realm 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cc0efbd7b0 0x55cc0efbfc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.638+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f29484be640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cc0efbd7b0 0x55cc0efbfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f29484be640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cc0efbd7b0 0x55cc0efbfc70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f29484be640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2938078060 0x7f29380073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.639+0000 7f293ffff640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2938078060 0x7f29380073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.640+0000 7f293ffff640 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2938078060 0x7f29380073e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.640+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293000f610 con 0x7f2938078060 2024-05-08T09:23:35.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.640+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.640+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.640+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293000f610 con 0x55cc0efb4310 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.655 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.641+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x7f2938078060 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.642+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.656 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f293002b040 con 0x7f2938078060 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.643+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.657 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.644+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x7f2938078060 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.645+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.658 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.646+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb8d00 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x7f2938078060 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efbd7b0 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293002b040 con 0x7f2938078060 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x55cc0efb4310 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.647+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f293002b040 con 0x55cc0efb4310 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc0340 con 0x7f2938078060 2024-05-08T09:23:35.659 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efbc1d0 con 0x55cc0efb4310 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efbbe10 con 0x55cc0efb4310 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.660 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.648+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efbcb70 con 0x55cc0efb4310 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 zone default found 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 4 Realm: () 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 zonegroup default 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc07e0 con 0x55cc0efb8d00 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.661 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc2ab0 con 0x55cc0efbd7b0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc2e50 con 0x55cc0efbd7b0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 started sync module instance, tier type = 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.649+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1f40 con 0x7f2938078060 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.650+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.650+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94334913094800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1f40 con 0x7f2938078060 2024-05-08T09:23:35.662 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.651+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc38a0 con 0x55cc0efb4310 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.652+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94334913094800] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.652+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.652+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94334913098672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1f40 con 0x55cc0efb4310 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.652+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc42f0 con 0x55cc0efbd7b0 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.653+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94334913098672] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.653+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.653+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94334913092240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1eb0 con 0x55cc0efbd7b0 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.653+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc51b0 con 0x7f2938078060 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.654+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94334913092240] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.654+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.654+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94334913105152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc55d0 con 0x7f2938078060 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.654+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc5f90 con 0x55cc0efb4310 2024-05-08T09:23:35.663 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.655+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94334913105152] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.655+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.655+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94334913106688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc5f90 con 0x55cc0efb4310 2024-05-08T09:23:35.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.655+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc6950 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.656+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94334913106688] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.657+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.657+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94334913108704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc5f00 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.657+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc76d0 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.658+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94334913108704] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.658+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.658+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94334913113328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc7690 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.658+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc80f0 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94334913113328] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94334913117088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc80b0 con 0x55cc0efb8d00 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=0 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=1 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=2 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=3 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=4 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=5 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.659+0000 7f294c729800 20 add_watcher() i=6 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.660+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94334913117088] v29'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.660+0000 7f294c729800 20 add_watcher() i=7 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.660+0000 7f294c729800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.660+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efcb540 con 0x55cc0efb4310 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.660+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.661+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94334913114384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc8a90 con 0x55cc0efb4310 2024-05-08T09:23:35.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94334913114384] v29'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f27fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 5 note: GC not initialized 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f27fd7e2640 20 reqs_thread_entry: start 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 20 Filter name: none 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f276effd640 20 reqs_thread_entry: start 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.662+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0effead0 con 0x55cc0efb8d00 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0effd290 con 0x55cc0efbd7b0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.663+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0effdc50 con 0x55cc0efb8d00 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v29'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f294c729800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f294c729800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f294c729800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94334913336960 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0f002410 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== watch-notify(notify (1) cookie 94334913094800 notify 124554051609 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f2930018040 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f28277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94334913094800 notifier 4834 bl.length()=533 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f28277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f28277fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f28277fe640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f280c003ea0 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(65 notify.0 [notify cookie 94334913336960 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== watch-notify(notify_complete (2) cookie 94334913336960 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f2930009050 con 0x7f2938078060 2024-05-08T09:23:35.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.665+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0effd680 con 0x55cc0efbd7b0 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.666+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v29'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.666+0000 7f294c729800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.666+0000 7f294c729800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.666+0000 7f294c729800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.666+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94334913351504 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55cc0f002830 con 0x55cc0efb4310 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94334913098672 notify 124554051608 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f2930009050 con 0x55cc0efb4310 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f2826ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051608 cookie 94334913098672 notifier 4834 bl.length()=176 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f2826ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f2826ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-05-08T09:23:35.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(68 notify.1 [notify cookie 94334913351504 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f2826ffd640 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f277c003400 con 0x55cc0efb4310 2024-05-08T09:23:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.676 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.667+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94334913351504 notify 124554051608 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55cc0ee83fb0 con 0x55cc0efb4310 2024-05-08T09:23:35.676 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-05-08T09:23:35.664682Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.664669Z","tags":[],"group_ids":[]} 2024-05-08T09:23:35.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.668+0000 7f27fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.668+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94334913114384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efcb170 con 0x55cc0efb4310 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.669+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94334913114384] v29'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.669+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94334913094800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc7110 con 0x7f2938078060 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.670+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94334913094800] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.670+0000 7f294c729800 20 remove_watcher() i=0 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.670+0000 7f294c729800 2 removed watcher, disabling cache 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.670+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94334913098672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc7110 con 0x55cc0efb4310 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.671+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94334913098672] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.671+0000 7f294c729800 20 remove_watcher() i=1 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.671+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94334913092240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc7110 con 0x55cc0efbd7b0 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.672+0000 7f29484be640 1 -- 172.21.15.161:0/2722198360 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94334913092240] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2938086040 con 0x55cc0efbd7b0 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.672+0000 7f294c729800 20 remove_watcher() i=2 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.672+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94334913105152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1a90 con 0x7f2938078060 2024-05-08T09:23:35.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.673+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94334913105152] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x7f2938078060 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.673+0000 7f294c729800 20 remove_watcher() i=3 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.673+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94334913106688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc7110 con 0x55cc0efb4310 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.674+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94334913106688] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f293003d040 con 0x55cc0efb4310 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.674+0000 7f294c729800 20 remove_watcher() i=4 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.674+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94334913108704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc4d00 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.675+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94334913108704] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.675+0000 7f294c729800 20 remove_watcher() i=5 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.675+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94334913113328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc1a90 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.676+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94334913113328] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.676+0000 7f294c729800 20 remove_watcher() i=6 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.676+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94334913117088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55cc0efc5ae0 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.677+0000 7f2948cbf640 1 -- 172.21.15.161:0/2722198360 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94334913117088] v29'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2940033030 con 0x55cc0efb8d00 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.677+0000 7f294c729800 20 remove_watcher() i=7 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0efb8d00 msgr2=0x55cc0efbb0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0efb8d00 0x55cc0efbb0f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0efb4310 msgr2=0x55cc0efb67d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0efb4310 0x55cc0efb67d0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2938078060 msgr2=0x7f29380073e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f2938078060 0x7f29380073e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cc0efbd7b0 msgr2=0x55cc0efbfc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55cc0efbd7b0 0x55cc0efbfc70 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 msgr2=0x7f2818038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2818036900 0x7f2818038dc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2938067fd0 tx=0x7f293808e000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f293ffff640 1 -- 172.21.15.161:0/2722198360 reap_dead start 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 msgr2=0x55cc0efa8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f2940013a10 tx=0x7f294004c880 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 shutdown_connections 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/2722198360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0efa1320 0x55cc0efa8800 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 >> 172.21.15.161:0/2722198360 conn(0x55cc0ef9d5f0 msgr2=0x55cc0ef9ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 shutdown_connections 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/2722198360 wait complete. 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 msgr2=0x7f2820038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 0x7f2820038dc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x55cc0ef804e0 tx=0x7f293808bd60 comp rx=0 tx=0).stop 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 msgr2=0x55cc0ef943d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x55cc0ef79610 tx=0x7f2940018830 comp rx=0 tx=0).stop 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 shutdown_connections 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2820036900 0x7f2820038dc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 --2- 172.21.15.161:0/1451904108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ef93fb0 0x55cc0ef943d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 >> 172.21.15.161:0/1451904108 conn(0x55cc0ef88050 msgr2=0x55cc0ef88450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 shutdown_connections 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.678+0000 7f294c729800 1 -- 172.21.15.161:0/1451904108 wait complete. 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 msgr2=0x55cc0ef84790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 0x55cc0ef84790 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 msgr2=0x55cc0ef7fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 0x55cc0ef7fbc0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 msgr2=0x7f2830038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 0x7f2830038e10 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2930000f60 tx=0x7f2930001370 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 msgr2=0x55cc0ef785f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f2938052540 tx=0x7f2938003020 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 shutdown_connections 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55cc0ef823a0 0x55cc0ef84790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55cc0ef7d7d0 0x55cc0ef7fbc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2830036950 0x7f2830038e10 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 --2- 172.21.15.161:0/724400242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cc0ee804a0 0x55cc0ef785f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 >> 172.21.15.161:0/724400242 conn(0x55cc0ee77540 msgr2=0x55cc0ee7c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.686 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 shutdown_connections 2024-05-08T09:23:35.687 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.679+0000 7f294c729800 1 -- 172.21.15.161:0/724400242 wait complete. 2024-05-08T09:23:35.687 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T09:23:35.664682Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.664669Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.687 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-05-08T09:23:35.664682Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.664669Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.688 ERROR:root:0 2024-05-08T09:23:35.688 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:35.692 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:35.693 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-05-08T09:23:35.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-05-08T09:23:35.693 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-05-08T09:23:35.737 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.737 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.739+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.739+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.739+0000 7fa01652d800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x555f0b9ff140 0x555f0b9ff560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.739+0000 7fa01652d800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555f0b9ffbe0 con 0x555f0ba00350 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.739+0000 7fa01652d800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x555f0b890050 con 0x555f0b9ff140 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.740+0000 7fa01222f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x555f0b9ff140 0x555f0b9ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.740+0000 7fa00bfff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x555f0ba00350 0x555f0ba007d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51110/0 (socket says 172.21.15.161:51110) 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.740+0000 7fa00bfff640 1 -- 172.21.15.161:0/1727350340 learned_addr learned my addr 172.21.15.161:0/1727350340 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.739 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.740+0000 7fa01222f640 1 -- 172.21.15.161:0/1727350340 >> v1:172.21.15.45:6789/0 conn(0x555f0ba00350 legacy=0x555f0ba007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.740 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.740+0000 7fa01222f640 1 -- 172.21.15.161:0/1727350340 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0ba00f10 con 0x555f0b9ff140 2024-05-08T09:23:35.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa01222f640 1 --2- 172.21.15.161:0/1727350340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9ff560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa00401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92ad65e3217c211 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa011a2e640 1 -- 172.21.15.161:0/1727350340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004057070 con 0x555f0b9ff140 2024-05-08T09:23:35.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa011a2e640 1 -- 172.21.15.161:0/1727350340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00404adc0 con 0x555f0b9ff140 2024-05-08T09:23:35.741 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa011a2e640 1 -- 172.21.15.161:0/1727350340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004052590 con 0x555f0b9ff140 2024-05-08T09:23:35.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa01652d800 1 -- 172.21.15.161:0/1727350340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 msgr2=0x555f0b9ff560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.742+0000 7fa01652d800 1 --2- 172.21.15.161:0/1727350340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9ff560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa00401ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.743+0000 7fa01652d800 1 -- 172.21.15.161:0/1727350340 shutdown_connections 2024-05-08T09:23:35.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.743+0000 7fa01652d800 1 --2- 172.21.15.161:0/1727350340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9ff560 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.742 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.743+0000 7fa01652d800 1 -- 172.21.15.161:0/1727350340 >> 172.21.15.161:0/1727350340 conn(0x555f0b9fa780 msgr2=0x555f0b9fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.743+0000 7fa01652d800 1 -- 172.21.15.161:0/1727350340 shutdown_connections 2024-05-08T09:23:35.743 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.743+0000 7fa01652d800 1 -- 172.21.15.161:0/1727350340 wait complete. 2024-05-08T09:23:35.755 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.756+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.756+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.756+0000 7fa01652d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.756 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.756+0000 7fa01652d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0b94a1d0 con 0x555f0b9ff140 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.757+0000 7fa01222f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.757+0000 7fa01222f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57340/0 (socket says 172.21.15.161:57340) 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.757+0000 7fa01222f640 1 -- 172.21.15.161:0/3004227179 learned_addr learned my addr 172.21.15.161:0/3004227179 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.757+0000 7fa01222f640 1 -- 172.21.15.161:0/3004227179 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0baf0da0 con 0x555f0b9ff140 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.757+0000 7fa01222f640 1 --2- 172.21.15.161:0/3004227179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa004055040 tx=0x7fa00404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bea38d0acc926c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7f9f00608640 1 -- 172.21.15.161:0/3004227179 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004057040 con 0x555f0b9ff140 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7f9f00608640 1 -- 172.21.15.161:0/3004227179 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa004063070 con 0x555f0b9ff140 2024-05-08T09:23:35.757 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7f9f00608640 1 -- 172.21.15.161:0/3004227179 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00405d790 con 0x555f0b9ff140 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 -- 172.21.15.161:0/3004227179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 msgr2=0x555f0baf07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 --2- 172.21.15.161:0/3004227179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa004055040 tx=0x7fa00404c000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 -- 172.21.15.161:0/3004227179 shutdown_connections 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 --2- 172.21.15.161:0/3004227179 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0baf07d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 -- 172.21.15.161:0/3004227179 >> 172.21.15.161:0/3004227179 conn(0x555f0b9fa780 msgr2=0x555f0baec0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 -- 172.21.15.161:0/3004227179 shutdown_connections 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.758+0000 7fa01652d800 1 -- 172.21.15.161:0/3004227179 wait complete. 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01652d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01652d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0ba08820 con 0x555f0b9ff140 2024-05-08T09:23:35.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01222f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01222f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57348/0 (socket says 172.21.15.161:57348) 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01222f640 1 -- 172.21.15.161:0/2103068404 learned_addr learned my addr 172.21.15.161:0/2103068404 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.759+0000 7fa01222f640 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0b972ee0 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7fa01222f640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa004002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7f9efee05640 1 -- 172.21.15.161:0/2103068404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004057050 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7f9efee05640 1 -- 172.21.15.161:0/2103068404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00405dc90 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f0b973170 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7f9efee05640 1 -- 172.21.15.161:0/2103068404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa004052440 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.760+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0b9736f0 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7f9efee05640 1 -- 172.21.15.161:0/2103068404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa0040525e0 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7f9efee05640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7f9efee05640 1 -- 172.21.15.161:0/2103068404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa00408dd00 con 0x555f0b9ff140 2024-05-08T09:23:35.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa00bfff640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 0x555f0bb017c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb01d00 con 0x555f0ba00350 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa012a30640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 0x555f0bb017c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa00bfff640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 0x7f9ef8038e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc0012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.761+0000 7fa012a30640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 0x555f0bb017c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa012a30640 1 -- 172.21.15.161:0/2103068404 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa00c00a4a0 con 0x555f0ba00350 2024-05-08T09:23:35.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb02550 con 0x555f0ba00350 2024-05-08T09:23:35.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa012a30640 1 -- 172.21.15.161:0/2103068404 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa00c00a4a0 con 0x555f0ba00350 2024-05-08T09:23:35.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 0x555f0bb06410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb06ba0 con 0x555f0bb03f80 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.762+0000 7fa01222f640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 0x555f0bb06410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.763+0000 7fa01222f640 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 0x555f0bb06410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.763+0000 7fa01222f640 1 -- 172.21.15.161:0/2103068404 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb03f80 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.763+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb02e00 con 0x555f0ba00350 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.763+0000 7fa012a30640 1 -- 172.21.15.161:0/2103068404 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa00c00a4a0 con 0x555f0ba00350 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.763+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb03260 con 0x555f0ba00350 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa012a30640 1 -- 172.21.15.161:0/2103068404 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa00c00a4a0 con 0x555f0ba00350 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa01652d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa01652d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0b974d30 con 0x555f0bb15d10 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.770 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57362/0 (socket says 172.21.15.161:57362) 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.764+0000 7fa012a30640 1 -- 172.21.15.161:0/1007131986 learned_addr learned my addr 172.21.15.161:0/1007131986 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7fa012a30640 1 -- 172.21.15.161:0/1007131986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0bb16670 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7fa012a30640 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x555f0b974150 tx=0x7fa00c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7f9ef7fff640 1 -- 172.21.15.161:0/1007131986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c014450 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7f9ef7fff640 1 -- 172.21.15.161:0/1007131986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c0145f0 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f0bb170e0 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7f9ef7fff640 1 -- 172.21.15.161:0/1007131986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c0148d0 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.765+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0bb175e0 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7f9ef7fff640 1 -- 172.21.15.161:0/1007131986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa00c011040 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7f9ef7fff640 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 0x7f9eec038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7f9ef7fff640 1 -- 172.21.15.161:0/1007131986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa00c01e070 con 0x555f0bb15d10 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7fa01222f640 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 0x7f9eec038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.771 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7fa01222f640 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 0x7f9eec038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x555f0b973ca0 tx=0x7fa00408bf20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.766+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa01652d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa01652d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0b8f0cf0 con 0x555f0bb22ff0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57378/0 (socket says 172.21.15.161:57378) 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa012a30640 1 -- 172.21.15.161:0/2616495099 learned_addr learned my addr 172.21.15.161:0/2616495099 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa012a30640 1 -- 172.21.15.161:0/2616495099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0bb239e0 con 0x555f0bb22ff0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7fa012a30640 1 --2- 172.21.15.161:0/2616495099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04ca10 tx=0x7fa00c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2af9d5da44dadb7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7f9ef5ffb640 1 -- 172.21.15.161:0/2616495099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c0167c0 con 0x555f0bb22ff0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7f9ef5ffb640 1 -- 172.21.15.161:0/2616495099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c013cb0 con 0x555f0bb22ff0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.767+0000 7f9ef5ffb640 1 -- 172.21.15.161:0/2616495099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c016960 con 0x555f0bb22ff0 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- 172.21.15.161:0/2616495099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 msgr2=0x555f0bb23410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.772 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 --2- 172.21.15.161:0/2616495099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04ca10 tx=0x7fa00c011700 comp rx=0 tx=0).stop 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- 172.21.15.161:0/2616495099 shutdown_connections 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 --2- 172.21.15.161:0/2616495099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb23410 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- 172.21.15.161:0/2616495099 >> 172.21.15.161:0/2616495099 conn(0x555f0bb1f350 msgr2=0x555f0bb1d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- 172.21.15.161:0/2616495099 shutdown_connections 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- 172.21.15.161:0/2616495099 wait complete. 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 Processor -- start 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- start start 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.768+0000 7fa01652d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x555f0bb23f70 con 0x555f0bb22ff0 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa012a30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57382/0 (socket says 172.21.15.161:57382) 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 learned_addr learned my addr 172.21.15.161:0/3728612720 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0bb2a990 con 0x555f0bb22ff0 2024-05-08T09:23:35.773 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa012a30640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04c940 tx=0x7fa00c04c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7f9ee3fff640 1 -- 172.21.15.161:0/3728612720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c011c50 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7f9ee3fff640 1 -- 172.21.15.161:0/3728612720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa00c0133b0 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555f0bb2ac20 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7f9ee3fff640 1 -- 172.21.15.161:0/3728612720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa00c013690 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.769+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0bb2d8d0 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.770+0000 7f9ee3fff640 1 -- 172.21.15.161:0/3728612720 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fa00c04e0d0 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.770+0000 7f9ee3fff640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9edc036950 0x7f9edc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.770+0000 7f9ee3fff640 1 -- 172.21.15.161:0/3728612720 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fa00c045030 con 0x555f0bb22ff0 2024-05-08T09:23:35.774 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.770+0000 7fa01222f640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9edc036950 0x7f9edc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa01222f640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9edc036950 0x7f9edc038e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa00408c2b0 tx=0x7fa004087000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0bb360e0 0x555f0bb385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb38cf0 con 0x555f0bb360e0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa00bfff640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0bb360e0 0x555f0bb385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.771+0000 7fa00bfff640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0bb360e0 0x555f0bb385a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc009050 con 0x555f0bb360e0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 realm 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb35530 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc009050 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb397e0 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc009050 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb3a0b0 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9ffc009050 con 0x555f0bb360e0 2024-05-08T09:23:35.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb3a9f0 0x555f0bb3cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.772+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb3d570 con 0x555f0bb3a9f0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa012a30640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb3a9f0 0x555f0bb3cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa012a30640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb3a9f0 0x555f0bb3cde0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa01652d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa01652d800 20 searching for the correct realm 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555f0bb3f540 0x555f0bb41a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.773+0000 7fa01222f640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555f0bb3f540 0x555f0bb41a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.774+0000 7fa01222f640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555f0bb3f540 0x555f0bb41a00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.774+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.774+0000 7fa01222f640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa00409b040 0x7fa004066380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.774+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.774+0000 7fa00bfff640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa00409b040 0x7fa004066380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.775+0000 7fa00bfff640 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa00409b040 0x7fa004066380 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.775+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc009050 con 0x7fa00409b040 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.775+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.775+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.775+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc009050 con 0x555f0bb360e0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.776+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.777+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.778+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.779+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.780+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.781+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb3f540 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x555f0bb360e0 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.782+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb420d0 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb3df30 con 0x555f0bb360e0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb3db70 con 0x555f0bb360e0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.796 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb3e8d0 con 0x555f0bb360e0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 zone default found 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 4 Realm: () 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 zonegroup default 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.783+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb42600 con 0x555f0bb3a9f0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb448d0 con 0x555f0bb3f540 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb44c70 con 0x555f0bb3f540 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 started sync module instance, tier type = 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.784+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb43d60 con 0x7fa00409b040 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.785+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.785+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93866706616960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb43d60 con 0x7fa00409b040 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.785+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb456c0 con 0x555f0bb360e0 2024-05-08T09:23:35.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.786+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93866706616960] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.786+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.786+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93866706620880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb43d60 con 0x555f0bb360e0 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.786+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb46150 con 0x555f0bb3f540 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.787+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.787+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93866706623520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb469f0 con 0x555f0bb3f540 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.787+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb474b0 con 0x7fa00409b040 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.788+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93866706620880] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.788+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93866706623520] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.789+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.789+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93866706625856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb438b0 con 0x7fa00409b040 2024-05-08T09:23:35.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.789+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb47d50 con 0x555f0bb360e0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.790+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.790+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93866706630688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb48140 con 0x555f0bb360e0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.790+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb48c40 con 0x555f0bb3a9f0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.790+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93866706625856] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.791+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93866706630688] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.791+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.791+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93866706631744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb48c00 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.791+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb494e0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.792+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(56 notify.6 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.792+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93866706636768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb498b0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.792+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb498b0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.792+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93866706631744] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93866706636768] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93866706637824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb49cd0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=0 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=1 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=2 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=3 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=4 2024-05-08T09:23:35.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=5 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.793+0000 7fa01652d800 20 add_watcher() i=6 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93866706637824] v29'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa01652d800 20 add_watcher() i=7 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa01652d800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb4cf40 con 0x555f0bb360e0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.794+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93866706639248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb4a260 con 0x555f0bb360e0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.795+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93866706639248] v29'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.795+0000 7f9ec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.796+0000 7fa01652d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.796+0000 7fa01652d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.796+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb55950 con 0x555f0bb360e0 2024-05-08T09:23:35.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.797+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.797+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb55fa0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.798+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.798+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb55fa0 con 0x555f0bb3f540 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.799+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.799+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb55440 con 0x555f0bb360e0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.800+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'246 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.800+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb56b00 con 0x7fa00409b040 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.801+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.801+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57070 con 0x555f0bb3f540 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.802+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'52 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.802+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57070 con 0x555f0bb360e0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.803+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.803+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57310 con 0x555f0bb3a9f0 2024-05-08T09:23:35.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.805+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'51 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.805+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57310 con 0x7fa00409b040 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.806+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.806+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57310 con 0x555f0bb3f540 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.807+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.807+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57310 con 0x7fa00409b040 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.807+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.807+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57310 con 0x555f0bb3a9f0 2024-05-08T09:23:35.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.809+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.809+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57330 con 0x7fa00409b040 2024-05-08T09:23:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.810+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.810+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57330 con 0x555f0bb3a9f0 2024-05-08T09:23:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.811+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.811+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57330 con 0x555f0bb360e0 2024-05-08T09:23:35.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.812+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'247 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.812+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb57330 con 0x555f0bb3f540 2024-05-08T09:23:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.813+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.813+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x7fa00409b040 2024-05-08T09:23:35.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.814+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.814+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.815+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'30 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.815+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb360e0 2024-05-08T09:23:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.816+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.815 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.816+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb360e0 2024-05-08T09:23:35.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.817+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'248 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.816 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.817+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.818+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.817 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.818+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x7fa00409b040 2024-05-08T09:23:35.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.819+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.818 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.819+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.820+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'33 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.820+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.821+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.821+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.822+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.822+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.823+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'53 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.823+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.824+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.824+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.825+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.825+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.826+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'52 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.826+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3f540 2024-05-08T09:23:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.828+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.828+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x555f0bb3a9f0 2024-05-08T09:23:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.829+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.829+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb578f0 con 0x7fa00409b040 2024-05-08T09:23:35.829 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.830+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7f9e437fe640 20 reqs_thread_entry: start 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 20 Filter name: none 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7f9e417fa640 20 reqs_thread_entry: start 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb82580 con 0x555f0bb3a9f0 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 20 rados_obj.operate() r=0 bl.length=349 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.831+0000 7fa01652d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.832+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb82560 con 0x555f0bb3a9f0 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.832+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.832+0000 7fa01652d800 10 removing key index: system_akey 2024-05-08T09:23:35.832 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.832+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb82560 con 0x555f0bb3f540 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(96 system_akey [delete] v29'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01652d800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 93866706876832 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb85370 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== watch-notify(notify (1) cookie 93866706620880 notify 124554051609 ret 0) ==== 203+0+0 (crc 0 0 0) 0x555f0bb56380 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7f9ef5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 93866706620880 notifier 4841 bl.length()=161 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7f9ef5ffb640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9ed8003d60 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(97 notify.1 [notify cookie 93866706876832 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== watch-notify(notify_complete (2) cookie 93866706876832 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f0bb55440 con 0x555f0bb360e0 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01652d800 10 removing email index: 2024-05-08T09:23:35.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01652d800 10 removing user buckets index 2024-05-08T09:23:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.833+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb82e40 con 0x555f0bb3a9f0 2024-05-08T09:23:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.835+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(99 system_user.buckets [delete] v29'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.835+0000 7fa01652d800 10 removing user index: system_user 2024-05-08T09:23:35.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.835+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb84960 con 0x555f0bb3a9f0 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(100 system_user [call,call,delete] v29'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa01652d800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa01652d800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 93866706872640 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb84220 con 0x7fa00409b040 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== watch-notify(notify (1) cookie 93866706616960 notify 124554051610 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555f0bb55440 con 0x7fa00409b040 2024-05-08T09:23:35.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7f9ef57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 93866706616960 notifier 4841 bl.length()=160 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7f9ef57fa640 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9e480032c0 con 0x7fa00409b040 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(101 notify.0 [notify cookie 93866706872640 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== watch-notify(notify_complete (2) cookie 93866706872640 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555f0bb56890 con 0x7fa00409b040 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.836+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.837+0000 7f9ec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.837 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.837+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93866706639248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb533e0 con 0x555f0bb360e0 2024-05-08T09:23:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.838+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93866706639248] v29'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.838+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93866706616960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb533e0 con 0x7fa00409b040 2024-05-08T09:23:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.839+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93866706616960] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.839+0000 7fa01652d800 20 remove_watcher() i=0 2024-05-08T09:23:35.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.839+0000 7fa01652d800 2 removed watcher, disabling cache 2024-05-08T09:23:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.839+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93866706620880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb44280 con 0x555f0bb360e0 2024-05-08T09:23:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.840+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93866706620880] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.840+0000 7fa01652d800 20 remove_watcher() i=1 2024-05-08T09:23:35.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.840+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93866706623520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb44280 con 0x555f0bb3f540 2024-05-08T09:23:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.841+0000 7fa01222f640 1 -- 172.21.15.161:0/3728612720 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93866706623520] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa004078070 con 0x555f0bb3f540 2024-05-08T09:23:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.841+0000 7fa01652d800 20 remove_watcher() i=2 2024-05-08T09:23:35.841 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.841+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93866706625856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb45c20 con 0x7fa00409b040 2024-05-08T09:23:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.843+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93866706625856] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x7fa00409b040 2024-05-08T09:23:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.843+0000 7fa01652d800 20 remove_watcher() i=3 2024-05-08T09:23:35.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.843+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93866706630688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb46540 con 0x555f0bb360e0 2024-05-08T09:23:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.844+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93866706630688] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9ffc029040 con 0x555f0bb360e0 2024-05-08T09:23:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.844+0000 7fa01652d800 20 remove_watcher() i=4 2024-05-08T09:23:35.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.844+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93866706631744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb45c20 con 0x555f0bb3a9f0 2024-05-08T09:23:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.845+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93866706631744] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.845+0000 7fa01652d800 20 remove_watcher() i=5 2024-05-08T09:23:35.844 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.845+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93866706636768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb46540 con 0x555f0bb3a9f0 2024-05-08T09:23:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.846+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93866706636768] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.846+0000 7fa01652d800 20 remove_watcher() i=6 2024-05-08T09:23:35.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.846+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93866706637824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x555f0bb45c20 con 0x555f0bb3a9f0 2024-05-08T09:23:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa012a30640 1 -- 172.21.15.161:0/3728612720 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93866706637824] v29'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa00c02a070 con 0x555f0bb3a9f0 2024-05-08T09:23:35.848 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 20 remove_watcher() i=7 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb3a9f0 msgr2=0x555f0bb3cde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb3a9f0 0x555f0bb3cde0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0bb360e0 msgr2=0x555f0bb385a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0bb360e0 0x555f0bb385a0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa00409b040 msgr2=0x7fa004066380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fa00409b040 0x7fa004066380 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555f0bb3f540 msgr2=0x555f0bb41a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x555f0bb3f540 0x555f0bb41a00 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9edc036950 msgr2=0x7f9edc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9edc036950 0x7f9edc038e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa00408c2b0 tx=0x7fa004087000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa00bfff640 1 -- 172.21.15.161:0/3728612720 reap_dead start 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 msgr2=0x555f0bb2a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.849 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fa00c04c940 tx=0x7fa00c04c970 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 shutdown_connections 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 --2- 172.21.15.161:0/3728612720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb22ff0 0x555f0bb2a450 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 >> 172.21.15.161:0/3728612720 conn(0x555f0bb1f350 msgr2=0x555f0bb1c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 shutdown_connections 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.847+0000 7fa01652d800 1 -- 172.21.15.161:0/3728612720 wait complete. 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 msgr2=0x7f9eec038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 0x7f9eec038dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x555f0b973ca0 tx=0x7fa00408bf20 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 msgr2=0x555f0bb16130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x555f0b974150 tx=0x7fa00c018830 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 shutdown_connections 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9eec036900 0x7f9eec038dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/1007131986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0bb15d10 0x555f0bb16130 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 >> 172.21.15.161:0/1007131986 conn(0x555f0bb09db0 msgr2=0x555f0bb0a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 shutdown_connections 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/1007131986 wait complete. 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 msgr2=0x555f0bb06410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 0x555f0bb06410 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 msgr2=0x555f0bb017c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 0x555f0bb017c0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 msgr2=0x7f9ef8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 0x7f9ef8038e10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000f60 tx=0x7f9ffc0012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 msgr2=0x555f0b9747f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa00400a470 tx=0x7fa004002fb0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 shutdown_connections 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x555f0bb03f80 0x555f0bb06410 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x555f0ba00350 0x555f0bb017c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9ef8036950 0x7f9ef8038e10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 --2- 172.21.15.161:0/2103068404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555f0b9ff140 0x555f0b9747f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 >> 172.21.15.161:0/2103068404 conn(0x555f0b9fa780 msgr2=0x555f0baea8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 shutdown_connections 2024-05-08T09:23:35.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.848+0000 7fa01652d800 1 -- 172.21.15.161:0/2103068404 wait complete. 2024-05-08T09:23:35.856 ERROR:root:None 2024-05-08T09:23:35.856 ERROR:root:0 2024-05-08T09:23:35.856 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T09:23:35.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-05-08T09:23:35.857 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-05-08T09:23:35.909 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:35.909 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe170898800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e74c182850 0x55e74c184c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe170898800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e74c185180 con 0x55e74c17c600 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe170898800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55e74c00d050 con 0x55e74c182850 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe16db9d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55e74c182850 0x55e74c184c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe16e39e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55e74c17c600 0x55e74c17ca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51126/0 (socket says 172.21.15.161:51126) 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.911+0000 7fe16e39e640 1 -- 172.21.15.161:0/20238069 learned_addr learned my addr 172.21.15.161:0/20238069 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.912+0000 7fe16db9d640 1 -- 172.21.15.161:0/20238069 >> v1:172.21.15.45:6789/0 conn(0x55e74c17c600 legacy=0x55e74c17ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.912+0000 7fe16db9d640 1 -- 172.21.15.161:0/20238069 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c186360 con 0x55e74c182850 2024-05-08T09:23:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe16db9d640 1 --2- 172.21.15.161:0/20238069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c182850 0x55e74c184c40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe16400a470 tx=0x7fe16401ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfddc64a72964308 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe16d39c640 1 -- 172.21.15.161:0/20238069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe164057070 con 0x55e74c182850 2024-05-08T09:23:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe16d39c640 1 -- 172.21.15.161:0/20238069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe164052570 con 0x55e74c182850 2024-05-08T09:23:35.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe16d39c640 1 -- 172.21.15.161:0/20238069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe164052870 con 0x55e74c182850 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 -- 172.21.15.161:0/20238069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c182850 msgr2=0x55e74c184c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 --2- 172.21.15.161:0/20238069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c182850 0x55e74c184c40 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fe16400a470 tx=0x7fe16401ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 -- 172.21.15.161:0/20238069 shutdown_connections 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 --2- 172.21.15.161:0/20238069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c182850 0x55e74c184c40 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 -- 172.21.15.161:0/20238069 >> 172.21.15.161:0/20238069 conn(0x55e74c175cd0 msgr2=0x55e74c1780f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 -- 172.21.15.161:0/20238069 shutdown_connections 2024-05-08T09:23:35.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.914+0000 7fe170898800 1 -- 172.21.15.161:0/20238069 wait complete. 2024-05-08T09:23:35.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe170898800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe170898800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e74c0c7170 con 0x55e74c17c600 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe16e39e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe16e39e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57400/0 (socket says 172.21.15.161:57400) 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.929+0000 7fe16e39e640 1 -- 172.21.15.161:0/196059021 learned_addr learned my addr 172.21.15.161:0/196059021 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.930+0000 7fe16e39e640 1 -- 172.21.15.161:0/196059021 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c26fe90 con 0x55e74c17c600 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.930+0000 7fe16e39e640 1 --2- 172.21.15.161:0/196059021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe160001e10 tx=0x7fe16000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ec39bf59d70b83 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.930+0000 7fe05c608640 1 -- 172.21.15.161:0/196059021 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160012020 con 0x55e74c17c600 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.930+0000 7fe05c608640 1 -- 172.21.15.161:0/196059021 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16000e5a0 con 0x55e74c17c600 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.930+0000 7fe05c608640 1 -- 172.21.15.161:0/196059021 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16000e8e0 con 0x55e74c17c600 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- 172.21.15.161:0/196059021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 msgr2=0x55e74c26f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 --2- 172.21.15.161:0/196059021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fe160001e10 tx=0x7fe16000b780 comp rx=0 tx=0).stop 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- 172.21.15.161:0/196059021 shutdown_connections 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 --2- 172.21.15.161:0/196059021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c26f8c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- 172.21.15.161:0/196059021 >> 172.21.15.161:0/196059021 conn(0x55e74c175cd0 msgr2=0x55e74c26b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- 172.21.15.161:0/196059021 shutdown_connections 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- 172.21.15.161:0/196059021 wait complete. 2024-05-08T09:23:35.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe170898800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e74c185650 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe16e39e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe16e39e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57410/0 (socket says 172.21.15.161:57410) 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.931+0000 7fe16e39e640 1 -- 172.21.15.161:0/2000380773 learned_addr learned my addr 172.21.15.161:0/2000380773 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe16e39e640 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c277970 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe16e39e640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b7c0 tx=0x7fe160000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe05ae05640 1 -- 172.21.15.161:0/2000380773 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe160012030 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe05ae05640 1 -- 172.21.15.161:0/2000380773 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe160001470 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e74c277c00 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe05ae05640 1 -- 172.21.15.161:0/2000380773 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16001a8d0 con 0x55e74c17c600 2024-05-08T09:23:35.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.932+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e74c27a8b0 con 0x55e74c17c600 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.933+0000 7fe05ae05640 1 -- 172.21.15.161:0/2000380773 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe160015020 con 0x55e74c17c600 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.933+0000 7fe05ae05640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 0x7fe054038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.933+0000 7fe05ae05640 1 -- 172.21.15.161:0/2000380773 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe160020030 con 0x55e74c17c600 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.933+0000 7fe16db9d640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 0x7fe054038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 0x55e74c27e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c27ebb0 con 0x55e74c182850 2024-05-08T09:23:35.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 0x55e74c27e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe16db9d640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 0x7fe054038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe16400a470 tx=0x7fe16404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 0x55e74c27e670 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe16eb9f640 1 -- 172.21.15.161:0/2000380773 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe16800a4a0 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.934+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c27bc40 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe16eb9f640 1 -- 172.21.15.161:0/2000380773 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe16800a4a0 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 0x55e74c2832f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2839e0 con 0x55e74c280f00 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe16e39e640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 0x55e74c2832f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe16e39e640 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 0x55e74c2832f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe16e39e640 1 -- 172.21.15.161:0/2000380773 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe16002dcf0 con 0x55e74c280f00 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.935+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c27feb0 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.936+0000 7fe16eb9f640 1 -- 172.21.15.161:0/2000380773 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe16800a4a0 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.936+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c280390 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.936+0000 7fe16eb9f640 1 -- 172.21.15.161:0/2000380773 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe16800a4a0 con 0x55e74c182850 2024-05-08T09:23:35.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.936+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.936+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe170898800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe170898800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e74c06dcf0 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57422/0 (socket says 172.21.15.161:57422) 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3736212035 learned_addr learned my addr 172.21.15.161:0/3736212035 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3736212035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c2934f0 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55e74c27efb0 tx=0x7fe168018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe053fff640 1 -- 172.21.15.161:0/3736212035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168014450 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe053fff640 1 -- 172.21.15.161:0/3736212035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe168014610 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e74c293f60 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe053fff640 1 -- 172.21.15.161:0/3736212035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168014930 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.937+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e74c294460 con 0x55e74c292b90 2024-05-08T09:23:35.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.938+0000 7fe053fff640 1 -- 172.21.15.161:0/3736212035 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe168011040 con 0x55e74c292b90 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.938+0000 7fe053fff640 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 0x7fe048038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.938+0000 7fe053fff640 1 -- 172.21.15.161:0/3736212035 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe16801e070 con 0x55e74c292b90 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 0x7fe048038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 0x7fe048038dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55e74c27f050 tx=0x7fe16002df90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe170898800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe170898800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e74c270210 con 0x55e74c29fea0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57426/0 (socket says 172.21.15.161:57426) 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.939+0000 7fe16eb9f640 1 -- 172.21.15.161:0/886071704 learned_addr learned my addr 172.21.15.161:0/886071704 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe16eb9f640 1 -- 172.21.15.161:0/886071704 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c2a0890 con 0x55e74c29fea0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/886071704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe16804c8d0 tx=0x7fe168011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=888e27f837901c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe051ffb640 1 -- 172.21.15.161:0/886071704 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16800dd90 con 0x55e74c29fea0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe051ffb640 1 -- 172.21.15.161:0/886071704 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1680167e0 con 0x55e74c29fea0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe051ffb640 1 -- 172.21.15.161:0/886071704 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168014ad0 con 0x55e74c29fea0 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 -- 172.21.15.161:0/886071704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 msgr2=0x55e74c2a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 --2- 172.21.15.161:0/886071704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fe16804c8d0 tx=0x7fe168011ef0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 -- 172.21.15.161:0/886071704 shutdown_connections 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 --2- 172.21.15.161:0/886071704 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a02c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 -- 172.21.15.161:0/886071704 >> 172.21.15.161:0/886071704 conn(0x55e74c29c170 msgr2=0x55e74c29a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 -- 172.21.15.161:0/886071704 shutdown_connections 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.940+0000 7fe170898800 1 -- 172.21.15.161:0/886071704 wait complete. 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe170898800 1 Processor -- start 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe170898800 1 -- start start 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe170898800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe170898800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55e74c2a1050 con 0x55e74c29fea0 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe16eb9f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57434/0 (socket says 172.21.15.161:57434) 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 learned_addr learned my addr 172.21.15.161:0/3935841227 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.941+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74c2a7890 con 0x55e74c29fea0 2024-05-08T09:23:35.953 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe168013e80 tx=0x7fe16804c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe03ffff640 1 -- 172.21.15.161:0/3935841227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16804b410 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe03ffff640 1 -- 172.21.15.161:0/3935841227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe16803bb20 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e74c2a7b20 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe03ffff640 1 -- 172.21.15.161:0/3935841227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16803bd10 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e74c2aa7d0 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.942+0000 7fe03ffff640 1 -- 172.21.15.161:0/3935841227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe16804e0d0 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe03ffff640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe038036900 0x7fe038038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe03ffff640 1 -- 172.21.15.161:0/3935841227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe16800e040 con 0x55e74c29fea0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe038036900 0x7fe038038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe038036900 0x7fe038038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe160000fd0 tx=0x7fe160037000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c2b2ea0 0x55e74c2b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.943+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2b5ab0 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe16db9d640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c2b2ea0 0x55e74c2b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe16db9d640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c2b2ea0 0x55e74c2b5360 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 20 realm 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2b5e80 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.944+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2b6750 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2b6af0 con 0x55e74c2b2ea0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c2b7850 0x55e74c2b9c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2ba250 con 0x55e74c2b7850 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c2b7850 0x55e74c2b9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.945+0000 7fe16eb9f640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c2b7850 0x55e74c2b9c40 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe170898800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe170898800 20 searching for the correct realm 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e74c2bc200 0x55e74c2be6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e74c2bc200 0x55e74c2be6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e74c2bc200 0x55e74c2be6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.946+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16e39e640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe160059040 0x7fe16004c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16db9d640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe160059040 0x7fe16004c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16db9d640 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe160059040 0x7fe16004c0c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.947+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.948+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.949+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.958 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.950+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.959 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.951+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.952+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.960 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.953+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.972 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.954+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b7850 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2bc200 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.955+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x55e74c2b2ea0 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.973 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bed90 con 0x7fe160059040 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bac10 con 0x55e74c2b2ea0 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.974 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bb4b0 con 0x55e74c2b2ea0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.956+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2ba850 con 0x55e74c2b2ea0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 zone default found 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 4 Realm: () 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 zonegroup default 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.975 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2bf2a0 con 0x55e74c2b7850 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c1570 con 0x55e74c2bc200 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c1910 con 0x55e74c2bc200 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 started sync module instance, tier type = 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.957+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c0a00 con 0x7fe160059040 2024-05-08T09:23:35.976 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.959+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.959+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94451903762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c0a00 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.959+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c2340 con 0x55e74c2b2ea0 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.960+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94451903762176] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.960+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.960+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94451903766672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c0a00 con 0x55e74c2b2ea0 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.960+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c2dd0 con 0x55e74c2bc200 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.961+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.961+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94451903768736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c3670 con 0x55e74c2bc200 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.961+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c4130 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.961+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94451903766672] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.962+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94451903768736] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.962+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.962+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94451903771072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c0550 con 0x7fe160059040 2024-05-08T09:23:35.977 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.962+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c4a10 con 0x55e74c2b2ea0 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.963+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.963+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94451903771072] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.963+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94451903775904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c4e00 con 0x55e74c2b2ea0 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.963+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c3c00 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.964+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94451903775904] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.964+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.964+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94451903776960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c58a0 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.964+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c6260 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.965+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94451903776960] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.966+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.966+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94451903780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c6260 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.966+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c6c20 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94451903780304] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.978 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94451903785296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c6260 con 0x55e74c2b7850 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=0 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=1 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=2 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=3 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=4 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=5 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.967+0000 7fe170898800 20 add_watcher() i=6 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94451903785296] v29'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe170898800 20 add_watcher() i=7 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe170898800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2ca040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.979 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.968+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94451903782784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c74c0 con 0x55e74c2b2ea0 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.969+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94451903782784] v29'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.969+0000 7fe024fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.969+0000 7fe170898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.969+0000 7fe170898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.969+0000 7fe170898800 5 note: GC not initialized 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fdf9f7fe640 20 reqs_thread_entry: start 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 20 Filter name: none 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fdf9d7fa640 20 reqs_thread_entry: start 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.980 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2fd4f0 con 0x55e74c2bc200 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 20 rados->read ofs=0 len=0 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.970+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2fc140 con 0x55e74c2bc200 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T09:23:35.981 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.971+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c300980 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v29'1 uv1 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe170898800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe170898800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe170898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94451904005424 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c301150 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== watch-notify(notify (1) cookie 94451903768736 notify 124554051609 ret 0) ==== 584+0+0 (crc 0 0 0) 0x55e74c2fbd40 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe051ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051609 cookie 94451903768736 notifier 4848 bl.length()=542 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe051ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe051ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe051ffb640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fe034003ea0 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(65 notify.2 [notify cookie 94451904005424 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.982 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== watch-notify(notify_complete (2) cookie 94451904005424 notify 124554051609 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe160033040 con 0x55e74c2bc200 2024-05-08T09:23:35.983 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.972+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2fc530 con 0x55e74c2bc200 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.973+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v29'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.973+0000 7fe170898800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.973+0000 7fe170898800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.973+0000 7fe170898800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.973+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94451904005424 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55e74c301050 con 0x55e74c2b7850 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== watch-notify(notify (1) cookie 94451903776960 notify 124554051622 ret 0) ==== 217+0+0 (crc 0 0 0) 0x55e74c2a7b20 con 0x55e74c2b7850 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe0517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051622 cookie 94451903776960 notifier 4848 bl.length()=175 2024-05-08T09:23:35.984 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe0517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe0517fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe0517fa640 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fdfa4003400 con 0x55e74c2b7850 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(68 notify.5 [notify cookie 94451904005424 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.974+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== watch-notify(notify_complete (2) cookie 94451904005424 notify 124554051622 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55e74c2a7890 con 0x55e74c2b7850 2024-05-08T09:23:35.985 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-05-08T09:23:35.971917Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.971894Z","tags":[],"group_ids":[]} 2024-05-08T09:23:35.990 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.975+0000 7fe024fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.975+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94451903782784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2ac870 con 0x55e74c2b2ea0 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.976+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94451903782784] v29'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.976+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94451903762176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c5f50 con 0x7fe160059040 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.977+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94451903762176] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.977+0000 7fe170898800 20 remove_watcher() i=0 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.977+0000 7fe170898800 2 removed watcher, disabling cache 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.977+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94451903766672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c0f00 con 0x55e74c2b2ea0 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.978+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94451903766672] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.978+0000 7fe170898800 20 remove_watcher() i=1 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.978+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94451903768736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c2070 con 0x55e74c2bc200 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.979+0000 7fe16e39e640 1 -- 172.21.15.161:0/3935841227 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94451903768736] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16000d3d0 con 0x55e74c2bc200 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.979+0000 7fe170898800 20 remove_watcher() i=2 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.979+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94451903771072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c28a0 con 0x7fe160059040 2024-05-08T09:23:35.991 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.980+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94451903771072] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x7fe160059040 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.980+0000 7fe170898800 20 remove_watcher() i=3 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.980+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94451903775904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c28a0 con 0x55e74c2b2ea0 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.982+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94451903775904] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16405a040 con 0x55e74c2b2ea0 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.982+0000 7fe170898800 20 remove_watcher() i=4 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.982+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94451903776960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c44a0 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.983+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94451903776960] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.983+0000 7fe170898800 20 remove_watcher() i=5 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.983+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94451903780304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c28a0 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.984+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94451903780304] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.984+0000 7fe170898800 20 remove_watcher() i=6 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.984+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94451903785296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55e74c2c55d0 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe16eb9f640 1 -- 172.21.15.161:0/3935841227 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94451903785296] v29'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe16802a070 con 0x55e74c2b7850 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 20 remove_watcher() i=7 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c2b7850 msgr2=0x55e74c2b9c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c2b7850 0x55e74c2b9c40 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.992 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c2b2ea0 msgr2=0x55e74c2b5360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c2b2ea0 0x55e74c2b5360 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe160059040 msgr2=0x7fe16004c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fe160059040 0x7fe16004c0c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e74c2bc200 msgr2=0x55e74c2be6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55e74c2bc200 0x55e74c2be6c0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe038036900 msgr2=0x7fe038038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe038036900 0x7fe038038dc0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe160000fd0 tx=0x7fe160037000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 msgr2=0x55e74c2a7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fe168013e80 tx=0x7fe16804c860 comp rx=0 tx=0).stop 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe16db9d640 1 -- 172.21.15.161:0/3935841227 reap_dead start 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 shutdown_connections 2024-05-08T09:23:35.993 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 --2- 172.21.15.161:0/3935841227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c29fea0 0x55e74c2a7350 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 >> 172.21.15.161:0/3935841227 conn(0x55e74c29c170 msgr2=0x55e74c2997d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.985+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 shutdown_connections 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3935841227 wait complete. 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 msgr2=0x7fe048038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 0x7fe048038dc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x55e74c27f050 tx=0x7fe16002df90 comp rx=0 tx=0).stop 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 msgr2=0x55e74c292fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x55e74c27efb0 tx=0x7fe168018830 comp rx=0 tx=0).stop 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 shutdown_connections 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe048036900 0x7fe048038dc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/3736212035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c292b90 0x55e74c292fb0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 >> 172.21.15.161:0/3736212035 conn(0x55e74c286c30 msgr2=0x55e74c287030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 shutdown_connections 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/3736212035 wait complete. 2024-05-08T09:23:35.994 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 msgr2=0x55e74c2832f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 0x55e74c2832f0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 msgr2=0x55e74c27e670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 0x55e74c27e670 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 msgr2=0x7fe054038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 0x7fe054038e10 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe16400a470 tx=0x7fe16404e000 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 msgr2=0x55e74c277430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b7c0 tx=0x7fe160000ed0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 shutdown_connections 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55e74c280f00 0x55e74c2832f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55e74c182850 0x55e74c27e670 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe054036950 0x7fe054038e10 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 --2- 172.21.15.161:0/2000380773 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e74c17c600 0x55e74c277430 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 >> 172.21.15.161:0/2000380773 conn(0x55e74c175cd0 msgr2=0x55e74c269a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:35.995 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 shutdown_connections 2024-05-08T09:23:35.996 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:35.986+0000 7fe170898800 1 -- 172.21.15.161:0/2000380773 wait complete. 2024-05-08T09:23:35.996 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T09:23:35.971917Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.971894Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.997 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-05-08T09:23:35.971917Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.971894Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:35.997 ERROR:root:0 2024-05-08T09:23:35.997 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:36.002 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:36.002 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-05-08T09:23:36.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-05-08T09:23:36.002 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-05-08T09:23:36.046 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.046 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d23929800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5578310bc570 0x5578310be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d23929800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578310bf020 con 0x5578310b97c0 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d23929800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x557830f49050 con 0x5578310bc570 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d17fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5578310bc570 0x5578310be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d1f571640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5578310b97c0 0x5578310b9be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51142/0 (socket says 172.21.15.161:51142) 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.048+0000 7f6d1f571640 1 -- 172.21.15.161:0/3076183102 learned_addr learned my addr 172.21.15.161:0/3076183102 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.049+0000 7f6d17fff640 1 -- 172.21.15.161:0/3076183102 >> v1:172.21.15.45:6789/0 conn(0x5578310b97c0 legacy=0x5578310b9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.049+0000 7f6d17fff640 1 -- 172.21.15.161:0/3076183102 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578310c0250 con 0x5578310bc570 2024-05-08T09:23:36.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.050+0000 7f6d17fff640 1 --2- 172.21.15.161:0/3076183102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310bc570 0x5578310be9a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800a470 tx=0x7f6d0801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ebfec9439ad70a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d1ed70640 1 -- 172.21.15.161:0/3076183102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d08057070 con 0x5578310bc570 2024-05-08T09:23:36.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d1ed70640 1 -- 172.21.15.161:0/3076183102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d08052570 con 0x5578310bc570 2024-05-08T09:23:36.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d1ed70640 1 -- 172.21.15.161:0/3076183102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d08052870 con 0x5578310bc570 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 -- 172.21.15.161:0/3076183102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310bc570 msgr2=0x5578310be9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 --2- 172.21.15.161:0/3076183102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310bc570 0x5578310be9a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f6d0800a470 tx=0x7f6d0801ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 -- 172.21.15.161:0/3076183102 shutdown_connections 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 --2- 172.21.15.161:0/3076183102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310bc570 0x5578310be9a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 -- 172.21.15.161:0/3076183102 >> 172.21.15.161:0/3076183102 conn(0x5578310b36a0 msgr2=0x5578310b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 -- 172.21.15.161:0/3076183102 shutdown_connections 2024-05-08T09:23:36.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.051+0000 7f6d23929800 1 -- 172.21.15.161:0/3076183102 wait complete. 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.065+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.065+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.065+0000 7f6d23929800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d23929800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5578310031d0 con 0x5578310b97c0 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d1f571640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d1f571640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57438/0 (socket says 172.21.15.161:57438) 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d1f571640 1 -- 172.21.15.161:0/3925474711 learned_addr learned my addr 172.21.15.161:0/3925474711 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d1f571640 1 -- 172.21.15.161:0/3925474711 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783102b520 con 0x5578310b97c0 2024-05-08T09:23:36.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.066+0000 7f6d1f571640 1 --2- 172.21.15.161:0/3925474711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001d80 tx=0x7f6d10001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bf3acda25f9a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6c0d60a640 1 -- 172.21.15.161:0/3925474711 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10013030 con 0x5578310b97c0 2024-05-08T09:23:36.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6c0d60a640 1 -- 172.21.15.161:0/3925474711 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1000e470 con 0x5578310b97c0 2024-05-08T09:23:36.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6c0d60a640 1 -- 172.21.15.161:0/3925474711 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1000e810 con 0x5578310b97c0 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 -- 172.21.15.161:0/3925474711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 msgr2=0x55783102cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 --2- 172.21.15.161:0/3925474711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001d80 tx=0x7f6d10001e70 comp rx=0 tx=0).stop 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 -- 172.21.15.161:0/3925474711 shutdown_connections 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 --2- 172.21.15.161:0/3925474711 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x55783102cf60 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 -- 172.21.15.161:0/3925474711 >> 172.21.15.161:0/3925474711 conn(0x5578310b36a0 msgr2=0x5578311a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 -- 172.21.15.161:0/3925474711 shutdown_connections 2024-05-08T09:23:36.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.067+0000 7f6d23929800 1 -- 172.21.15.161:0/3925474711 wait complete. 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d23929800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d23929800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5578310bf4f0 con 0x5578310b97c0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d1f571640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d1f571640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57452/0 (socket says 172.21.15.161:57452) 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d1f571640 1 -- 172.21.15.161:0/3235815435 learned_addr learned my addr 172.21.15.161:0/3235815435 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d1f571640 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578311b3940 con 0x5578310b97c0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.068+0000 7f6d1f571640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6d10004000 tx=0x7f6d10000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6c0be07640 1 -- 172.21.15.161:0/3235815435 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10027070 con 0x5578310b97c0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6c0be07640 1 -- 172.21.15.161:0/3235815435 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10001400 con 0x5578310b97c0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578311b3bd0 con 0x5578310b97c0 2024-05-08T09:23:36.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6c0be07640 1 -- 172.21.15.161:0/3235815435 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d10019a70 con 0x5578310b97c0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578311b6880 con 0x5578310b97c0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.069+0000 7f6c0be07640 1 -- 172.21.15.161:0/3235815435 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d1002a070 con 0x5578310b97c0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6c0be07640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 0x7f6c04038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6c0be07640 1 -- 172.21.15.161:0/3235815435 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d1001f070 con 0x5578310b97c0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d17fff640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 0x7f6c04038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 0x5578311ba640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311bab80 con 0x5578310bc570 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 0x5578311ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d17fff640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 0x7f6c04038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d08054000 tx=0x7f6d0804e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 0x5578311ba640 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.070+0000 7f6d1fd72640 1 -- 172.21.15.161:0/3235815435 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d1800a4a0 con 0x5578310bc570 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311b7c10 con 0x5578310bc570 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d1fd72640 1 -- 172.21.15.161:0/3235815435 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d1800a4a0 con 0x5578310bc570 2024-05-08T09:23:36.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 0x5578311bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311bf9b0 con 0x5578311bced0 2024-05-08T09:23:36.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d1f571640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 0x5578311bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.071+0000 7f6d1f571640 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 0x5578311bf2c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.072+0000 7f6d1f571640 1 -- 172.21.15.161:0/3235815435 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6d10029030 con 0x5578311bced0 2024-05-08T09:23:36.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.072+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311bbe80 con 0x5578310bc570 2024-05-08T09:23:36.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.072+0000 7f6d1fd72640 1 -- 172.21.15.161:0/3235815435 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d1800a4a0 con 0x5578310bc570 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.072+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311bc360 con 0x5578310bc570 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d1fd72640 1 -- 172.21.15.161:0/3235815435 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6d1800a4a0 con 0x5578310bc570 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d23929800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d23929800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x557830fa9cf0 con 0x5578311ceb60 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57458/0 (socket says 172.21.15.161:57458) 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.073+0000 7f6d1fd72640 1 -- 172.21.15.161:0/2180078273 learned_addr learned my addr 172.21.15.161:0/2180078273 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6d1fd72640 1 -- 172.21.15.161:0/2180078273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578311cf4c0 con 0x5578311ceb60 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x5578311baf80 tx=0x7f6d18018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6c09602640 1 -- 172.21.15.161:0/2180078273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18014450 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6c09602640 1 -- 172.21.15.161:0/2180078273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18014610 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578311cff30 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6c09602640 1 -- 172.21.15.161:0/2180078273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18014930 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.074+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578311d0430 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6c09602640 1 -- 172.21.15.161:0/2180078273 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d18011040 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6c09602640 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 0x7f6bf8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6c09602640 1 -- 172.21.15.161:0/2180078273 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d1801e070 con 0x5578311ceb60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6d1f571640 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 0x7f6bf8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6d1f571640 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 0x7f6bf8038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5578311bb020 tx=0x7f6d1000c3e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.075+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d23929800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d23929800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55783102b8a0 con 0x5578311dbd60 2024-05-08T09:23:36.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57460/0 (socket says 172.21.15.161:57460) 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d1fd72640 1 -- 172.21.15.161:0/2892498726 learned_addr learned my addr 172.21.15.161:0/2892498726 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d1fd72640 1 -- 172.21.15.161:0/2892498726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578311dc750 con 0x5578311dbd60 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/2892498726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6d1804c890 tx=0x7f6d18014ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aef93156185e897 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6c02ffd640 1 -- 172.21.15.161:0/2892498726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18028070 con 0x5578311dbd60 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6c02ffd640 1 -- 172.21.15.161:0/2892498726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d180167c0 con 0x5578311dbd60 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.076+0000 7f6c02ffd640 1 -- 172.21.15.161:0/2892498726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18013ca0 con 0x5578311dbd60 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- 172.21.15.161:0/2892498726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 msgr2=0x5578311dc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 --2- 172.21.15.161:0/2892498726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6d1804c890 tx=0x7f6d18014ea0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- 172.21.15.161:0/2892498726 shutdown_connections 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 --2- 172.21.15.161:0/2892498726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311dc180 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- 172.21.15.161:0/2892498726 >> 172.21.15.161:0/2892498726 conn(0x5578311d8110 msgr2=0x5578311d6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- 172.21.15.161:0/2892498726 shutdown_connections 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- 172.21.15.161:0/2892498726 wait complete. 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 Processor -- start 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- start start 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d23929800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5578311dceb0 con 0x5578311dbd60 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.077+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d1fd72640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57474/0 (socket says 172.21.15.161:57474) 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 learned_addr learned my addr 172.21.15.161:0/1017635169 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578311e38b0 con 0x5578311dbd60 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6d18014ee0 tx=0x7f6d1804c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6c017fa640 1 -- 172.21.15.161:0/1017635169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d18033070 con 0x5578311dbd60 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6c017fa640 1 -- 172.21.15.161:0/1017635169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1804e2e0 con 0x5578311dbd60 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578311e3b40 con 0x5578311dbd60 2024-05-08T09:23:36.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6c017fa640 1 -- 172.21.15.161:0/1017635169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d1803bae0 con 0x5578311dbd60 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.078+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578311e67f0 con 0x5578311dbd60 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.079+0000 7f6c017fa640 1 -- 172.21.15.161:0/1017635169 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6d1803bca0 con 0x5578311dbd60 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.079+0000 7f6c017fa640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6be8036950 0x7f6be8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.079+0000 7f6c017fa640 1 -- 172.21.15.161:0/1017635169 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6d1800e040 con 0x5578311dbd60 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.079+0000 7f6d1f571640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6be8036950 0x7f6be8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d1f571640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6be8036950 0x7f6be8038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000bba0 tx=0x7f6d10035000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578311ef040 0x5578311f1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f1c50 con 0x5578311ef040 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d17fff640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578311ef040 0x5578311f1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.080+0000 7f6d17fff640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578311ef040 0x5578311f1500 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.093 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 realm 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f2020 con 0x5578311ef040 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f28f0 con 0x5578311ef040 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f2c90 con 0x5578311ef040 2024-05-08T09:23:36.094 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311f39f0 0x5578311f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.081+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f63a0 con 0x5578311f39f0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311f39f0 0x5578311f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d1fd72640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311f39f0 0x5578311f5de0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d23929800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d23929800 20 searching for the correct realm 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5578311f8370 0x5578311fa830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.082+0000 7f6d1f571640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5578311f8370 0x5578311fa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.095 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.083+0000 7f6d1f571640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5578311f8370 0x5578311fa830 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.083+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.083+0000 7f6d1f571640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d1002c060 0x7f6d1002a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.083+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.083+0000 7f6d17fff640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d1002c060 0x7f6d1002a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d1002c060 0x7f6d1002a360 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.084+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.096 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.085+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.097 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.086+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.087+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.098 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.088+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.089+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.099 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.100 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f39f0 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.090+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311f8370 2024-05-08T09:23:36.108 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x5578311ef040 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5578311faf00 con 0x7f6d1002c060 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.091+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f6d60 con 0x5578311ef040 2024-05-08T09:23:36.109 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f7600 con 0x5578311ef040 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311f69a0 con 0x5578311ef040 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 zone default found 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 4 Realm: () 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.110 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 zonegroup default 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.092+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311fb430 con 0x5578311f39f0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311fd700 con 0x5578311f8370 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5578311fdaa0 con 0x5578311f8370 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.111 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 started sync module instance, tier type = 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.093+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fcb90 con 0x7f6d1002c060 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.094+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.094+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93974708605120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fcb90 con 0x7f6d1002c060 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.094+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fe4b0 con 0x5578311ef040 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.095+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93974708605120] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.095+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.096+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93974708609504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fcb90 con 0x5578311ef040 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.096+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fef00 con 0x5578311f8370 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.096+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93974708609504] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.097+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.097+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93974708602592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fcb00 con 0x5578311f8370 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.097+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311ffce0 con 0x7f6d1002c060 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.098+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93974708602592] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.112 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.098+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.098+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93974708613920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311ffca0 con 0x7f6d1002c060 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.098+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831200760 con 0x5578311ef040 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.099+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.099+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93974708613920] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.099+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93974708617792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831200760 con 0x5578311ef040 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.099+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831201170 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.100+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93974708617792] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.100+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.100+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93974708620480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831201510 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.100+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831201f10 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.101+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(56 notify.6 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.101+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93974708623904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831201ec0 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.101+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831202ee0 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.101+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93974708620480] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.113 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v29'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93974708623904] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93974708627888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311ff740 con 0x5578311f39f0 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=0 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=1 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=2 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=3 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=4 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=5 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.102+0000 7f6d23929800 20 add_watcher() i=6 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.103+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93974708627888] v29'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.103+0000 7f6d23929800 20 add_watcher() i=7 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.103+0000 7f6d23929800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.103+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x557831205ed0 con 0x5578311ef040 2024-05-08T09:23:36.114 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.104+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.104+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93974708626224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831203350 con 0x5578311ef040 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.105+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93974708626224] v29'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.105+0000 7f6bd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.105+0000 7f6d23929800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.105+0000 7f6d23929800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.105+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120e6f0 con 0x5578311ef040 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.106+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.106+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120edc0 con 0x5578311f39f0 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.107+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.107+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120edc0 con 0x5578311f8370 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.108+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.115 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.108+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120f270 con 0x5578311ef040 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.109+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'253 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.109+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120c5a0 con 0x7f6d1002c060 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.110+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.110+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120c5a0 con 0x5578311f8370 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.111+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'54 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.111+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120c5a0 con 0x5578311ef040 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.112+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.113+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120fdd0 con 0x5578311f39f0 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.114+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'53 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.114+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120fdd0 con 0x7f6d1002c060 2024-05-08T09:23:36.118 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.115+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.115+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120fdd0 con 0x5578311f8370 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.116+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.116+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120fdd0 con 0x7f6d1002c060 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.117+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.117+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120fdd0 con 0x5578311f39f0 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.118+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'36 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.118+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120ffa0 con 0x7f6d1002c060 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.119+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.119 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.119+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120ffa0 con 0x5578311f39f0 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.120+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.120+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783120ffa0 con 0x5578311ef040 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.121+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'254 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.121+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.122+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.122 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.122+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x7f6d1002c060 2024-05-08T09:23:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.123+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.123+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.124+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'31 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.123 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.124+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311ef040 2024-05-08T09:23:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.125+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.124 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.125+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311ef040 2024-05-08T09:23:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.126+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'255 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.125 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.126+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.127+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.126 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.127+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x7f6d1002c060 2024-05-08T09:23:36.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.128+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.127 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.128+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.129+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'34 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.128 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.129+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.130+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.129 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.130+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.131+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.130 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.131+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.132+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'55 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.131 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.132+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f39f0 2024-05-08T09:23:36.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.133+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.132 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.133+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.134+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.133 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.134+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f39f0 2024-05-08T09:23:36.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.135+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'54 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.134 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.135+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f8370 2024-05-08T09:23:36.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.136+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.135 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.136+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x5578311f39f0 2024-05-08T09:23:36.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.137+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.138+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x557831210550 con 0x7f6d1002c060 2024-05-08T09:23:36.137 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.138+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6bd4fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6d23929800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6d23929800 20 Filter name: none 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6b4e7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6d23929800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-05-08T09:23:36.139 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6d23929800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.139+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55783123b1b0 con 0x5578311f8370 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 20 rados_obj.operate() r=0 bl.length=363 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55783123dae0 con 0x5578311f8370 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 10 removing key index: true_admin_akey 2024-05-08T09:23:36.140 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.140+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123bac0 con 0x5578311f8370 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(96 true_admin_akey [delete] v29'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d23929800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 93974708864464 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55783123e030 con 0x5578311f39f0 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== watch-notify(notify (1) cookie 93974708620480 notify 124554051623 ret 0) ==== 207+0+0 (crc 0 0 0) 0x55783120cbb0 con 0x5578311f39f0 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6c02ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051623 cookie 93974708620480 notifier 4855 bl.length()=165 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(97 notify.5 [notify cookie 93974708864464 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6c02ffd640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6be4003d60 con 0x5578311f39f0 2024-05-08T09:23:36.142 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== watch-notify(notify_complete (2) cookie 93974708864464 notify 124554051623 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5578311e3b40 con 0x5578311f39f0 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d23929800 10 removing email index: 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d23929800 10 removing user buckets index 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.141+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123df10 con 0x5578311f8370 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.142+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(99 a_user.buckets [delete] v29'1 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.142+0000 7f6d23929800 10 removing user index: a_user 2024-05-08T09:23:36.143 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.142+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123df10 con 0x5578311f8370 2024-05-08T09:23:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.143+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(100 a_user [call,call,delete] v29'2 uv2 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.143+0000 7f6d23929800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-05-08T09:23:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.143+0000 7f6d23929800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-05-08T09:23:36.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.143+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 93974708869728 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55783123c5d0 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== watch-notify(notify (1) cookie 93974708602592 notify 124554051610 ret 0) ==== 197+0+0 (crc 0 0 0) 0x557831210090 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6c027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 93974708602592 notifier 4855 bl.length()=155 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(101 notify.2 [notify cookie 93974708869728 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6c027fc640 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f6b540032c0 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.144+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== watch-notify(notify_complete (2) cookie 93974708869728 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6d10052040 con 0x5578311f8370 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.145+0000 7f6bd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.145+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93974708626224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x5578311ef040 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.146+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 93974708626224] v29'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.146+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93974708605120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x7f6d1002c060 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.147+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 93974708605120] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.147+0000 7f6d23929800 20 remove_watcher() i=0 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.147+0000 7f6d23929800 2 removed watcher, disabling cache 2024-05-08T09:23:36.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.147+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93974708609504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x5578311ef040 2024-05-08T09:23:36.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.148+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 93974708609504] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.148+0000 7f6d23929800 20 remove_watcher() i=1 2024-05-08T09:23:36.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.148+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93974708602592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x5578311f8370 2024-05-08T09:23:36.148 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.149+0000 7f6d1f571640 1 -- 172.21.15.161:0/1017635169 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 93974708602592] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d10029030 con 0x5578311f8370 2024-05-08T09:23:36.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.149+0000 7f6d23929800 20 remove_watcher() i=2 2024-05-08T09:23:36.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.149+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93974708613920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x7f6d1002c060 2024-05-08T09:23:36.149 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.150+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 93974708613920] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x7f6d1002c060 2024-05-08T09:23:36.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.150+0000 7f6d23929800 20 remove_watcher() i=3 2024-05-08T09:23:36.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.150+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93974708617792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x5578311ef040 2024-05-08T09:23:36.150 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.151+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 93974708617792] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d0805a040 con 0x5578311ef040 2024-05-08T09:23:36.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.151+0000 7f6d23929800 20 remove_watcher() i=4 2024-05-08T09:23:36.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.151+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93974708620480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55783123d680 con 0x5578311f39f0 2024-05-08T09:23:36.151 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.152+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 93974708620480] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.152+0000 7f6d23929800 20 remove_watcher() i=5 2024-05-08T09:23:36.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.152+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93974708623904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311fc6e0 con 0x5578311f39f0 2024-05-08T09:23:36.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.153+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 93974708623904] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.152 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.153+0000 7f6d23929800 20 remove_watcher() i=6 2024-05-08T09:23:36.153 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.153+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93974708627888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5578311ff320 con 0x5578311f39f0 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d1fd72640 1 -- 172.21.15.161:0/1017635169 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 93974708627888] v29'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6d1802a070 con 0x5578311f39f0 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 20 remove_watcher() i=7 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311f39f0 msgr2=0x5578311f5de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311f39f0 0x5578311f5de0 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578311ef040 msgr2=0x5578311f1500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578311ef040 0x5578311f1500 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.156 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d1002c060 msgr2=0x7f6d1002a360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6d1002c060 0x7f6d1002a360 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5578311f8370 msgr2=0x5578311fa830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.154+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5578311f8370 0x5578311fa830 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6be8036950 msgr2=0x7f6be8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6be8036950 0x7f6be8038e10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000bba0 tx=0x7f6d10035000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 msgr2=0x5578311e3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d17fff640 1 -- 172.21.15.161:0/1017635169 reap_dead start 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f6d18014ee0 tx=0x7f6d1804c820 comp rx=0 tx=0).stop 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 shutdown_connections 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/1017635169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311dbd60 0x5578311e3370 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 >> 172.21.15.161:0/1017635169 conn(0x5578311d8110 msgr2=0x5578311dd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 shutdown_connections 2024-05-08T09:23:36.157 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/1017635169 wait complete. 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 msgr2=0x7f6bf8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 0x7f6bf8038e10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5578311bb020 tx=0x7f6d1000c3e0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 msgr2=0x5578311cef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x5578311baf80 tx=0x7f6d18018830 comp rx=0 tx=0).stop 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 shutdown_connections 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6bf8036950 0x7f6bf8038e10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/2180078273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578311ceb60 0x5578311cef80 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 >> 172.21.15.161:0/2180078273 conn(0x5578311c2c00 msgr2=0x5578311c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 shutdown_connections 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/2180078273 wait complete. 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 msgr2=0x5578311bf2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 0x5578311bf2c0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.158 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 msgr2=0x5578311ba640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.155+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 0x5578311ba640 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 msgr2=0x7f6c04038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 0x7f6c04038e10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6d08054000 tx=0x7f6d0804e000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 msgr2=0x5578311b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f6d10004000 tx=0x7f6d10000bc0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 shutdown_connections 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5578311bced0 0x5578311bf2c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5578310bc570 0x5578311ba640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6c04036950 0x7f6c04038e10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 --2- 172.21.15.161:0/3235815435 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5578310b97c0 0x5578311b3400 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 >> 172.21.15.161:0/3235815435 conn(0x5578310b36a0 msgr2=0x55783102be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 shutdown_connections 2024-05-08T09:23:36.159 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.156+0000 7f6d23929800 1 -- 172.21.15.161:0/3235815435 wait complete. 2024-05-08T09:23:36.163 ERROR:root:None 2024-05-08T09:23:36.163 ERROR:root:0 2024-05-08T09:23:36.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T09:23:36.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-05-08T09:23:36.164 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-05-08T09:23:36.209 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.210 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.211+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.211+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.211+0000 7f5d4351f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55929e686470 0x55929e688860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d4351f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55929e688e30 con 0x55929e681fe0 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d4351f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55929e514050 con 0x55929e686470 2024-05-08T09:23:36.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3e9e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55929e686470 0x55929e688860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3e9e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55929e686470 0x55929e688860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57476/0 (socket says 172.21.15.161:57476) 2024-05-08T09:23:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/1440158530 learned_addr learned my addr 172.21.15.161:0/1440158530 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3f1e7640 1 --1- 172.21.15.161:0/1440158530 >> v1:172.21.15.45:6789/0 conn(0x55929e681fe0 0x55929e682400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51148/0 (socket says 172.21.15.161:51148) 2024-05-08T09:23:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/1440158530 >> v1:172.21.15.45:6789/0 conn(0x55929e681fe0 legacy=0x55929e682400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.212+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/1440158530 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e68a060 con 0x55929e686470 2024-05-08T09:23:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.214+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/1440158530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e686470 0x55929e688860 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400a520 tx=0x7f5d3401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0c3630a744d4aa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.214+0000 7f5d3e1e5640 1 -- 172.21.15.161:0/1440158530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d34057070 con 0x55929e686470 2024-05-08T09:23:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.214+0000 7f5d3e1e5640 1 -- 172.21.15.161:0/1440158530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d34052570 con 0x55929e686470 2024-05-08T09:23:36.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.214+0000 7f5d3e1e5640 1 -- 172.21.15.161:0/1440158530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3404ae60 con 0x55929e686470 2024-05-08T09:23:36.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 -- 172.21.15.161:0/1440158530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e686470 msgr2=0x55929e688860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1440158530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e686470 0x55929e688860 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400a520 tx=0x7f5d3401d010 comp rx=0 tx=0).stop 2024-05-08T09:23:36.214 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 -- 172.21.15.161:0/1440158530 shutdown_connections 2024-05-08T09:23:36.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1440158530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e686470 0x55929e688860 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 -- 172.21.15.161:0/1440158530 >> 172.21.15.161:0/1440158530 conn(0x55929e67d5c0 msgr2=0x55929e67f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 -- 172.21.15.161:0/1440158530 shutdown_connections 2024-05-08T09:23:36.215 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.215+0000 7f5d4351f800 1 -- 172.21.15.161:0/1440158530 wait complete. 2024-05-08T09:23:36.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.228+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d4351f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.228 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d4351f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55929e5ce1c0 con 0x55929e681fe0 2024-05-08T09:23:36.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d3f1e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d3f1e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57486/0 (socket says 172.21.15.161:57486) 2024-05-08T09:23:36.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/1717631387 learned_addr learned my addr 172.21.15.161:0/1717631387 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/1717631387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e7774a0 con 0x55929e681fe0 2024-05-08T09:23:36.229 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.229+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/1717631387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5d30001650 tx=0x7f5d30001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b595440fdf4ca7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5c2d60a640 1 -- 172.21.15.161:0/1717631387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30013420 con 0x55929e681fe0 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5c2d60a640 1 -- 172.21.15.161:0/1717631387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d300135c0 con 0x55929e681fe0 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5c2d60a640 1 -- 172.21.15.161:0/1717631387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d300138c0 con 0x55929e681fe0 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 -- 172.21.15.161:0/1717631387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 msgr2=0x55929e5f5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1717631387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5d30001650 tx=0x7f5d30001b10 comp rx=0 tx=0).stop 2024-05-08T09:23:36.231 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 -- 172.21.15.161:0/1717631387 shutdown_connections 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1717631387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e5f5e50 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 -- 172.21.15.161:0/1717631387 >> 172.21.15.161:0/1717631387 conn(0x55929e67d5c0 msgr2=0x55929e76ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 -- 172.21.15.161:0/1717631387 shutdown_connections 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.230+0000 7f5d4351f800 1 -- 172.21.15.161:0/1717631387 wait complete. 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d4351f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d4351f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55929e689300 con 0x55929e681fe0 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d3f1e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d3f1e7640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57490/0 (socket says 172.21.15.161:57490) 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/686380528 learned_addr learned my addr 172.21.15.161:0/686380528 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.231+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e77c8c0 con 0x55929e681fe0 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55929e5f5480 tx=0x7f5d30001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.232 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5c2be07640 1 -- 172.21.15.161:0/686380528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30022020 con 0x55929e681fe0 2024-05-08T09:23:36.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5c2be07640 1 -- 172.21.15.161:0/686380528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d30006830 con 0x55929e681fe0 2024-05-08T09:23:36.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55929e77cb50 con 0x55929e681fe0 2024-05-08T09:23:36.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5c2be07640 1 -- 172.21.15.161:0/686380528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d30004b30 con 0x55929e681fe0 2024-05-08T09:23:36.233 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.232+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929e77f7b0 con 0x55929e681fe0 2024-05-08T09:23:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5c2be07640 1 -- 172.21.15.161:0/686380528 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d30025020 con 0x55929e681fe0 2024-05-08T09:23:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5c2be07640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 0x7f5c24038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5c2be07640 1 -- 172.21.15.161:0/686380528 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5d30018030 con 0x55929e681fe0 2024-05-08T09:23:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 0x7f5c24038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.238 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 0x55929e783570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e783b00 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 0x55929e783570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 0x7f5c24038e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d34054000 tx=0x7f5d3404e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.233+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 0x55929e783570 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/686380528 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d380083e0 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e780b20 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/686380528 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d380083e0 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 0x55929e788200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7888f0 con 0x55929e785e10 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.234+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 0x55929e788200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.235+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 0x55929e788200 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.235+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/686380528 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e785e10 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.235+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e784dc0 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.235+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/686380528 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d380083e0 con 0x55929e686470 2024-05-08T09:23:36.239 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.235+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e785260 con 0x55929e686470 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/686380528 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d380083e0 con 0x55929e686470 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d4351f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d4351f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55929e574cf0 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57498/0 (socket says 172.21.15.161:57498) 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.236+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2689147108 learned_addr learned my addr 172.21.15.161:0/2689147108 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2689147108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e798380 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55929e77d200 tx=0x7f5d3800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5c29602640 1 -- 172.21.15.161:0/2689147108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d38007d00 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5c29602640 1 -- 172.21.15.161:0/2689147108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3801e020 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5c29602640 1 -- 172.21.15.161:0/2689147108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d38019420 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55929e798df0 con 0x55929e797a20 2024-05-08T09:23:36.240 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.237+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929e7992f0 con 0x55929e797a20 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5c29602640 1 -- 172.21.15.161:0/2689147108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d38016040 con 0x55929e797a20 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5c29602640 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 0x7f5c18038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5c29602640 1 -- 172.21.15.161:0/2689147108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5d3801f030 con 0x55929e797a20 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 0x7f5c18038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 0x7f5c18038e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55929e783f80 tx=0x7f5d300263b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d4351f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.238+0000 7f5d4351f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55929e7777f0 con 0x55929e774a80 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57500/0 (socket says 172.21.15.161:57500) 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/1510466664 learned_addr learned my addr 172.21.15.161:0/1510466664 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/1510466664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e773280 con 0x55929e774a80 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/1510466664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5d38022470 tx=0x7f5d38017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a2b96d51edee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.241 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5c22ffd640 1 -- 172.21.15.161:0/1510466664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3801d040 con 0x55929e774a80 2024-05-08T09:23:36.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5c22ffd640 1 -- 172.21.15.161:0/1510466664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d3803f030 con 0x55929e774a80 2024-05-08T09:23:36.242 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.239+0000 7f5c22ffd640 1 -- 172.21.15.161:0/1510466664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d38015d00 con 0x55929e774a80 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- 172.21.15.161:0/1510466664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 msgr2=0x55929e774ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1510466664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f5d38022470 tx=0x7f5d38017fa0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- 172.21.15.161:0/1510466664 shutdown_connections 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 --2- 172.21.15.161:0/1510466664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e774ea0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- 172.21.15.161:0/1510466664 >> 172.21.15.161:0/1510466664 conn(0x55929e7a0fc0 msgr2=0x55929e79f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- 172.21.15.161:0/1510466664 shutdown_connections 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- 172.21.15.161:0/1510466664 wait complete. 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 Processor -- start 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- start start 2024-05-08T09:23:36.253 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d4351f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55929e773750 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d3f9e8640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57502/0 (socket says 172.21.15.161:57502) 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.240+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 learned_addr learned my addr 172.21.15.161:0/2206195308 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55929e7ae9a0 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5d38022f90 tx=0x7f5d3804cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5c217fa640 1 -- 172.21.15.161:0/2206195308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d3801d040 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5c217fa640 1 -- 172.21.15.161:0/2206195308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d38023410 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55929e7aec30 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5c217fa640 1 -- 172.21.15.161:0/2206195308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d38019b20 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.241+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55929e7b18e0 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.242+0000 7f5c217fa640 1 -- 172.21.15.161:0/2206195308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5d380153e0 con 0x55929e774a80 2024-05-08T09:23:36.254 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.242+0000 7f5c217fa640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c08036950 0x7f5c08038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.242+0000 7f5c217fa640 1 -- 172.21.15.161:0/2206195308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5d3800c0b0 con 0x55929e774a80 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.242+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c08036950 0x7f5c08038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.242+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c08036950 0x7f5c08038e10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5d30002060 tx=0x7f5d30033000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e7b9f60 0x55929e7bc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7bcb70 con 0x55929e7b9f60 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e7b9f60 0x55929e7bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e7b9f60 0x55929e7bc420 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 20 realm 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.255 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7bcf40 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.243+0000 7f5d4351f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7bd810 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7bdbb0 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e7be910 0x55929e7c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.256 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7be910 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.244+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e7be910 0x55929e7c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d3f9e8640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e7be910 0x55929e7c0d00 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d4351f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d4351f800 20 searching for the correct realm 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55929e7c32e0 0x55929e7c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c5e70 con 0x55929e7c32e0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.245+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55929e7c32e0 0x55929e7c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55929e7c32e0 0x55929e7c57a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3f1e7640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5d30027020 0x7f5d300265d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c5e70 con 0x7f5d30027020 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5d30027020 0x7f5d300265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.257 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.246+0000 7f5d3e9e6640 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5d30027020 0x7f5d300265d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c5e70 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7b9f60 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7b9f60 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.247+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x7f5d30027020 2024-05-08T09:23:36.258 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.248+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1310 con 0x55929e7c32e0 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7be910 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x7f5d30027020 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.249+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.259 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7be910 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.250+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.251+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7be910 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.260 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x7f5d30027020 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.252+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7be910 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7be910 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.253+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x7f5d30027020 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7c32e0 2024-05-08T09:23:36.261 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.262 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x7f5d30027020 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x55929e7b9f60 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.254+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f5d30058040 con 0x7f5d30027020 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.271 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1bd0 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c1fc0 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c23e0 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.272 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 zone default found 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 4 Realm: () 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 zonegroup default 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.255+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c62f0 con 0x55929e7be910 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c8070 con 0x55929e7c32e0 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.273 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c8500 con 0x55929e7c32e0 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 started sync module instance, tier type = 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.256+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c7510 con 0x7f5d30027020 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.257+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.257+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088212544016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c7510 con 0x7f5d30027020 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.257+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9010 con 0x55929e7b9f60 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.259+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088212544016] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.274 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.259+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.259+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088212548352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c7510 con 0x55929e7b9f60 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.259+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9aa0 con 0x55929e7c32e0 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.260+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.260+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088212551024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7ca340 con 0x55929e7c32e0 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.260+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cade0 con 0x7f5d30027020 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.260+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088212548352] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.261+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.261+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088212551024] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.261+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088212555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cb1d0 con 0x7f5d30027020 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.261+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9e90 con 0x55929e7b9f60 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.262+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088212555952] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.262+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.275 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.262+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088212541536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9e90 con 0x55929e7b9f60 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.262+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cc040 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.263+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088212541536] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.263+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.263+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088212559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cbfb0 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.263+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cca40 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.264+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088212559584] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.264+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.264+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088212563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7ccc40 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.264+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd4d0 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088212563216] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088212560640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd6b0 con 0x55929e7be910 2024-05-08T09:23:36.276 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=0 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=1 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=2 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=3 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=4 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=5 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.265+0000 7f5d4351f800 20 add_watcher() i=6 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.266+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088212560640] v29'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.266+0000 7f5d4351f800 20 add_watcher() i=7 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.266+0000 7f5d4351f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.266+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e7d0a80 con 0x55929e7b9f60 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.267+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.267+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088212567456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cde70 con 0x55929e7b9f60 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.267+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088212567456] v29'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.277 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 5 note: GC not initialized 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5bf4fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 20 Filter name: none 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5b6e7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.268+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e803e90 con 0x55929e7be910 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.278 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d4351f800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d4351f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d4351f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d4351f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.269+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e80a160 con 0x55929e7be910 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.270+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.270+0000 7f5d4351f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.270+0000 7f5d4351f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.270+0000 7f5d4351f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.270+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94088212814800 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55929e8059b0 con 0x55929e7b9f60 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94088212541536 notify 124554051610 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55929e68a060 con 0x55929e7b9f60 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5c22ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051610 cookie 94088212541536 notifier 4862 bl.length()=666 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5c22ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5c22ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.279 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94088212814800 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5c22ffd640 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f5c04003ea0 con 0x55929e7b9f60 2024-05-08T09:23:36.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.280 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.271+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94088212814800 notify 124554051610 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5d3405dc30 con 0x55929e7b9f60 2024-05-08T09:23:36.280 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.272+0000 7f5bf5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.272+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088212567456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e809010 con 0x55929e7b9f60 2024-05-08T09:23:36.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.273+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94088212567456] v29'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.285 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.273+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088212544016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd5a0 con 0x7f5d30027020 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.274+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94088212544016] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.274+0000 7f5d4351f800 20 remove_watcher() i=0 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.274+0000 7f5d4351f800 2 removed watcher, disabling cache 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.274+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088212548352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd5a0 con 0x55929e7b9f60 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.275+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94088212548352] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.275+0000 7f5d4351f800 20 remove_watcher() i=1 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.275+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088212551024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd5a0 con 0x55929e7c32e0 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.276+0000 7f5d3f1e7640 1 -- 172.21.15.161:0/2206195308 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94088212551024] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3001b070 con 0x55929e7c32e0 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.276+0000 7f5d4351f800 20 remove_watcher() i=2 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.276+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088212555952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9570 con 0x7f5d30027020 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.277+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94088212555952] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x7f5d30027020 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.277+0000 7f5d4351f800 20 remove_watcher() i=3 2024-05-08T09:23:36.286 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.277+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088212541536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd5a0 con 0x55929e7b9f60 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.278+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94088212541536] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3405a040 con 0x55929e7b9f60 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.278+0000 7f5d4351f800 20 remove_watcher() i=4 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.278+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088212559584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7c9570 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.279+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94088212559584] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.279+0000 7f5d4351f800 20 remove_watcher() i=5 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.279+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088212563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cd5a0 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.280+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94088212563216] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.280+0000 7f5d4351f800 20 remove_watcher() i=6 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.280+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088212560640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55929e7cb6e0 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d3f9e8640 1 -- 172.21.15.161:0/2206195308 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94088212560640] v29'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d3802a070 con 0x55929e7be910 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 20 remove_watcher() i=7 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e7be910 msgr2=0x55929e7c0d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.287 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e7be910 0x55929e7c0d00 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e7b9f60 msgr2=0x55929e7bc420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e7b9f60 0x55929e7bc420 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5d30027020 msgr2=0x7f5d300265d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f5d30027020 0x7f5d300265d0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55929e7c32e0 msgr2=0x55929e7c57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55929e7c32e0 0x55929e7c57a0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c08036950 msgr2=0x7f5c08038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.281+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c08036950 0x7f5c08038e10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5d30002060 tx=0x7f5d30033000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.288 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 msgr2=0x55929e7ae460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d3e9e6640 1 -- 172.21.15.161:0/2206195308 reap_dead start 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5d38022f90 tx=0x7f5d3804cb30 comp rx=0 tx=0).stop 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 shutdown_connections 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2206195308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e774a80 0x55929e7ae460 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 >> 172.21.15.161:0/2206195308 conn(0x55929e7a0fc0 msgr2=0x55929e79e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 shutdown_connections 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2206195308 wait complete. 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 msgr2=0x7f5c18038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 0x7f5c18038e10 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55929e783f80 tx=0x7f5d300263b0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 msgr2=0x55929e797e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55929e77d200 tx=0x7f5d3800aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 shutdown_connections 2024-05-08T09:23:36.289 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c18036950 0x7f5c18038e10 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/2689147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e797a20 0x55929e797e40 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 >> 172.21.15.161:0/2689147108 conn(0x55929e78bac0 msgr2=0x55929e78bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 shutdown_connections 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/2689147108 wait complete. 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 msgr2=0x55929e788200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 0x55929e788200 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 msgr2=0x55929e783570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 0x55929e783570 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 msgr2=0x7f5c24038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 0x7f5c24038e10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5d34054000 tx=0x7f5d3404e000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 msgr2=0x55929e77c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.290 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x55929e5f5480 tx=0x7f5d30001250 comp rx=0 tx=0).stop 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.282+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 shutdown_connections 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55929e785e10 0x55929e788200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55929e686470 0x55929e783570 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5c24036950 0x7f5c24038e10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 --2- 172.21.15.161:0/686380528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55929e681fe0 0x55929e77c380 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 >> 172.21.15.161:0/686380528 conn(0x55929e67d5c0 msgr2=0x55929e76d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 shutdown_connections 2024-05-08T09:23:36.291 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.283+0000 7f5d4351f800 1 -- 172.21.15.161:0/686380528 wait complete. 2024-05-08T09:23:36.292 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.292 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.292 ERROR:root:0 2024-05-08T09:23:36.292 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:36.297 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:36.297 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T09:23:36.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-05-08T09:23:36.298 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-05-08T09:23:36.343 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.344 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.345+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.345+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.344 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.345+0000 7f10a0210800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56419414e550 0x564194157050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.345+0000 7f10a0210800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5641940c1910 con 0x56419414ca10 2024-05-08T09:23:36.345 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.345+0000 7f10a0210800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x564193fdf050 con 0x56419414e550 2024-05-08T09:23:36.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.346+0000 7f109b1b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56419414e550 0x564194157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.346+0000 7f109b1b8640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56419414e550 0x564194157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57514/0 (socket says 172.21.15.161:57514) 2024-05-08T09:23:36.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.346+0000 7f109b1b8640 1 -- 172.21.15.161:0/964900659 learned_addr learned my addr 172.21.15.161:0/964900659 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.346+0000 7f109b1b8640 1 -- 172.21.15.161:0/964900659 >> v1:172.21.15.45:6789/0 conn(0x56419414ca10 legacy=0x56419414ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.346 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.346+0000 7f109b1b8640 1 -- 172.21.15.161:0/964900659 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641940c1ae0 con 0x56419414e550 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f109b1b8640 1 --2- 172.21.15.161:0/964900659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414e550 0x564194157050 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f109000a520 tx=0x7f109001d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ac8d1fbc1af0be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f109a9b7640 1 -- 172.21.15.161:0/964900659 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1090057070 con 0x56419414e550 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f109a9b7640 1 -- 172.21.15.161:0/964900659 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1090052570 con 0x56419414e550 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f109a9b7640 1 -- 172.21.15.161:0/964900659 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109004ae60 con 0x56419414e550 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f10a0210800 1 -- 172.21.15.161:0/964900659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414e550 msgr2=0x564194157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.348+0000 7f10a0210800 1 --2- 172.21.15.161:0/964900659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414e550 0x564194157050 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f109000a520 tx=0x7f109001d010 comp rx=0 tx=0).stop 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.349+0000 7f10a0210800 1 -- 172.21.15.161:0/964900659 shutdown_connections 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.349+0000 7f10a0210800 1 --2- 172.21.15.161:0/964900659 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414e550 0x564194157050 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.349+0000 7f10a0210800 1 -- 172.21.15.161:0/964900659 >> 172.21.15.161:0/964900659 conn(0x5641941485b0 msgr2=0x56419414a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.348 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.349+0000 7f10a0210800 1 -- 172.21.15.161:0/964900659 shutdown_connections 2024-05-08T09:23:36.349 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.349+0000 7f10a0210800 1 -- 172.21.15.161:0/964900659 wait complete. 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.363+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.363+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.363+0000 7f10a0210800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.363+0000 7f10a0210800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5641940991c0 con 0x56419414ca10 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.363+0000 7f109b9b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.363 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f109b9b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57522/0 (socket says 172.21.15.161:57522) 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f109b9b9640 1 -- 172.21.15.161:0/1709961688 learned_addr learned my addr 172.21.15.161:0/1709961688 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f109b9b9640 1 -- 172.21.15.161:0/1709961688 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564194241f20 con 0x56419414ca10 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f109b9b9640 1 --2- 172.21.15.161:0/1709961688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f108c0015f0 tx=0x7f108c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70bd35bd695a37c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f0f89e0b640 1 -- 172.21.15.161:0/1709961688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c017070 con 0x56419414ca10 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f0f89e0b640 1 -- 172.21.15.161:0/1709961688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c00f640 con 0x56419414ca10 2024-05-08T09:23:36.364 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.364+0000 7f0f89e0b640 1 -- 172.21.15.161:0/1709961688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c00f980 con 0x56419414ca10 2024-05-08T09:23:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- 172.21.15.161:0/1709961688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 msgr2=0x564194241950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 --2- 172.21.15.161:0/1709961688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f108c0015f0 tx=0x7f108c001ab0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- 172.21.15.161:0/1709961688 shutdown_connections 2024-05-08T09:23:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 --2- 172.21.15.161:0/1709961688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194241950 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.367 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- 172.21.15.161:0/1709961688 >> 172.21.15.161:0/1709961688 conn(0x5641941485b0 msgr2=0x56419423d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- 172.21.15.161:0/1709961688 shutdown_connections 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- 172.21.15.161:0/1709961688 wait complete. 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.365+0000 7f10a0210800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564194157860 con 0x56419414ca10 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f109b9b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f109b9b9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57534/0 (socket says 172.21.15.161:57534) 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f109b9b9640 1 -- 172.21.15.161:0/3446498812 learned_addr learned my addr 172.21.15.161:0/3446498812 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f109b9b9640 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564194249aa0 con 0x56419414ca10 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f109b9b9640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f80 tx=0x7f108c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f0f83fff640 1 -- 172.21.15.161:0/3446498812 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c017040 con 0x56419414ca10 2024-05-08T09:23:36.368 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f0f83fff640 1 -- 172.21.15.161:0/3446498812 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f108c006160 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f0f83fff640 1 -- 172.21.15.161:0/3446498812 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f108c0128f0 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564194249d30 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.366+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419424c990 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.367+0000 7f0f83fff640 1 -- 172.21.15.161:0/3446498812 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f108c012a90 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.367+0000 7f0f83fff640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 0x7f0f84038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.367+0000 7f0f83fff640 1 -- 172.21.15.161:0/3446498812 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f108c04c6b0 con 0x56419414ca10 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.367+0000 7f109b1b8640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 0x7f0f84038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 0x564194250750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194250ce0 con 0x56419414e550 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f109c1ba640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 0x564194250750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f109b1b8640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 0x7f0f84038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1090054000 tx=0x7f109004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f109c1ba640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 0x564194250750 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.369 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f109c1ba640 1 -- 172.21.15.161:0/3446498812 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f10940083e0 con 0x56419414e550 2024-05-08T09:23:36.370 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.368+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419424dd00 con 0x56419414e550 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f109c1ba640 1 -- 172.21.15.161:0/3446498812 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f10940083e0 con 0x56419414e550 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 0x5641942553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194255ad0 con 0x564194252ff0 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f109b9b9640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 0x5641942553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f109b9b9640 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 0x5641942553e0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f109b9b9640 1 -- 172.21.15.161:0/3446498812 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f108c024020 con 0x564194252ff0 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.369+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194251fa0 con 0x56419414e550 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.370+0000 7f109c1ba640 1 -- 172.21.15.161:0/3446498812 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f10940083e0 con 0x56419414e550 2024-05-08T09:23:36.381 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.370+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194252440 con 0x56419414e550 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.370+0000 7f109c1ba640 1 -- 172.21.15.161:0/3446498812 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f10940083e0 con 0x56419414e550 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.370+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f10a0210800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f10a0210800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56419403fcf0 con 0x564194264c70 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57542/0 (socket says 172.21.15.161:57542) 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f109c1ba640 1 -- 172.21.15.161:0/2328285691 learned_addr learned my addr 172.21.15.161:0/2328285691 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f109c1ba640 1 -- 172.21.15.161:0/2328285691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641942655d0 con 0x564194264c70 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f109c1ba640 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56419424a3e0 tx=0x7f109400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f0f81ffb640 1 -- 172.21.15.161:0/2328285691 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094007d00 con 0x564194264c70 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f0f81ffb640 1 -- 172.21.15.161:0/2328285691 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109401e020 con 0x564194264c70 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564194266040 con 0x564194264c70 2024-05-08T09:23:36.382 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.371+0000 7f0f81ffb640 1 -- 172.21.15.161:0/2328285691 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094019420 con 0x564194264c70 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.372+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564194266540 con 0x564194264c70 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.372+0000 7f0f81ffb640 1 -- 172.21.15.161:0/2328285691 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f1094016040 con 0x564194264c70 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.372+0000 7f0f81ffb640 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 0x7f0f74038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.372+0000 7f0f81ffb640 1 -- 172.21.15.161:0/2328285691 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f109401f030 con 0x564194264c70 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 0x7f0f74038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 0x7f0f74038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564194251160 tx=0x7f108c001ab0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f10a0210800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f10a0210800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5641942422a0 con 0x564194271e90 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57546/0 (socket says 172.21.15.161:57546) 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.373+0000 7f109c1ba640 1 -- 172.21.15.161:0/3499626949 learned_addr learned my addr 172.21.15.161:0/3499626949 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.383 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f109c1ba640 1 -- 172.21.15.161:0/3499626949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564194272880 con 0x564194271e90 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f109c1ba640 1 --2- 172.21.15.161:0/3499626949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1094022470 tx=0x7f1094017fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667ea33a6e23cfca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f0f7affd640 1 -- 172.21.15.161:0/3499626949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109401d040 con 0x564194271e90 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f0f7affd640 1 -- 172.21.15.161:0/3499626949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f109403f030 con 0x564194271e90 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f0f7affd640 1 -- 172.21.15.161:0/3499626949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094015d00 con 0x564194271e90 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 -- 172.21.15.161:0/3499626949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 msgr2=0x5641942722b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 --2- 172.21.15.161:0/3499626949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f1094022470 tx=0x7f1094017fa0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 -- 172.21.15.161:0/3499626949 shutdown_connections 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 --2- 172.21.15.161:0/3499626949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942722b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 -- 172.21.15.161:0/3499626949 >> 172.21.15.161:0/3499626949 conn(0x56419426e1f0 msgr2=0x56419426c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 -- 172.21.15.161:0/3499626949 shutdown_connections 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.374+0000 7f10a0210800 1 -- 172.21.15.161:0/3499626949 wait complete. 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f10a0210800 1 Processor -- start 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f10a0210800 1 -- start start 2024-05-08T09:23:36.384 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f10a0210800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f10a0210800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x564194272ff0 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f109c1ba640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57556/0 (socket says 172.21.15.161:57556) 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 learned_addr learned my addr 172.21.15.161:0/2779492921 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641942799e0 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.375+0000 7f109c1ba640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1094017fe0 tx=0x7f109404cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f0f797fa640 1 -- 172.21.15.161:0/2779492921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f109401d040 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f0f797fa640 1 -- 172.21.15.161:0/2779492921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1094023410 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564194279c70 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f0f797fa640 1 -- 172.21.15.161:0/2779492921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1094019b20 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56419427c920 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.376+0000 7f0f797fa640 1 -- 172.21.15.161:0/2779492921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f10940153e0 con 0x564194271e90 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f0f797fa640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f64036950 0x7f0f64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.385 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f0f797fa640 1 -- 172.21.15.161:0/2779492921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f109400c0b0 con 0x564194271e90 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f64036950 0x7f0f64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f64036950 0x7f0f64038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f108c04c010 tx=0x7f108c033040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564194284f30 0x5641942873f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194287b40 con 0x564194284f30 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.377+0000 7f109b1b8640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564194284f30 0x5641942873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f109b1b8640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564194284f30 0x5641942873f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 realm 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194287f10 con 0x564194284f30 2024-05-08T09:23:36.386 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5641942887e0 con 0x564194284f30 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.378+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194288b80 con 0x564194284f30 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f10a0210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5641942898e0 0x56419428bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.387 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f109c1ba640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5641942898e0 0x56419428bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.379+0000 7f109c1ba640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5641942898e0 0x56419428bcd0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f10a0210800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f10a0210800 20 searching for the correct realm 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56419428e2b0 0x564194290770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564194290e40 con 0x56419428e2b0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56419428e2b0 0x564194290770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56419428e2b0 0x564194290770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109b9b9640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f108c0490e0 0x7f108c04c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.380+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564194290e40 con 0x7f108c0490e0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109b1b8640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f108c0490e0 0x7f108c04c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.388 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109b1b8640 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f108c0490e0 0x7f108c04c950 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x564194290e40 con 0x5641942898e0 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.381+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.389 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.402 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.382+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.383+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.403 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.384+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.404 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.385+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.386+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x5641942898e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.387+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x56419428e2b0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x564194284f30 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.406 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.388+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56419428c2e0 con 0x7f108c0490e0 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419428cba0 con 0x564194284f30 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419428cf90 con 0x564194284f30 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.407 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419428d3b0 con 0x564194284f30 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 zone default found 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 4 Realm: () 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 zonegroup default 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.389+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5641942912c0 con 0x5641942898e0 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.408 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x564194293070 con 0x56419428e2b0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.390+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5641942934b0 con 0x56419428e2b0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.391+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.391+0000 7f10a0210800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.391+0000 7f10a0210800 20 started sync module instance, tier type = 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.391+0000 7f10a0210800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.391+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942924e0 con 0x7f108c0490e0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.392+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.409 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.392+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94839658588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942924e0 con 0x7f108c0490e0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.392+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194293fc0 con 0x564194284f30 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.393+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94839658588640] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.393+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.393+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94839658592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942924e0 con 0x564194284f30 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.393+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194294a70 con 0x56419428e2b0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.394+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.394+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94839658595664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194295310 con 0x56419428e2b0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.394+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194295db0 con 0x7f108c0490e0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.394+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94839658592944] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.395+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94839658595664] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.395+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.410 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.395+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94839658597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194292030 con 0x7f108c0490e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.395+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194296690 con 0x564194284f30 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.396+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.396+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94839658602784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194296a80 con 0x564194284f30 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.396+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942975a0 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.396+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94839658597984] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.397+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.397+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94839658606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194297560 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.397+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194297fd0 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.397+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94839658602784] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.398+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94839658606704] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.398+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.398+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94839658600576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194297fd0 con 0x5641942898e0 2024-05-08T09:23:36.411 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.398+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194298440 con 0x5641942898e0 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94839658600576] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94839658603840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194298400 con 0x5641942898e0 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=0 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=1 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=2 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=3 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=4 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=5 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.399+0000 7f10a0210800 20 add_watcher() i=6 2024-05-08T09:23:36.412 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94839658603840] v29'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f10a0210800 20 add_watcher() i=7 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f10a0210800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56419429b8f0 con 0x564194284f30 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.400+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94839658609408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194298da0 con 0x564194284f30 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.401+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94839658609408] v29'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f0f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 5 note: GC not initialized 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f0f50fe1640 20 reqs_thread_entry: start 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.413 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 20 Filter name: none 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f0eca7fc640 20 reqs_thread_entry: start 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.402+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5641942cee20 con 0x5641942898e0 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f10a0210800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f10a0210800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f10a0210800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f10a0210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.414 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.403+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942d5240 con 0x5641942898e0 2024-05-08T09:23:36.415 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.404+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.404+0000 7f10a0210800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.404+0000 7f10a0210800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.404+0000 7f10a0210800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.404+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94839658859696 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5641942d3dd0 con 0x564194284f30 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94839658602784 notify 124554051611 ret 0) ==== 708+0+0 (crc 0 0 0) 0x5641940c1ae0 con 0x564194284f30 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f0f7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051611 cookie 94839658602784 notifier 4869 bl.length()=666 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94839658859696 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f0f7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f0f7affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f0f7affd640 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0f60003ea0 con 0x564194284f30 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.416 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.405+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94839658859696 notify 124554051611 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f109005dc50 con 0x564194284f30 2024-05-08T09:23:36.417 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.406+0000 7f0f51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.406+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94839658609408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942d4190 con 0x564194284f30 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.407+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94839658609408] v29'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.407+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94839658588640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942d3ce0 con 0x7f108c0490e0 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.408+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94839658588640] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.408+0000 7f10a0210800 20 remove_watcher() i=0 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.408+0000 7f10a0210800 2 removed watcher, disabling cache 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.408+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94839658592944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942929e0 con 0x564194284f30 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.409+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94839658592944] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.409+0000 7f10a0210800 20 remove_watcher() i=1 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.409+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94839658595664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5641942929e0 con 0x56419428e2b0 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.410+0000 7f109b9b9640 1 -- 172.21.15.161:0/2779492921 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94839658595664] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f108c053040 con 0x56419428e2b0 2024-05-08T09:23:36.422 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.410+0000 7f10a0210800 20 remove_watcher() i=2 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.410+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94839658597984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194293ab0 con 0x7f108c0490e0 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.411+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94839658597984] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x7f108c0490e0 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.411+0000 7f10a0210800 20 remove_watcher() i=3 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.411+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94839658602784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194293ab0 con 0x564194284f30 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.412+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94839658602784] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109005a040 con 0x564194284f30 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.412+0000 7f10a0210800 20 remove_watcher() i=4 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.412+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94839658606704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194296120 con 0x5641942898e0 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.413+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94839658606704] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.413+0000 7f10a0210800 20 remove_watcher() i=5 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.413+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94839658600576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194293ab0 con 0x5641942898e0 2024-05-08T09:23:36.423 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.414+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94839658600576] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.414+0000 7f10a0210800 20 remove_watcher() i=6 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.414+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94839658603840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x564194297070 con 0x5641942898e0 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f109c1ba640 1 -- 172.21.15.161:0/2779492921 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94839658603840] v29'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f109402a070 con 0x5641942898e0 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 20 remove_watcher() i=7 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5641942898e0 msgr2=0x56419428bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5641942898e0 0x56419428bcd0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564194284f30 msgr2=0x5641942873f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x564194284f30 0x5641942873f0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f108c0490e0 msgr2=0x7f108c04c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f108c0490e0 0x7f108c04c950 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56419428e2b0 msgr2=0x564194290770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56419428e2b0 0x564194290770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f64036950 msgr2=0x7f0f64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f64036950 0x7f0f64038e10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f108c04c010 tx=0x7f108c033040 comp rx=0 tx=0).stop 2024-05-08T09:23:36.424 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 msgr2=0x5641942794a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f109b1b8640 1 -- 172.21.15.161:0/2779492921 reap_dead start 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.415+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1094017fe0 tx=0x7f109404cb30 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 shutdown_connections 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/2779492921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194271e90 0x5641942794a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 >> 172.21.15.161:0/2779492921 conn(0x56419426e1f0 msgr2=0x56419426b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 shutdown_connections 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2779492921 wait complete. 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 msgr2=0x7f0f74038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 0x7f0f74038e10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x564194251160 tx=0x7f108c001ab0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 msgr2=0x564194265090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x56419424a3e0 tx=0x7f109400aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 shutdown_connections 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f74036950 0x7f0f74038e10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/2328285691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564194264c70 0x564194265090 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 >> 172.21.15.161:0/2328285691 conn(0x564194258d10 msgr2=0x564194259110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.425 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 shutdown_connections 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/2328285691 wait complete. 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 msgr2=0x5641942553e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 0x5641942553e0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 msgr2=0x564194250750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 0x564194250750 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 msgr2=0x7f0f84038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.416+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 0x7f0f84038e10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1090054000 tx=0x7f109004e000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 msgr2=0x564194249560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f108c000f80 tx=0x7f108c001250 comp rx=0 tx=0).stop 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 shutdown_connections 2024-05-08T09:23:36.426 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x564194252ff0 0x5641942553e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56419414e550 0x564194250750 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0f84036950 0x7f0f84038e10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 --2- 172.21.15.161:0/3446498812 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56419414ca10 0x564194249560 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 >> 172.21.15.161:0/3446498812 conn(0x5641941485b0 msgr2=0x56419423ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 shutdown_connections 2024-05-08T09:23:36.427 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.417+0000 7f10a0210800 1 -- 172.21.15.161:0/3446498812 wait complete. 2024-05-08T09:23:36.428 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.428 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.428 ERROR:root:0 2024-05-08T09:23:36.428 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:36.432 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:36.433 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:36.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:36.433 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T09:23:36.479 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.479 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.480 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a78328800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55fea2778150 0x55fea2778570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a78328800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fea2778bf0 con 0x55fea2779360 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a78328800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55fea2609050 con 0x55fea2778150 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a74060640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55fea2778150 0x55fea2778570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a74060640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55fea2778150 0x55fea2778570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57560/0 (socket says 172.21.15.161:57560) 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a74060640 1 -- 172.21.15.161:0/673687949 learned_addr learned my addr 172.21.15.161:0/673687949 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a74060640 1 -- 172.21.15.161:0/673687949 >> v1:172.21.15.45:6789/0 conn(0x55fea2779360 legacy=0x55fea27797e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a7385f640 1 -- 172.21.15.161:0/673687949 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536780222 0 0) 0x55fea2778bf0 con 0x55fea2779360 2024-05-08T09:23:36.481 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.481+0000 7f4a74060640 1 -- 172.21.15.161:0/673687949 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea2779f20 con 0x55fea2778150 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.483+0000 7f4a74060640 1 --2- 172.21.15.161:0/673687949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2778570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400a520 tx=0x7f4a6401d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d577c4927e39354d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.483+0000 7f4a7385f640 1 -- 172.21.15.161:0/673687949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64057070 con 0x55fea2778150 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.483+0000 7f4a7385f640 1 -- 172.21.15.161:0/673687949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a64052570 con 0x55fea2778150 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.483+0000 7f4a7385f640 1 -- 172.21.15.161:0/673687949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64052870 con 0x55fea2778150 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 -- 172.21.15.161:0/673687949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 msgr2=0x55fea2778570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 --2- 172.21.15.161:0/673687949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2778570 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4a6400a520 tx=0x7f4a6401d010 comp rx=0 tx=0).stop 2024-05-08T09:23:36.483 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 -- 172.21.15.161:0/673687949 shutdown_connections 2024-05-08T09:23:36.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 --2- 172.21.15.161:0/673687949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2778570 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 -- 172.21.15.161:0/673687949 >> 172.21.15.161:0/673687949 conn(0x55fea2773790 msgr2=0x55fea2775bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 -- 172.21.15.161:0/673687949 shutdown_connections 2024-05-08T09:23:36.484 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.484+0000 7f4a78328800 1 -- 172.21.15.161:0/673687949 wait complete. 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.498+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.498+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.498+0000 7f4a78328800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.498+0000 7f4a78328800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea26c31c0 con 0x55fea2778150 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f4a74060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f4a74060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57564/0 (socket says 172.21.15.161:57564) 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f4a74060640 1 -- 172.21.15.161:0/16000453 learned_addr learned my addr 172.21.15.161:0/16000453 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.498 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f4a74060640 1 -- 172.21.15.161:0/16000453 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea2869c30 con 0x55fea2778150 2024-05-08T09:23:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f4a74060640 1 --2- 172.21.15.161:0/16000453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4a64055040 tx=0x7f4a6404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f453ad5771faa89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f496260c640 1 -- 172.21.15.161:0/16000453 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64057040 con 0x55fea2778150 2024-05-08T09:23:36.502 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f496260c640 1 -- 172.21.15.161:0/16000453 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a64052850 con 0x55fea2778150 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.499+0000 7f496260c640 1 -- 172.21.15.161:0/16000453 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64052b50 con 0x55fea2778150 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- 172.21.15.161:0/16000453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 msgr2=0x55fea2869660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 --2- 172.21.15.161:0/16000453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f4a64055040 tx=0x7f4a6404c000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- 172.21.15.161:0/16000453 shutdown_connections 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 --2- 172.21.15.161:0/16000453 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea2869660 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- 172.21.15.161:0/16000453 >> 172.21.15.161:0/16000453 conn(0x55fea2773790 msgr2=0x55fea2864f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- 172.21.15.161:0/16000453 shutdown_connections 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- 172.21.15.161:0/16000453 wait complete. 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.503 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.500+0000 7f4a78328800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea2781830 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a74060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a74060640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57568/0 (socket says 172.21.15.161:57568) 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a74060640 1 -- 172.21.15.161:0/4151345398 learned_addr learned my addr 172.21.15.161:0/4151345398 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a74060640 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea26ebef0 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a74060640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4a64052540 tx=0x7f4a64003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4960e09640 1 -- 172.21.15.161:0/4151345398 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64073070 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4960e09640 1 -- 172.21.15.161:0/4151345398 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6405d570 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4960e09640 1 -- 172.21.15.161:0/4151345398 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a64057070 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fea26ec180 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.501+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea26ec6a0 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4960e09640 1 -- 172.21.15.161:0/4151345398 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4a64076070 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4960e09640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 0x7f495c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4960e09640 1 -- 172.21.15.161:0/4151345398 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4a6408de60 con 0x55fea2778150 2024-05-08T09:23:36.504 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 0x7f495c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 0x55fea287a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea287aa30 con 0x55fea2779360 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.502+0000 7f4a74861640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 0x55fea287a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 0x7f495c038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000f60 tx=0x7f4a5c0013f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a74861640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 0x55fea287a4b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a74861640 1 -- 172.21.15.161:0/4151345398 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a6c00a4a0 con 0x55fea2779360 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea287b360 con 0x55fea2779360 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a74861640 1 -- 172.21.15.161:0/4151345398 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a6c00a4a0 con 0x55fea2779360 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 0x55fea287f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.505 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.503+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea287f9e0 con 0x55fea287cd90 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.504+0000 7f4a74060640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 0x55fea287f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.504+0000 7f4a74060640 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 0x55fea287f250 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.504+0000 7f4a74060640 1 -- 172.21.15.161:0/4151345398 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4a64075030 con 0x55fea287cd90 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.504+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea287bbe0 con 0x55fea2779360 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a74861640 1 -- 172.21.15.161:0/4151345398 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a6c00a4a0 con 0x55fea2779360 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea287c0c0 con 0x55fea2779360 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a74861640 1 -- 172.21.15.161:0/4151345398 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4a6c00a4a0 con 0x55fea2779360 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a78328800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.505+0000 7f4a78328800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea26edd40 con 0x55fea288eb50 2024-05-08T09:23:36.518 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57584/0 (socket says 172.21.15.161:57584) 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a74861640 1 -- 172.21.15.161:0/3719103419 learned_addr learned my addr 172.21.15.161:0/3719103419 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a74861640 1 -- 172.21.15.161:0/3719103419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea288f4b0 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a74861640 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55fea287ae30 tx=0x7f4a6c018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4959ffb640 1 -- 172.21.15.161:0/3719103419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c014450 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4959ffb640 1 -- 172.21.15.161:0/3719103419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c014610 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fea288ff20 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4959ffb640 1 -- 172.21.15.161:0/3719103419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c014930 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.506+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea2890420 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.507+0000 7f4959ffb640 1 -- 172.21.15.161:0/3719103419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4a6c011040 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.507+0000 7f4959ffb640 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 0x7f494c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.507+0000 7f4959ffb640 1 -- 172.21.15.161:0/3719103419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4a6c01e070 con 0x55fea288eb50 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.507+0000 7f4a74060640 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 0x7f494c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.519 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a74060640 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 0x7f494c038dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fea26ecc70 tx=0x7f4a640069f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a78328800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a78328800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea2669cf0 con 0x55fea289be30 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57594/0 (socket says 172.21.15.161:57594) 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a74861640 1 -- 172.21.15.161:0/3985868876 learned_addr learned my addr 172.21.15.161:0/3985868876 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.508+0000 7f4a74861640 1 -- 172.21.15.161:0/3985868876 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea289c820 con 0x55fea289be30 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a74861640 1 --2- 172.21.15.161:0/3985868876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c04c9d0 tx=0x7f4a6c011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b9ff628174e883 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f49537fe640 1 -- 172.21.15.161:0/3985868876 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c016940 con 0x55fea289be30 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f49537fe640 1 -- 172.21.15.161:0/3985868876 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c02ba60 con 0x55fea289be30 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f49537fe640 1 -- 172.21.15.161:0/3985868876 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c02bd80 con 0x55fea289be30 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 -- 172.21.15.161:0/3985868876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 msgr2=0x55fea289c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.520 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 --2- 172.21.15.161:0/3985868876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c04c9d0 tx=0x7f4a6c011700 comp rx=0 tx=0).stop 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 -- 172.21.15.161:0/3985868876 shutdown_connections 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 --2- 172.21.15.161:0/3985868876 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea289c250 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 -- 172.21.15.161:0/3985868876 >> 172.21.15.161:0/3985868876 conn(0x55fea2898190 msgr2=0x55fea28961f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 -- 172.21.15.161:0/3985868876 shutdown_connections 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 -- 172.21.15.161:0/3985868876 wait complete. 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.509+0000 7f4a78328800 1 Processor -- start 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a78328800 1 -- start start 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a78328800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a78328800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55fea289cdb0 con 0x55fea289be30 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a74861640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57606/0 (socket says 172.21.15.161:57606) 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 learned_addr learned my addr 172.21.15.161:0/450694709 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea28a3740 con 0x55fea289be30 2024-05-08T09:23:36.521 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a74861640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0119b0 tx=0x7f4a6c04c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4951ffb640 1 -- 172.21.15.161:0/450694709 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c016940 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4951ffb640 1 -- 172.21.15.161:0/450694709 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a6c04b3c0 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fea28a39d0 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4951ffb640 1 -- 172.21.15.161:0/450694709 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a6c04e0d0 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.510+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea28a6680 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.511+0000 7f4951ffb640 1 -- 172.21.15.161:0/450694709 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f4a6c04e270 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.511+0000 7f4951ffb640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4944036950 0x7f4944038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.511+0000 7f4951ffb640 1 -- 172.21.15.161:0/450694709 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f4a6c00e040 con 0x55fea289be30 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.511+0000 7f4a74060640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4944036950 0x7f4944038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a74060640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4944036950 0x7f4944038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a6405dab0 tx=0x7f4a64091000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea28aef00 0x55fea28b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.522 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b1b10 con 0x55fea28aef00 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea28aef00 0x55fea28b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.512+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea28aef00 0x55fea28b13c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5c010510 con 0x55fea28aef00 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 realm 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28ae350 con 0x55fea28aef00 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5c010510 con 0x55fea28aef00 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b2600 con 0x55fea28aef00 2024-05-08T09:23:36.523 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5c010510 con 0x55fea28aef00 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b2ed0 con 0x55fea28aef00 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4a5c010510 con 0x55fea28aef00 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea28b38f0 0x55fea28b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.513+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b6420 con 0x55fea28b38f0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a74861640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea28b38f0 0x55fea28b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a74861640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea28b38f0 0x55fea28b5ce0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a78328800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a78328800 20 searching for the correct realm 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55fea28b83b0 0x55fea28ba870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.524 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.514+0000 7f4a74060640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55fea28b83b0 0x55fea28ba870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.515+0000 7f4a74060640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55fea28b83b0 0x55fea28ba870 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.515+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.515+0000 7f4a74060640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4a640a5040 0x7f4a64079420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.515+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.515+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4a640a5040 0x7f4a64079420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a6bfff640 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4a640a5040 0x7f4a64079420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c010510 con 0x7f4a640a5040 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c010510 con 0x55fea28aef00 2024-05-08T09:23:36.525 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.516+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.517+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x7f4a640a5040 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.526 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.518+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4a5c02a040 con 0x7f4a640a5040 2024-05-08T09:23:36.527 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.519+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.520+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.538 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.521+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x7f4a640a5040 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.539 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.522+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b38f0 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28b83b0 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c02a040 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.523+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x55fea28aef00 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4a5c02a040 con 0x55fea28aef00 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55fea28baf40 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.540 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b7900 con 0x55fea28aef00 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b7170 con 0x55fea28aef00 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.524+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28b68b0 con 0x55fea28aef00 2024-05-08T09:23:36.541 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 zone default found 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 4 Realm: () 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 zonegroup default 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bb870 con 0x55fea28b38f0 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.542 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bdb20 con 0x55fea28b83b0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bdec0 con 0x55fea28b83b0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.525+0000 7f4a78328800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.526+0000 7f4a78328800 20 started sync module instance, tier type = 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.526+0000 7f4a78328800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.526+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bcfb0 con 0x7f4a640a5040 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.527+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.527+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94552137127088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bcfb0 con 0x7f4a640a5040 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.527+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be8d0 con 0x55fea28aef00 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.528+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94552137127088] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.543 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.528+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.528+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94552137125088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be8d0 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.528+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bf2d0 con 0x55fea28b83b0 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.529+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94552137125088] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.529+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.529+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94552137131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be840 con 0x55fea28b83b0 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.529+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c0090 con 0x7f4a640a5040 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.530+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94552137131040] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.530+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.530+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94552137135808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c0480 con 0x7f4a640a5040 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.530+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c0e80 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.531+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94552137135808] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.531+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.531+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94552137136864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c0e40 con 0x55fea28aef00 2024-05-08T09:23:36.544 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.531+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c1890 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.532+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94552137136864] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.533+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.533+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94552137140624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c0db0 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.533+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c2750 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.534+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94552137140624] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.534+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.534+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94552137145472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c2750 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.534+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c3110 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94552137145472] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94552137147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c3110 con 0x55fea28b38f0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=0 2024-05-08T09:23:36.545 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=1 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=2 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=3 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=4 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=5 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.535+0000 7f4a78328800 20 add_watcher() i=6 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.536+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94552137147520] v29'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.536+0000 7f4a78328800 20 add_watcher() i=7 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.536+0000 7f4a78328800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.536+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c6510 con 0x55fea28aef00 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.537+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.537+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94552137150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c3aa0 con 0x55fea28aef00 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94552137150000] v29'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.546 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f492a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a78328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a78328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a78328800 5 note: GC not initialized 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f49297e2640 20 reqs_thread_entry: start 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a78328800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.538+0000 7f4a78328800 20 Filter name: none 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.539+0000 7f489affd640 20 reqs_thread_entry: start 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.539+0000 7f4a78328800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.539+0000 7f4a78328800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.547 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.539+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28f9a50 con 0x55fea28b38f0 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a78328800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a78328800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a78328800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a78328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.540+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28ffe70 con 0x55fea28b38f0 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v29'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.549 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a78328800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a78328800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a78328800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94552137398496 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55fea28fea00 con 0x55fea28aef00 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.541+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94552137136864 notify 124554051612 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f4a5c02f870 con 0x55fea28aef00 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f49537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051612 cookie 94552137136864 notifier 4876 bl.length()=679 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f49537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94552137398496 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f49537fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f49537fe640 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f4938003ea0 con 0x55fea28aef00 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.550 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.542+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94552137398496 notify 124554051612 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f4a5c02fb10 con 0x55fea28aef00 2024-05-08T09:23:36.551 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.543+0000 7f492a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.543+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94552137150000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28aa740 con 0x55fea28aef00 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.544+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94552137150000] v29'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.544+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94552137127088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c2e00 con 0x7f4a640a5040 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.545+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94552137127088] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.556 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.545+0000 7f4a78328800 20 remove_watcher() i=0 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.545+0000 7f4a78328800 2 removed watcher, disabling cache 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.545+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94552137125088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bd4b0 con 0x55fea28aef00 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.546+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94552137125088] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.546+0000 7f4a78328800 20 remove_watcher() i=1 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.546+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94552137131040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28bd4b0 con 0x55fea28b83b0 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.547+0000 7f4a74060640 1 -- 172.21.15.161:0/450694709 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94552137131040] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a64075030 con 0x55fea28b83b0 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.547+0000 7f4a78328800 20 remove_watcher() i=2 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.547+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94552137135808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be420 con 0x7f4a640a5040 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.548+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94552137135808] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x7f4a640a5040 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.548+0000 7f4a78328800 20 remove_watcher() i=3 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.548+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94552137136864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be420 con 0x55fea28aef00 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.549+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94552137136864] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a5c03c040 con 0x55fea28aef00 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.549+0000 7f4a78328800 20 remove_watcher() i=4 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.549+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94552137140624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be420 con 0x55fea28b38f0 2024-05-08T09:23:36.557 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.550+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94552137140624] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.550+0000 7f4a78328800 20 remove_watcher() i=5 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.550+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94552137145472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28be420 con 0x55fea28b38f0 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.551+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94552137145472] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.551+0000 7f4a78328800 20 remove_watcher() i=6 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.551+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94552137147520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55fea28c1c80 con 0x55fea28b38f0 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a74861640 1 -- 172.21.15.161:0/450694709 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94552137147520] v29'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4a6c02a070 con 0x55fea28b38f0 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 20 remove_watcher() i=7 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea28b38f0 msgr2=0x55fea28b5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea28b38f0 0x55fea28b5ce0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea28aef00 msgr2=0x55fea28b13c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea28aef00 0x55fea28b13c0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4a640a5040 msgr2=0x7f4a64079420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f4a640a5040 0x7f4a64079420 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55fea28b83b0 msgr2=0x55fea28ba870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.558 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55fea28b83b0 0x55fea28ba870 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4944036950 msgr2=0x7f4944038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f4944036950 0x7f4944038e10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a6405dab0 tx=0x7f4a64091000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a6bfff640 1 -- 172.21.15.161:0/450694709 reap_dead start 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 msgr2=0x55fea28a3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0119b0 tx=0x7f4a6c04c960 comp rx=0 tx=0).stop 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 shutdown_connections 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 --2- 172.21.15.161:0/450694709 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea289be30 0x55fea28a3200 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 >> 172.21.15.161:0/450694709 conn(0x55fea2898190 msgr2=0x55fea28957f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 shutdown_connections 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.553+0000 7f4a78328800 1 -- 172.21.15.161:0/450694709 wait complete. 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 msgr2=0x7f494c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 0x7f494c038dc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55fea26ecc70 tx=0x7f4a640069f0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 msgr2=0x55fea288ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.559 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x55fea287ae30 tx=0x7f4a6c018830 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 shutdown_connections 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f494c036900 0x7f494c038dc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/3719103419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea288eb50 0x55fea288ef70 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 >> 172.21.15.161:0/3719103419 conn(0x55fea2882bf0 msgr2=0x55fea2882ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 shutdown_connections 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/3719103419 wait complete. 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 msgr2=0x55fea287f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 0x55fea287f250 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 msgr2=0x55fea287a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 0x55fea287a4b0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 msgr2=0x7f495c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 0x7f495c038e10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c000f60 tx=0x7f4a5c0013f0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 msgr2=0x55fea26ed800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f4a64052540 tx=0x7f4a64003020 comp rx=0 tx=0).stop 2024-05-08T09:23:36.560 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 shutdown_connections 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55fea287cd90 0x55fea287f250 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55fea2779360 0x55fea287a4b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f495c036950 0x7f495c038e10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 --2- 172.21.15.161:0/4151345398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fea2778150 0x55fea26ed800 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 >> 172.21.15.161:0/4151345398 conn(0x55fea2773790 msgr2=0x55fea2863780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 shutdown_connections 2024-05-08T09:23:36.561 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.554+0000 7f4a78328800 1 -- 172.21.15.161:0/4151345398 wait complete. 2024-05-08T09:23:36.562 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.562 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.562 ERROR:root:0 2024-05-08T09:23:36.563 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:36.567 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:36.567 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T09:23:36.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-05-08T09:23:36.567 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-05-08T09:23:36.613 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.613 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.615+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.615+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.615+0000 7f05e152d800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5561501adb70 0x5561501aff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.615+0000 7f05e152d800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5561501b3fb0 con 0x5561501b04a0 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.615+0000 7f05e152d800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55615003e050 con 0x5561501adb70 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.616+0000 7f05dd22f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5561501adb70 0x5561501aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.616+0000 7f05d4a2e640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5561501b04a0 0x5561501b2890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51166/0 (socket says 172.21.15.161:51166) 2024-05-08T09:23:36.615 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.616+0000 7f05d4a2e640 1 -- 172.21.15.161:0/3269671269 learned_addr learned my addr 172.21.15.161:0/3269671269 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:36.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.616+0000 7f05dd22f640 1 -- 172.21.15.161:0/3269671269 >> v1:172.21.15.45:6789/0 conn(0x5561501b04a0 legacy=0x5561501b2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.616 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.616+0000 7f05dd22f640 1 -- 172.21.15.161:0/3269671269 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561501b5190 con 0x5561501adb70 2024-05-08T09:23:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05dd22f640 1 --2- 172.21.15.161:0/3269671269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561501aff60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f05d000a470 tx=0x7f05d001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb4a492246e8ead7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05dca2e640 1 -- 172.21.15.161:0/3269671269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0057070 con 0x5561501adb70 2024-05-08T09:23:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05dca2e640 1 -- 172.21.15.161:0/3269671269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0052570 con 0x5561501adb70 2024-05-08T09:23:36.617 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05dca2e640 1 -- 172.21.15.161:0/3269671269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0052870 con 0x5561501adb70 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 -- 172.21.15.161:0/3269671269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 msgr2=0x5561501aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 --2- 172.21.15.161:0/3269671269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561501aff60 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f05d000a470 tx=0x7f05d001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 -- 172.21.15.161:0/3269671269 shutdown_connections 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 --2- 172.21.15.161:0/3269671269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561501aff60 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 -- 172.21.15.161:0/3269671269 >> 172.21.15.161:0/3269671269 conn(0x5561501a75c0 msgr2=0x5561501a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 -- 172.21.15.161:0/3269671269 shutdown_connections 2024-05-08T09:23:36.618 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.618+0000 7f05e152d800 1 -- 172.21.15.161:0/3269671269 wait complete. 2024-05-08T09:23:36.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.632+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.632+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05e152d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.632 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05e152d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5561500f81c0 con 0x5561501adb70 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05dd22f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05dd22f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57612/0 (socket says 172.21.15.161:57612) 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05dd22f640 1 -- 172.21.15.161:0/1277544476 learned_addr learned my addr 172.21.15.161:0/1277544476 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05dd22f640 1 -- 172.21.15.161:0/1277544476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55615029ed50 con 0x5561501adb70 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.633+0000 7f05dd22f640 1 --2- 172.21.15.161:0/1277544476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f05d0055040 tx=0x7f05d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc17f66ca23568e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f04cb606640 1 -- 172.21.15.161:0/1277544476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0057040 con 0x5561501adb70 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f04cb606640 1 -- 172.21.15.161:0/1277544476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d0052990 con 0x5561501adb70 2024-05-08T09:23:36.633 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f04cb606640 1 -- 172.21.15.161:0/1277544476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0052c70 con 0x5561501adb70 2024-05-08T09:23:36.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f05e152d800 1 -- 172.21.15.161:0/1277544476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 msgr2=0x55615029e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f05e152d800 1 --2- 172.21.15.161:0/1277544476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f05d0055040 tx=0x7f05d004c000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.635 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f05e152d800 1 -- 172.21.15.161:0/1277544476 shutdown_connections 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f05e152d800 1 --2- 172.21.15.161:0/1277544476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x55615029e780 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.634+0000 7f05e152d800 1 -- 172.21.15.161:0/1277544476 >> 172.21.15.161:0/1277544476 conn(0x5561501a75c0 msgr2=0x55615029a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 -- 172.21.15.161:0/1277544476 shutdown_connections 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 -- 172.21.15.161:0/1277544476 wait complete. 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05e152d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5561501b4420 con 0x5561501adb70 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05dd22f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05dd22f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57624/0 (socket says 172.21.15.161:57624) 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05dd22f640 1 -- 172.21.15.161:0/2399228098 learned_addr learned my addr 172.21.15.161:0/2399228098 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.635+0000 7f05dd22f640 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561502a66e0 con 0x5561501adb70 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f05dd22f640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f05d000a470 tx=0x7f05d0003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.636 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f04c9e03640 1 -- 172.21.15.161:0/2399228098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0073070 con 0x5561501adb70 2024-05-08T09:23:36.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561502a6970 con 0x5561501adb70 2024-05-08T09:23:36.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f04c9e03640 1 -- 172.21.15.161:0/2399228098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d005d780 con 0x5561501adb70 2024-05-08T09:23:36.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561502a9620 con 0x5561501adb70 2024-05-08T09:23:36.637 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.636+0000 7f04c9e03640 1 -- 172.21.15.161:0/2399228098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d0057070 con 0x5561501adb70 2024-05-08T09:23:36.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f04c9e03640 1 -- 172.21.15.161:0/2399228098 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05d0076070 con 0x5561501adb70 2024-05-08T09:23:36.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f04c9e03640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 0x7f04c4038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f04c9e03640 1 -- 172.21.15.161:0/2399228098 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05d008e0f0 con 0x5561501adb70 2024-05-08T09:23:36.644 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 0x7f04c4038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 0x5561502ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502ad920 con 0x5561501b04a0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f05dda30640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 0x5561502ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.637+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 0x7f04c4038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c80012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05dda30640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 0x5561502ad3e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05dda30640 1 -- 172.21.15.161:0/2399228098 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05d800a4a0 con 0x5561501b04a0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502aa9b0 con 0x5561501b04a0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05dda30640 1 -- 172.21.15.161:0/2399228098 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05d800a4a0 con 0x5561501b04a0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 0x5561502b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502b27a0 con 0x5561502afcc0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.638+0000 7f05dd22f640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 0x5561502b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.639+0000 7f05dd22f640 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 0x5561502b20b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.639+0000 7f05dd22f640 1 -- 172.21.15.161:0/2399228098 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f05d0075030 con 0x5561502afcc0 2024-05-08T09:23:36.645 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.639+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502aec70 con 0x5561501b04a0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.639+0000 7f05dda30640 1 -- 172.21.15.161:0/2399228098 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05d800a4a0 con 0x5561501b04a0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.639+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502af150 con 0x5561501b04a0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05dda30640 1 -- 172.21.15.161:0/2399228098 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f05d800a4a0 con 0x5561501b04a0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05e152d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05e152d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55615009ecf0 con 0x5561502c1950 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57632/0 (socket says 172.21.15.161:57632) 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05dda30640 1 -- 172.21.15.161:0/3071314472 learned_addr learned my addr 172.21.15.161:0/3071314472 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.640+0000 7f05dda30640 1 -- 172.21.15.161:0/3071314472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561502c22b0 con 0x5561502c1950 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f05dda30640 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x5561502add20 tx=0x7f05d8018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.646 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f04c2ffd640 1 -- 172.21.15.161:0/3071314472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8014450 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f04c2ffd640 1 -- 172.21.15.161:0/3071314472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d8014610 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561502c2d20 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f04c2ffd640 1 -- 172.21.15.161:0/3071314472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8014930 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.641+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561502c3220 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f04c2ffd640 1 -- 172.21.15.161:0/3071314472 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05d8011040 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f04c2ffd640 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 0x7f04b4038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f04c2ffd640 1 -- 172.21.15.161:0/3071314472 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05d801e070 con 0x5561502c1950 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05dd22f640 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 0x7f04b4038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05dd22f640 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 0x7f04b4038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5561502ade10 tx=0x7f05d0006f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05e152d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.647 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.642+0000 7f05e152d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55615029f010 con 0x5561501ad160 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57648/0 (socket says 172.21.15.161:57648) 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f05dda30640 1 -- 172.21.15.161:0/189286094 learned_addr learned my addr 172.21.15.161:0/189286094 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f05dda30640 1 -- 172.21.15.161:0/189286094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561501ab960 con 0x5561501ad160 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f05dda30640 1 --2- 172.21.15.161:0/189286094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f05d804c930 tx=0x7f05d802bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32814c45c3689557 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f04c0ff9640 1 -- 172.21.15.161:0/189286094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8016940 con 0x5561501ad160 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f04c0ff9640 1 -- 172.21.15.161:0/189286094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d803bb80 con 0x5561501ad160 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.643+0000 7f04c0ff9640 1 -- 172.21.15.161:0/189286094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d803be60 con 0x5561501ad160 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- 172.21.15.161:0/189286094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 msgr2=0x5561501ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 --2- 172.21.15.161:0/189286094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f05d804c930 tx=0x7f05d802bce0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- 172.21.15.161:0/189286094 shutdown_connections 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 --2- 172.21.15.161:0/189286094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561501ad580 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- 172.21.15.161:0/189286094 >> 172.21.15.161:0/189286094 conn(0x5561502caee0 msgr2=0x5561502c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.648 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- 172.21.15.161:0/189286094 shutdown_connections 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- 172.21.15.161:0/189286094 wait complete. 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 Processor -- start 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- start start 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05e152d800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5561501abdd0 con 0x5561501ad160 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05dda30640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57664/0 (socket says 172.21.15.161:57664) 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.644+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 learned_addr learned my addr 172.21.15.161:0/522829480 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5561502d8820 con 0x5561501ad160 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f05dda30640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f05d802bf90 tx=0x7f05d804c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f04b2ffd640 1 -- 172.21.15.161:0/522829480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d8016940 con 0x5561501ad160 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f04b2ffd640 1 -- 172.21.15.161:0/522829480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05d804e070 con 0x5561501ad160 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5561502d8ab0 con 0x5561501ad160 2024-05-08T09:23:36.649 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f04b2ffd640 1 -- 172.21.15.161:0/522829480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f05d804e350 con 0x5561501ad160 2024-05-08T09:23:36.650 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.645+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5561502db760 con 0x5561501ad160 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.646+0000 7f04b2ffd640 1 -- 172.21.15.161:0/522829480 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f05d8035030 con 0x5561501ad160 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.646+0000 7f04b2ffd640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04a8036950 0x7f04a8038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.646+0000 7f04b2ffd640 1 -- 172.21.15.161:0/522829480 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f05d8033070 con 0x5561501ad160 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.646+0000 7f05dd22f640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04a8036950 0x7f04a8038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.646+0000 7f05dd22f640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04a8036950 0x7f04a8038e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f05d0052bf0 tx=0x7f05d0079000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561502e3e40 0x5561502e6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502e6a50 con 0x5561502e3e40 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561502e3e40 0x5561502e6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561502e3e40 0x5561502e6300 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c8009050 con 0x5561502e3e40 2024-05-08T09:23:36.664 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 realm 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502e3290 con 0x5561502e3e40 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c8009050 con 0x5561502e3e40 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.647+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502e7540 con 0x5561502e3e40 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c8009050 con 0x5561502e3e40 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502e7e10 con 0x5561502e3e40 2024-05-08T09:23:36.665 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f05c8009050 con 0x5561502e3e40 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502e8750 0x5561502eab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502eb2d0 con 0x5561502e8750 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.648+0000 7f05dda30640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502e8750 0x5561502eab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05dda30640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502e8750 0x5561502eab40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05e152d800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05e152d800 20 searching for the correct realm 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5561502ed2a0 0x5561502ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05dd22f640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5561502ed2a0 0x5561502ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.666 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.649+0000 7f05dd22f640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5561502ed2a0 0x5561502ef760 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05dd22f640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f05d0089040 0x7f05d008c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f05d0089040 0x7f05d008c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05d4a2e640 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f05d0089040 0x7f05d008c790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8009050 con 0x7f05d0089040 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.650+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8009050 con 0x5561502e3e40 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.667 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.651+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.652+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.668 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.653+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.654+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.669 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.655+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.656+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.670 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e8750 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.657+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502ed2a0 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.658+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x5561502e3e40 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.671 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5561502efe30 con 0x7f05d0089040 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502ebcc0 con 0x5561502e3e40 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502ec560 con 0x5561502e3e40 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.672 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.659+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502eb900 con 0x5561502e3e40 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 zone default found 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 4 Realm: () 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 zonegroup default 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502f0360 con 0x5561502e8750 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.673 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502f2630 con 0x5561502ed2a0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.660+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502f29d0 con 0x5561502ed2a0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.661+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.661+0000 7f05e152d800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.661+0000 7f05e152d800 20 started sync module instance, tier type = 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.661+0000 7f05e152d800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.661+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1ac0 con 0x7f05d0089040 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.662+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.662+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93876445454320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1ac0 con 0x7f05d0089040 2024-05-08T09:23:36.674 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.662+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f33e0 con 0x5561502e3e40 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.663+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93876445454320] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.663+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.663+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93876445458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1ac0 con 0x5561502e3e40 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.663+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f3e60 con 0x5561502ed2a0 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.664+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 93876445458704] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.664+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.664+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93876445451792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1a30 con 0x5561502ed2a0 2024-05-08T09:23:36.675 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.664+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f4d20 con 0x7f05d0089040 2024-05-08T09:23:36.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.665+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.665+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93876445465168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f5460 con 0x7f05d0089040 2024-05-08T09:23:36.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.665+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f5f80 con 0x5561502e3e40 2024-05-08T09:23:36.680 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.665+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93876445451792] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.666+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93876445465168] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.666+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.666+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93876445469264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f5f40 con 0x5561502e3e40 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.666+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f6820 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.667+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 93876445469264] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.667+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.667+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93876445471600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f5f40 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.667+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f71e0 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.668+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93876445471600] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.668+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.668+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93876445463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f71e0 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.668+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f7c50 con 0x5561502e8750 2024-05-08T09:23:36.681 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.669+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(58 notify.7 [create] v29'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93876445476672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f7c10 con 0x5561502e8750 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=0 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=1 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=2 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=3 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=4 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=5 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93876445463120] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=6 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93876445476672] v29'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.682 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 20 add_watcher() i=7 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.670+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5561502f6d30 con 0x5561502e3e40 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.671+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.671+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93876445478976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f6d30 con 0x5561502e3e40 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93876445478976] v29'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f04937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f05e152d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f05e152d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f05e152d800 5 note: GC not initialized 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f04927e4640 20 reqs_thread_entry: start 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.672+0000 7f05e152d800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 20 Filter name: none 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f0403fff640 20 reqs_thread_entry: start 2024-05-08T09:23:36.683 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55615032e5f0 con 0x5561502e8750 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 20 rados_obj.operate() r=0 bl.length=503 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.673+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556150334ce0 con 0x5561502e8750 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05e152d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05e152d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05e152d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93876445726544 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x556150330570 con 0x5561502e3e40 2024-05-08T09:23:36.684 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 93876445469264 notify 124554051613 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5561501b3fb0 con 0x5561502e3e40 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 93876445726544 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f04b3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051613 cookie 93876445469264 notifier 4883 bl.length()=636 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f04b3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f04b3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.675+0000 7f04b3fff640 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f0410003430 con 0x5561502e3e40 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.676+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.676+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 93876445726544 notify 124554051613 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f05c803e610 con 0x5561502e3e40 2024-05-08T09:23:36.685 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.677+0000 7f04937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.677+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93876445478976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x556150333790 con 0x5561502e3e40 2024-05-08T09:23:36.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.678+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93876445478976] v29'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.690 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.678+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93876445454320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f8020 con 0x7f05d0089040 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.679+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93876445454320] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.679+0000 7f05e152d800 20 remove_watcher() i=0 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.679+0000 7f05e152d800 2 removed watcher, disabling cache 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.679+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93876445458704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1ff0 con 0x5561502e3e40 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.680+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93876445458704] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.680+0000 7f05e152d800 20 remove_watcher() i=1 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.680+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93876445451792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f3110 con 0x5561502ed2a0 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.681+0000 7f05dd22f640 1 -- 172.21.15.161:0/522829480 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93876445451792] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d0075030 con 0x5561502ed2a0 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.681+0000 7f05e152d800 20 remove_watcher() i=2 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.681+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93876445465168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1610 con 0x7f05d0089040 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.682+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93876445465168] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x7f05d0089040 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.682+0000 7f05e152d800 20 remove_watcher() i=3 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.682+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93876445469264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1610 con 0x5561502e3e40 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.683+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93876445469264] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05c8029040 con 0x5561502e3e40 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.683+0000 7f05e152d800 20 remove_watcher() i=4 2024-05-08T09:23:36.691 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.683+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93876445471600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1610 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.684+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93876445471600] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.684+0000 7f05e152d800 20 remove_watcher() i=5 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.684+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93876445463120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1610 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.685+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93876445463120] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.685+0000 7f05e152d800 20 remove_watcher() i=6 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.685+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93876445476672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5561502f1610 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.686+0000 7f05dda30640 1 -- 172.21.15.161:0/522829480 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93876445476672] v29'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f05d8056040 con 0x5561502e8750 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 20 remove_watcher() i=7 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502e8750 msgr2=0x5561502eab40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502e8750 0x5561502eab40 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561502e3e40 msgr2=0x5561502e6300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561502e3e40 0x5561502e6300 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f05d0089040 msgr2=0x7f05d008c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f05d0089040 0x7f05d008c790 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.692 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5561502ed2a0 msgr2=0x5561502ef760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5561502ed2a0 0x5561502ef760 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04a8036950 msgr2=0x7f04a8038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04a8036950 0x7f04a8038e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f05d0052bf0 tx=0x7f05d0079000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 msgr2=0x5561502d82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05d4a2e640 1 -- 172.21.15.161:0/522829480 reap_dead start 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f05d802bf90 tx=0x7f05d804c8c0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 shutdown_connections 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/522829480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501ad160 0x5561502d82e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 >> 172.21.15.161:0/522829480 conn(0x5561502caee0 msgr2=0x5561502c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 shutdown_connections 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/522829480 wait complete. 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 msgr2=0x7f04b4038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 0x7f04b4038e10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x5561502ade10 tx=0x7f05d0006f50 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 msgr2=0x5561502c1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x5561502add20 tx=0x7f05d8018830 comp rx=0 tx=0).stop 2024-05-08T09:23:36.693 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 shutdown_connections 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04b4036950 0x7f04b4038e10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 --2- 172.21.15.161:0/3071314472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561502c1950 0x5561502c1d70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 >> 172.21.15.161:0/3071314472 conn(0x5561502b59f0 msgr2=0x5561502b5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 shutdown_connections 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.687+0000 7f05e152d800 1 -- 172.21.15.161:0/3071314472 wait complete. 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 msgr2=0x5561502b20b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 0x5561502b20b0 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 msgr2=0x5561502ad3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 0x5561502ad3e0 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 msgr2=0x7f04c4038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 0x7f04c4038dc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f05c8000f60 tx=0x7f05c80012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 msgr2=0x5561502a61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f05d000a470 tx=0x7f05d0003020 comp rx=0 tx=0).stop 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 shutdown_connections 2024-05-08T09:23:36.694 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5561502afcc0 0x5561502b20b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5561501b04a0 0x5561502ad3e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f04c4036900 0x7f04c4038dc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 --2- 172.21.15.161:0/2399228098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561501adb70 0x5561502a61a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 >> 172.21.15.161:0/2399228098 conn(0x5561501a75c0 msgr2=0x5561502988a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 shutdown_connections 2024-05-08T09:23:36.695 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.688+0000 7f05e152d800 1 -- 172.21.15.161:0/2399228098 wait complete. 2024-05-08T09:23:36.696 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.696 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.696 ERROR:root:0 2024-05-08T09:23:36.696 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T09:23:36.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T09:23:36.696 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-05-08T09:23:36.743 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.743 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.744+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.744 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.744+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.744+0000 7f9b8e662800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55df4e8d4470 0x55df4e8d6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.744+0000 7f9b8e662800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55df4e8d6e30 con 0x55df4e8cffe0 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.744+0000 7f9b8e662800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55df4e762050 con 0x55df4e8d4470 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.745+0000 7f9b8b967640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55df4e8d4470 0x55df4e8d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.745+0000 7f9b8c168640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55df4e8cffe0 0x55df4e8d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51178/0 (socket says 172.21.15.161:51178) 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.745+0000 7f9b8c168640 1 -- 172.21.15.161:0/1494725305 learned_addr learned my addr 172.21.15.161:0/1494725305 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.745+0000 7f9b8b967640 1 -- 172.21.15.161:0/1494725305 >> v1:172.21.15.45:6789/0 conn(0x55df4e8cffe0 legacy=0x55df4e8d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.745+0000 7f9b8b967640 1 -- 172.21.15.161:0/1494725305 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e8d8060 con 0x55df4e8d4470 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8b967640 1 --2- 172.21.15.161:0/1494725305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8d4470 0x55df4e8d6860 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000a470 tx=0x7f9b8001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23bc1ac69613f8d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8b166640 1 -- 172.21.15.161:0/1494725305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80057070 con 0x55df4e8d4470 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8b166640 1 -- 172.21.15.161:0/1494725305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b80052570 con 0x55df4e8d4470 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8b166640 1 -- 172.21.15.161:0/1494725305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b80052870 con 0x55df4e8d4470 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8e662800 1 -- 172.21.15.161:0/1494725305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8d4470 msgr2=0x55df4e8d6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.747+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1494725305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8d4470 0x55df4e8d6860 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f9b8000a470 tx=0x7f9b8001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.748+0000 7f9b8e662800 1 -- 172.21.15.161:0/1494725305 shutdown_connections 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.748+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1494725305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8d4470 0x55df4e8d6860 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.748+0000 7f9b8e662800 1 -- 172.21.15.161:0/1494725305 >> 172.21.15.161:0/1494725305 conn(0x55df4e8cb5c0 msgr2=0x55df4e8cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.748+0000 7f9b8e662800 1 -- 172.21.15.161:0/1494725305 shutdown_connections 2024-05-08T09:23:36.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.748+0000 7f9b8e662800 1 -- 172.21.15.161:0/1494725305 wait complete. 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8e662800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8e662800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55df4e81c1c0 con 0x55df4e8cffe0 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8c168640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8c168640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57686/0 (socket says 172.21.15.161:57686) 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8c168640 1 -- 172.21.15.161:0/2360341798 learned_addr learned my addr 172.21.15.161:0/2360341798 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8c168640 1 -- 172.21.15.161:0/2360341798 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e9c1c40 con 0x55df4e8cffe0 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.762+0000 7f9b8c168640 1 --2- 172.21.15.161:0/2360341798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0017a0 tx=0x7f9b7c001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8c53e8d982e980 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9a7a60c640 1 -- 172.21.15.161:0/2360341798 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c016070 con 0x55df4e8cffe0 2024-05-08T09:23:36.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9a7a60c640 1 -- 172.21.15.161:0/2360341798 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c004520 con 0x55df4e8cffe0 2024-05-08T09:23:36.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9a7a60c640 1 -- 172.21.15.161:0/2360341798 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c004820 con 0x55df4e8cffe0 2024-05-08T09:23:36.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 -- 172.21.15.161:0/2360341798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 msgr2=0x55df4e9c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 --2- 172.21.15.161:0/2360341798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c0017a0 tx=0x7f9b7c001c60 comp rx=0 tx=0).stop 2024-05-08T09:23:36.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 -- 172.21.15.161:0/2360341798 shutdown_connections 2024-05-08T09:23:36.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 --2- 172.21.15.161:0/2360341798 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c1670 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 -- 172.21.15.161:0/2360341798 >> 172.21.15.161:0/2360341798 conn(0x55df4e8cb5c0 msgr2=0x55df4e9bcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 -- 172.21.15.161:0/2360341798 shutdown_connections 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.763+0000 7f9b8e662800 1 -- 172.21.15.161:0/2360341798 wait complete. 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8e662800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8e662800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55df4e8d7300 con 0x55df4e8cffe0 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8c168640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8c168640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57690/0 (socket says 172.21.15.161:57690) 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8c168640 1 -- 172.21.15.161:0/1076701214 learned_addr learned my addr 172.21.15.161:0/1076701214 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8c168640 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e9c4d40 con 0x55df4e8cffe0 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.764+0000 7f9b8c168640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000f80 tx=0x7f9b7c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9a78e09640 1 -- 172.21.15.161:0/1076701214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c016040 con 0x55df4e8cffe0 2024-05-08T09:23:36.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9a78e09640 1 -- 172.21.15.161:0/1076701214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b7c011530 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9a78e09640 1 -- 172.21.15.161:0/1076701214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b7c011890 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4e9c4fd0 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4e9c5550 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.765+0000 7f9a78e09640 1 -- 172.21.15.161:0/1076701214 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b7c01c3f0 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9a78e09640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 0x7f9a74038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9a78e09640 1 -- 172.21.15.161:0/1076701214 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9b7c04ba50 con 0x55df4e8cffe0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8b967640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 0x7f9a74038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 0x55df4e9d3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4e9d3d50 con 0x55df4e8d4470 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8c969640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 0x55df4e9d3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8b967640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 0x7f9a74038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9b80054000 tx=0x7f9b8004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8c969640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 0x55df4e9d3770 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.768 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8c969640 1 -- 172.21.15.161:0/1076701214 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4e8d4470 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.766+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4e9d4630 con 0x55df4e8d4470 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.767+0000 7f9b8c969640 1 -- 172.21.15.161:0/1076701214 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4e8d4470 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.767+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 0x55df4e9d8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.767+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4e9d8cd0 con 0x55df4e9d60b0 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.767+0000 7f9b8c168640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 0x55df4e9d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.769 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.767+0000 7f9b8c168640 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 0x55df4e9d8540 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.768+0000 7f9b8c168640 1 -- 172.21.15.161:0/1076701214 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4e9d60b0 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.768+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4e9d4eb0 con 0x55df4e8d4470 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.768+0000 7f9b8c969640 1 -- 172.21.15.161:0/1076701214 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4e8d4470 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.768+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4e9d5370 con 0x55df4e8d4470 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.768+0000 7f9b8c969640 1 -- 172.21.15.161:0/1076701214 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4e8d4470 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8e662800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8e662800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55df4e9c6b90 con 0x55df4e9e7e20 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57692/0 (socket says 172.21.15.161:57692) 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8c969640 1 -- 172.21.15.161:0/4057421757 learned_addr learned my addr 172.21.15.161:0/4057421757 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8c969640 1 -- 172.21.15.161:0/4057421757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e9e8780 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.769+0000 7f9b8c969640 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55df4e9c6390 tx=0x7f9b8400aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9a71ffb640 1 -- 172.21.15.161:0/4057421757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84007d00 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9a71ffb640 1 -- 172.21.15.161:0/4057421757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8401e020 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4e9e91f0 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9a71ffb640 1 -- 172.21.15.161:0/4057421757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84019420 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4e9e96f0 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.770+0000 7f9a71ffb640 1 -- 172.21.15.161:0/4057421757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b84016040 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9a71ffb640 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 0x7f9a64038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9a71ffb640 1 -- 172.21.15.161:0/4057421757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9b8401f030 con 0x55df4e9e7e20 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 0x7f9a64038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 0x7f9a64038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55df4e9c5a90 tx=0x7f9b7c049cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8e662800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8e662800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55df4e7c2cf0 con 0x55df4e9f5160 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57698/0 (socket says 172.21.15.161:57698) 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c969640 1 -- 172.21.15.161:0/4057536484 learned_addr learned my addr 172.21.15.161:0/4057536484 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.771+0000 7f9b8c969640 1 -- 172.21.15.161:0/4057536484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e9f5b50 con 0x55df4e9f5160 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8c969640 1 --2- 172.21.15.161:0/4057536484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9b8404c820 tx=0x7f9b84014640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebeeb8775b8c9a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9a6b7fe640 1 -- 172.21.15.161:0/4057536484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8401d070 con 0x55df4e9f5160 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9a6b7fe640 1 -- 172.21.15.161:0/4057536484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b8404e2e0 con 0x55df4e9f5160 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9a6b7fe640 1 -- 172.21.15.161:0/4057536484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b8404b380 con 0x55df4e9f5160 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057536484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 msgr2=0x55df4e9f5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057536484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9b8404c820 tx=0x7f9b84014640 comp rx=0 tx=0).stop 2024-05-08T09:23:36.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057536484 shutdown_connections 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057536484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9f5580 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057536484 >> 172.21.15.161:0/4057536484 conn(0x55df4e9f1470 msgr2=0x55df4e9ef520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057536484 shutdown_connections 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.772+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057536484 wait complete. 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8e662800 1 Processor -- start 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8e662800 1 -- start start 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8e662800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8e662800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55df4e9f6140 con 0x55df4e9f5160 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8c969640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57704/0 (socket says 172.21.15.161:57704) 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 learned_addr learned my addr 172.21.15.161:0/4293386197 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df4e9fcac0 con 0x55df4e9f5160 2024-05-08T09:23:36.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.773+0000 7f9b8c969640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9b8404b790 tx=0x7f9b8404c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 -- 172.21.15.161:0/4293386197 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84032070 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 -- 172.21.15.161:0/4293386197 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b84014950 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55df4e9fcd50 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 -- 172.21.15.161:0/4293386197 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9b84014c50 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df4e9ffa00 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 -- 172.21.15.161:0/4293386197 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f9b840195c0 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a5c036950 0x7f9a5c038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.774+0000 7f9a69ffb640 1 -- 172.21.15.161:0/4293386197 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f9b84037d10 con 0x55df4e9f5160 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a5c036950 0x7f9a5c038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a5c036950 0x7f9a5c038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c019860 tx=0x7f9b7c03f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4ea07fd0 0x55df4ea0a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0abe0 con 0x55df4ea07fd0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.775+0000 7f9b8b967640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4ea07fd0 0x55df4ea0a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8b967640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4ea07fd0 0x55df4ea0a490 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 realm 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0afb0 con 0x55df4ea07fd0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0b880 con 0x55df4ea07fd0 2024-05-08T09:23:36.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.776+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0bc20 con 0x55df4ea07fd0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4ea0c980 0x55df4ea0ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0f330 con 0x55df4ea0c980 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8c969640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4ea0c980 0x55df4ea0ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8c969640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4ea0c980 0x55df4ea0ed70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 20 searching for the correct realm 2024-05-08T09:23:36.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55df4ea11300 0x55df4ea137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.777+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55df4ea11300 0x55df4ea137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55df4ea11300 0x55df4ea137c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8c168640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9b7c00f300 0x7f9b7c0433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.778+0000 7f9b8b967640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9b7c00f300 0x7f9b7c0433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.779+0000 7f9b8b967640 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9b7c00f300 0x7f9b7c0433b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.779+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.779+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.789 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.780+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.790 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.781+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.782+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.783+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.784+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.785+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea0c980 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea11300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x55df4ea07fd0 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.786+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea13e90 con 0x7f9b7c00f300 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0fd20 con 0x55df4ea07fd0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea105c0 con 0x55df4ea07fd0 2024-05-08T09:23:36.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea0f960 con 0x55df4ea07fd0 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 zone default found 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 4 Realm: () 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 zonegroup default 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.787+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea143a0 con 0x55df4ea0c980 2024-05-08T09:23:36.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16670 con 0x55df4ea11300 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16a10 con 0x55df4ea11300 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.788+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.789+0000 7f9b8e662800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.789+0000 7f9b8e662800 20 started sync module instance, tier type = 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.789+0000 7f9b8e662800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.789+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea15b00 con 0x7f9b7c00f300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.790+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.790+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94417585266768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea15b00 con 0x7f9b7c00f300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.790+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea17420 con 0x55df4ea07fd0 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.791+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94417585266768] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.791+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.791+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94417585264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea17420 con 0x55df4ea07fd0 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.791+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea17e20 con 0x55df4ea11300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.792+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94417585264688] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.792+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.792+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94417585270640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea17390 con 0x55df4ea11300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.792+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea18d10 con 0x7f9b7c00f300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.794+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94417585270640] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.795+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.795+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94417585277024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea18c80 con 0x7f9b7c00f300 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.795+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea19bd0 con 0x55df4ea07fd0 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.796+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.796+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94417585280800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea19b40 con 0x55df4ea07fd0 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.796+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1aad0 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.796+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94417585277024] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.797+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94417585280800] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.797+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.797+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94417585283008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1a5e0 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.797+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1b370 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.798+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94417585283008] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.798+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.798+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94417585279232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1a5e0 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.798+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1b9d0 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94417585279232] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94417585286768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1b990 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=0 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=1 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=2 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=3 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=4 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=5 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.799+0000 7f9b8e662800 20 add_watcher() i=6 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94417585286768] v29'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8e662800 20 add_watcher() i=7 2024-05-08T09:23:36.810 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8e662800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1ee20 con 0x55df4ea07fd0 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.800+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94417585288880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1c2a0 con 0x55df4ea07fd0 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.801+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94417585288880] v29'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.801+0000 7f9a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.801+0000 7f9b8e662800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.801+0000 7f9b8e662800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.801+0000 7f9b8e662800 5 note: GC not initialized 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9a417e2640 20 reqs_thread_entry: start 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9b8e662800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9b8e662800 20 Filter name: none 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f99b2ffd640 20 reqs_thread_entry: start 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9b8e662800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9b8e662800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.802+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea522c0 con 0x55df4ea0c980 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8e662800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8e662800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8e662800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8e662800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.803+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea585e0 con 0x55df4ea0c980 2024-05-08T09:23:36.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v29'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8e662800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8e662800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8e662800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94417585537104 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea53e30 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94417585280800 notify 124554051614 ret 0) ==== 708+0+0 (crc 0 0 0) 0x55df4e8d8060 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9a6b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051614 cookie 94417585280800 notifier 4890 bl.length()=666 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94417585537104 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9a6b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9a6b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9a6b7fe640 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f9a50003ea0 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.804+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.805+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94417585537104 notify 124554051614 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9b80081400 con 0x55df4ea07fd0 2024-05-08T09:23:36.814 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.819 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.805+0000 7f9a427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.805+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94417585288880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea57490 con 0x55df4ea07fd0 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.806+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94417585288880] v29'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.806+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94417585266768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea1b680 con 0x7f9b7c00f300 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.807+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94417585266768] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.807+0000 7f9b8e662800 20 remove_watcher() i=0 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.807+0000 7f9b8e662800 2 removed watcher, disabling cache 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.807+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94417585264688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16030 con 0x55df4ea07fd0 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.808+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94417585264688] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.808+0000 7f9b8e662800 20 remove_watcher() i=1 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.808+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94417585270640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea15830 con 0x55df4ea11300 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.809+0000 7f9b8c168640 1 -- 172.21.15.161:0/4293386197 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94417585270640] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b7c019050 con 0x55df4ea11300 2024-05-08T09:23:36.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.809+0000 7f9b8e662800 20 remove_watcher() i=2 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.809+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94417585277024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16f70 con 0x7f9b7c00f300 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.810+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94417585277024] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x7f9b7c00f300 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.810+0000 7f9b8e662800 20 remove_watcher() i=3 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.810+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94417585280800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16f70 con 0x55df4ea07fd0 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.811+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94417585280800] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b8005a040 con 0x55df4ea07fd0 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.812+0000 7f9b8e662800 20 remove_watcher() i=4 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.812+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94417585283008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea19720 con 0x55df4ea0c980 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.813+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94417585283008] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.813+0000 7f9b8e662800 20 remove_watcher() i=5 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.813+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94417585279232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea16f70 con 0x55df4ea0c980 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.814+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94417585279232] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.814+0000 7f9b8e662800 20 remove_watcher() i=6 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.814+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94417585286768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55df4ea19fc0 con 0x55df4ea0c980 2024-05-08T09:23:36.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8c969640 1 -- 172.21.15.161:0/4293386197 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94417585286768] v29'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9b840083e0 con 0x55df4ea0c980 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 20 remove_watcher() i=7 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4ea0c980 msgr2=0x55df4ea0ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4ea0c980 0x55df4ea0ed70 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4ea07fd0 msgr2=0x55df4ea0a490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4ea07fd0 0x55df4ea0a490 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9b7c00f300 msgr2=0x7f9b7c0433b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f9b7c00f300 0x7f9b7c0433b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55df4ea11300 msgr2=0x55df4ea137c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55df4ea11300 0x55df4ea137c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a5c036950 msgr2=0x7f9a5c038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a5c036950 0x7f9a5c038e10 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c019860 tx=0x7f9b7c03f000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 msgr2=0x55df4e9fc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.822 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8b967640 1 -- 172.21.15.161:0/4293386197 reap_dead start 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9b8404b790 tx=0x7f9b8404c7b0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 shutdown_connections 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4293386197 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9f5160 0x55df4e9fc580 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 >> 172.21.15.161:0/4293386197 conn(0x55df4e9f1470 msgr2=0x55df4e9eeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 shutdown_connections 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4293386197 wait complete. 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.815+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 msgr2=0x7f9a64038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 0x7f9a64038e10 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55df4e9c5a90 tx=0x7f9b7c049cb0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 msgr2=0x55df4e9e8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55df4e9c6390 tx=0x7f9b8400aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 shutdown_connections 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a64036950 0x7f9a64038e10 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/4057421757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e9e7e20 0x55df4e9e8240 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 >> 172.21.15.161:0/4057421757 conn(0x55df4e9dbec0 msgr2=0x55df4e9dc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 shutdown_connections 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/4057421757 wait complete. 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 msgr2=0x55df4e9d8540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 0x55df4e9d8540 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 msgr2=0x55df4e9d3770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 0x55df4e9d3770 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 msgr2=0x7f9a74038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 0x7f9a74038dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9b80054000 tx=0x7f9b8004e000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 msgr2=0x55df4e9c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c000f80 tx=0x7f9b7c001250 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 shutdown_connections 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55df4e9d60b0 0x55df4e9d8540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55df4e8d4470 0x55df4e9d3770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f9a74036900 0x7f9a74038dc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 --2- 172.21.15.161:0/1076701214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55df4e8cffe0 0x55df4e9c6650 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 >> 172.21.15.161:0/1076701214 conn(0x55df4e8cb5c0 msgr2=0x55df4e8434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 shutdown_connections 2024-05-08T09:23:36.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.816+0000 7f9b8e662800 1 -- 172.21.15.161:0/1076701214 wait complete. 2024-05-08T09:23:36.826 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.826 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.826 ERROR:root:0 2024-05-08T09:23:36.826 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:36.831 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx000003511b3e3e62c65a3-00663b4498-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:23:36.831 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T09:23:36.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-05-08T09:23:36.831 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-05-08T09:23:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:36.877 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.879+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.879+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.879+0000 7faffad33800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5630abe3a6f0 0x5630abe3cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.878 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.879+0000 7faffad33800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5630abe3d020 con 0x5630abe36be0 2024-05-08T09:23:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.879+0000 7faffad33800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x5630abcc7050 con 0x5630abe3a6f0 2024-05-08T09:23:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.880+0000 7faff61f4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x5630abe3a6f0 0x5630abe3cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.880+0000 7faff69f5640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x5630abe36be0 0x5630abe38fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51182/0 (socket says 172.21.15.161:51182) 2024-05-08T09:23:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.880+0000 7faff69f5640 1 -- 172.21.15.161:0/2298351428 learned_addr learned my addr 172.21.15.161:0/2298351428 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:36.879 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.880+0000 7faff61f4640 1 -- 172.21.15.161:0/2298351428 >> v1:172.21.15.45:6789/0 conn(0x5630abe36be0 legacy=0x5630abe38fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.880+0000 7faff61f4640 1 -- 172.21.15.161:0/2298351428 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abe3e200 con 0x5630abe3a6f0 2024-05-08T09:23:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faff61f4640 1 --2- 172.21.15.161:0/2298351428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe3a6f0 0x5630abe3cae0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fafe000a470 tx=0x7fafe001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3c5201856939df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faff59f3640 1 -- 172.21.15.161:0/2298351428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe0057070 con 0x5630abe3a6f0 2024-05-08T09:23:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faff59f3640 1 -- 172.21.15.161:0/2298351428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe0052570 con 0x5630abe3a6f0 2024-05-08T09:23:36.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faff59f3640 1 -- 172.21.15.161:0/2298351428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe0052870 con 0x5630abe3a6f0 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 -- 172.21.15.161:0/2298351428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe3a6f0 msgr2=0x5630abe3cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 --2- 172.21.15.161:0/2298351428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe3a6f0 0x5630abe3cae0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fafe000a470 tx=0x7fafe001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 -- 172.21.15.161:0/2298351428 shutdown_connections 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 --2- 172.21.15.161:0/2298351428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe3a6f0 0x5630abe3cae0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 -- 172.21.15.161:0/2298351428 >> 172.21.15.161:0/2298351428 conn(0x5630abe305b0 msgr2=0x5630abe329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 -- 172.21.15.161:0/2298351428 shutdown_connections 2024-05-08T09:23:36.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.882+0000 7faffad33800 1 -- 172.21.15.161:0/2298351428 wait complete. 2024-05-08T09:23:36.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.896+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.896+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.896 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.896+0000 7faffad33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.896+0000 7faffad33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5630abd811c0 con 0x5630abe36be0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faff69f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faff69f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57718/0 (socket says 172.21.15.161:57718) 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faff69f5640 1 -- 172.21.15.161:0/4256564828 learned_addr learned my addr 172.21.15.161:0/4256564828 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faff69f5640 1 -- 172.21.15.161:0/4256564828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abf27d20 con 0x5630abe36be0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faff69f5640 1 --2- 172.21.15.161:0/4256564828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7faff00017a0 tx=0x7faff0001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb2b9fd1ed6ddf2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faee4e09640 1 -- 172.21.15.161:0/4256564828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff0004520 con 0x5630abe36be0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faee4e09640 1 -- 172.21.15.161:0/4256564828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff00046c0 con 0x5630abe36be0 2024-05-08T09:23:36.897 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.897+0000 7faee4e09640 1 -- 172.21.15.161:0/4256564828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff0004a00 con 0x5630abe36be0 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- 172.21.15.161:0/4256564828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 msgr2=0x5630abf27750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 --2- 172.21.15.161:0/4256564828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7faff00017a0 tx=0x7faff0001c60 comp rx=0 tx=0).stop 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- 172.21.15.161:0/4256564828 shutdown_connections 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 --2- 172.21.15.161:0/4256564828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf27750 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- 172.21.15.161:0/4256564828 >> 172.21.15.161:0/4256564828 conn(0x5630abe305b0 msgr2=0x5630abf23070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- 172.21.15.161:0/4256564828 shutdown_connections 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- 172.21.15.161:0/4256564828 wait complete. 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.898+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faffad33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faffad33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5630abe3d4f0 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faff69f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faff69f5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57722/0 (socket says 172.21.15.161:57722) 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faff69f5640 1 -- 172.21.15.161:0/81969934 learned_addr learned my addr 172.21.15.161:0/81969934 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faff69f5640 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abf2f800 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.899+0000 7faff69f5640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faff0000f80 tx=0x7faff0001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faee3606640 1 -- 172.21.15.161:0/81969934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff0022020 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faee3606640 1 -- 172.21.15.161:0/81969934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0014870 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faee3606640 1 -- 172.21.15.161:0/81969934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faff0014bb0 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630abf2fa90 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630abf32740 con 0x5630abe36be0 2024-05-08T09:23:36.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faee3606640 1 -- 172.21.15.161:0/81969934 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7faff0025020 con 0x5630abe36be0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.900+0000 7faee3606640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 0x7faedc038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faee3606640 1 -- 172.21.15.161:0/81969934 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7faff0018030 con 0x5630abe36be0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faff61f4640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 0x7faedc038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 0x5630abf36500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf36a90 con 0x5630abe3a6f0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faff71f6640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 0x5630abf36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faff61f4640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 0x7faedc038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fafe0054000 tx=0x7fafe004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faff71f6640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 0x5630abf36500 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faff71f6640 1 -- 172.21.15.161:0/81969934 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe80083e0 con 0x5630abe3a6f0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.901+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf33ab0 con 0x5630abe3a6f0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.902+0000 7faff71f6640 1 -- 172.21.15.161:0/81969934 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafe80083e0 con 0x5630abe3a6f0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.902+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 0x5630abf3b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.902+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf3b8a0 con 0x5630abf38dc0 2024-05-08T09:23:36.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.902+0000 7faff69f5640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 0x5630abf3b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.902+0000 7faff69f5640 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 0x5630abf3b1b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faff69f5640 1 -- 172.21.15.161:0/81969934 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7faff001b070 con 0x5630abf38dc0 2024-05-08T09:23:36.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf37d70 con 0x5630abe3a6f0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faff71f6640 1 -- 172.21.15.161:0/81969934 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafe80083e0 con 0x5630abe3a6f0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf38230 con 0x5630abe3a6f0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faff71f6640 1 -- 172.21.15.161:0/81969934 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fafe80083e0 con 0x5630abe3a6f0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.903+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faffad33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faffad33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5630abd27cf0 con 0x5630abf4aa50 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57736/0 (socket says 172.21.15.161:57736) 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faff71f6640 1 -- 172.21.15.161:0/1363158811 learned_addr learned my addr 172.21.15.161:0/1363158811 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faff71f6640 1 -- 172.21.15.161:0/1363158811 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abf4b3b0 con 0x5630abf4aa50 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faff71f6640 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x5630abf306c0 tx=0x7fafe800aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.914 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faee0e01640 1 -- 172.21.15.161:0/1363158811 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe8007d00 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faee0e01640 1 -- 172.21.15.161:0/1363158811 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe801e020 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630abf4be20 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faee0e01640 1 -- 172.21.15.161:0/1363158811 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe8019420 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.904+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630abf4c320 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.905+0000 7faee0e01640 1 -- 172.21.15.161:0/1363158811 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafe8016040 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.905+0000 7faee0e01640 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 0x7faed0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.905+0000 7faee0e01640 1 -- 172.21.15.161:0/1363158811 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fafe801f030 con 0x5630abf4aa50 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.905+0000 7faff69f5640 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 0x7faed0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faff69f5640 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 0x7faed0038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5630abf36f30 tx=0x7faff0012ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faffad33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faffad33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5630abf280a0 con 0x5630abf57d70 2024-05-08T09:23:36.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57742/0 (socket says 172.21.15.161:57742) 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faff71f6640 1 -- 172.21.15.161:0/1788957134 learned_addr learned my addr 172.21.15.161:0/1788957134 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.906+0000 7faff71f6640 1 -- 172.21.15.161:0/1788957134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abf58760 con 0x5630abf57d70 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faff71f6640 1 --2- 172.21.15.161:0/1788957134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fafe8018fd0 tx=0x7fafe80163f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea13a0e7b53fa9a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faeda7fc640 1 -- 172.21.15.161:0/1788957134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe801d070 con 0x5630abf57d70 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faeda7fc640 1 -- 172.21.15.161:0/1788957134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe804b230 con 0x5630abf57d70 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faeda7fc640 1 -- 172.21.15.161:0/1788957134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe8017570 con 0x5630abf57d70 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 -- 172.21.15.161:0/1788957134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 msgr2=0x5630abf58190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 --2- 172.21.15.161:0/1788957134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fafe8018fd0 tx=0x7fafe80163f0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 -- 172.21.15.161:0/1788957134 shutdown_connections 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 --2- 172.21.15.161:0/1788957134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf58190 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 -- 172.21.15.161:0/1788957134 >> 172.21.15.161:0/1788957134 conn(0x5630abf540d0 msgr2=0x5630abf52130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 -- 172.21.15.161:0/1788957134 shutdown_connections 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 -- 172.21.15.161:0/1788957134 wait complete. 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.907+0000 7faffad33800 1 Processor -- start 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faffad33800 1 -- start start 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faffad33800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faffad33800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x5630abf58ed0 con 0x5630abf57d70 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faff71f6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57758/0 (socket says 172.21.15.161:57758) 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 learned_addr learned my addr 172.21.15.161:0/1602350107 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630abf5f910 con 0x5630abf57d70 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faff71f6640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fafe804cbc0 tx=0x7fafe804c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faed8ff9640 1 -- 172.21.15.161:0/1602350107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe8031030 con 0x5630abf57d70 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faed8ff9640 1 -- 172.21.15.161:0/1602350107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafe803be30 con 0x5630abf57d70 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faed8ff9640 1 -- 172.21.15.161:0/1602350107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fafe8014a80 con 0x5630abf57d70 2024-05-08T09:23:36.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5630abf5fba0 con 0x5630abf57d70 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.908+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630abf62850 con 0x5630abf57d70 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.909+0000 7faed8ff9640 1 -- 172.21.15.161:0/1602350107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fafe8034070 con 0x5630abf57d70 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.909+0000 7faed8ff9640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faec00368b0 0x7faec0038d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.909+0000 7faed8ff9640 1 -- 172.21.15.161:0/1602350107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fafe8032070 con 0x5630abf57d70 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.909+0000 7faff69f5640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faec00368b0 0x7faec0038d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faff69f5640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faec00368b0 0x7faec0038d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faff00021b0 tx=0x7faff004c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abf6aec0 0x5630abf6d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf6dad0 con 0x5630abf6aec0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faff61f4640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abf6aec0 0x5630abf6d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.910+0000 7faff61f4640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abf6aec0 0x5630abf6d380 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.918 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 realm 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf6dea0 con 0x5630abf6aec0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf6e770 con 0x5630abf6aec0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf6eb10 con 0x5630abf6aec0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf6f870 0x5630abf71c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.911+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf72220 con 0x5630abf6f870 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faff71f6640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf6f870 0x5630abf71c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faff71f6640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf6f870 0x5630abf71c60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faffad33800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faffad33800 20 searching for the correct realm 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5630abf741f0 0x5630abf766b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.912+0000 7faff69f5640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5630abf741f0 0x5630abf766b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff69f5640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5630abf741f0 0x5630abf766b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff69f5640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7faff0032040 0x7faff001d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff61f4640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7faff0032040 0x7faff001d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.913+0000 7faff61f4640 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7faff0032040 0x7faff001d950 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.914+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.915+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.916+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.917+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.918+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.918+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.918+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.918+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.919+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.920+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6f870 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf741f0 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.921+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x5630abf6aec0 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x5630abf76d80 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf72be0 con 0x5630abf6aec0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.922+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf72820 con 0x5630abf6aec0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:36.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf73580 con 0x5630abf6aec0 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 zone default found 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 4 Realm: () 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 zonegroup default 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf77290 con 0x5630abf6f870 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.923+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf79560 con 0x5630abf741f0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf79900 con 0x5630abf741f0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 20 started sync module instance, tier type = 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.924+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf789a0 con 0x7faff0032040 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.925+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.925+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94767043546832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf789a0 con 0x7faff0032040 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.925+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7a300 con 0x5630abf6aec0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.928+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.928+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94767043546832] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.928+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94767043550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7a2d0 con 0x5630abf6aec0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.928+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf78530 con 0x5630abf741f0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.929+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.929+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94767043554752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7b690 con 0x5630abf741f0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.929+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7c0d0 con 0x7faff0032040 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.929+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94767043550736] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.930+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94767043554752] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.930+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.930+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94767043555808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7a6a0 con 0x7faff0032040 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.930+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7c970 con 0x5630abf6aec0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.931+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94767043555808] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.931+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.932+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94767043558304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7c920 con 0x5630abf6aec0 2024-05-08T09:23:36.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.932+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7d380 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.932+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94767043558304] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.933+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.933+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94767043561040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7d380 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.933+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7dd40 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.934+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94767043561040] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.934+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.934+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94767043563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7df20 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.934+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e7b0 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94767043563216] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94767043566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e990 con 0x5630abf6f870 2024-05-08T09:23:36.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=0 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=1 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=2 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=3 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=4 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=5 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.935+0000 7faffad33800 20 add_watcher() i=6 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94767043566192] v29'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faffad33800 20 add_watcher() i=7 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faffad33800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abf81d60 con 0x5630abf6aec0 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.936+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94767043569792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7f150 con 0x5630abf6aec0 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.937+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94767043569792] v29'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.937+0000 7faead7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.937+0000 7faffad33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.937+0000 7faffad33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.937+0000 7faffad33800 5 note: GC not initialized 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7fae27fff640 20 reqs_thread_entry: start 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 20 Filter name: none 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7fae25ffb640 20 reqs_thread_entry: start 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 20 rados->read ofs=0 len=0 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abfb5150 con 0x5630abf6f870 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.938+0000 7faffad33800 20 rados_obj.operate() r=0 bl.length=490 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.939+0000 7faffad33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.939+0000 7faffad33800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.939+0000 7faffad33800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:36.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.939+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abfbb530 con 0x5630abf6f870 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v29'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faffad33800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faffad33800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faffad33800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94767043817376 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x5630abfba0c0 con 0x5630abf6aec0 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94767043558304 notify 124554051615 ret 0) ==== 678+0+0 (crc 0 0 0) 0x5630abe3e200 con 0x5630abf6aec0 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faeda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051615 cookie 94767043558304 notifier 4897 bl.length()=636 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faeda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faeda7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faeda7fc640 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7faebc003ea0 con 0x5630abf6aec0 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94767043817376 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.946 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.940+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94767043817376 notify 124554051615 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fafe0081400 con 0x5630abf6aec0 2024-05-08T09:23:36.947 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.941+0000 7faead7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.941+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94767043569792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abfb8e20 con 0x5630abf6aec0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.942+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94767043569792] v29'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.942+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94767043546832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e880 con 0x7faff0032040 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.943+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94767043546832] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.943+0000 7faffad33800 20 remove_watcher() i=0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.943+0000 7faffad33800 2 removed watcher, disabling cache 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.943+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94767043550736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e880 con 0x5630abf6aec0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.945+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94767043550736] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.945+0000 7faffad33800 20 remove_watcher() i=1 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.945+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94767043554752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e880 con 0x5630abf741f0 2024-05-08T09:23:36.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.946+0000 7faff69f5640 1 -- 172.21.15.161:0/1602350107 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94767043554752] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7faff001b070 con 0x5630abf741f0 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.946+0000 7faffad33800 20 remove_watcher() i=2 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.946+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94767043555808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7adc0 con 0x7faff0032040 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.947+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94767043555808] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x7faff0032040 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.947+0000 7faffad33800 20 remove_watcher() i=3 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.947+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94767043558304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7b270 con 0x5630abf6aec0 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.948+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94767043558304] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe005a040 con 0x5630abf6aec0 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.948+0000 7faffad33800 20 remove_watcher() i=4 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.948+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94767043561040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e880 con 0x5630abf6f870 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.949+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94767043561040] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.949+0000 7faffad33800 20 remove_watcher() i=5 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.949+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94767043563216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7bba0 con 0x5630abf6f870 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.950+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94767043563216] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.950+0000 7faffad33800 20 remove_watcher() i=6 2024-05-08T09:23:36.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.950+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94767043566192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x5630abf7e880 con 0x5630abf6f870 2024-05-08T09:23:36.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faff71f6640 1 -- 172.21.15.161:0/1602350107 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94767043566192] v29'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fafe8057040 con 0x5630abf6f870 2024-05-08T09:23:36.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 20 remove_watcher() i=7 2024-05-08T09:23:36.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf6f870 msgr2=0x5630abf71c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf6f870 0x5630abf71c60 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.954 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abf6aec0 msgr2=0x5630abf6d380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abf6aec0 0x5630abf6d380 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7faff0032040 msgr2=0x7faff001d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7faff0032040 0x7faff001d950 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5630abf741f0 msgr2=0x5630abf766b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x5630abf741f0 0x5630abf766b0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faec00368b0 msgr2=0x7faec0038d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faec00368b0 0x7faec0038d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faff00021b0 tx=0x7faff004c000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 msgr2=0x5630abf5f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faff61f4640 1 -- 172.21.15.161:0/1602350107 reap_dead start 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fafe804cbc0 tx=0x7fafe804c7b0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 shutdown_connections 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1602350107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf57d70 0x5630abf5f3d0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.955 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 >> 172.21.15.161:0/1602350107 conn(0x5630abf540d0 msgr2=0x5630abf51730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 shutdown_connections 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1602350107 wait complete. 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 msgr2=0x7faed0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 0x7faed0038e10 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x5630abf36f30 tx=0x7faff0012ec0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 msgr2=0x5630abf4ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.952+0000 7faffad33800 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x5630abf306c0 tx=0x7fafe800aec0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 shutdown_connections 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faed0036950 0x7faed0038e10 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/1363158811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abf4aa50 0x5630abf4ae70 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 >> 172.21.15.161:0/1363158811 conn(0x5630abf3eaf0 msgr2=0x5630abf3eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 shutdown_connections 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/1363158811 wait complete. 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 msgr2=0x5630abf3b1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.956 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 0x5630abf3b1b0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 msgr2=0x5630abf36500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 0x5630abf36500 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 msgr2=0x7faedc038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 0x7faedc038e10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fafe0054000 tx=0x7fafe004e000 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 msgr2=0x5630abf2f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faff0000f80 tx=0x7faff0001250 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 shutdown_connections 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x5630abf38dc0 0x5630abf3b1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x5630abe3a6f0 0x5630abf36500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7faedc036950 0x7faedc038e10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 --2- 172.21.15.161:0/81969934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5630abe36be0 0x5630abf2f2c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 >> 172.21.15.161:0/81969934 conn(0x5630abe305b0 msgr2=0x5630abf21870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 shutdown_connections 2024-05-08T09:23:36.957 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:36.953+0000 7faffad33800 1 -- 172.21.15.161:0/81969934 wait complete. 2024-05-08T09:23:36.961 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.962 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:36.962 ERROR:root:0 2024-05-08T09:23:36.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:36.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:36.962 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T09:23:37.011 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:37.011 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23caa1f800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559da0f7a3a0 0x559da0f7a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23caa1f800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559da0f7ae40 con 0x559da0f7d3e0 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23caa1f800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x559da0e0d050 con 0x559da0f7a3a0 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23c851e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x559da0f7a3a0 0x559da0f7a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23bffff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x559da0f7d3e0 0x559da0f7d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51184/0 (socket says 172.21.15.161:51184) 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.013+0000 7f23bffff640 1 -- 172.21.15.161:0/1738131934 learned_addr learned my addr 172.21.15.161:0/1738131934 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.014+0000 7f23c851e640 1 -- 172.21.15.161:0/1738131934 >> v1:172.21.15.45:6789/0 conn(0x559da0f7d3e0 legacy=0x559da0f7d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.013 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.014+0000 7f23c851e640 1 -- 172.21.15.161:0/1738131934 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da0f7df70 con 0x559da0f7a3a0 2024-05-08T09:23:37.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23c851e640 1 --2- 172.21.15.161:0/1738131934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da0f7a7c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f23b800a470 tx=0x7f23b801ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32edc162e2b04728 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23c7d1d640 1 -- 172.21.15.161:0/1738131934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8057070 con 0x559da0f7a3a0 2024-05-08T09:23:37.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23c7d1d640 1 -- 172.21.15.161:0/1738131934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b804adc0 con 0x559da0f7a3a0 2024-05-08T09:23:37.015 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23c7d1d640 1 -- 172.21.15.161:0/1738131934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8052590 con 0x559da0f7a3a0 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 -- 172.21.15.161:0/1738131934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 msgr2=0x559da0f7a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 --2- 172.21.15.161:0/1738131934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da0f7a7c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f23b800a470 tx=0x7f23b801ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 -- 172.21.15.161:0/1738131934 shutdown_connections 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 --2- 172.21.15.161:0/1738131934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da0f7a7c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 -- 172.21.15.161:0/1738131934 >> 172.21.15.161:0/1738131934 conn(0x559da0f75d40 msgr2=0x559da0f78160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 -- 172.21.15.161:0/1738131934 shutdown_connections 2024-05-08T09:23:37.016 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.016+0000 7f23caa1f800 1 -- 172.21.15.161:0/1738131934 wait complete. 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.030+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.030+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.030+0000 7f23caa1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.030+0000 7f23caa1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559da0ec71c0 con 0x559da0f7a3a0 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f23c851e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f23c851e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57774/0 (socket says 172.21.15.161:57774) 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f23c851e640 1 -- 172.21.15.161:0/1596744896 learned_addr learned my addr 172.21.15.161:0/1596744896 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f23c851e640 1 -- 172.21.15.161:0/1596744896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da106de60 con 0x559da0f7a3a0 2024-05-08T09:23:37.030 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f23c851e640 1 --2- 172.21.15.161:0/1596744896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f23b8055040 tx=0x7f23b804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183307349b704d26 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f22b660c640 1 -- 172.21.15.161:0/1596744896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8057040 con 0x559da0f7a3a0 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f22b660c640 1 -- 172.21.15.161:0/1596744896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8063070 con 0x559da0f7a3a0 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.031+0000 7f22b660c640 1 -- 172.21.15.161:0/1596744896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b805d790 con 0x559da0f7a3a0 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- 172.21.15.161:0/1596744896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 msgr2=0x559da106d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 --2- 172.21.15.161:0/1596744896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f23b8055040 tx=0x7f23b804c000 comp rx=0 tx=0).stop 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- 172.21.15.161:0/1596744896 shutdown_connections 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 --2- 172.21.15.161:0/1596744896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da106d890 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- 172.21.15.161:0/1596744896 >> 172.21.15.161:0/1596744896 conn(0x559da0f75d40 msgr2=0x559da10691b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.034 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- 172.21.15.161:0/1596744896 shutdown_connections 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- 172.21.15.161:0/1596744896 wait complete. 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.032+0000 7f23caa1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559da0f85880 con 0x559da0f7a3a0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23c851e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23c851e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57780/0 (socket says 172.21.15.161:57780) 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23c851e640 1 -- 172.21.15.161:0/2301507388 learned_addr learned my addr 172.21.15.161:0/2301507388 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23c851e640 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da10757e0 con 0x559da0f7a3a0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23c851e640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f23b800a470 tx=0x7f23b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f22b4e09640 1 -- 172.21.15.161:0/2301507388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8057050 con 0x559da0f7a3a0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f22b4e09640 1 -- 172.21.15.161:0/2301507388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b805dd40 con 0x559da0f7a3a0 2024-05-08T09:23:37.035 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f22b4e09640 1 -- 172.21.15.161:0/2301507388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23b8052570 con 0x559da0f7a3a0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da1075a70 con 0x559da0f7a3a0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.033+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da1078720 con 0x559da0f7a3a0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.034+0000 7f22b4e09640 1 -- 172.21.15.161:0/2301507388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23b8052710 con 0x559da0f7a3a0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.034+0000 7f22b4e09640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 0x7f22b0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.034+0000 7f22b4e09640 1 -- 172.21.15.161:0/2301507388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f23b808ddd0 con 0x559da0f7a3a0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.034+0000 7f23bffff640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 0x7f22b0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 0x559da107c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da107cab0 con 0x559da0f7d3e0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 0x559da107c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23bffff640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 0x7f22b0038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000f60 tx=0x7f23b00012b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.036 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 0x559da107c4e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2301507388 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23c000a4a0 con 0x559da0f7d3e0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.035+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da1079ab0 con 0x559da0f7d3e0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2301507388 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23c000a4a0 con 0x559da0f7d3e0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 0x559da10811d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10818c0 con 0x559da107ede0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23c851e640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 0x559da10811d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23c851e640 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 0x559da10811d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23c851e640 1 -- 172.21.15.161:0/2301507388 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f23b808d040 con 0x559da107ede0 2024-05-08T09:23:37.047 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.036+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da107dd90 con 0x559da0f7d3e0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2301507388 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23c000a4a0 con 0x559da0f7d3e0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da107e270 con 0x559da0f7d3e0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2301507388 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f23c000a4a0 con 0x559da0f7d3e0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23caa1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.037+0000 7f23caa1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559da0e6dcf0 con 0x559da0f7cfa0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.038+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.038+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57792/0 (socket says 172.21.15.161:57792) 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.038+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2819255729 learned_addr learned my addr 172.21.15.161:0/2819255729 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.038+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2819255729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da0f7b950 con 0x559da0f7cfa0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.038+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x559da107ce90 tx=0x7f23c0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f22adffb640 1 -- 172.21.15.161:0/2819255729 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c0014450 con 0x559da0f7cfa0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f22adffb640 1 -- 172.21.15.161:0/2819255729 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c0014610 con 0x559da0f7cfa0 2024-05-08T09:23:37.048 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f22adffb640 1 -- 172.21.15.161:0/2819255729 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c0014930 con 0x559da0f7cfa0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da0f7bbe0 con 0x559da0f7cfa0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da0f7c0e0 con 0x559da0f7cfa0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.039+0000 7f22adffb640 1 -- 172.21.15.161:0/2819255729 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23c0011040 con 0x559da0f7cfa0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f22adffb640 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 0x7f22a0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f22adffb640 1 -- 172.21.15.161:0/2819255729 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f23c001e070 con 0x559da0f7cfa0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23c851e640 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 0x7f22a0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23c851e640 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 0x7f22a0038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x559da107cf30 tx=0x7f23b8066f30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23caa1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23caa1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559da106e120 con 0x559da109ff40 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.040+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.049 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57806/0 (socket says 172.21.15.161:57806) 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2516853039 learned_addr learned my addr 172.21.15.161:0/2516853039 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23c8d1f640 1 -- 172.21.15.161:0/2516853039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da10a0930 con 0x559da109ff40 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/2516853039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f23c004c8d0 tx=0x7f23c0011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f7a9a7296921c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f229f7fe640 1 -- 172.21.15.161:0/2516853039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c00167e0 con 0x559da109ff40 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f229f7fe640 1 -- 172.21.15.161:0/2516853039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c0014ad0 con 0x559da109ff40 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f229f7fe640 1 -- 172.21.15.161:0/2516853039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c0016980 con 0x559da109ff40 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23caa1f800 1 -- 172.21.15.161:0/2516853039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 msgr2=0x559da10a0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.041+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2516853039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f23c004c8d0 tx=0x7f23c0011ef0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- 172.21.15.161:0/2516853039 shutdown_connections 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2516853039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a0360 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- 172.21.15.161:0/2516853039 >> 172.21.15.161:0/2516853039 conn(0x559da109c210 msgr2=0x559da109a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- 172.21.15.161:0/2516853039 shutdown_connections 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- 172.21.15.161:0/2516853039 wait complete. 2024-05-08T09:23:37.050 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 Processor -- start 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- start start 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23caa1f800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x559da10a1080 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23c8d1f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57816/0 (socket says 172.21.15.161:57816) 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 learned_addr learned my addr 172.21.15.161:0/4165974152 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.042+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559da10a7950 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f23c00119b0 tx=0x7f23c004c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f229dffb640 1 -- 172.21.15.161:0/4165974152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c0014c80 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f229dffb640 1 -- 172.21.15.161:0/4165974152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23c004e380 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559da10a7be0 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f229dffb640 1 -- 172.21.15.161:0/4165974152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f23c003bb20 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559da10aa890 con 0x559da109ff40 2024-05-08T09:23:37.051 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.043+0000 7f229dffb640 1 -- 172.21.15.161:0/4165974152 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f23c003bcc0 con 0x559da109ff40 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f229dffb640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2290036950 0x7f2290038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f229dffb640 1 -- 172.21.15.161:0/4165974152 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f23c000e040 con 0x559da109ff40 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f23c851e640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2290036950 0x7f2290038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f23c851e640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2290036950 0x7f2290038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x559da1081cc0 tx=0x7f23b8089000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da10b2f50 0x559da10b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.044+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10b5b60 con 0x559da10b2f50 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23bffff640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da10b2f50 0x559da10b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23bffff640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da10b2f50 0x559da10b5410 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23b0009050 con 0x559da10b2f50 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 realm 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.052 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10b23a0 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23b0009050 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10b6650 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23b0009050 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.045+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10b6f20 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f23b0009050 con 0x559da10b2f50 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.053 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da10b7860 0x559da10b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10ba3e0 con 0x559da10b7860 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da10b7860 0x559da10b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23c8d1f640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da10b7860 0x559da10b9c50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 20 searching for the correct realm 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.046+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559da10bc3b0 0x559da10be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10bc3b0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23c851e640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559da10bc3b0 0x559da10be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23c851e640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559da10bc3b0 0x559da10be870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23c851e640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f23b809a040 0x7f23b8080a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.054 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x7f23b809a040 2024-05-08T09:23:37.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.047+0000 7f23bffff640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f23b809a040 0x7f23b8080a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.048+0000 7f23bffff640 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f23b809a040 0x7f23b8080a90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.048+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0009050 con 0x7f23b809a040 2024-05-08T09:23:37.055 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.048+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b2f50 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0009050 con 0x559da10b2f50 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b2f50 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.049+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x7f23b809a040 2024-05-08T09:23:37.066 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10bc3b0 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b2f50 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.050+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b7860 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10b2f50 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x7f23b809a040 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x559da10bef40 con 0x559da10bc3b0 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.051+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.067 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b7860 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.052+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.053+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b2f50 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.053+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.053+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b2f50 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.053+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.053+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b7860 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.068 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x7f23b809a040 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b2f50 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.054+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b7860 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b7860 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x7f23b809a040 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.055+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10bc3b0 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x7f23b809a040 2024-05-08T09:23:37.069 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x559da10b2f50 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f23b80a8040 con 0x7f23b809a040 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.056+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10badd0 con 0x559da10b2f50 2024-05-08T09:23:37.070 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10bb670 con 0x559da10b2f50 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10baa10 con 0x559da10b2f50 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 zone default found 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 4 Realm: () 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:37.071 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 zonegroup default 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10bf470 con 0x559da10b7860 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.057+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10c1740 con 0x559da10bc3b0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10c1ae0 con 0x559da10bc3b0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 20 started sync module instance, tier type = 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:37.072 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.058+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c0bd0 con 0x7f23b809a040 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.059+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.059+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94135500148992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c0bd0 con 0x7f23b809a040 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.059+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c24f0 con 0x559da10b2f50 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.060+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94135500148992] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.060+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.060+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94135500153376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c0bd0 con 0x559da10b2f50 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.060+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c2f40 con 0x559da10bc3b0 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.061+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94135500153376] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.061+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.061+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94135500146464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c0b40 con 0x559da10bc3b0 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.062+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c3e00 con 0x7f23b809a040 2024-05-08T09:23:37.073 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.062+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94135500146464] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.063+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.063+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94135500159312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c4220 con 0x7f23b809a040 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.063+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c4be0 con 0x559da10b2f50 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.064+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94135500159312] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.064+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.064+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94135500160848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c4be0 con 0x559da10b2f50 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.064+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c55a0 con 0x559da10b7860 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.065+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94135500160848] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.067+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.067+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94135500162864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c4b50 con 0x559da10b7860 2024-05-08T09:23:37.074 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.067+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c6300 con 0x559da10b7860 2024-05-08T09:23:37.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.068+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94135500162864] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.078 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.068+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.068+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94135500167488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c62c0 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.068+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c6d70 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94135500167488] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94135500171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c6d30 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=0 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=1 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=2 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=3 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=4 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=5 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.069+0000 7f23caa1f800 20 add_watcher() i=6 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94135500171360] v29'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.079 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23caa1f800 20 add_watcher() i=7 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23caa1f800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10ca220 con 0x559da10b2f50 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.070+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94135500168544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c7770 con 0x559da10b2f50 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.071+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94135500168544] v29'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.071+0000 7f227e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 5 note: GC not initialized 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f227d7e2640 20 reqs_thread_entry: start 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 20 Filter name: none 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f21eeffd640 20 reqs_thread_entry: start 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:37.080 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.072+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10fd770 con 0x559da10b7860 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23caa1f800 20 rados_obj.operate() r=0 bl.length=460 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23caa1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23caa1f800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23caa1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.073+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1103a90 con 0x559da10b7860 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.074+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.074+0000 7f23caa1f800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.074+0000 7f23caa1f800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.074+0000 7f23caa1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.074+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94135500420352 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x559da10ff2e0 con 0x559da10b2f50 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94135500160848 notify 124554051616 ret 0) ==== 691+0+0 (crc 0 0 0) 0x559da0f7ae40 con 0x559da10b2f50 2024-05-08T09:23:37.081 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f229f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051616 cookie 94135500160848 notifier 4904 bl.length()=649 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f229f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f229f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94135500420352 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f229f7fe640 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7f228c003ea0 con 0x559da10b2f50 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.075+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94135500420352 notify 124554051616 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f23b003e610 con 0x559da10b2f50 2024-05-08T09:23:37.082 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:37.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.076+0000 7f227e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:37.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.076+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94135500168544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1102de0 con 0x559da10b2f50 2024-05-08T09:23:37.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.077+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94135500168544] v29'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.077+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94135500148992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1102de0 con 0x7f23b809a040 2024-05-08T09:23:37.087 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.078+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94135500148992] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.078+0000 7f23caa1f800 20 remove_watcher() i=0 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.078+0000 7f23caa1f800 2 removed watcher, disabling cache 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.078+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94135500153376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1102de0 con 0x559da10b2f50 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.079+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94135500153376] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.079+0000 7f23caa1f800 20 remove_watcher() i=1 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.079+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94135500146464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1102de0 con 0x559da10bc3b0 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.080+0000 7f23c851e640 1 -- 172.21.15.161:0/4165974152 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94135500146464] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b8096070 con 0x559da10bc3b0 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.080+0000 7f23caa1f800 20 remove_watcher() i=2 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.080+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94135500159312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da1102de0 con 0x7f23b809a040 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.081+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94135500159312] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x7f23b809a040 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.081+0000 7f23caa1f800 20 remove_watcher() i=3 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.081+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94135500160848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c2220 con 0x559da10b2f50 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.082+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94135500160848] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23b0029040 con 0x559da10b2f50 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.082+0000 7f23caa1f800 20 remove_watcher() i=4 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.082+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94135500162864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c0720 con 0x559da10b7860 2024-05-08T09:23:37.088 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.083+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94135500162864] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.083+0000 7f23caa1f800 20 remove_watcher() i=5 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.083+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94135500167488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c3950 con 0x559da10b7860 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.085+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94135500167488] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.085+0000 7f23caa1f800 20 remove_watcher() i=6 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.085+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94135500171360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x559da10c2220 con 0x559da10b7860 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23c8d1f640 1 -- 172.21.15.161:0/4165974152 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94135500171360] v29'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f23c002a070 con 0x559da10b7860 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 20 remove_watcher() i=7 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da10b7860 msgr2=0x559da10b9c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da10b7860 0x559da10b9c50 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da10b2f50 msgr2=0x559da10b5410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da10b2f50 0x559da10b5410 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f23b809a040 msgr2=0x7f23b8080a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f23b809a040 0x7f23b8080a90 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.089 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559da10bc3b0 msgr2=0x559da10be870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x559da10bc3b0 0x559da10be870 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2290036950 msgr2=0x7f2290038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2290036950 0x7f2290038e10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x559da1081cc0 tx=0x7f23b8089000 comp rx=0 tx=0).stop 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 msgr2=0x559da10a7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23bffff640 1 -- 172.21.15.161:0/4165974152 reap_dead start 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f23c00119b0 tx=0x7f23c004c860 comp rx=0 tx=0).stop 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 shutdown_connections 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/4165974152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da109ff40 0x559da10a7410 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 >> 172.21.15.161:0/4165974152 conn(0x559da109c210 msgr2=0x559da1099870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 shutdown_connections 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/4165974152 wait complete. 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 msgr2=0x7f22a0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.090 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 0x7f22a0038e10 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x559da107cf30 tx=0x7f23b8066f30 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 msgr2=0x559da0f7b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x559da107ce90 tx=0x7f23c0018830 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 shutdown_connections 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22a0036950 0x7f22a0038e10 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2819255729 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7cfa0 0x559da0f7b410 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 >> 172.21.15.161:0/2819255729 conn(0x559da1084ad0 msgr2=0x559da1084ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 shutdown_connections 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.086+0000 7f23caa1f800 1 -- 172.21.15.161:0/2819255729 wait complete. 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 msgr2=0x559da10811d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 0x559da10811d0 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 msgr2=0x559da107c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 0x559da107c4e0 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 msgr2=0x7f22b0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 0x7f22b0038e10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f23b0000f60 tx=0x7f23b00012b0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.091 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 msgr2=0x559da10752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f23b800a470 tx=0x7f23b8002fb0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 shutdown_connections 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x559da107ede0 0x559da10811d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x559da0f7d3e0 0x559da107c4e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f22b0036950 0x7f22b0038e10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 --2- 172.21.15.161:0/2301507388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559da0f7a3a0 0x559da10752a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 >> 172.21.15.161:0/2301507388 conn(0x559da0f75d40 msgr2=0x559da10679b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 shutdown_connections 2024-05-08T09:23:37.092 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.087+0000 7f23caa1f800 1 -- 172.21.15.161:0/2301507388 wait complete. 2024-05-08T09:23:37.095 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:37.095 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:37.095 ERROR:root:0 2024-05-08T09:23:37.095 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:37.095 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-05-08T09:23:37.096 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.143+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.143+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.143+0000 7fccca923800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ce88631700 0x55ce88633af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccca923800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ce88634030 con 0x55ce8862dbf0 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccca923800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x55ce884be050 con 0x55ce88631700 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccbdee3640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x55ce88631700 0x55ce88633af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccc66e4640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x55ce8862dbf0 0x55ce8862ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:51194/0 (socket says 172.21.15.161:51194) 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccc66e4640 1 -- 172.21.15.161:0/1004928675 learned_addr learned my addr 172.21.15.161:0/1004928675 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccbdee3640 1 -- 172.21.15.161:0/1004928675 >> v1:172.21.15.45:6789/0 conn(0x55ce8862dbf0 legacy=0x55ce8862ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.144 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.144+0000 7fccbdee3640 1 -- 172.21.15.161:0/1004928675 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce88635210 con 0x55ce88631700 2024-05-08T09:23:37.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.146+0000 7fccbdee3640 1 --2- 172.21.15.161:0/1004928675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88631700 0x55ce88633af0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fccb000a470 tx=0x7fccb001ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42cb5dc8dfc80091 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.146+0000 7fccc5ee3640 1 -- 172.21.15.161:0/1004928675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb0057070 con 0x55ce88631700 2024-05-08T09:23:37.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.146+0000 7fccc5ee3640 1 -- 172.21.15.161:0/1004928675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb0052570 con 0x55ce88631700 2024-05-08T09:23:37.145 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.146+0000 7fccc5ee3640 1 -- 172.21.15.161:0/1004928675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb0052870 con 0x55ce88631700 2024-05-08T09:23:37.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 -- 172.21.15.161:0/1004928675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88631700 msgr2=0x55ce88633af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.146 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 --2- 172.21.15.161:0/1004928675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88631700 0x55ce88633af0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fccb000a470 tx=0x7fccb001ce90 comp rx=0 tx=0).stop 2024-05-08T09:23:37.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 -- 172.21.15.161:0/1004928675 shutdown_connections 2024-05-08T09:23:37.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 --2- 172.21.15.161:0/1004928675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88631700 0x55ce88633af0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 -- 172.21.15.161:0/1004928675 >> 172.21.15.161:0/1004928675 conn(0x55ce886275c0 msgr2=0x55ce886299e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 -- 172.21.15.161:0/1004928675 shutdown_connections 2024-05-08T09:23:37.147 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.147+0000 7fccca923800 1 -- 172.21.15.161:0/1004928675 wait complete. 2024-05-08T09:23:37.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.160 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccca923800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccca923800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce885781c0 con 0x55ce8862dbf0 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccc66e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccc66e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57830/0 (socket says 172.21.15.161:57830) 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccc66e4640 1 -- 172.21.15.161:0/3595148347 learned_addr learned my addr 172.21.15.161:0/3595148347 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.161+0000 7fccc66e4640 1 -- 172.21.15.161:0/3595148347 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce8862baf0 con 0x55ce8862dbf0 2024-05-08T09:23:37.161 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccc66e4640 1 --2- 172.21.15.161:0/3595148347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fccb8001d50 tx=0x7fccb800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e59f34d8d830866 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fcbb4608640 1 -- 172.21.15.161:0/3595148347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb8013030 con 0x55ce8862dbf0 2024-05-08T09:23:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fcbb4608640 1 -- 172.21.15.161:0/3595148347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb800e470 con 0x55ce8862dbf0 2024-05-08T09:23:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fcbb4608640 1 -- 172.21.15.161:0/3595148347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb800e810 con 0x55ce8862dbf0 2024-05-08T09:23:37.163 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccca923800 1 -- 172.21.15.161:0/3595148347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 msgr2=0x55ce8862d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccca923800 1 --2- 172.21.15.161:0/3595148347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fccb8001d50 tx=0x7fccb800b6c0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccca923800 1 -- 172.21.15.161:0/3595148347 shutdown_connections 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccca923800 1 --2- 172.21.15.161:0/3595148347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce8862d530 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.162+0000 7fccca923800 1 -- 172.21.15.161:0/3595148347 >> 172.21.15.161:0/3595148347 conn(0x55ce886275c0 msgr2=0x55ce8871a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 -- 172.21.15.161:0/3595148347 shutdown_connections 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 -- 172.21.15.161:0/3595148347 wait complete. 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccca923800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce88634500 con 0x55ce8862dbf0 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccc66e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccc66e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57840/0 (socket says 172.21.15.161:57840) 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccc66e4640 1 -- 172.21.15.161:0/110498414 learned_addr learned my addr 172.21.15.161:0/110498414 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.164 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.163+0000 7fccc66e4640 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce887289c0 con 0x55ce8862dbf0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fccc66e4640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x55ce8862cb60 tx=0x7fccb8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fcbb2e05640 1 -- 172.21.15.161:0/110498414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb8027070 con 0x55ce8862dbf0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fcbb2e05640 1 -- 172.21.15.161:0/110498414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb8019900 con 0x55ce8862dbf0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce88728c50 con 0x55ce8862dbf0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fcbb2e05640 1 -- 172.21.15.161:0/110498414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccb8019c40 con 0x55ce8862dbf0 2024-05-08T09:23:37.165 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.164+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce8872b900 con 0x55ce8862dbf0 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fcbb2e05640 1 -- 172.21.15.161:0/110498414 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fccb802a070 con 0x55ce8862dbf0 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fcbb2e05640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 0x7fcbac038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fcbb2e05640 1 -- 172.21.15.161:0/110498414 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fccb801f070 con 0x55ce8862dbf0 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccbdee3640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 0x7fcbac038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 0x55ce8872f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8872fc00 con 0x55ce88631700 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 0x55ce8872f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.172 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccbdee3640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 0x7fcbac038dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fccb0054000 tx=0x7fccb004e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.165+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 0x55ce8872f6c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccc6ee5640 1 -- 172.21.15.161:0/110498414 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccc000a4a0 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8872cc90 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccc6ee5640 1 -- 172.21.15.161:0/110498414 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccc000a4a0 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 0x55ce88734320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88734a10 con 0x55ce88731f30 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.166+0000 7fccc66e4640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 0x55ce88734320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.167+0000 7fccc66e4640 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 0x55ce88734320 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.167+0000 7fccc66e4640 1 -- 172.21.15.161:0/110498414 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fccb8029030 con 0x55ce88731f30 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.167+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88730ee0 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.167+0000 7fccc6ee5640 1 -- 172.21.15.161:0/110498414 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccc000a4a0 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.167+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88731380 con 0x55ce88631700 2024-05-08T09:23:37.173 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccc6ee5640 1 -- 172.21.15.161:0/110498414 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fccc000a4a0 con 0x55ce88631700 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccca923800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccca923800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce8851ecf0 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57850/0 (socket says 172.21.15.161:57850) 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.168+0000 7fccc6ee5640 1 -- 172.21.15.161:0/1958638822 learned_addr learned my addr 172.21.15.161:0/1958638822 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fccc6ee5640 1 -- 172.21.15.161:0/1958638822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce88744490 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55ce88729880 tx=0x7fccc0018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fcbabfff640 1 -- 172.21.15.161:0/1958638822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc0014450 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fcbabfff640 1 -- 172.21.15.161:0/1958638822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc00145f0 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fcbabfff640 1 -- 172.21.15.161:0/1958638822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc0014910 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce88744f00 con 0x55ce88743b30 2024-05-08T09:23:37.174 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.169+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce88745400 con 0x55ce88743b30 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fcbabfff640 1 -- 172.21.15.161:0/1958638822 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fccc0011040 con 0x55ce88743b30 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fcbabfff640 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 0x7fcba0038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fcbabfff640 1 -- 172.21.15.161:0/1958638822 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fccc001e070 con 0x55ce88743b30 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccc66e4640 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 0x7fcba0038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccc66e4640 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 0x7fcba0038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55ce88730080 tx=0x7fccb800ef30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccca923800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.170+0000 7fccca923800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce8862be70 con 0x55ce88750ea0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57858/0 (socket says 172.21.15.161:57858) 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccc6ee5640 1 -- 172.21.15.161:0/3971452739 learned_addr learned my addr 172.21.15.161:0/3971452739 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccc6ee5640 1 -- 172.21.15.161:0/3971452739 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce88751890 con 0x55ce88750ea0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/3971452739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fccc004c970 tx=0x7fccc0011700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfae43fad52c8d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.175 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fcba9ffb640 1 -- 172.21.15.161:0/3971452739 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc0016940 con 0x55ce88750ea0 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fcba9ffb640 1 -- 172.21.15.161:0/3971452739 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc003bb90 con 0x55ce88750ea0 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fcba9ffb640 1 -- 172.21.15.161:0/3971452739 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc004b1f0 con 0x55ce88750ea0 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccca923800 1 -- 172.21.15.161:0/3971452739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 msgr2=0x55ce887512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccca923800 1 --2- 172.21.15.161:0/3971452739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fccc004c970 tx=0x7fccc0011700 comp rx=0 tx=0).stop 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccca923800 1 -- 172.21.15.161:0/3971452739 shutdown_connections 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccca923800 1 --2- 172.21.15.161:0/3971452739 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887512c0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.171+0000 7fccca923800 1 -- 172.21.15.161:0/3971452739 >> 172.21.15.161:0/3971452739 conn(0x55ce8874d170 msgr2=0x55ce8874b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 -- 172.21.15.161:0/3971452739 shutdown_connections 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 -- 172.21.15.161:0/3971452739 wait complete. 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 Processor -- start 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 -- start start 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccca923800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x55ce88752020 con 0x55ce88750ea0 2024-05-08T09:23:37.176 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccc6ee5640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:57870/0 (socket says 172.21.15.161:57870) 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 learned_addr learned my addr 172.21.15.161:0/788509474 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.172+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce887588f0 con 0x55ce88750ea0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fccc002bfd0 tx=0x7fccc004c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fcb97fff640 1 -- 172.21.15.161:0/788509474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc004e070 con 0x55ce88750ea0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fcb97fff640 1 -- 172.21.15.161:0/788509474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccc004e210 con 0x55ce88750ea0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ce88758b80 con 0x55ce88750ea0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fcb97fff640 1 -- 172.21.15.161:0/788509474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fccc00133b0 con 0x55ce88750ea0 2024-05-08T09:23:37.177 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce8875b830 con 0x55ce88750ea0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.173+0000 7fcb97fff640 1 -- 172.21.15.161:0/788509474 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fccc0013550 con 0x55ce88750ea0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fcb97fff640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcb90036900 0x7fcb90038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fcb97fff640 1 -- 172.21.15.161:0/788509474 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fccc0033030 con 0x55ce88750ea0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccc66e4640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcb90036900 0x7fcb90038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccc66e4640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcb90036900 0x7fcb90038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccb8017a60 tx=0x7fccb804c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce887640c0 0x55ce88766580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88766cd0 con 0x55ce887640c0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.174+0000 7fccbdee3640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce887640c0 0x55ce88766580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccbdee3640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce887640c0 0x55ce88766580 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.192 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 realm 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce887670a0 con 0x55ce887640c0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88767970 con 0x55ce887640c0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.175+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88767d10 con 0x55ce887640c0 2024-05-08T09:23:37.193 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccca923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88768a70 0x55ce8876ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876b470 con 0x55ce88768a70 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88768a70 0x55ce8876ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccc6ee5640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88768a70 0x55ce8876ae60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.176+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccca923800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccca923800 20 searching for the correct realm 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce8876d400 0x55ce8876f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccc66e4640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce8876d400 0x55ce8876f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.194 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccc66e4640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce8876d400 0x55ce8876f8c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.177+0000 7fccc66e4640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fccb804ac20 0x7fccb80446e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.178+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.178+0000 7fccbdee3640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fccb804ac20 0x7fccb80446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.178+0000 7fccbdee3640 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fccb804ac20 0x7fccb80446e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.178+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.178+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.195 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.179+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.180+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.196 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.181+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.197 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.182+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.183+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.184+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.198 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce88768a70 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.185+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce8876d400 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x55ce887640c0 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876ff90 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.199 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.186+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876c950 con 0x55ce887640c0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876bda0 con 0x55ce887640c0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.200 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8876b860 con 0x55ce887640c0 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 zone default found 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 4 Realm: () 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 zonegroup default 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce887708c0 con 0x55ce88768a70 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.201 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.187+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88772af0 con 0x55ce8876d400 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce88772e90 con 0x55ce8876d400 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 20 started sync module instance, tier type = 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.188+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88771f30 con 0x7fccb804ac20 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.189+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.202 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.189+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94345541133360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88771f30 con 0x7fccb804ac20 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.189+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88773850 con 0x55ce887640c0 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.190+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94345541133360] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.191+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.191+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94345541131360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88773850 con 0x55ce887640c0 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.191+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88774270 con 0x55ce8876d400 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.192+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94345541131360] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.192+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.192+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94345541137312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887737c0 con 0x55ce8876d400 2024-05-08T09:23:37.203 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.192+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88775130 con 0x7fccb804ac20 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.193+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94345541137312] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.193+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.193+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94345541143680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88775550 con 0x7fccb804ac20 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.193+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88775f10 con 0x55ce887640c0 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.194+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.208 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.194+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94345541147232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88775e80 con 0x55ce887640c0 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.194+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88776ec0 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.194+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94345541143680] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.195+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94345541147232] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.195+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.195+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94345541149440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88776ec0 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.195+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88777760 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.196+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94345541149440] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.196+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.196+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94345541144736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88776ec0 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.196+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88777de0 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.197+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94345541144736] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.197+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.197+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94345541155024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88777da0 con 0x55ce88768a70 2024-05-08T09:23:37.209 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.197+0000 7fccca923800 20 add_watcher() i=0 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=1 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=2 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=3 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=4 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=5 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=6 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94345541155024] v29'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 20 add_watcher() i=7 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 2 all 8 watchers are set, enabling cache 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.198+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce8877b230 con 0x55ce887640c0 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.199+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.199+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94345541153456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887786b0 con 0x55ce887640c0 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94345541153456] v29'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.210 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fcb7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccca923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccca923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccca923800 5 note: GC not initialized 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fcaf77fe640 20 reqs_thread_entry: start 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccca923800 20 init_complete bucket index max shards: 11 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.200+0000 7fccca923800 20 Filter name: none 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fcaf57fa640 20 reqs_thread_entry: start 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 20 rados->read ofs=0 len=0 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce887ae6c0 con 0x55ce88768a70 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 20 rados_obj.operate() r=0 bl.length=473 2024-05-08T09:23:37.211 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.201+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887b4d00 con 0x55ce88768a70 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.202+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v29'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.202+0000 7fccca923800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.202+0000 7fccca923800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.202+0000 7fccca923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.202+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94345541404528 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x55ce887b3850 con 0x55ce887640c0 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== watch-notify(notify (1) cookie 94345541147232 notify 124554051617 ret 0) ==== 691+0+0 (crc 0 0 0) 0x55ce88635210 con 0x55ce887640c0 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fcba9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 124554051617 cookie 94345541147232 notifier 4911 bl.length()=649 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fcba9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fcba9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(64 notify.4 [notify cookie 94345541404528 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.212 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fcba9ffb640 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x7fcb8c003ea0 con 0x55ce887640c0 2024-05-08T09:23:37.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.213 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.203+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== watch-notify(notify_complete (2) cookie 94345541404528 notify 124554051617 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fccb005db60 con 0x55ce887640c0 2024-05-08T09:23:37.213 INFO:teuthology.orchestra.run.smithi161.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-05-08T09:23:35.331403Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-05-08T09:23:35.331384Z","tags":[],"group_ids":[]} 2024-05-08T09:23:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.204+0000 7fcb7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:23:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.204+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94345541153456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887b3c00 con 0x55ce887640c0 2024-05-08T09:23:37.218 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.205+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94345541153456] v29'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.205+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94345541133360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887772b0 con 0x7fccb804ac20 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.206+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94345541133360] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.206+0000 7fccca923800 20 remove_watcher() i=0 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.206+0000 7fccca923800 2 removed watcher, disabling cache 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.206+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94345541131360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887772b0 con 0x55ce887640c0 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.207+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94345541131360] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.207+0000 7fccca923800 20 remove_watcher() i=1 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.207+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94345541137312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887772b0 con 0x55ce8876d400 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.208+0000 7fccc66e4640 1 -- 172.21.15.161:0/788509474 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94345541137312] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb8029030 con 0x55ce8876d400 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.208+0000 7fccca923800 20 remove_watcher() i=2 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.208+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94345541143680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887733a0 con 0x7fccb804ac20 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.209+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94345541143680] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x7fccb804ac20 2024-05-08T09:23:37.219 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.209+0000 7fccca923800 20 remove_watcher() i=3 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.209+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94345541147232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887733a0 con 0x55ce887640c0 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.210+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94345541147232] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccb005a040 con 0x55ce887640c0 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.210+0000 7fccca923800 20 remove_watcher() i=4 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.210+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94345541149440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce88775a60 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.211+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94345541149440] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.211+0000 7fccca923800 20 remove_watcher() i=5 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.211+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94345541144736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887733a0 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.212+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94345541144736] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.212+0000 7fccca923800 20 remove_watcher() i=6 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.212+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94345541155024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x55ce887733a0 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccc6ee5640 1 -- 172.21.15.161:0/788509474 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94345541155024] v29'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fccc002a070 con 0x55ce88768a70 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 20 remove_watcher() i=7 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88768a70 msgr2=0x55ce8876ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.220 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88768a70 0x55ce8876ae60 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce887640c0 msgr2=0x55ce88766580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce887640c0 0x55ce88766580 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fccb804ac20 msgr2=0x7fccb80446e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7fccb804ac20 0x7fccb80446e0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce8876d400 msgr2=0x55ce8876f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.213+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x55ce8876d400 0x55ce8876f8c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcb90036900 msgr2=0x7fcb90038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcb90036900 0x7fcb90038dc0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccb8017a60 tx=0x7fccb804c000 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 msgr2=0x55ce887583b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccbdee3640 1 -- 172.21.15.161:0/788509474 reap_dead start 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fccc002bfd0 tx=0x7fccc004c8d0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 shutdown_connections 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/788509474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88750ea0 0x55ce887583b0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.221 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 >> 172.21.15.161:0/788509474 conn(0x55ce8874d170 msgr2=0x55ce8874a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 shutdown_connections 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/788509474 wait complete. 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 msgr2=0x7fcba0038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 0x7fcba0038e10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x55ce88730080 tx=0x7fccb800ef30 comp rx=0 tx=0).stop 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 msgr2=0x55ce88743f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x55ce88729880 tx=0x7fccc0018830 comp rx=0 tx=0).stop 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 shutdown_connections 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcba0036950 0x7fcba0038e10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/1958638822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce88743b30 0x55ce88743f50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 >> 172.21.15.161:0/1958638822 conn(0x55ce88737bd0 msgr2=0x55ce88737fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 shutdown_connections 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/1958638822 wait complete. 2024-05-08T09:23:37.222 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 msgr2=0x55ce88734320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 0x55ce88734320 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 msgr2=0x55ce8872f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.214+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 0x55ce8872f6c0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 msgr2=0x7fcbac038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 0x7fcbac038dc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fccb0054000 tx=0x7fccb004e000 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 msgr2=0x55ce88728480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x55ce8862cb60 tx=0x7fccb8000bc0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 shutdown_connections 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x55ce88731f30 0x55ce88734320 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x55ce88631700 0x55ce8872f6c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fcbac036900 0x7fcbac038dc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 --2- 172.21.15.161:0/110498414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55ce8862dbf0 0x55ce88728480 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 >> 172.21.15.161:0/110498414 conn(0x55ce886275c0 msgr2=0x55ce8862c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:23:37.223 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 shutdown_connections 2024-05-08T09:23:37.224 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:23:37.215+0000 7fccca923800 1 -- 172.21.15.161:0/110498414 wait complete. 2024-05-08T09:23:37.224 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:37.225 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-05-08T09:23:35.331403Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-05-08T09:23:35.331384Z', 'tags': [], 'group_ids': []} 2024-05-08T09:23:37.225 ERROR:root:0 2024-05-08T09:23:37.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T09:23:37.232 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.233 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.236 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.237 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T09:23:37.242 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.243 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.246 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.246 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-05-08T09:23:37.254 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-05-08T09:23:37.254 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.258 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.258 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-05-08T09:23:37.265 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.265 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.268 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.269 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-05-08T09:23:37.275 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-05-08T09:23:37.276 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.279 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.280 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-05-08T09:23:37.287 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-05-08T09:23:37.288 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.291 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.291 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-05-08T09:23:37.299 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.300 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.304 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.304 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-05-08T09:23:37.309 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.313 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.314 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-05-08T09:23:37.320 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.320 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.324 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.324 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.329 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T09:23:37.329 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T09:23:37.333 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T09:23:37.344 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-05-08T09:23:37.348 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-05-08T09:23:37.348 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T09:23:37.352 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:23:37.342140Z', 'creation_time': '2024-05-08T09:23:37.339506Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:23:37.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-05-08T09:23:37.357 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:23:37.342140Z', 'creation_time': '2024-05-08T09:23:37.339506Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}}] 2024-05-08T09:23:37.363 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T09:23:37.367 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:23:37.342140Z', 'creation_time': '2024-05-08T09:23:37.339506Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:23:37.367 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-05-08T09:23:37.371 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000ad25a25fceface8b-00663b4499-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:23:37.376 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-05-08T09:23:37.382 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.383 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-05-08T09:23:37.391 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:23:37.439 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11'} 2024-05-08T09:23:37.448 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.453 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11'} 2024-05-08T09:23:37.463 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.464 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-05-08T09:23:37.473 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.483 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-05-08T09:23:37.490 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:23:37.491 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-05-08T09:23:37.495 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '05c85a99-f6a8-405d-b310-d83661265ff5', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'marker': '7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-05-08T09:23:37.460676Z', 'creation_time': '2024-05-08T09:23:37.339506Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}} 2024-05-08T09:24:37.545 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-05-08T09:24:37.565 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'anonymous', 'categories': []}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'bar', 'categories': []}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'bud', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'fud', 'categories': []}, {'bucket': 'myfoo7', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'fud', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}]} 2024-05-08T09:24:37.565 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-05-08T09:24:37.581 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}]}, {'bucket': 'myfoo7', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4}}]} 2024-05-08T09:24:37.581 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T09:24:37.587 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10}}]} 2024-05-08T09:24:37.587 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-05-08T09:24:37.592 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}}]} 2024-05-08T09:24:37.592 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-05-08T09:24:37.597 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}}]} 2024-05-08T09:24:37.597 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-05-08T09:24:37.602 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}]}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}}]} 2024-05-08T09:24:37.602 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-05-08T09:24:37.606 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': []}, {'bucket': 'useless-bucket', 'time': '2024-05-08T09:00:00.000000Z', 'epoch': 1715158800, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}]} 2024-05-08T09:24:37.607 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-05-08T09:24:37.614 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:37.614 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-05-08T09:24:37.619 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-05-08T09:24:37.619 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-05-08T09:24:37.628 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:24:37.632 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-05-08T09:24:37.640 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:24:37.909 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T09:24:37.914 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000d3479997364e5580-00663b44d5-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.011 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T09:24:38.016 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T09:24:38.020 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-05-08T09:24:38.025 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-05-08T09:24:38.134 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-05-08T09:24:38.174 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:38.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T09:24:38.180 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-05-08T09:24:38.181 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-05-08T09:24:38.186 INFO:tasks.radosgw_admin_rest: json result: [] 2024-05-08T09:24:38.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-05-08T09:24:38.202 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx00000f3b07c5e40ac1aea-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.226 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-05-08T09:24:38.256 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:38.256 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-05-08T09:24:38.260 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000e6dc4b0576153f07-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.260 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-05-08T09:24:38.264 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': '57dabfa9-0c4c-41b5-8694-d94716898a33'}]}} 2024-05-08T09:24:38.264 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-05-08T09:24:38.274 INFO:tasks.radosgw_admin_rest: json result: {'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-05-08T09:24:38.275 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T09:24:38.279 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T09:24:38.279 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-05-08T09:24:38.283 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000de037594722e6ea4-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.283 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-05-08T09:24:38.287 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000007bfe2737658a83f8-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.298 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T09:24:38.302 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T09:24:38.302 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-05-08T09:24:38.305 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000226788d0ecf0e45a-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.306 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-05-08T09:24:38.310 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000f2a66a924ca790e1-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.310 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-05-08T09:24:38.314 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-05-08T09:24:38.315 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-05-08T09:24:38.318 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000006d024fce3183339a-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.318 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-05-08T09:24:38.322 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000c20cef5e363da2b4-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.322 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-05-08T09:24:38.326 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008eb1a7f0284cb948-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.326 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-05-08T09:24:38.330 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000044dc8c48438ab20a-00663b44d6-4223-default', 'HostId': '4223-default-default'} 2024-05-08T09:24:38.330 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-05-08T09:24:38.339 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:38.339 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-05-08T09:24:38.343 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-05-08T09:24:38.343 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-05-08T09:24:38.348 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:38.349 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-05-08T09:24:38.352 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-05-08T09:24:38.353 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-05-08T09:24:38.358 INFO:tasks.radosgw_admin_rest: empty result 2024-05-08T09:24:38.362 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-05-08T09:24:38.373 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-05-08T09:24:38.373 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:24:38.374 INFO:tasks.rgw.client.0.smithi161.stdout:2024-05-08T09:24:38.375+0000 7fbd01e1a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 35152) UID: 0 2024-05-08T09:24:38.374 INFO:tasks.rgw.client.0.smithi161.stdout:2024-05-08T09:24:38.375+0000 7fbd0566b880 -1 shutting down 2024-05-08T09:24:40.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-05-08T09:24:44.475 INFO:tasks.rgw.client.0:Stopped 2024-05-08T09:24:44.475 DEBUG:teuthology.orchestra.run.smithi161:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-05-08T09:24:44.494 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /etc/ceph/vault-root-token 2024-05-08T09:24:44.564 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-05-08T09:24:44.632 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-05-08T09:24:44.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-05-08T09:24:44.632 DEBUG:teuthology.orchestra.run.smithi161:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-05-08T09:24:44.718 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setuser ceph since I am not root 2024-05-08T09:24:44.718 INFO:teuthology.orchestra.run.smithi161.stderr:ignoring --setgroup ceph since I am not root 2024-05-08T09:24:44.719 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.720+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.720+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.720+0000 7f0778d46800 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56292f065450 0x56292f067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.720+0000 7f0778d46800 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56292f067e10 con 0x56292f060fc0 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.720+0000 7f0778d46800 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x56292eef3050 con 0x56292f065450 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.721+0000 7f076ffff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x56292f065450 0x56292f067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.721+0000 7f077684c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x56292f060fc0 0x56292f0613e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.161:36950/0 (socket says 172.21.15.161:36950) 2024-05-08T09:24:44.720 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.721+0000 7f077684c640 1 -- 172.21.15.161:0/3762095642 learned_addr learned my addr 172.21.15.161:0/3762095642 (peer_addr_for_me v1:172.21.15.161:0/0) 2024-05-08T09:24:44.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.721+0000 7f076ffff640 1 -- 172.21.15.161:0/3762095642 >> v1:172.21.15.45:6789/0 conn(0x56292f060fc0 legacy=0x56292f0613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.721 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.721+0000 7f076ffff640 1 -- 172.21.15.161:0/3762095642 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f069040 con 0x56292f065450 2024-05-08T09:24:44.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.723+0000 7f076ffff640 1 --2- 172.21.15.161:0/3762095642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f065450 0x56292f067840 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f076000a600 tx=0x7f076001ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a10011b994468d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.723+0000 7f077604b640 1 -- 172.21.15.161:0/3762095642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f076000a200 con 0x56292f065450 2024-05-08T09:24:44.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.723+0000 7f077604b640 1 -- 172.21.15.161:0/3762095642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076000a3a0 con 0x56292f065450 2024-05-08T09:24:44.722 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.723+0000 7f077604b640 1 -- 172.21.15.161:0/3762095642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07600086e0 con 0x56292f065450 2024-05-08T09:24:44.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 -- 172.21.15.161:0/3762095642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f065450 msgr2=0x56292f067840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 --2- 172.21.15.161:0/3762095642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f065450 0x56292f067840 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f076000a600 tx=0x7f076001ed70 comp rx=0 tx=0).stop 2024-05-08T09:24:44.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 -- 172.21.15.161:0/3762095642 shutdown_connections 2024-05-08T09:24:44.723 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 --2- 172.21.15.161:0/3762095642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f065450 0x56292f067840 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 -- 172.21.15.161:0/3762095642 >> 172.21.15.161:0/3762095642 conn(0x56292f05c560 msgr2=0x56292f05e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 -- 172.21.15.161:0/3762095642 shutdown_connections 2024-05-08T09:24:44.724 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.724+0000 7f0778d46800 1 -- 172.21.15.161:0/3762095642 wait complete. 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.738+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.738+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f0778d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f0778d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56292efad1d0 con 0x56292f060fc0 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f077684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f077684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32814/0 (socket says 172.21.15.161:32814) 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f077684c640 1 -- 172.21.15.161:0/3033756860 learned_addr learned my addr 172.21.15.161:0/3033756860 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:24:44.738 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f077684c640 1 -- 172.21.15.161:0/3033756860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f155de0 con 0x56292f060fc0 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.739+0000 7f077684c640 1 --2- 172.21.15.161:0/3033756860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0768001d80 tx=0x7f0768001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d718794033227b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0664e09640 1 -- 172.21.15.161:0/3033756860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0768013030 con 0x56292f060fc0 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0664e09640 1 -- 172.21.15.161:0/3033756860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f076800e470 con 0x56292f060fc0 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0664e09640 1 -- 172.21.15.161:0/3033756860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f076800e810 con 0x56292f060fc0 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 -- 172.21.15.161:0/3033756860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 msgr2=0x56292f155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 --2- 172.21.15.161:0/3033756860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0768001d80 tx=0x7f0768001e70 comp rx=0 tx=0).stop 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 -- 172.21.15.161:0/3033756860 shutdown_connections 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 --2- 172.21.15.161:0/3033756860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f155810 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 -- 172.21.15.161:0/3033756860 >> 172.21.15.161:0/3033756860 conn(0x56292f05c560 msgr2=0x56292f14cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 -- 172.21.15.161:0/3033756860 shutdown_connections 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.740+0000 7f0778d46800 1 -- 172.21.15.161:0/3033756860 wait complete. 2024-05-08T09:24:44.745 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f0778d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f0778d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56292f068280 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f077684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f077684c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32820/0 (socket says 172.21.15.161:32820) 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f077684c640 1 -- 172.21.15.161:0/275007569 learned_addr learned my addr 172.21.15.161:0/275007569 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.741+0000 7f077684c640 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f15d8b0 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f077684c640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0768004000 tx=0x7f0768000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f0663606640 1 -- 172.21.15.161:0/275007569 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0768027070 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f0663606640 1 -- 172.21.15.161:0/275007569 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0768019900 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56292f15db40 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f0663606640 1 -- 172.21.15.161:0/275007569 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0768019c60 con 0x56292f060fc0 2024-05-08T09:24:44.746 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.742+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292f1607f0 con 0x56292f060fc0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f0663606640 1 -- 172.21.15.161:0/275007569 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f076802a070 con 0x56292f060fc0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f0663606640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 0x7f065c038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f0663606640 1 -- 172.21.15.161:0/275007569 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f076801f070 con 0x56292f060fc0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f076ffff640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 0x7f065c038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 0x56292f1645b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f164af0 con 0x56292f065450 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.743+0000 7f077704d640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 0x56292f1645b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f076ffff640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 0x7f065c038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0760055000 tx=0x7f0760050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f077704d640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 0x56292f1645b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f077704d640 1 -- 172.21.15.161:0/275007569 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f077000a4a0 con 0x56292f065450 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f161b80 con 0x56292f065450 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f077704d640 1 -- 172.21.15.161:0/275007569 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f077000a4a0 con 0x56292f065450 2024-05-08T09:24:44.747 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 0x56292f169210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.744+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:3 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f169900 con 0x56292f166e20 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.745+0000 7f077684c640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 0x56292f169210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.745+0000 7f077684c640 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 0x56292f169210 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.745+0000 7f077684c640 1 -- 172.21.15.161:0/275007569 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(3 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0768029030 con 0x56292f166e20 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f165dd0 con 0x56292f065450 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f077704d640 1 -- 172.21.15.161:0/275007569 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f077000a4a0 con 0x56292f065450 2024-05-08T09:24:44.748 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:5 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1662b0 con 0x56292f065450 2024-05-08T09:24:44.758 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f077704d640 1 -- 172.21.15.161:0/275007569 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(5 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f077000a4a0 con 0x56292f065450 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.746+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f0778d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f0778d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56292ef53cf0 con 0x56292f178a70 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32824/0 (socket says 172.21.15.161:32824) 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f077704d640 1 -- 172.21.15.161:0/577903293 learned_addr learned my addr 172.21.15.161:0/577903293 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f077704d640 1 -- 172.21.15.161:0/577903293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f1793d0 con 0x56292f178a70 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.747+0000 7f077704d640 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x56292f164ed0 tx=0x7f0770018830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.748+0000 7f0660e01640 1 -- 172.21.15.161:0/577903293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0770014450 con 0x56292f178a70 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.748+0000 7f0660e01640 1 -- 172.21.15.161:0/577903293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770014610 con 0x56292f178a70 2024-05-08T09:24:44.759 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.748+0000 7f0660e01640 1 -- 172.21.15.161:0/577903293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0770014930 con 0x56292f178a70 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.748+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56292f179e40 con 0x56292f178a70 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.748+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292f17a340 con 0x56292f178a70 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0660e01640 1 -- 172.21.15.161:0/577903293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0770011040 con 0x56292f178a70 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0660e01640 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 0x7f0650038e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0660e01640 1 -- 172.21.15.161:0/577903293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f077001e070 con 0x56292f178a70 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f077684c640 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 0x7f0650038e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f077684c640 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 0x7f0650038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56292f164f70 tx=0x7f076800df90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0778d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.749+0000 7f0778d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56292f156160 con 0x56292f185d60 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32828/0 (socket says 172.21.15.161:32828) 2024-05-08T09:24:44.760 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f077704d640 1 -- 172.21.15.161:0/2379627178 learned_addr learned my addr 172.21.15.161:0/2379627178 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f077704d640 1 -- 172.21.15.161:0/2379627178 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f186750 con 0x56292f185d60 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f077704d640 1 --2- 172.21.15.161:0/2379627178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f077004c8d0 tx=0x7f0770011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ba262b6b590900 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f065a7fc640 1 -- 172.21.15.161:0/2379627178 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07700167e0 con 0x56292f185d60 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f065a7fc640 1 -- 172.21.15.161:0/2379627178 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770014ad0 con 0x56292f185d60 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.750+0000 7f065a7fc640 1 -- 172.21.15.161:0/2379627178 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0770016980 con 0x56292f185d60 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- 172.21.15.161:0/2379627178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 msgr2=0x56292f186180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 --2- 172.21.15.161:0/2379627178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f077004c8d0 tx=0x7f0770011ef0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- 172.21.15.161:0/2379627178 shutdown_connections 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 --2- 172.21.15.161:0/2379627178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f186180 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- 172.21.15.161:0/2379627178 >> 172.21.15.161:0/2379627178 conn(0x56292f182070 msgr2=0x56292f1800d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- 172.21.15.161:0/2379627178 shutdown_connections 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- 172.21.15.161:0/2379627178 wait complete. 2024-05-08T09:24:44.761 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 Processor -- start 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.751+0000 7f0778d46800 1 -- start start 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0778d46800 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0778d46800 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x56292f186e40 con 0x56292f185d60 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f077704d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.161:32832/0 (socket says 172.21.15.161:32832) 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 learned_addr learned my addr 172.21.15.161:0/579673951 (peer_addr_for_me v2:172.21.15.161:0/0) 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56292f18d790 con 0x56292f185d60 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f077704d640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0770040040 tx=0x7f077004c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0658ff9640 1 -- 172.21.15.161:0/579673951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0770013cf0 con 0x56292f185d60 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0658ff9640 1 -- 172.21.15.161:0/579673951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770014c80 con 0x56292f185d60 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0658ff9640 1 -- 172.21.15.161:0/579673951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f077003bb20 con 0x56292f185d60 2024-05-08T09:24:44.762 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.752+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56292f18da20 con 0x56292f185d60 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.753+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56292f1906d0 con 0x56292f185d60 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.753+0000 7f0658ff9640 1 -- 172.21.15.161:0/579673951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f077003bcc0 con 0x56292f185d60 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f0658ff9640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0640036900 0x7f0640038dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f0658ff9640 1 -- 172.21.15.161:0/579673951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f077000e040 con 0x56292f185d60 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f077684c640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0640036900 0x7f0640038dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f077684c640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0640036900 0x7f0640038dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f076800c520 tx=0x7f076804c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f198de0 0x56292f19b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f19b9f0 con 0x56292f198de0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.754+0000 7f076ffff640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f198de0 0x56292f19b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f076ffff640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f198de0 0x56292f19b2a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.763 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 realm 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f19be20 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f19c6f0 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.755+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f19ca90 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.764 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f0778d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f19d7f0 0x56292f19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:5 5.c 5:34710f8b:::zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a01f0 con 0x56292f19d7f0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f077704d640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f19d7f0 0x56292f19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.756+0000 7f077704d640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f19d7f0 0x56292f19fbe0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== osd_op_reply(5 zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f0778d46800 20 rados_obj.operate() r=0 bl.length=993 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f0778d46800 20 searching for the correct realm 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56292f1a2180 0x56292f1a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a4d10 con 0x56292f1a2180 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f077684c640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56292f1a2180 0x56292f1a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.757+0000 7f077684c640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56292f1a2180 0x56292f1a4640 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.765 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== osd_op_reply(6 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f077684c640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f076802c060 0x7f076802a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a4d10 con 0x7f076802c060 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f076ffff640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f076802c060 0x7f076802a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f076ffff640 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f076802c060 0x7f076802a580 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== osd_op_reply(7 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.758+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a4d10 con 0x56292f19d7f0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== osd_op_reply(8 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a4d10 con 0x56292f198de0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 5 ==== osd_op_reply(9 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a4d10 con 0x56292f198de0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 6 ==== osd_op_reply(10 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.759+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.766 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 3 ==== osd_op_reply(11 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.767 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 4 ==== osd_op_reply(12 [pgnls start_epoch 29 out=107b] v29'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.778 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== osd_op_reply(13 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.760+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== osd_op_reply(14 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 7 ==== osd_op_reply(15 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 5 ==== osd_op_reply(16 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 8 ==== osd_op_reply(17 [pgnls start_epoch 29 out=112b] v20'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.761+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 3 ==== osd_op_reply(18 [pgnls start_epoch 29 out=79b] v20'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 3 ==== osd_op_reply(19 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.779 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 4 ==== osd_op_reply(20 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 6 ==== osd_op_reply(21 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.762+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 5 ==== osd_op_reply(22 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 6 ==== osd_op_reply(23 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 9 ==== osd_op_reply(24 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 10 ==== osd_op_reply(25 [pgnls start_epoch 29 out=74b] v29'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.763+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.780 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 7 ==== osd_op_reply(26 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 7 ==== osd_op_reply(27 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 4 ==== osd_op_reply(28 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.764+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 11 ==== osd_op_reply(29 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.765+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.765+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 8 ==== osd_op_reply(30 [pgnls start_epoch 29 out=82b] v29'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.765+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.765+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 8 ==== osd_op_reply(31 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.765+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f19d7f0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 9 ==== osd_op_reply(32 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.781 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 5 ==== osd_op_reply(33 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f1a2180 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 9 ==== osd_op_reply(34 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 6 ==== osd_op_reply(35 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x56292f198de0 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 12 ==== osd_op_reply(36 [pgnls start_epoch 29 out=115b] v29'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.766+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 29 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e29) -- 0x7f0760076040 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 7 ==== osd_op_reply(37 [pgnls start_epoch 29 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got zone_info.7cebcda8-1953-4641-9d19-b10f40cc5883 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-05-08T09:24:44.782 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got default.zone. 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got period_config.default 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a0a40 con 0x56292f198de0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a0590 con 0x56292f198de0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados_obj.operate() r=0 bl.length=46 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.783 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:40 5.1a 5:5938f355:::zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a0590 con 0x56292f198de0 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 15 ==== osd_op_reply(40 zonegroup_info.05c85a99-f6a8-405d-b310-d83661265ff5 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.767+0000 7f0778d46800 20 rados_obj.operate() r=0 bl.length=436 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 zone default found 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 4 Realm: () 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 4 ZoneGroup: default (05c85a99-f6a8-405d-b310-d83661265ff5) 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 4 Zone: default (7cebcda8-1953-4641-9d19-b10f40cc5883) 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 zonegroup default 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a09b0 con 0x56292f19d7f0 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 rados_obj.operate() r=0 bl.length=187 2024-05-08T09:24:44.784 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a7020 con 0x56292f1a2180 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 20 rados->read ofs=0 len=0 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a73c0 con 0x56292f1a2180 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.768+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.769+0000 7f0778d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.769+0000 7f0778d46800 20 started sync module instance, tier type = 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.769+0000 7f0778d46800 20 started zone id=7cebcda8-1953-4641-9d19-b10f40cc5883 (name=default) with tier type = 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.769+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a6460 con 0x7f076802c060 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.770+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 8 ==== osd_op_reply(44 notify.0 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.770+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94734883907712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a6460 con 0x7f076802c060 2024-05-08T09:24:44.785 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.770+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a7c70 con 0x56292f198de0 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.771+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94734883907712] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.771+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 16 ==== osd_op_reply(46 notify.1 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.771+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94734883911520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a6460 con 0x56292f198de0 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.771+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a8680 con 0x56292f1a2180 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.772+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 17 ==== osd_op_reply(47 notify.1 [watch watch cookie 94734883911520] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.773+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 12 ==== osd_op_reply(48 notify.2 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.773+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94734883905456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a63d0 con 0x56292f1a2180 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.773+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a9540 con 0x7f076802c060 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.774+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94734883905456] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.774+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 10 ==== osd_op_reply(50 notify.3 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.774+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94734883917968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a9960 con 0x7f076802c060 2024-05-08T09:24:44.786 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.774+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1aa230 con 0x56292f198de0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.775+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94734883917968] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.775+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 18 ==== osd_op_reply(52 notify.4 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.775+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94734883919024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a9d80 con 0x56292f198de0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.775+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1aac40 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.776+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 19 ==== osd_op_reply(53 notify.4 [watch watch cookie 94734883919024] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.776+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 11 ==== osd_op_reply(54 notify.5 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.776+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94734883920080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1a9cf0 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.776+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1abb00 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.777+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94734883920080] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.777+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 13 ==== osd_op_reply(56 notify.6 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.777+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94734883926064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1abb00 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.777+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ac4c0 con 0x56292f19d7f0 2024-05-08T09:24:44.787 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94734883926064] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 15 ==== osd_op_reply(58 notify.7 [create] v29'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94734883928112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ac4c0 con 0x56292f19d7f0 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=0 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=1 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=2 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=3 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=4 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=5 2024-05-08T09:24:44.788 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.779+0000 7f0778d46800 20 add_watcher() i=6 2024-05-08T09:24:44.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.780+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94734883928112] v29'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.780+0000 7f0778d46800 20 add_watcher() i=7 2024-05-08T09:24:44.791 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.780+0000 7f0778d46800 2 all 8 watchers are set, enabling cache 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.780+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1af8c0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.781+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 20 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.781+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94734883930592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1acde0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.782+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 21 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94734883930592] v29'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.782+0000 7f062d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.782+0000 7f0778d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.782+0000 7f0778d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.782+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b80e0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.783+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 22 ==== osd_op_reply(62 gc.0 [create,call,call,call] v29'39 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.783+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b8730 con 0x56292f19d7f0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.784+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.784+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b8730 con 0x56292f1a2180 2024-05-08T09:24:44.792 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.785+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v29'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.785+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b9210 con 0x56292f198de0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.786+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 23 ==== osd_op_reply(65 gc.3 [create,call,call,call] v29'275 uv162 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.786+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5f90 con 0x7f076802c060 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.787+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v29'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.787+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5f60 con 0x56292f1a2180 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.788+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v29'56 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.788+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b9ba0 con 0x56292f198de0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.790+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 24 ==== osd_op_reply(68 gc.6 [create,call,call,call] v29'34 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.790+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b6130 con 0x56292f19d7f0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.791+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v29'55 uv34 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.791+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b6130 con 0x7f076802c060 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.792+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v29'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.793 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.792+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b9fe0 con 0x56292f1a2180 2024-05-08T09:24:44.794 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.793+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.793+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b9fe0 con 0x7f076802c060 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.794+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v29'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.794+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b9fe0 con 0x56292f19d7f0 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.795+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v29'41 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.795+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x7f076802c060 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.796+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v29'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.795 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.796+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f19d7f0 2024-05-08T09:24:44.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.798+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v29'62 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.797 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.798+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f198de0 2024-05-08T09:24:44.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.799+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 25 ==== osd_op_reply(76 gc.14 [create,call,call,call] v29'276 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.798 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.799+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f1a2180 2024-05-08T09:24:44.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.800+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v29'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.799 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.800+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x7f076802c060 2024-05-08T09:24:44.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.802+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v29'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.802+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f1a2180 2024-05-08T09:24:44.801 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.803+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v29'32 uv22 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.802 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.803+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f198de0 2024-05-08T09:24:44.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.804+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 26 ==== osd_op_reply(80 gc.18 [create,call,call,call] v29'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.803 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.804+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba410 con 0x56292f198de0 2024-05-08T09:24:44.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.805+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 27 ==== osd_op_reply(81 gc.19 [create,call,call,call] v29'277 uv166 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.804 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.805+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.806+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v29'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.805 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.806+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x7f076802c060 2024-05-08T09:24:44.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.807+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v29'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.807+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.806 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.808+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v29'35 uv25 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.808+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.807 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.809+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v29'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.809+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.808 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.810+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v29'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.810+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.810+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v29'57 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.809 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.810+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f19d7f0 2024-05-08T09:24:44.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.812+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v29'35 uv34 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.812+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.811 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.813+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v29'33 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.812 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.813+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f19d7f0 2024-05-08T09:24:44.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.814+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v29'56 uv36 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.813 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.814+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f1a2180 2024-05-08T09:24:44.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.815+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v29'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.814 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.815+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x56292f19d7f0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.816+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v29'63 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.816+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ba4a0 con 0x7f076802c060 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.817+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v29'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f05a7fff640 20 reqs_thread_entry: start 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f0778d46800 20 init_complete bucket index max shards: 11 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f0778d46800 20 Filter name: none 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f05a5ffb640 20 reqs_thread_entry: start 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.818+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.819+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 28 ==== osd_op_reply(94 gc.0 [call] v29'40 uv40 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.819+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.820 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.819+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 29 ==== osd_op_reply(95 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.819+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.819+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 30 ==== osd_op_reply(96 gc.0 [call out=24b] v0'0 uv40 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:97 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 31 ==== osd_op_reply(97 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:98 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 32 ==== osd_op_reply(98 gc.0 [call out=15b] v0'0 uv40 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.821 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.820+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:99 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.821+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 33 ==== osd_op_reply(99 gc.0 [call] v29'41 uv41 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.823 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.821+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.821+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:100 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.822+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 24 ==== osd_op_reply(100 gc.1 [call] v29'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.822+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:101 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.822+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 25 ==== osd_op_reply(101 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.822+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.822+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:102 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 26 ==== osd_op_reply(102 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:103 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 27 ==== osd_op_reply(103 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:104 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 28 ==== osd_op_reply(104 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.824 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.823+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:105 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.824+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 29 ==== osd_op_reply(105 gc.1 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.824+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-05-08T09:24:44.825 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.824+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:106 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.825+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 26 ==== osd_op_reply(106 gc.2 [call] v29'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.826 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.825+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:107 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.825+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 27 ==== osd_op_reply(107 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:108 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 28 ==== osd_op_reply(108 gc.2 [call out=24b] v0'0 uv33 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:109 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 29 ==== osd_op_reply(109 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:110 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 30 ==== osd_op_reply(110 gc.2 [call out=15b] v0'0 uv33 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.826+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:111 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.827+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 31 ==== osd_op_reply(111 gc.2 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.827 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.827+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-05-08T09:24:44.828 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.827+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:112 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 34 ==== osd_op_reply(112 gc.3 [call] v29'278 uv278 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:113 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 35 ==== osd_op_reply(113 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:114 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 36 ==== osd_op_reply(114 gc.3 [call out=24b] v0'0 uv278 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.828+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:115 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 37 ==== osd_op_reply(115 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.830 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:116 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 38 ==== osd_op_reply(116 gc.3 [call out=15b] v0'0 uv278 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.829+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:117 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.830+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 39 ==== osd_op_reply(117 gc.3 [call] v29'279 uv279 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.830+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.830+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:118 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 19 ==== osd_op_reply(118 gc.4 [call] v29'86 uv86 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.831 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:119 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 20 ==== osd_op_reply(119 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:120 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 21 ==== osd_op_reply(120 gc.4 [call out=24b] v0'0 uv86 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.834 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.831+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:121 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 22 ==== osd_op_reply(121 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:122 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 23 ==== osd_op_reply(122 gc.4 [call out=15b] v0'0 uv86 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.832+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:123 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.833+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 24 ==== osd_op_reply(123 gc.4 [call] v29'87 uv87 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.833+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.833+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:124 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.834+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 32 ==== osd_op_reply(124 gc.5 [call] v29'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.834+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:125 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.834+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 33 ==== osd_op_reply(125 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.835 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.834+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.834+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:126 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 34 ==== osd_op_reply(126 gc.5 [call out=24b] v0'0 uv58 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:127 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 35 ==== osd_op_reply(127 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:128 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 36 ==== osd_op_reply(128 gc.5 [call out=15b] v0'0 uv58 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.836 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.835+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:129 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.838 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.836+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 37 ==== osd_op_reply(129 gc.5 [call] v29'59 uv59 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.836+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.836+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:130 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.837+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 40 ==== osd_op_reply(130 gc.6 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.837+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:131 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.837+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 41 ==== osd_op_reply(131 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.837+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.837+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:132 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 42 ==== osd_op_reply(132 gc.6 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:133 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.839 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 43 ==== osd_op_reply(133 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:134 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 44 ==== osd_op_reply(134 gc.6 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.838+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:135 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.839+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 45 ==== osd_op_reply(135 gc.6 [call] v29'36 uv36 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.839+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-05-08T09:24:44.840 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.839+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:136 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.840+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 30 ==== osd_op_reply(136 gc.7 [call] v29'57 uv57 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.840+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:137 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 31 ==== osd_op_reply(137 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.842 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:138 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 32 ==== osd_op_reply(138 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:139 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 33 ==== osd_op_reply(139 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.841+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:140 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.842+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 34 ==== osd_op_reply(140 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.842+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.842+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:141 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.843+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 35 ==== osd_op_reply(141 gc.7 [call] v29'58 uv58 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.843+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-05-08T09:24:44.843 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.843+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:142 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 25 ==== osd_op_reply(142 gc.8 [call] v29'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.845 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:143 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 26 ==== osd_op_reply(143 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:144 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 27 ==== osd_op_reply(144 gc.8 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.844+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:145 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 28 ==== osd_op_reply(145 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:146 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 29 ==== osd_op_reply(146 gc.8 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.845+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:147 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.846 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.846+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 30 ==== osd_op_reply(147 gc.8 [call] v29'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.846+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-05-08T09:24:44.847 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.846+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:148 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.847+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 38 ==== osd_op_reply(148 gc.9 [call] v29'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.847+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:149 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.850 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.847+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 39 ==== osd_op_reply(149 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.847+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.847+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:150 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 40 ==== osd_op_reply(150 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:151 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 41 ==== osd_op_reply(151 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:152 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 42 ==== osd_op_reply(152 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.851 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.848+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:153 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.849+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 43 ==== osd_op_reply(153 gc.9 [call] v29'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.849+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.849+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:154 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.850+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 31 ==== osd_op_reply(154 gc.10 [call] v29'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.850+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:155 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.850+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 32 ==== osd_op_reply(155 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.850+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.850+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:156 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 33 ==== osd_op_reply(156 gc.10 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:157 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.852 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 34 ==== osd_op_reply(157 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:158 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 35 ==== osd_op_reply(158 gc.10 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.853 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.851+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:159 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.852+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 36 ==== osd_op_reply(159 gc.10 [call] v29'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.852+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.852+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:160 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.853+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 36 ==== osd_op_reply(160 gc.11 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.853+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:161 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.853+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 37 ==== osd_op_reply(161 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.853+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.853+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:162 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.857 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 38 ==== osd_op_reply(162 gc.11 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:163 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 39 ==== osd_op_reply(163 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:164 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 40 ==== osd_op_reply(164 gc.11 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.854+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:165 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.855+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 41 ==== osd_op_reply(165 gc.11 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.855+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-05-08T09:24:44.858 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.855+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:166 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.856+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 37 ==== osd_op_reply(166 gc.12 [call] v29'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.856+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:167 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 38 ==== osd_op_reply(167 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:168 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 39 ==== osd_op_reply(168 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:169 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 40 ==== osd_op_reply(169 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:170 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 41 ==== osd_op_reply(170 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.859 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.860 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.857+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:171 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.858+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 42 ==== osd_op_reply(171 gc.12 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.858+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.858+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:172 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 42 ==== osd_op_reply(172 gc.13 [call] v29'64 uv64 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:173 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 43 ==== osd_op_reply(173 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:174 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 44 ==== osd_op_reply(174 gc.13 [call out=24b] v0'0 uv64 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.862 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.860+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:175 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 45 ==== osd_op_reply(175 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:176 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 46 ==== osd_op_reply(176 gc.13 [call out=15b] v0'0 uv64 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.861+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:177 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.862+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 47 ==== osd_op_reply(177 gc.13 [call] v29'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.862+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-05-08T09:24:44.863 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.862+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:178 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.863+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 46 ==== osd_op_reply(178 gc.14 [call] v29'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.863+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:179 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.863+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 47 ==== osd_op_reply(179 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.863+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.863+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:180 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 48 ==== osd_op_reply(180 gc.14 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:181 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.865 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 49 ==== osd_op_reply(181 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:182 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 50 ==== osd_op_reply(182 gc.14 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.864+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:183 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.865+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 51 ==== osd_op_reply(183 gc.14 [call] v29'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.865+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-05-08T09:24:44.866 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.865+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:184 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 44 ==== osd_op_reply(184 gc.15 [call] v29'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:185 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 45 ==== osd_op_reply(185 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:186 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 46 ==== osd_op_reply(186 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.868 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:187 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 47 ==== osd_op_reply(187 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:188 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 48 ==== osd_op_reply(188 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.867+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:189 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.868+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 49 ==== osd_op_reply(189 gc.15 [call] v29'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.868+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-05-08T09:24:44.869 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.868+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:190 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.869+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 43 ==== osd_op_reply(190 gc.16 [call] v29'90 uv90 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.869+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:191 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 44 ==== osd_op_reply(191 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.873 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:192 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 45 ==== osd_op_reply(192 gc.16 [call out=24b] v0'0 uv90 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:193 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 46 ==== osd_op_reply(193 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:194 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 47 ==== osd_op_reply(194 gc.16 [call out=15b] v0'0 uv90 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.870+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:195 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.871+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 48 ==== osd_op_reply(195 gc.16 [call] v29'91 uv91 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.874 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.871+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.871+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:196 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.872+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 50 ==== osd_op_reply(196 gc.17 [call] v29'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.872+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:197 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.872+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 51 ==== osd_op_reply(197 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.872+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.872+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:198 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 52 ==== osd_op_reply(198 gc.17 [call out=24b] v0'0 uv33 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:199 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 53 ==== osd_op_reply(199 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.875 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:200 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 54 ==== osd_op_reply(200 gc.17 [call out=15b] v0'0 uv33 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.873+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:201 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.874+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 55 ==== osd_op_reply(201 gc.17 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.874+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-05-08T09:24:44.876 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.874+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:202 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 52 ==== osd_op_reply(202 gc.18 [call] v29'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:203 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 53 ==== osd_op_reply(203 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.880 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:204 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 54 ==== osd_op_reply(204 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:205 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 55 ==== osd_op_reply(205 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:206 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 56 ==== osd_op_reply(206 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.876+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:207 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.878+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 57 ==== osd_op_reply(207 gc.18 [call] v29'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.878+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-05-08T09:24:44.881 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.878+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:208 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.878+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 58 ==== osd_op_reply(208 gc.19 [call] v29'282 uv282 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.878+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:209 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 59 ==== osd_op_reply(209 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:210 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 60 ==== osd_op_reply(210 gc.19 [call out=24b] v0'0 uv282 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:211 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 61 ==== osd_op_reply(211 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.882 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:212 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 62 ==== osd_op_reply(212 gc.19 [call out=15b] v0'0 uv282 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.879+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:213 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f198de0 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.880+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 63 ==== osd_op_reply(213 gc.19 [call] v29'283 uv283 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.880+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-05-08T09:24:44.883 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.881+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:214 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 56 ==== osd_op_reply(214 gc.20 [call] v29'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:215 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 57 ==== osd_op_reply(215 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.890 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:216 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 58 ==== osd_op_reply(216 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:217 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 59 ==== osd_op_reply(217 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.882+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:218 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.883+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 60 ==== osd_op_reply(218 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.883+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.883+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:219 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.884+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 61 ==== osd_op_reply(219 gc.20 [call] v29'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.891 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.884+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.884+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:220 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.884+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 49 ==== osd_op_reply(220 gc.21 [call] v29'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.884+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:221 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 50 ==== osd_op_reply(221 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:222 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 51 ==== osd_op_reply(222 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:223 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 52 ==== osd_op_reply(223 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:224 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.892 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.885+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 53 ==== osd_op_reply(224 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.886+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.886+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:225 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x7f076802c060 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.886+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 54 ==== osd_op_reply(225 gc.21 [call] v29'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.886+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.886+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:226 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.887+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 62 ==== osd_op_reply(226 gc.22 [call] v29'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.887+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:227 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 63 ==== osd_op_reply(227 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:228 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 64 ==== osd_op_reply(228 gc.22 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:229 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.893 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 65 ==== osd_op_reply(229 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:230 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 66 ==== osd_op_reply(230 gc.22 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.888+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:231 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.889+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 67 ==== osd_op_reply(231 gc.22 [call] v29'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.889+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.889+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:232 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 68 ==== osd_op_reply(232 gc.23 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:233 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.894 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 69 ==== osd_op_reply(233 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:234 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.890+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 70 ==== osd_op_reply(234 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:235 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 71 ==== osd_op_reply(235 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:236 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 72 ==== osd_op_reply(236 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.895 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.891+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:237 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.901 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.892+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 73 ==== osd_op_reply(237 gc.23 [call] v29'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.892+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.892+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:238 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 74 ==== osd_op_reply(238 gc.24 [call] v29'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:239 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 75 ==== osd_op_reply(239 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:240 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 76 ==== osd_op_reply(240 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.893+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:241 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.902 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 77 ==== osd_op_reply(241 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:242 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 78 ==== osd_op_reply(242 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.894+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:243 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.895+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 79 ==== osd_op_reply(243 gc.24 [call] v29'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.895+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.895+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:244 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 80 ==== osd_op_reply(244 gc.25 [call] v29'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.903 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:245 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 81 ==== osd_op_reply(245 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:246 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 82 ==== osd_op_reply(246 gc.25 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.896+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:247 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 83 ==== osd_op_reply(247 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:248 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 84 ==== osd_op_reply(248 gc.25 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.904 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.897+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:249 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f1a2180 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.898+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 85 ==== osd_op_reply(249 gc.25 [call] v29'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.898+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.898+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:250 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.899+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 48 ==== osd_op_reply(250 gc.26 [call] v29'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.899+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:251 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 49 ==== osd_op_reply(251 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:252 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.905 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 50 ==== osd_op_reply(252 gc.26 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:253 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 51 ==== osd_op_reply(253 gc.26 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.900+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:254 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1b5540 con 0x56292f19d7f0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 52 ==== osd_op_reply(254 gc.26 [call out=1716b] v0'0 uv36 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 20 garbage collection: RGWGC::process iterating over entry tag='7cebcda8-1953-4641-9d19-b10f40cc5883.4223.17475796143398259852', time=2024-05-08T09:24:52.907682+0000, chain.objs.size()=7 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_1 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:255 3.10s0 3:08a6b8fd:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e6c50 con 0x56292f198de0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_2 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:256 3.37s0 3:efc0515e:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e98e0 con 0x56292f198de0 2024-05-08T09:24:44.906 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_3 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:257 3.19s0 3:98bcfe5c:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ec3d0 con 0x56292f198de0 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_4 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:258 3.1cs0 3:381a3a42:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e98e0 con 0x56292f198de0 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_5 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:259 3.7s0 3:e123c551:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1ec3d0 con 0x56292f1a2180 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_6 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:260 3.2ds0 3:b4c7e2aa:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1f3960 con 0x56292f1a2180 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_7 2024-05-08T09:24:44.907 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.901+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:261 3.2as0 3:5460dade:::7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1f61d0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.904+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 64 ==== osd_op_reply(255 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_1 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.904+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 65 ==== osd_op_reply(257 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_3 [call] v29'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.904+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 66 ==== osd_op_reply(256 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_2 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.905+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 86 ==== osd_op_reply(260 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_6 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.905+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 87 ==== osd_op_reply(259 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_5 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.906+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 67 ==== osd_op_reply(258 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_4 [call] v29'6 uv6 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.906+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 68 ==== osd_op_reply(261 7cebcda8-1953-4641-9d19-b10f40cc5883.4223.11__shadow_.xIqSavzlLfxkOL-K-EBqK4IBV57wBzO_7 [call] v29'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.906+0000 7f0778d46800 5 garbage collection: RGWGC::process removing entries, marker: 2024-05-08T09:24:44.909 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.906+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:262 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e46c0 con 0x56292f19d7f0 2024-05-08T09:24:44.910 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.912+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 53 ==== osd_op_reply(262 gc.26 [call] v29'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.911 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.912+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:263 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e46c0 con 0x56292f19d7f0 2024-05-08T09:24:44.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.914+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 54 ==== osd_op_reply(263 gc.26 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.914+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-05-08T09:24:44.913 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.914+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e46c0 con 0x56292f1a2180 2024-05-08T09:24:44.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 88 ==== osd_op_reply(264 gc.27 [call] v29'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e71d0 con 0x56292f1a2180 2024-05-08T09:24:44.915 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 89 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e5b80 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 90 ==== osd_op_reply(266 gc.27 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.915+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e71d0 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 91 ==== osd_op_reply(267 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:268 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e71d0 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 92 ==== osd_op_reply(268 gc.27 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.916 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.916+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:269 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f1a2180 2024-05-08T09:24:44.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.917+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 93 ==== osd_op_reply(269 gc.27 [call] v29'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.917+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-05-08T09:24:44.917 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.917+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.920+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 55 ==== osd_op_reply(270 gc.28 [call] v29'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.919 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.920+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.921+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 56 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.921+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.920 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.921+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.922+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 57 ==== osd_op_reply(272 gc.28 [call out=24b] v0'0 uv59 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.921 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.922+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:273 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.923+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 58 ==== osd_op_reply(273 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.923+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.922 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.923+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:274 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.924+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 59 ==== osd_op_reply(274 gc.28 [call out=15b] v0'0 uv59 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.924+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.923 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.924+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:275 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f19d7f0 2024-05-08T09:24:44.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.925+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 60 ==== osd_op_reply(275 gc.28 [call] v29'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.925+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-05-08T09:24:44.924 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.925+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:276 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7180 con 0x56292f1a2180 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 94 ==== osd_op_reply(276 gc.29 [call] v29'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:277 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7130 con 0x56292f1a2180 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 95 ==== osd_op_reply(277 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:278 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7130 con 0x56292f1a2180 2024-05-08T09:24:44.926 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 96 ==== osd_op_reply(278 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.926+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:279 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 97 ==== osd_op_reply(279 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:280 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 98 ==== osd_op_reply(280 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.927+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:281 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f1a2180 2024-05-08T09:24:44.927 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.928+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 99 ==== osd_op_reply(281 gc.29 [call] v29'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.928+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-05-08T09:24:44.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.928+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:282 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.929+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 61 ==== osd_op_reply(282 gc.30 [call] v29'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.928 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.929+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:283 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.929+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 62 ==== osd_op_reply(283 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:284 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 63 ==== osd_op_reply(284 gc.30 [call out=24b] v0'0 uv66 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.929 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:285 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 64 ==== osd_op_reply(285 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.930+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:286 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.931+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 65 ==== osd_op_reply(286 gc.30 [call out=15b] v0'0 uv66 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.931+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.930 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.931+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:287 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.932+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 66 ==== osd_op_reply(287 gc.30 [call] v29'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.932+0000 7f0778d46800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-05-08T09:24:44.931 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.932+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:288 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 55 ==== osd_op_reply(288 gc.31 [call] v29'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:289 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 56 ==== osd_op_reply(289 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.932 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:290 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 57 ==== osd_op_reply(290 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.933+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:291 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.933 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 58 ==== osd_op_reply(291 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:292 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 59 ==== osd_op_reply(292 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f0778d46800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.934+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:293 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.934 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.935+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 60 ==== osd_op_reply(293 gc.31 [call] v29'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.936+0000 7f062d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-05-08T09:24:44.935 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.936+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94734883930592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f198de0 2024-05-08T09:24:44.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.937+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 69 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94734883930592] v29'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.936 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.937+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94734883907712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.938+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 61 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94734883907712] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.937 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.938+0000 7f0778d46800 20 remove_watcher() i=0 2024-05-08T09:24:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.938+0000 7f0778d46800 2 removed watcher, disabling cache 2024-05-08T09:24:44.938 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.938+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94734883911520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f198de0 2024-05-08T09:24:44.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.940+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 70 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94734883911520] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.940+0000 7f0778d46800 20 remove_watcher() i=1 2024-05-08T09:24:44.939 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.940+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94734883905456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f1a2180 2024-05-08T09:24:44.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.941+0000 7f077684c640 1 -- 172.21.15.161:0/579673951 <== osd.3 v2:172.21.15.161:6804/1879099265 100 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94734883905456] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0768029030 con 0x56292f1a2180 2024-05-08T09:24:44.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.941+0000 7f0778d46800 20 remove_watcher() i=2 2024-05-08T09:24:44.940 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.941+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94734883917968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x7f076802c060 2024-05-08T09:24:44.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.942+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.2 v2:172.21.15.161:6800/1967789976 62 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94734883917968] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x7f076802c060 2024-05-08T09:24:44.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.942+0000 7f0778d46800 20 remove_watcher() i=3 2024-05-08T09:24:44.941 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.942+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94734883919024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f198de0 2024-05-08T09:24:44.942 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.943+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 <== osd.1 v2:172.21.15.161:6801/4188235102 71 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94734883919024] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f07600085a0 con 0x56292f198de0 2024-05-08T09:24:44.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.943+0000 7f0778d46800 20 remove_watcher() i=4 2024-05-08T09:24:44.943 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.943+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94734883920080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.944+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 67 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94734883920080] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.944+0000 7f0778d46800 20 remove_watcher() i=5 2024-05-08T09:24:44.944 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.944+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94734883926064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.946+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 68 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94734883926064] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.946+0000 7f0778d46800 20 remove_watcher() i=6 2024-05-08T09:24:44.945 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.946+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94734883928112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29) -- 0x56292f1e7110 con 0x56292f19d7f0 2024-05-08T09:24:44.948 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f077704d640 1 -- 172.21.15.161:0/579673951 <== osd.0 v2:172.21.15.45:6800/2579517728 69 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94734883928112] v29'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f077002a070 con 0x56292f19d7f0 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 20 remove_watcher() i=7 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f19d7f0 msgr2=0x56292f19fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f19d7f0 0x56292f19fbe0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f198de0 msgr2=0x56292f19b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f198de0 0x56292f19b2a0 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f076802c060 msgr2=0x7f076802a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f076802c060 0x7f076802a580 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56292f1a2180 msgr2=0x56292f1a4640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x56292f1a2180 0x56292f1a4640 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0640036900 msgr2=0x7f0640038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0640036900 0x7f0640038dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f076800c520 tx=0x7f076804c000 comp rx=0 tx=0).stop 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 msgr2=0x56292f18d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.949 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f076ffff640 1 -- 172.21.15.161:0/579673951 reap_dead start 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f0770040040 tx=0x7f077004c860 comp rx=0 tx=0).stop 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 shutdown_connections 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 --2- 172.21.15.161:0/579673951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f185d60 0x56292f18d250 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 >> 172.21.15.161:0/579673951 conn(0x56292f182070 msgr2=0x56292f187560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 shutdown_connections 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.947+0000 7f0778d46800 1 -- 172.21.15.161:0/579673951 wait complete. 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 msgr2=0x7f0650038e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 0x7f0650038e10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56292f164f70 tx=0x7f076800df90 comp rx=0 tx=0).stop 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 msgr2=0x56292f178e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x56292f164ed0 tx=0x7f0770018830 comp rx=0 tx=0).stop 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 shutdown_connections 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0650036950 0x7f0650038e10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.950 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/577903293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f178a70 0x56292f178e90 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 >> 172.21.15.161:0/577903293 conn(0x56292f16cb10 msgr2=0x56292f16cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 shutdown_connections 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/577903293 wait complete. 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 msgr2=0x56292f169210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 0x56292f169210 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 msgr2=0x56292f1645b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 0x56292f1645b0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 msgr2=0x7f065c038dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 0x7f065c038dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0760055000 tx=0x7f0760050000 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 msgr2=0x56292f15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0768004000 tx=0x7f0768000bc0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 shutdown_connections 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x56292f166e20 0x56292f169210 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.951 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x56292f065450 0x56292f1645b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f065c036900 0x7f065c038dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 --2- 172.21.15.161:0/275007569 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56292f060fc0 0x56292f15d370 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:44.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 >> 172.21.15.161:0/275007569 conn(0x56292f05c560 msgr2=0x56292f14b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:44.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 shutdown_connections 2024-05-08T09:24:44.952 INFO:teuthology.orchestra.run.smithi161.stderr:2024-05-08T09:24:44.948+0000 7f0778d46800 1 -- 172.21.15.161:0/275007569 wait complete. 2024-05-08T09:24:44.957 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-08T09:24:44.967 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-08T09:24:44.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:24:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.073+0000 7f0d8c4e6640 1 Processor -- start 2024-05-08T09:24:45.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.073+0000 7f0d8c4e6640 1 -- start start 2024-05-08T09:24:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.073+0000 7f0d8c4e6640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d8412c5b0 0x7f0d8412c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.073+0000 7f0d8c4e6640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d84113dd0 con 0x7f0d8412ced0 2024-05-08T09:24:45.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.073+0000 7f0d8c4e6640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f0d84072290 con 0x7f0d8412c5b0 2024-05-08T09:24:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.074+0000 7f0d8a282640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d8412c5b0 0x7f0d8412c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.074+0000 7f0d89a81640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0d8412ced0 0x7f0d8406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46532/0 (socket says 172.21.15.45:46532) 2024-05-08T09:24:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.074+0000 7f0d89a81640 1 -- 172.21.15.45:0/2804888946 learned_addr learned my addr 172.21.15.45:0/2804888946 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.074+0000 7f0d8a282640 1 -- 172.21.15.45:0/2804888946 >> v1:172.21.15.45:6789/0 conn(0x7f0d8412ced0 legacy=0x7f0d8406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.074+0000 7f0d8a282640 1 -- 172.21.15.45:0/2804888946 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d8412c390 con 0x7f0d8412c5b0 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8a282640 1 --2- 172.21.15.45:0/2804888946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d8412c990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009720 tx=0x7f0d8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafe10e1901712ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d89280640 1 -- 172.21.15.45:0/2804888946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d800316d0 con 0x7f0d8412c5b0 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d89280640 1 -- 172.21.15.45:0/2804888946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d80037070 con 0x7f0d8412c5b0 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d89280640 1 -- 172.21.15.45:0/2804888946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d800319c0 con 0x7f0d8412c5b0 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/2804888946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 msgr2=0x7f0d8412c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/2804888946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d8412c990 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009720 tx=0x7f0d8002b840 comp rx=0 tx=0).stop 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/2804888946 shutdown_connections 2024-05-08T09:24:45.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/2804888946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d8412c990 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/2804888946 >> 172.21.15.45:0/2804888946 conn(0x7f0d84099380 msgr2=0x7f0d84099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/2804888946 shutdown_connections 2024-05-08T09:24:45.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.075+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/2804888946 wait complete. 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.076+0000 7f0d8c4e6640 1 Processor -- start 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.076+0000 7f0d8c4e6640 1 -- start start 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8c4e6640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8c4e6640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f0d84113b10 con 0x7f0d8412c5b0 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8a282640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8a282640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46014/0 (socket says 172.21.15.45:46014) 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8a282640 1 -- 172.21.15.45:0/3214356086 learned_addr learned my addr 172.21.15.45:0/3214356086 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8a282640 1 -- 172.21.15.45:0/3214356086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d84118a00 con 0x7f0d8412c5b0 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.077+0000 7f0d8a282640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009720 tx=0x7f0d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d80032770 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d80032910 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d8412b650 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d80032bf0 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d84119870 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f0d8004d3f0 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.078+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d84062e90 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.079+0000 7f0d7affd640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 0x7f0d6803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.079+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f0d8002f050 con 0x7f0d8412c5b0 2024-05-08T09:24:45.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.079+0000 7f0d89a81640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 0x7f0d6803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.079+0000 7f0d89a81640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 0x7f0d6803a520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d74007fd0 tx=0x7f0d74007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.084+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f0d84119870 con 0x7f0d8412c5b0 2024-05-08T09:24:45.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.262+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0d8411a1a0 con 0x7f0d68038060 2024-05-08T09:24:45.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.278+0000 7f0d7affd640 1 -- 172.21.15.45:0/3214356086 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665914 (secure 0 0 0) 0x7f0d8411a1a0 con 0x7f0d68038060 2024-05-08T09:24:45.286 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:24:45.293 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:24:45.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 msgr2=0x7f0d6803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 0x7f0d6803a520 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0d74007fd0 tx=0x7f0d74007ac0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 msgr2=0x7f0d841c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009720 tx=0x7f0d800046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 shutdown_connections 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.283+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f0d68038060 0x7f0d6803a520 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.284+0000 7f0d8c4e6640 1 --2- 172.21.15.45:0/3214356086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d8412c5b0 0x7f0d841c13b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.284+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 >> 172.21.15.45:0/3214356086 conn(0x7f0d84099380 msgr2=0x7f0d8409b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.284+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 shutdown_connections 2024-05-08T09:24:45.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.284+0000 7f0d8c4e6640 1 -- 172.21.15.45:0/3214356086 wait complete. 2024-05-08T09:24:45.298 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T09:24:44.893774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4884,"num_read_kb":4461,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001076+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:22:16.001076+0000","last_peered":"2024-05-08T09:22:16.001076+0000","last_clean":"2024-05-08T09:22:16.001076+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:22:16.001076+0000","last_undegraded":"2024-05-08T09:22:16.001076+0000","last_fullsized":"2024-05-08T09:22:16.001076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916991+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:03.916991+0000","last_peered":"2024-05-08T09:24:03.916991+0000","last_clean":"2024-05-08T09:24:03.916991+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:03.916991+0000","last_undegraded":"2024-05-08T09:24:03.916991+0000","last_fullsized":"2024-05-08T09:24:03.916991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:23.115981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.375414+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.375414+0000","last_peered":"2024-05-08T09:23:37.375414+0000","last_clean":"2024-05-08T09:23:37.375414+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.375414+0000","last_undegraded":"2024-05-08T09:23:37.375414+0000","last_fullsized":"2024-05-08T09:23:37.375414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:09.233706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166680+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.166680+0000","last_peered":"2024-05-08T09:24:38.166680+0000","last_clean":"2024-05-08T09:24:38.166680+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.166680+0000","last_undegraded":"2024-05-08T09:24:38.166680+0000","last_fullsized":"2024-05-08T09:24:38.166680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:08.198970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997644+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:22:15.997644+0000","last_peered":"2024-05-08T09:22:15.997644+0000","last_clean":"2024-05-08T09:22:15.997644+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:22:15.997644+0000","last_undegraded":"2024-05-08T09:22:15.997644+0000","last_fullsized":"2024-05-08T09:22:15.997644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:15.219028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961300+0000","last_change":"2024-05-08T09:21:30.959732+0000","last_active":"2024-05-08T09:22:53.961300+0000","last_peered":"2024-05-08T09:22:53.961300+0000","last_clean":"2024-05-08T09:22:53.961300+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:22:53.961300+0000","last_undegraded":"2024-05-08T09:22:53.961300+0000","last_fullsized":"2024-05-08T09:22:53.961300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:51.106660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000563+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:22:16.000563+0000","last_peered":"2024-05-08T09:22:16.000563+0000","last_clean":"2024-05-08T09:22:16.000563+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:22:16.000563+0000","last_undegraded":"2024-05-08T09:22:16.000563+0000","last_fullsized":"2024-05-08T09:22:16.000563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944601+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.944601+0000","last_peered":"2024-05-08T09:24:37.944601+0000","last_clean":"2024-05-08T09:24:37.944601+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.944601+0000","last_undegraded":"2024-05-08T09:24:37.944601+0000","last_fullsized":"2024-05-08T09:24:37.944601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:05.452991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996051+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:22:15.996051+0000","last_peered":"2024-05-08T09:22:15.996051+0000","last_clean":"2024-05-08T09:22:15.996051+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:22:15.996051+0000","last_undegraded":"2024-05-08T09:22:15.996051+0000","last_fullsized":"2024-05-08T09:22:15.996051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:33.486446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030810+0000","last_change":"2024-05-08T09:21:30.942925+0000","last_active":"2024-05-08T09:24:38.030810+0000","last_peered":"2024-05-08T09:24:38.030810+0000","last_clean":"2024-05-08T09:24:38.030810+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:24:38.030810+0000","last_undegraded":"2024-05-08T09:24:38.030810+0000","last_fullsized":"2024-05-08T09:24:38.030810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998378+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:22:15.998378+0000","last_peered":"2024-05-08T09:22:15.998378+0000","last_clean":"2024-05-08T09:22:15.998378+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:22:15.998378+0000","last_undegraded":"2024-05-08T09:22:15.998378+0000","last_fullsized":"2024-05-08T09:22:15.998378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.946666+0000","last_change":"2024-05-08T09:21:30.960649+0000","last_active":"2024-05-08T09:24:37.946666+0000","last_peered":"2024-05-08T09:24:37.946666+0000","last_clean":"2024-05-08T09:24:37.946666+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:24:37.946666+0000","last_undegraded":"2024-05-08T09:24:37.946666+0000","last_fullsized":"2024-05-08T09:24:37.946666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:38.405348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995105+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:22:15.995105+0000","last_peered":"2024-05-08T09:22:15.995105+0000","last_clean":"2024-05-08T09:22:15.995105+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:22:15.995105+0000","last_undegraded":"2024-05-08T09:22:15.995105+0000","last_fullsized":"2024-05-08T09:22:15.995105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:05.261094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000928+0000","last_change":"2024-05-08T09:21:30.950639+0000","last_active":"2024-05-08T09:22:16.000928+0000","last_peered":"2024-05-08T09:22:16.000928+0000","last_clean":"2024-05-08T09:22:16.000928+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:22:16.000928+0000","last_undegraded":"2024-05-08T09:22:16.000928+0000","last_fullsized":"2024-05-08T09:22:16.000928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.951539+0000","last_change":"2024-05-08T09:21:28.962227+0000","last_active":"2024-05-08T09:22:53.951539+0000","last_peered":"2024-05-08T09:22:53.951539+0000","last_clean":"2024-05-08T09:22:53.951539+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:22:53.951539+0000","last_undegraded":"2024-05-08T09:22:53.951539+0000","last_fullsized":"2024-05-08T09:22:53.951539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030974+0000","last_change":"2024-05-08T09:21:30.953880+0000","last_active":"2024-05-08T09:24:38.030974+0000","last_peered":"2024-05-08T09:24:38.030974+0000","last_clean":"2024-05-08T09:24:38.030974+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:24:38.030974+0000","last_undegraded":"2024-05-08T09:24:38.030974+0000","last_fullsized":"2024-05-08T09:24:38.030974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166447+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.166447+0000","last_peered":"2024-05-08T09:24:38.166447+0000","last_clean":"2024-05-08T09:24:38.166447+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.166447+0000","last_undegraded":"2024-05-08T09:24:38.166447+0000","last_fullsized":"2024-05-08T09:24:38.166447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:30.090468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915499+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:23:53.915499+0000","last_peered":"2024-05-08T09:23:53.915499+0000","last_clean":"2024-05-08T09:23:53.915499+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:23:53.915499+0000","last_undegraded":"2024-05-08T09:23:53.915499+0000","last_fullsized":"2024-05-08T09:23:53.915499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.772673+0000","last_change":"2024-05-08T09:21:30.945729+0000","last_active":"2024-05-08T09:22:53.772673+0000","last_peered":"2024-05-08T09:22:53.772673+0000","last_clean":"2024-05-08T09:22:53.772673+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:22:53.772673+0000","last_undegraded":"2024-05-08T09:22:53.772673+0000","last_fullsized":"2024-05-08T09:22:53.772673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000634+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:22:16.000634+0000","last_peered":"2024-05-08T09:22:16.000634+0000","last_clean":"2024-05-08T09:22:16.000634+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:22:16.000634+0000","last_undegraded":"2024-05-08T09:22:16.000634+0000","last_fullsized":"2024-05-08T09:22:16.000634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.770379+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:22:53.770379+0000","last_peered":"2024-05-08T09:22:53.770379+0000","last_clean":"2024-05-08T09:22:53.770379+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:22:53.770379+0000","last_undegraded":"2024-05-08T09:22:53.770379+0000","last_fullsized":"2024-05-08T09:22:53.770379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.519313+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:37.519313+0000","last_peered":"2024-05-08T09:23:37.519313+0000","last_clean":"2024-05-08T09:23:37.519313+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:37.519313+0000","last_undegraded":"2024-05-08T09:23:37.519313+0000","last_fullsized":"2024-05-08T09:23:37.519313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542123+0000","last_change":"2024-05-08T09:21:30.955095+0000","last_active":"2024-05-08T09:23:37.542123+0000","last_peered":"2024-05-08T09:23:37.542123+0000","last_clean":"2024-05-08T09:23:37.542123+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:23:37.542123+0000","last_undegraded":"2024-05-08T09:23:37.542123+0000","last_fullsized":"2024-05-08T09:23:37.542123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.760684+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:22:53.760684+0000","last_peered":"2024-05-08T09:22:53.760684+0000","last_clean":"2024-05-08T09:22:53.760684+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:22:53.760684+0000","last_undegraded":"2024-05-08T09:22:53.760684+0000","last_fullsized":"2024-05-08T09:22:53.760684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241110+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.241110+0000","last_peered":"2024-05-08T09:24:38.241110+0000","last_clean":"2024-05-08T09:24:38.241110+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.241110+0000","last_undegraded":"2024-05-08T09:24:38.241110+0000","last_fullsized":"2024-05-08T09:24:38.241110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064683+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:22:16.064683+0000","last_peered":"2024-05-08T09:22:16.064683+0000","last_clean":"2024-05-08T09:22:16.064683+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:22:16.064683+0000","last_undegraded":"2024-05-08T09:22:16.064683+0000","last_fullsized":"2024-05-08T09:22:16.064683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031836+0000","last_change":"2024-05-08T09:21:30.941566+0000","last_active":"2024-05-08T09:24:38.031836+0000","last_peered":"2024-05-08T09:24:38.031836+0000","last_clean":"2024-05-08T09:24:38.031836+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:24:38.031836+0000","last_undegraded":"2024-05-08T09:24:38.031836+0000","last_fullsized":"2024-05-08T09:24:38.031836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:22.230967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996884+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:22:15.996884+0000","last_peered":"2024-05-08T09:22:15.996884+0000","last_clean":"2024-05-08T09:22:15.996884+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:22:15.996884+0000","last_undegraded":"2024-05-08T09:22:15.996884+0000","last_fullsized":"2024-05-08T09:22:15.996884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:06.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.187676+0000","last_change":"2024-05-08T09:21:38.981335+0000","last_active":"2024-05-08T09:24:38.187676+0000","last_peered":"2024-05-08T09:24:38.187676+0000","last_clean":"2024-05-08T09:24:38.187676+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:24:38.187676+0000","last_undegraded":"2024-05-08T09:24:38.187676+0000","last_fullsized":"2024-05-08T09:24:38.187676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:10.950358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218288+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218288+0000","last_peered":"2024-05-08T09:24:38.218288+0000","last_clean":"2024-05-08T09:24:38.218288+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218288+0000","last_undegraded":"2024-05-08T09:24:38.218288+0000","last_fullsized":"2024-05-08T09:24:38.218288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:11.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151832+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.151832+0000","last_peered":"2024-05-08T09:24:38.151832+0000","last_clean":"2024-05-08T09:24:38.151832+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.151832+0000","last_undegraded":"2024-05-08T09:24:38.151832+0000","last_fullsized":"2024-05-08T09:24:38.151832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:46.927060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996807+0000","last_change":"2024-05-08T09:21:32.954624+0000","last_active":"2024-05-08T09:22:15.996807+0000","last_peered":"2024-05-08T09:22:15.996807+0000","last_clean":"2024-05-08T09:22:15.996807+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:22:15.996807+0000","last_undegraded":"2024-05-08T09:22:15.996807+0000","last_fullsized":"2024-05-08T09:22:15.996807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:12.055591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.125390+0000","last_change":"2024-05-08T09:21:34.968612+0000","last_active":"2024-05-08T09:23:36.125390+0000","last_peered":"2024-05-08T09:23:36.125390+0000","last_clean":"2024-05-08T09:23:36.125390+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:23:36.125390+0000","last_undegraded":"2024-05-08T09:23:36.125390+0000","last_fullsized":"2024-05-08T09:23:36.125390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:14.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001471+0000","last_change":"2024-05-08T09:21:36.977259+0000","last_active":"2024-05-08T09:22:16.001471+0000","last_peered":"2024-05-08T09:22:16.001471+0000","last_clean":"2024-05-08T09:22:16.001471+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:22:16.001471+0000","last_undegraded":"2024-05-08T09:22:16.001471+0000","last_fullsized":"2024-05-08T09:22:16.001471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.780267+0000","last_change":"2024-05-08T09:21:38.984125+0000","last_active":"2024-05-08T09:22:53.780267+0000","last_peered":"2024-05-08T09:22:53.780267+0000","last_clean":"2024-05-08T09:22:53.780267+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:22:53.780267+0000","last_undegraded":"2024-05-08T09:22:53.780267+0000","last_fullsized":"2024-05-08T09:22:53.780267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240957+0000","last_change":"2024-05-08T09:21:30.961147+0000","last_active":"2024-05-08T09:24:38.240957+0000","last_peered":"2024-05-08T09:24:38.240957+0000","last_clean":"2024-05-08T09:24:38.240957+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:24:38.240957+0000","last_undegraded":"2024-05-08T09:24:38.240957+0000","last_fullsized":"2024-05-08T09:24:38.240957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:21.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998085+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:22:15.998085+0000","last_peered":"2024-05-08T09:22:15.998085+0000","last_clean":"2024-05-08T09:22:15.998085+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:22:15.998085+0000","last_undegraded":"2024-05-08T09:22:15.998085+0000","last_fullsized":"2024-05-08T09:22:15.998085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065092+0000","last_change":"2024-05-08T09:21:32.957525+0000","last_active":"2024-05-08T09:22:16.065092+0000","last_peered":"2024-05-08T09:22:16.065092+0000","last_clean":"2024-05-08T09:22:16.065092+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:22:16.065092+0000","last_undegraded":"2024-05-08T09:22:16.065092+0000","last_fullsized":"2024-05-08T09:22:16.065092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:36.828402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.963076+0000","last_change":"2024-05-08T09:21:34.968421+0000","last_active":"2024-05-08T09:22:53.963076+0000","last_peered":"2024-05-08T09:22:53.963076+0000","last_clean":"2024-05-08T09:22:53.963076+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:22:53.963076+0000","last_undegraded":"2024-05-08T09:22:53.963076+0000","last_fullsized":"2024-05-08T09:22:53.963076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:49.987542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999400+0000","last_change":"2024-05-08T09:21:36.971614+0000","last_active":"2024-05-08T09:22:15.999400+0000","last_peered":"2024-05-08T09:22:15.999400+0000","last_clean":"2024-05-08T09:22:15.999400+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:22:15.999400+0000","last_undegraded":"2024-05-08T09:22:15.999400+0000","last_fullsized":"2024-05-08T09:22:15.999400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062726+0000","last_change":"2024-05-08T09:21:38.971525+0000","last_active":"2024-05-08T09:22:16.062726+0000","last_peered":"2024-05-08T09:22:16.062726+0000","last_clean":"2024-05-08T09:22:16.062726+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:22:16.062726+0000","last_undegraded":"2024-05-08T09:22:16.062726+0000","last_fullsized":"2024-05-08T09:22:16.062726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.209901+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.209901+0000","last_peered":"2024-05-08T09:24:38.209901+0000","last_clean":"2024-05-08T09:24:38.209901+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.209901+0000","last_undegraded":"2024-05-08T09:24:38.209901+0000","last_fullsized":"2024-05-08T09:24:38.209901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:39.126588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993965+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:22:15.993965+0000","last_peered":"2024-05-08T09:22:15.993965+0000","last_clean":"2024-05-08T09:22:15.993965+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:22:15.993965+0000","last_undegraded":"2024-05-08T09:22:15.993965+0000","last_fullsized":"2024-05-08T09:22:15.993965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:01.393034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:18.900511+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:22:18.900511+0000","last_peered":"2024-05-08T09:22:18.900511+0000","last_clean":"2024-05-08T09:22:18.900511+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:22:18.900511+0000","last_undegraded":"2024-05-08T09:22:18.900511+0000","last_fullsized":"2024-05-08T09:22:18.900511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:52.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000357+0000","last_change":"2024-05-08T09:21:34.970071+0000","last_active":"2024-05-08T09:22:16.000357+0000","last_peered":"2024-05-08T09:22:16.000357+0000","last_clean":"2024-05-08T09:22:16.000357+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:22:16.000357+0000","last_undegraded":"2024-05-08T09:22:16.000357+0000","last_fullsized":"2024-05-08T09:22:16.000357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:24.049898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043550+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:38.043550+0000","last_peered":"2024-05-08T09:24:38.043550+0000","last_clean":"2024-05-08T09:24:38.043550+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:38.043550+0000","last_undegraded":"2024-05-08T09:24:38.043550+0000","last_fullsized":"2024-05-08T09:24:38.043550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:20.146454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993615+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:22:15.993615+0000","last_peered":"2024-05-08T09:22:15.993615+0000","last_clean":"2024-05-08T09:22:15.993615+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:22:15.993615+0000","last_undegraded":"2024-05-08T09:22:15.993615+0000","last_fullsized":"2024-05-08T09:22:15.993615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:43.864633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240927+0000","last_change":"2024-05-08T09:21:30.943637+0000","last_active":"2024-05-08T09:24:38.240927+0000","last_peered":"2024-05-08T09:24:38.240927+0000","last_clean":"2024-05-08T09:24:38.240927+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:24:38.240927+0000","last_undegraded":"2024-05-08T09:24:38.240927+0000","last_fullsized":"2024-05-08T09:24:38.240927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914364+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:23:48.914364+0000","last_peered":"2024-05-08T09:23:48.914364+0000","last_clean":"2024-05-08T09:23:48.914364+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:23:48.914364+0000","last_undegraded":"2024-05-08T09:23:48.914364+0000","last_fullsized":"2024-05-08T09:23:48.914364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:46.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997524+0000","last_change":"2024-05-08T09:21:32.954018+0000","last_active":"2024-05-08T09:22:15.997524+0000","last_peered":"2024-05-08T09:22:15.997524+0000","last_clean":"2024-05-08T09:22:15.997524+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:22:15.997524+0000","last_undegraded":"2024-05-08T09:22:15.997524+0000","last_fullsized":"2024-05-08T09:22:15.997524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:47.581536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.120007+0000","last_change":"2024-05-08T09:21:34.969072+0000","last_active":"2024-05-08T09:23:36.120007+0000","last_peered":"2024-05-08T09:23:36.120007+0000","last_clean":"2024-05-08T09:23:36.120007+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:23:36.120007+0000","last_undegraded":"2024-05-08T09:23:36.120007+0000","last_fullsized":"2024-05-08T09:23:36.120007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:38.834811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.243750+0000","last_change":"2024-05-08T09:21:36.965387+0000","last_active":"2024-05-08T09:24:38.243750+0000","last_peered":"2024-05-08T09:24:38.243750+0000","last_clean":"2024-05-08T09:24:38.243750+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:38.243750+0000","last_undegraded":"2024-05-08T09:24:38.243750+0000","last_fullsized":"2024-05-08T09:24:38.243750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207965+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.207965+0000","last_peered":"2024-05-08T09:24:38.207965+0000","last_clean":"2024-05-08T09:24:38.207965+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.207965+0000","last_undegraded":"2024-05-08T09:24:38.207965+0000","last_fullsized":"2024-05-08T09:24:38.207965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:45.973741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.148771+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.148771+0000","last_peered":"2024-05-08T09:24:38.148771+0000","last_clean":"2024-05-08T09:24:38.148771+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.148771+0000","last_undegraded":"2024-05-08T09:24:38.148771+0000","last_fullsized":"2024-05-08T09:24:38.148771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993880+0000","last_change":"2024-05-08T09:21:32.958870+0000","last_active":"2024-05-08T09:22:15.993880+0000","last_peered":"2024-05-08T09:22:15.993880+0000","last_clean":"2024-05-08T09:22:15.993880+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:22:15.993880+0000","last_undegraded":"2024-05-08T09:22:15.993880+0000","last_fullsized":"2024-05-08T09:22:15.993880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:13.060641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.129369+0000","last_change":"2024-05-08T09:21:34.966604+0000","last_active":"2024-05-08T09:23:36.129369+0000","last_peered":"2024-05-08T09:23:36.129369+0000","last_clean":"2024-05-08T09:23:36.129369+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:23:36.129369+0000","last_undegraded":"2024-05-08T09:23:36.129369+0000","last_fullsized":"2024-05-08T09:23:36.129369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:14:01.043108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064548+0000","last_change":"2024-05-08T09:21:36.964833+0000","last_active":"2024-05-08T09:22:16.064548+0000","last_peered":"2024-05-08T09:22:16.064548+0000","last_clean":"2024-05-08T09:22:16.064548+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:22:16.064548+0000","last_undegraded":"2024-05-08T09:22:16.064548+0000","last_fullsized":"2024-05-08T09:22:16.064548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:51.594598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.782118+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:22:53.782118+0000","last_peered":"2024-05-08T09:22:53.782118+0000","last_clean":"2024-05-08T09:22:53.782118+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:22:53.782118+0000","last_undegraded":"2024-05-08T09:22:53.782118+0000","last_fullsized":"2024-05-08T09:22:53.782118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.051881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240991+0000","last_change":"2024-05-08T09:21:30.942033+0000","last_active":"2024-05-08T09:24:38.240991+0000","last_peered":"2024-05-08T09:24:38.240991+0000","last_clean":"2024-05-08T09:24:38.240991+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:24:38.240991+0000","last_undegraded":"2024-05-08T09:24:38.240991+0000","last_fullsized":"2024-05-08T09:24:38.240991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000003+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:22:16.000003+0000","last_peered":"2024-05-08T09:22:16.000003+0000","last_clean":"2024-05-08T09:22:16.000003+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:22:16.000003+0000","last_undegraded":"2024-05-08T09:22:16.000003+0000","last_fullsized":"2024-05-08T09:22:16.000003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063135+0000","last_change":"2024-05-08T09:21:32.956199+0000","last_active":"2024-05-08T09:22:16.063135+0000","last_peered":"2024-05-08T09:22:16.063135+0000","last_clean":"2024-05-08T09:22:16.063135+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:22:16.063135+0000","last_undegraded":"2024-05-08T09:22:16.063135+0000","last_fullsized":"2024-05-08T09:22:16.063135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:22.043489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.109617+0000","last_change":"2024-05-08T09:21:34.969113+0000","last_active":"2024-05-08T09:23:36.109617+0000","last_peered":"2024-05-08T09:23:36.109617+0000","last_clean":"2024-05-08T09:23:36.109617+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:23:36.109617+0000","last_undegraded":"2024-05-08T09:23:36.109617+0000","last_fullsized":"2024-05-08T09:23:36.109617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:18.664086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063764+0000","last_change":"2024-05-08T09:21:36.966245+0000","last_active":"2024-05-08T09:22:16.063764+0000","last_peered":"2024-05-08T09:22:16.063764+0000","last_clean":"2024-05-08T09:22:16.063764+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:22:16.063764+0000","last_undegraded":"2024-05-08T09:22:16.063764+0000","last_fullsized":"2024-05-08T09:22:16.063764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.539672+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:37.539672+0000","last_peered":"2024-05-08T09:23:37.539672+0000","last_clean":"2024-05-08T09:23:37.539672+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:37.539672+0000","last_undegraded":"2024-05-08T09:23:37.539672+0000","last_fullsized":"2024-05-08T09:23:37.539672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999146+0000","last_change":"2024-05-08T09:21:30.953247+0000","last_active":"2024-05-08T09:22:15.999146+0000","last_peered":"2024-05-08T09:22:15.999146+0000","last_clean":"2024-05-08T09:22:15.999146+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:22:15.999146+0000","last_undegraded":"2024-05-08T09:22:15.999146+0000","last_fullsized":"2024-05-08T09:22:15.999146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:03.399759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997399+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:22:15.997399+0000","last_peered":"2024-05-08T09:22:15.997399+0000","last_clean":"2024-05-08T09:22:15.997399+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:22:15.997399+0000","last_undegraded":"2024-05-08T09:22:15.997399+0000","last_fullsized":"2024-05-08T09:22:15.997399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:56.441900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063881+0000","last_change":"2024-05-08T09:21:32.957626+0000","last_active":"2024-05-08T09:22:16.063881+0000","last_peered":"2024-05-08T09:22:16.063881+0000","last_clean":"2024-05-08T09:22:16.063881+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:22:16.063881+0000","last_undegraded":"2024-05-08T09:22:16.063881+0000","last_fullsized":"2024-05-08T09:22:16.063881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:21:40.755189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914793+0000","last_change":"2024-05-08T09:21:34.962754+0000","last_active":"2024-05-08T09:23:48.914793+0000","last_peered":"2024-05-08T09:23:48.914793+0000","last_clean":"2024-05-08T09:23:48.914793+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:23:48.914793+0000","last_undegraded":"2024-05-08T09:23:48.914793+0000","last_fullsized":"2024-05-08T09:23:48.914793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:25.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.360406+0000","last_change":"2024-05-08T09:21:36.978801+0000","last_active":"2024-05-08T09:24:38.360406+0000","last_peered":"2024-05-08T09:24:38.360406+0000","last_clean":"2024-05-08T09:24:38.360406+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:24:38.360406+0000","last_undegraded":"2024-05-08T09:24:38.360406+0000","last_fullsized":"2024-05-08T09:24:38.360406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064571+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:22:16.064571+0000","last_peered":"2024-05-08T09:22:16.064571+0000","last_clean":"2024-05-08T09:22:16.064571+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:22:16.064571+0000","last_undegraded":"2024-05-08T09:22:16.064571+0000","last_fullsized":"2024-05-08T09:22:16.064571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:29.324457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998301+0000","last_change":"2024-05-08T09:21:30.951955+0000","last_active":"2024-05-08T09:22:15.998301+0000","last_peered":"2024-05-08T09:22:15.998301+0000","last_clean":"2024-05-08T09:22:15.998301+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:22:15.998301+0000","last_undegraded":"2024-05-08T09:22:15.998301+0000","last_fullsized":"2024-05-08T09:22:15.998301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:07.718728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996601+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:22:15.996601+0000","last_peered":"2024-05-08T09:22:15.996601+0000","last_clean":"2024-05-08T09:22:15.996601+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:22:15.996601+0000","last_undegraded":"2024-05-08T09:22:15.996601+0000","last_fullsized":"2024-05-08T09:22:15.996601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:06.582694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063416+0000","last_change":"2024-05-08T09:21:32.957023+0000","last_active":"2024-05-08T09:22:16.063416+0000","last_peered":"2024-05-08T09:22:16.063416+0000","last_clean":"2024-05-08T09:22:16.063416+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:22:16.063416+0000","last_undegraded":"2024-05-08T09:22:16.063416+0000","last_fullsized":"2024-05-08T09:22:16.063416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:40.029960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.133206+0000","last_change":"2024-05-08T09:21:34.966546+0000","last_active":"2024-05-08T09:23:36.133206+0000","last_peered":"2024-05-08T09:23:36.133206+0000","last_clean":"2024-05-08T09:23:36.133206+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:23:36.133206+0000","last_undegraded":"2024-05-08T09:23:36.133206+0000","last_fullsized":"2024-05-08T09:23:36.133206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:29:37.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062735+0000","last_change":"2024-05-08T09:21:36.971385+0000","last_active":"2024-05-08T09:22:16.062735+0000","last_peered":"2024-05-08T09:22:16.062735+0000","last_clean":"2024-05-08T09:22:16.062735+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:22:16.062735+0000","last_undegraded":"2024-05-08T09:22:16.062735+0000","last_fullsized":"2024-05-08T09:22:16.062735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:49.044705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.337428+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.337428+0000","last_peered":"2024-05-08T09:24:38.337428+0000","last_clean":"2024-05-08T09:24:38.337428+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.337428+0000","last_undegraded":"2024-05-08T09:24:38.337428+0000","last_fullsized":"2024-05-08T09:24:38.337428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:53.334530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166739+0000","last_change":"2024-05-08T09:21:30.955072+0000","last_active":"2024-05-08T09:24:38.166739+0000","last_peered":"2024-05-08T09:24:38.166739+0000","last_clean":"2024-05-08T09:24:38.166739+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:24:38.166739+0000","last_undegraded":"2024-05-08T09:24:38.166739+0000","last_fullsized":"2024-05-08T09:24:38.166739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064027+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:22:16.064027+0000","last_peered":"2024-05-08T09:22:16.064027+0000","last_clean":"2024-05-08T09:22:16.064027+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:22:16.064027+0000","last_undegraded":"2024-05-08T09:22:16.064027+0000","last_fullsized":"2024-05-08T09:22:16.064027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995287+0000","last_change":"2024-05-08T09:21:32.958822+0000","last_active":"2024-05-08T09:22:15.995287+0000","last_peered":"2024-05-08T09:22:15.995287+0000","last_clean":"2024-05-08T09:22:15.995287+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:22:15.995287+0000","last_undegraded":"2024-05-08T09:22:15.995287+0000","last_fullsized":"2024-05-08T09:22:15.995287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:35.925851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.113715+0000","last_change":"2024-05-08T09:21:34.965442+0000","last_active":"2024-05-08T09:23:36.113715+0000","last_peered":"2024-05-08T09:23:36.113715+0000","last_clean":"2024-05-08T09:23:36.113715+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:23:36.113715+0000","last_undegraded":"2024-05-08T09:23:36.113715+0000","last_fullsized":"2024-05-08T09:23:36.113715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:19.669692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998369+0000","last_change":"2024-05-08T09:21:36.980935+0000","last_active":"2024-05-08T09:22:15.998369+0000","last_peered":"2024-05-08T09:22:15.998369+0000","last_clean":"2024-05-08T09:22:15.998369+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:22:15.998369+0000","last_undegraded":"2024-05-08T09:22:15.998369+0000","last_fullsized":"2024-05-08T09:22:15.998369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912987+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:23:38.912987+0000","last_peered":"2024-05-08T09:23:38.912987+0000","last_clean":"2024-05-08T09:23:38.912987+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:23:38.912987+0000","last_undegraded":"2024-05-08T09:23:38.912987+0000","last_fullsized":"2024-05-08T09:23:38.912987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:30:24.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999240+0000","last_change":"2024-05-08T09:21:30.961704+0000","last_active":"2024-05-08T09:22:15.999240+0000","last_peered":"2024-05-08T09:22:15.999240+0000","last_clean":"2024-05-08T09:22:15.999240+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:22:15.999240+0000","last_undegraded":"2024-05-08T09:22:15.999240+0000","last_fullsized":"2024-05-08T09:22:15.999240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:15.655892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997331+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:22:15.997331+0000","last_peered":"2024-05-08T09:22:15.997331+0000","last_clean":"2024-05-08T09:22:15.997331+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:22:15.997331+0000","last_undegraded":"2024-05-08T09:22:15.997331+0000","last_fullsized":"2024-05-08T09:22:15.997331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:21.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.177753+0000","last_change":"2024-05-08T09:21:32.957213+0000","last_active":"2024-05-08T09:23:37.177753+0000","last_peered":"2024-05-08T09:23:37.177753+0000","last_clean":"2024-05-08T09:23:37.177753+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:23:37.177753+0000","last_undegraded":"2024-05-08T09:23:37.177753+0000","last_fullsized":"2024-05-08T09:23:37.177753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:46.321295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.139733+0000","last_change":"2024-05-08T09:21:34.958793+0000","last_active":"2024-05-08T09:23:36.139733+0000","last_peered":"2024-05-08T09:23:36.139733+0000","last_clean":"2024-05-08T09:23:36.139733+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:23:36.139733+0000","last_undegraded":"2024-05-08T09:23:36.139733+0000","last_fullsized":"2024-05-08T09:23:36.139733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:15.067049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.341387+0000","last_change":"2024-05-08T09:21:36.971576+0000","last_active":"2024-05-08T09:24:38.341387+0000","last_peered":"2024-05-08T09:24:38.341387+0000","last_clean":"2024-05-08T09:24:38.341387+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:38.341387+0000","last_undegraded":"2024-05-08T09:24:38.341387+0000","last_fullsized":"2024-05-08T09:24:38.341387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:05.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.950071+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:37.950071+0000","last_peered":"2024-05-08T09:24:37.950071+0000","last_clean":"2024-05-08T09:24:37.950071+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:37.950071+0000","last_undegraded":"2024-05-08T09:24:37.950071+0000","last_fullsized":"2024-05-08T09:24:37.950071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001229+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:22:16.001229+0000","last_peered":"2024-05-08T09:22:16.001229+0000","last_clean":"2024-05-08T09:22:16.001229+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:22:16.001229+0000","last_undegraded":"2024-05-08T09:22:16.001229+0000","last_fullsized":"2024-05-08T09:22:16.001229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995509+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:22:15.995509+0000","last_peered":"2024-05-08T09:22:15.995509+0000","last_clean":"2024-05-08T09:22:15.995509+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:22:15.995509+0000","last_undegraded":"2024-05-08T09:22:15.995509+0000","last_fullsized":"2024-05-08T09:22:15.995509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:48.376085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188113+0000","last_change":"2024-05-08T09:21:32.955025+0000","last_active":"2024-05-08T09:23:37.188113+0000","last_peered":"2024-05-08T09:23:37.188113+0000","last_clean":"2024-05-08T09:23:37.188113+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:23:37.188113+0000","last_undegraded":"2024-05-08T09:23:37.188113+0000","last_fullsized":"2024-05-08T09:23:37.188113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:48.868737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999772+0000","last_change":"2024-05-08T09:21:34.969633+0000","last_active":"2024-05-08T09:22:15.999772+0000","last_peered":"2024-05-08T09:22:15.999772+0000","last_clean":"2024-05-08T09:22:15.999772+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:22:15.999772+0000","last_undegraded":"2024-05-08T09:22:15.999772+0000","last_fullsized":"2024-05-08T09:22:15.999772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:12:38.074915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.299223+0000","last_change":"2024-05-08T09:21:36.971697+0000","last_active":"2024-05-08T09:24:38.299223+0000","last_peered":"2024-05-08T09:24:38.299223+0000","last_clean":"2024-05-08T09:24:38.299223+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:38.299223+0000","last_undegraded":"2024-05-08T09:24:38.299223+0000","last_fullsized":"2024-05-08T09:24:38.299223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.321717+0000","last_change":"2024-05-08T09:21:38.969278+0000","last_active":"2024-05-08T09:23:37.321717+0000","last_peered":"2024-05-08T09:23:37.321717+0000","last_clean":"2024-05-08T09:23:37.321717+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:23:37.321717+0000","last_undegraded":"2024-05-08T09:23:37.321717+0000","last_fullsized":"2024-05-08T09:23:37.321717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:06.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210299+0000","last_change":"2024-05-08T09:21:30.955832+0000","last_active":"2024-05-08T09:24:38.210299+0000","last_peered":"2024-05-08T09:24:38.210299+0000","last_clean":"2024-05-08T09:24:38.210299+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:24:38.210299+0000","last_undegraded":"2024-05-08T09:24:38.210299+0000","last_fullsized":"2024-05-08T09:24:38.210299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:51.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992620+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:22:15.992620+0000","last_peered":"2024-05-08T09:22:15.992620+0000","last_clean":"2024-05-08T09:22:15.992620+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:22:15.992620+0000","last_undegraded":"2024-05-08T09:22:15.992620+0000","last_fullsized":"2024-05-08T09:22:15.992620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:26:59.095251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997769+0000","last_change":"2024-05-08T09:21:32.958748+0000","last_active":"2024-05-08T09:22:15.997769+0000","last_peered":"2024-05-08T09:22:15.997769+0000","last_clean":"2024-05-08T09:22:15.997769+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:22:15.997769+0000","last_undegraded":"2024-05-08T09:22:15.997769+0000","last_fullsized":"2024-05-08T09:22:15.997769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:33.281026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.126382+0000","last_change":"2024-05-08T09:21:34.960277+0000","last_active":"2024-05-08T09:23:36.126382+0000","last_peered":"2024-05-08T09:23:36.126382+0000","last_clean":"2024-05-08T09:23:36.126382+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:23:36.126382+0000","last_undegraded":"2024-05-08T09:23:36.126382+0000","last_fullsized":"2024-05-08T09:23:36.126382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:56.211138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001233+0000","last_change":"2024-05-08T09:21:36.975280+0000","last_active":"2024-05-08T09:22:16.001233+0000","last_peered":"2024-05-08T09:22:16.001233+0000","last_clean":"2024-05-08T09:22:16.001233+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:22:16.001233+0000","last_undegraded":"2024-05-08T09:22:16.001233+0000","last_fullsized":"2024-05-08T09:22:16.001233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:48.690526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.274231+0000","last_change":"2024-05-08T09:21:38.977441+0000","last_active":"2024-05-08T09:24:38.274231+0000","last_peered":"2024-05-08T09:24:38.274231+0000","last_clean":"2024-05-08T09:24:38.274231+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:24:38.274231+0000","last_undegraded":"2024-05-08T09:24:38.274231+0000","last_fullsized":"2024-05-08T09:24:38.274231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542061+0000","last_change":"2024-05-08T09:21:30.961518+0000","last_active":"2024-05-08T09:23:37.542061+0000","last_peered":"2024-05-08T09:23:37.542061+0000","last_clean":"2024-05-08T09:23:37.542061+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:23:37.542061+0000","last_undegraded":"2024-05-08T09:23:37.542061+0000","last_fullsized":"2024-05-08T09:23:37.542061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:42.670072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993805+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:22:15.993805+0000","last_peered":"2024-05-08T09:22:15.993805+0000","last_clean":"2024-05-08T09:22:15.993805+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:22:15.993805+0000","last_undegraded":"2024-05-08T09:22:15.993805+0000","last_fullsized":"2024-05-08T09:22:15.993805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996416+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:22:15.996416+0000","last_peered":"2024-05-08T09:22:15.996416+0000","last_clean":"2024-05-08T09:22:15.996416+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:22:15.996416+0000","last_undegraded":"2024-05-08T09:22:15.996416+0000","last_fullsized":"2024-05-08T09:22:15.996416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996694+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:22:15.996694+0000","last_peered":"2024-05-08T09:22:15.996694+0000","last_clean":"2024-05-08T09:22:15.996694+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:22:15.996694+0000","last_undegraded":"2024-05-08T09:22:15.996694+0000","last_fullsized":"2024-05-08T09:22:15.996694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:52.688659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995940+0000","last_change":"2024-05-08T09:21:32.954960+0000","last_active":"2024-05-08T09:22:15.995940+0000","last_peered":"2024-05-08T09:22:15.995940+0000","last_clean":"2024-05-08T09:22:15.995940+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:22:15.995940+0000","last_undegraded":"2024-05-08T09:22:15.995940+0000","last_fullsized":"2024-05-08T09:22:15.995940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:07.460383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.137506+0000","last_change":"2024-05-08T09:21:34.958243+0000","last_active":"2024-05-08T09:23:36.137506+0000","last_peered":"2024-05-08T09:23:36.137506+0000","last_clean":"2024-05-08T09:23:36.137506+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:23:36.137506+0000","last_undegraded":"2024-05-08T09:23:36.137506+0000","last_fullsized":"2024-05-08T09:23:36.137506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:20.157874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064709+0000","last_change":"2024-05-08T09:21:36.973660+0000","last_active":"2024-05-08T09:22:16.064709+0000","last_peered":"2024-05-08T09:22:16.064709+0000","last_clean":"2024-05-08T09:22:16.064709+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:22:16.064709+0000","last_undegraded":"2024-05-08T09:22:16.064709+0000","last_fullsized":"2024-05-08T09:22:16.064709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.251742+0000","last_change":"2024-05-08T09:21:38.970424+0000","last_active":"2024-05-08T09:24:38.251742+0000","last_peered":"2024-05-08T09:24:38.251742+0000","last_clean":"2024-05-08T09:24:38.251742+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:24:38.251742+0000","last_undegraded":"2024-05-08T09:24:38.251742+0000","last_fullsized":"2024-05-08T09:24:38.251742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:39.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914170+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:23:43.914170+0000","last_peered":"2024-05-08T09:23:43.914170+0000","last_clean":"2024-05-08T09:23:43.914170+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:23:43.914170+0000","last_undegraded":"2024-05-08T09:23:43.914170+0000","last_fullsized":"2024-05-08T09:23:43.914170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:41.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992288+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:22:15.992288+0000","last_peered":"2024-05-08T09:22:15.992288+0000","last_clean":"2024-05-08T09:22:15.992288+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:22:15.992288+0000","last_undegraded":"2024-05-08T09:22:15.992288+0000","last_fullsized":"2024-05-08T09:22:15.992288+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.236384+0000","last_change":"2024-05-08T09:21:28.963914+0000","last_active":"2024-05-08T09:24:38.236384+0000","last_peered":"2024-05-08T09:24:38.236384+0000","last_clean":"2024-05-08T09:24:38.236384+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:24:38.236384+0000","last_undegraded":"2024-05-08T09:24:38.236384+0000","last_fullsized":"2024-05-08T09:24:38.236384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998540+0000","last_change":"2024-05-08T09:21:32.956037+0000","last_active":"2024-05-08T09:22:15.998540+0000","last_peered":"2024-05-08T09:22:15.998540+0000","last_clean":"2024-05-08T09:22:15.998540+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:22:15.998540+0000","last_undegraded":"2024-05-08T09:22:15.998540+0000","last_fullsized":"2024-05-08T09:22:15.998540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:35.197031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043243+0000","last_change":"2024-05-08T09:21:34.968703+0000","last_active":"2024-05-08T09:24:38.043243+0000","last_peered":"2024-05-08T09:24:38.043243+0000","last_clean":"2024-05-08T09:24:38.043243+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:38.043243+0000","last_undegraded":"2024-05-08T09:24:38.043243+0000","last_fullsized":"2024-05-08T09:24:38.043243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:23.830443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996211+0000","last_change":"2024-05-08T09:21:36.982457+0000","last_active":"2024-05-08T09:22:15.996211+0000","last_peered":"2024-05-08T09:22:15.996211+0000","last_clean":"2024-05-08T09:22:15.996211+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:22:15.996211+0000","last_undegraded":"2024-05-08T09:22:15.996211+0000","last_fullsized":"2024-05-08T09:22:15.996211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:59.498636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.778538+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:22:53.778538+0000","last_peered":"2024-05-08T09:22:53.778538+0000","last_clean":"2024-05-08T09:22:53.778538+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:22:53.778538+0000","last_undegraded":"2024-05-08T09:22:53.778538+0000","last_fullsized":"2024-05-08T09:22:53.778538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:53.706014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544450+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:37.544450+0000","last_peered":"2024-05-08T09:23:37.544450+0000","last_clean":"2024-05-08T09:23:37.544450+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:37.544450+0000","last_undegraded":"2024-05-08T09:23:37.544450+0000","last_fullsized":"2024-05-08T09:23:37.544450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997429+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:22:15.997429+0000","last_peered":"2024-05-08T09:22:15.997429+0000","last_clean":"2024-05-08T09:22:15.997429+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:22:15.997429+0000","last_undegraded":"2024-05-08T09:22:15.997429+0000","last_fullsized":"2024-05-08T09:22:15.997429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:07.226430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062347+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:22:16.062347+0000","last_peered":"2024-05-08T09:22:16.062347+0000","last_clean":"2024-05-08T09:22:16.062347+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:22:16.062347+0000","last_undegraded":"2024-05-08T09:22:16.062347+0000","last_fullsized":"2024-05-08T09:22:16.062347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999681+0000","last_change":"2024-05-08T09:21:32.954033+0000","last_active":"2024-05-08T09:22:15.999681+0000","last_peered":"2024-05-08T09:22:15.999681+0000","last_clean":"2024-05-08T09:22:15.999681+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:22:15.999681+0000","last_undegraded":"2024-05-08T09:22:15.999681+0000","last_fullsized":"2024-05-08T09:22:15.999681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.238359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043198+0000","last_change":"2024-05-08T09:21:34.961617+0000","last_active":"2024-05-08T09:24:38.043198+0000","last_peered":"2024-05-08T09:24:38.043198+0000","last_clean":"2024-05-08T09:24:38.043198+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:24:38.043198+0000","last_undegraded":"2024-05-08T09:24:38.043198+0000","last_fullsized":"2024-05-08T09:24:38.043198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:00:00.996503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065985+0000","last_change":"2024-05-08T09:21:36.973699+0000","last_active":"2024-05-08T09:22:16.065985+0000","last_peered":"2024-05-08T09:22:16.065985+0000","last_clean":"2024-05-08T09:22:16.065985+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:22:16.065985+0000","last_undegraded":"2024-05-08T09:22:16.065985+0000","last_fullsized":"2024-05-08T09:22:16.065985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:37.294088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994876+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:22:15.994876+0000","last_peered":"2024-05-08T09:22:15.994876+0000","last_clean":"2024-05-08T09:22:15.994876+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:22:15.994876+0000","last_undegraded":"2024-05-08T09:22:15.994876+0000","last_fullsized":"2024-05-08T09:22:15.994876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:58.388645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.541714+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:37.541714+0000","last_peered":"2024-05-08T09:23:37.541714+0000","last_clean":"2024-05-08T09:23:37.541714+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:37.541714+0000","last_undegraded":"2024-05-08T09:23:37.541714+0000","last_fullsized":"2024-05-08T09:23:37.541714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996203+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:22:15.996203+0000","last_peered":"2024-05-08T09:22:15.996203+0000","last_clean":"2024-05-08T09:22:15.996203+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:22:15.996203+0000","last_undegraded":"2024-05-08T09:22:15.996203+0000","last_fullsized":"2024-05-08T09:22:15.996203+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995492+0000","last_change":"2024-05-08T09:21:28.975541+0000","last_active":"2024-05-08T09:22:15.995492+0000","last_peered":"2024-05-08T09:22:15.995492+0000","last_clean":"2024-05-08T09:22:15.995492+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:22:15.995492+0000","last_undegraded":"2024-05-08T09:22:15.995492+0000","last_fullsized":"2024-05-08T09:22:15.995492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064398+0000","last_change":"2024-05-08T09:21:32.958810+0000","last_active":"2024-05-08T09:22:16.064398+0000","last_peered":"2024-05-08T09:22:16.064398+0000","last_clean":"2024-05-08T09:22:16.064398+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:22:16.064398+0000","last_undegraded":"2024-05-08T09:22:16.064398+0000","last_fullsized":"2024-05-08T09:22:16.064398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:13:59.036699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.555805+0000","last_change":"2024-05-08T09:21:34.958674+0000","last_active":"2024-05-08T09:24:37.555805+0000","last_peered":"2024-05-08T09:24:37.555805+0000","last_clean":"2024-05-08T09:24:37.555805+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:37.555805+0000","last_undegraded":"2024-05-08T09:24:37.555805+0000","last_fullsized":"2024-05-08T09:24:37.555805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:51.780853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998784+0000","last_change":"2024-05-08T09:21:36.980954+0000","last_active":"2024-05-08T09:22:15.998784+0000","last_peered":"2024-05-08T09:22:15.998784+0000","last_clean":"2024-05-08T09:22:15.998784+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:22:15.998784+0000","last_undegraded":"2024-05-08T09:22:15.998784+0000","last_fullsized":"2024-05-08T09:22:15.998784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:19.944195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.300793+0000","last_change":"2024-05-08T09:21:38.979327+0000","last_active":"2024-05-08T09:23:37.300793+0000","last_peered":"2024-05-08T09:23:37.300793+0000","last_clean":"2024-05-08T09:23:37.300793+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:23:37.300793+0000","last_undegraded":"2024-05-08T09:23:37.300793+0000","last_fullsized":"2024-05-08T09:23:37.300793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:08.072829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166882+0000","last_change":"2024-05-08T09:21:30.954313+0000","last_active":"2024-05-08T09:24:38.166882+0000","last_peered":"2024-05-08T09:24:38.166882+0000","last_clean":"2024-05-08T09:24:38.166882+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:24:38.166882+0000","last_undegraded":"2024-05-08T09:24:38.166882+0000","last_fullsized":"2024-05-08T09:24:38.166882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.902533+0000","last_change":"2024-05-08T09:21:28.977568+0000","last_active":"2024-05-08T09:24:37.902533+0000","last_peered":"2024-05-08T09:24:37.902533+0000","last_clean":"2024-05-08T09:24:37.902533+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:24:37.902533+0000","last_undegraded":"2024-05-08T09:24:37.902533+0000","last_fullsized":"2024-05-08T09:24:37.902533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065853+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:22:16.065853+0000","last_peered":"2024-05-08T09:22:16.065853+0000","last_clean":"2024-05-08T09:22:16.065853+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:22:16.065853+0000","last_undegraded":"2024-05-08T09:22:16.065853+0000","last_fullsized":"2024-05-08T09:22:16.065853+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:33:18.664257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908099+0000","last_change":"2024-05-08T09:21:32.957975+0000","last_active":"2024-05-08T09:23:38.908099+0000","last_peered":"2024-05-08T09:23:38.908099+0000","last_clean":"2024-05-08T09:23:38.908099+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:23:38.908099+0000","last_undegraded":"2024-05-08T09:23:38.908099+0000","last_fullsized":"2024-05-08T09:23:38.908099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:05:57.275150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'61","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908015+0000","last_change":"2024-05-08T09:21:34.962670+0000","last_active":"2024-05-08T09:23:38.908015+0000","last_peered":"2024-05-08T09:23:38.908015+0000","last_clean":"2024-05-08T09:23:38.908015+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:23:38.908015+0000","last_undegraded":"2024-05-08T09:23:38.908015+0000","last_fullsized":"2024-05-08T09:23:38.908015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:45.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996880+0000","last_change":"2024-05-08T09:21:36.970971+0000","last_active":"2024-05-08T09:22:15.996880+0000","last_peered":"2024-05-08T09:22:15.996880+0000","last_clean":"2024-05-08T09:22:15.996880+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:22:15.996880+0000","last_undegraded":"2024-05-08T09:22:15.996880+0000","last_fullsized":"2024-05-08T09:22:15.996880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:45.147043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.211724+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.211724+0000","last_peered":"2024-05-08T09:24:38.211724+0000","last_clean":"2024-05-08T09:24:38.211724+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.211724+0000","last_undegraded":"2024-05-08T09:24:38.211724+0000","last_fullsized":"2024-05-08T09:24:38.211724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:16.801888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912699+0000","last_change":"2024-05-08T09:21:30.954500+0000","last_active":"2024-05-08T09:23:38.912699+0000","last_peered":"2024-05-08T09:23:38.912699+0000","last_clean":"2024-05-08T09:23:38.912699+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:23:38.912699+0000","last_undegraded":"2024-05-08T09:23:38.912699+0000","last_fullsized":"2024-05-08T09:23:38.912699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:32.782785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066126+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:22:16.066126+0000","last_peered":"2024-05-08T09:22:16.066126+0000","last_clean":"2024-05-08T09:22:16.066126+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:22:16.066126+0000","last_undegraded":"2024-05-08T09:22:16.066126+0000","last_fullsized":"2024-05-08T09:22:16.066126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997047+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:22:15.997047+0000","last_peered":"2024-05-08T09:22:15.997047+0000","last_clean":"2024-05-08T09:22:15.997047+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:22:15.997047+0000","last_undegraded":"2024-05-08T09:22:15.997047+0000","last_fullsized":"2024-05-08T09:22:15.997047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995954+0000","last_change":"2024-05-08T09:21:32.955946+0000","last_active":"2024-05-08T09:22:15.995954+0000","last_peered":"2024-05-08T09:22:15.995954+0000","last_clean":"2024-05-08T09:22:15.995954+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:22:15.995954+0000","last_undegraded":"2024-05-08T09:22:15.995954+0000","last_fullsized":"2024-05-08T09:22:15.995954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:05.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994372+0000","last_change":"2024-05-08T09:21:34.968595+0000","last_active":"2024-05-08T09:22:15.994372+0000","last_peered":"2024-05-08T09:22:15.994372+0000","last_clean":"2024-05-08T09:22:15.994372+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:22:15.994372+0000","last_undegraded":"2024-05-08T09:22:15.994372+0000","last_fullsized":"2024-05-08T09:22:15.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:43.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":356,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350586+0000","last_change":"2024-05-08T09:21:36.971304+0000","last_active":"2024-05-08T09:24:38.350586+0000","last_peered":"2024-05-08T09:24:38.350586+0000","last_clean":"2024-05-08T09:24:38.350586+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:38.350586+0000","last_undegraded":"2024-05-08T09:24:38.350586+0000","last_fullsized":"2024-05-08T09:24:38.350586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998082+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:22:15.998082+0000","last_peered":"2024-05-08T09:22:15.998082+0000","last_clean":"2024-05-08T09:22:15.998082+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:22:15.998082+0000","last_undegraded":"2024-05-08T09:22:15.998082+0000","last_fullsized":"2024-05-08T09:22:15.998082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:56.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.534998+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.534998+0000","last_peered":"2024-05-08T09:23:37.534998+0000","last_clean":"2024-05-08T09:23:37.534998+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.534998+0000","last_undegraded":"2024-05-08T09:23:37.534998+0000","last_fullsized":"2024-05-08T09:23:37.534998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:46.861344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913368+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:23:38.913368+0000","last_peered":"2024-05-08T09:23:38.913368+0000","last_clean":"2024-05-08T09:23:38.913368+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:23:38.913368+0000","last_undegraded":"2024-05-08T09:23:38.913368+0000","last_fullsized":"2024-05-08T09:23:38.913368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:07.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065021+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:22:16.065021+0000","last_peered":"2024-05-08T09:22:16.065021+0000","last_clean":"2024-05-08T09:22:16.065021+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:22:16.065021+0000","last_undegraded":"2024-05-08T09:22:16.065021+0000","last_fullsized":"2024-05-08T09:22:16.065021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:05.319652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993871+0000","last_change":"2024-05-08T09:21:32.953187+0000","last_active":"2024-05-08T09:22:15.993871+0000","last_peered":"2024-05-08T09:22:15.993871+0000","last_clean":"2024-05-08T09:22:15.993871+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:22:15.993871+0000","last_undegraded":"2024-05-08T09:22:15.993871+0000","last_fullsized":"2024-05-08T09:22:15.993871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:55.009101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997211+0000","last_change":"2024-05-08T09:21:34.965238+0000","last_active":"2024-05-08T09:22:15.997211+0000","last_peered":"2024-05-08T09:22:15.997211+0000","last_clean":"2024-05-08T09:22:15.997211+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:22:15.997211+0000","last_undegraded":"2024-05-08T09:22:15.997211+0000","last_fullsized":"2024-05-08T09:22:15.997211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:18.697994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.338025+0000","last_change":"2024-05-08T09:21:36.964762+0000","last_active":"2024-05-08T09:24:38.338025+0000","last_peered":"2024-05-08T09:24:38.338025+0000","last_clean":"2024-05-08T09:24:38.338025+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:38.338025+0000","last_undegraded":"2024-05-08T09:24:38.338025+0000","last_fullsized":"2024-05-08T09:24:38.338025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.195367+0000","last_change":"2024-05-08T09:21:38.976489+0000","last_active":"2024-05-08T09:24:38.195367+0000","last_peered":"2024-05-08T09:24:38.195367+0000","last_clean":"2024-05-08T09:24:38.195367+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:24:38.195367+0000","last_undegraded":"2024-05-08T09:24:38.195367+0000","last_fullsized":"2024-05-08T09:24:38.195367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294339+0000","last_change":"2024-05-08T09:21:30.954521+0000","last_active":"2024-05-08T09:24:38.294339+0000","last_peered":"2024-05-08T09:24:38.294339+0000","last_clean":"2024-05-08T09:24:38.294339+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:24:38.294339+0000","last_undegraded":"2024-05-08T09:24:38.294339+0000","last_fullsized":"2024-05-08T09:24:38.294339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:48.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999497+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:22:15.999497+0000","last_peered":"2024-05-08T09:22:15.999497+0000","last_clean":"2024-05-08T09:22:15.999497+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:22:15.999497+0000","last_undegraded":"2024-05-08T09:22:15.999497+0000","last_fullsized":"2024-05-08T09:22:15.999497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998995+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:22:15.998995+0000","last_peered":"2024-05-08T09:22:15.998995+0000","last_clean":"2024-05-08T09:22:15.998995+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:22:15.998995+0000","last_undegraded":"2024-05-08T09:22:15.998995+0000","last_fullsized":"2024-05-08T09:22:15.998995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992213+0000","last_change":"2024-05-08T09:21:32.951089+0000","last_active":"2024-05-08T09:22:15.992213+0000","last_peered":"2024-05-08T09:22:15.992213+0000","last_clean":"2024-05-08T09:22:15.992213+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:22:15.992213+0000","last_undegraded":"2024-05-08T09:22:15.992213+0000","last_fullsized":"2024-05-08T09:22:15.992213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:27.953425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.124374+0000","last_change":"2024-05-08T09:21:34.967958+0000","last_active":"2024-05-08T09:23:36.124374+0000","last_peered":"2024-05-08T09:23:36.124374+0000","last_clean":"2024-05-08T09:23:36.124374+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:23:36.124374+0000","last_undegraded":"2024-05-08T09:23:36.124374+0000","last_fullsized":"2024-05-08T09:23:36.124374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:48.327703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062871+0000","last_change":"2024-05-08T09:21:36.971440+0000","last_active":"2024-05-08T09:22:16.062871+0000","last_peered":"2024-05-08T09:22:16.062871+0000","last_clean":"2024-05-08T09:22:16.062871+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:22:16.062871+0000","last_undegraded":"2024-05-08T09:22:16.062871+0000","last_fullsized":"2024-05-08T09:22:16.062871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:04.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995443+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:22:15.995443+0000","last_peered":"2024-05-08T09:22:15.995443+0000","last_clean":"2024-05-08T09:22:15.995443+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:22:15.995443+0000","last_undegraded":"2024-05-08T09:22:15.995443+0000","last_fullsized":"2024-05-08T09:22:15.995443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000438+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:22:16.000438+0000","last_peered":"2024-05-08T09:22:16.000438+0000","last_clean":"2024-05-08T09:22:16.000438+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:22:16.000438+0000","last_undegraded":"2024-05-08T09:22:16.000438+0000","last_fullsized":"2024-05-08T09:22:16.000438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:33.973664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247048+0000","last_change":"2024-05-08T09:21:30.956220+0000","last_active":"2024-05-08T09:24:38.247048+0000","last_peered":"2024-05-08T09:24:38.247048+0000","last_clean":"2024-05-08T09:24:38.247048+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:24:38.247048+0000","last_undegraded":"2024-05-08T09:24:38.247048+0000","last_fullsized":"2024-05-08T09:24:38.247048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996735+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:22:15.996735+0000","last_peered":"2024-05-08T09:22:15.996735+0000","last_clean":"2024-05-08T09:22:15.996735+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:22:15.996735+0000","last_undegraded":"2024-05-08T09:22:15.996735+0000","last_fullsized":"2024-05-08T09:22:15.996735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:21.186952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993609+0000","last_change":"2024-05-08T09:21:32.958181+0000","last_active":"2024-05-08T09:22:15.993609+0000","last_peered":"2024-05-08T09:22:15.993609+0000","last_clean":"2024-05-08T09:22:15.993609+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:22:15.993609+0000","last_undegraded":"2024-05-08T09:22:15.993609+0000","last_fullsized":"2024-05-08T09:22:15.993609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:40.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.130334+0000","last_change":"2024-05-08T09:21:34.964839+0000","last_active":"2024-05-08T09:23:36.130334+0000","last_peered":"2024-05-08T09:23:36.130334+0000","last_clean":"2024-05-08T09:23:36.130334+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:23:36.130334+0000","last_undegraded":"2024-05-08T09:23:36.130334+0000","last_fullsized":"2024-05-08T09:23:36.130334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:49.320700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992942+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:22:15.992942+0000","last_peered":"2024-05-08T09:22:15.992942+0000","last_clean":"2024-05-08T09:22:15.992942+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:22:15.992942+0000","last_undegraded":"2024-05-08T09:22:15.992942+0000","last_fullsized":"2024-05-08T09:22:15.992942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:59.583179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.033000+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.033000+0000","last_peered":"2024-05-08T09:24:38.033000+0000","last_clean":"2024-05-08T09:24:38.033000+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.033000+0000","last_undegraded":"2024-05-08T09:24:38.033000+0000","last_fullsized":"2024-05-08T09:24:38.033000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240929+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.240929+0000","last_peered":"2024-05-08T09:24:38.240929+0000","last_clean":"2024-05-08T09:24:38.240929+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.240929+0000","last_undegraded":"2024-05-08T09:24:38.240929+0000","last_fullsized":"2024-05-08T09:24:38.240929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:54:43.535283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993959+0000","last_change":"2024-05-08T09:21:28.977160+0000","last_active":"2024-05-08T09:22:15.993959+0000","last_peered":"2024-05-08T09:22:15.993959+0000","last_clean":"2024-05-08T09:22:15.993959+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:22:15.993959+0000","last_undegraded":"2024-05-08T09:22:15.993959+0000","last_fullsized":"2024-05-08T09:22:15.993959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995252+0000","last_change":"2024-05-08T09:21:32.951442+0000","last_active":"2024-05-08T09:22:15.995252+0000","last_peered":"2024-05-08T09:22:15.995252+0000","last_clean":"2024-05-08T09:22:15.995252+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:22:15.995252+0000","last_undegraded":"2024-05-08T09:22:15.995252+0000","last_fullsized":"2024-05-08T09:22:15.995252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:14.017416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.560512+0000","last_change":"2024-05-08T09:21:34.958618+0000","last_active":"2024-05-08T09:24:37.560512+0000","last_peered":"2024-05-08T09:24:37.560512+0000","last_clean":"2024-05-08T09:24:37.560512+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:24:37.560512+0000","last_undegraded":"2024-05-08T09:24:37.560512+0000","last_fullsized":"2024-05-08T09:24:37.560512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:29.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997200+0000","last_change":"2024-05-08T09:21:36.967739+0000","last_active":"2024-05-08T09:22:15.997200+0000","last_peered":"2024-05-08T09:22:15.997200+0000","last_clean":"2024-05-08T09:22:15.997200+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:22:15.997200+0000","last_undegraded":"2024-05-08T09:22:15.997200+0000","last_fullsized":"2024-05-08T09:22:15.997200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:27.327024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063979+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:22:16.063979+0000","last_peered":"2024-05-08T09:22:16.063979+0000","last_clean":"2024-05-08T09:22:16.063979+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:22:16.063979+0000","last_undegraded":"2024-05-08T09:22:16.063979+0000","last_fullsized":"2024-05-08T09:22:16.063979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944236+0000","last_change":"2024-05-08T09:21:30.953686+0000","last_active":"2024-05-08T09:24:37.944236+0000","last_peered":"2024-05-08T09:24:37.944236+0000","last_clean":"2024-05-08T09:24:37.944236+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:24:37.944236+0000","last_undegraded":"2024-05-08T09:24:37.944236+0000","last_fullsized":"2024-05-08T09:24:37.944236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000191+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:22:16.000191+0000","last_peered":"2024-05-08T09:22:16.000191+0000","last_clean":"2024-05-08T09:22:16.000191+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:22:16.000191+0000","last_undegraded":"2024-05-08T09:22:16.000191+0000","last_fullsized":"2024-05-08T09:22:16.000191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994229+0000","last_change":"2024-05-08T09:21:32.956150+0000","last_active":"2024-05-08T09:22:15.994229+0000","last_peered":"2024-05-08T09:22:15.994229+0000","last_clean":"2024-05-08T09:22:15.994229+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:22:15.994229+0000","last_undegraded":"2024-05-08T09:22:15.994229+0000","last_fullsized":"2024-05-08T09:22:15.994229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:34.790177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.620657+0000","last_change":"2024-05-08T09:21:34.964255+0000","last_active":"2024-05-08T09:24:37.620657+0000","last_peered":"2024-05-08T09:24:37.620657+0000","last_clean":"2024-05-08T09:24:37.620657+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:37.620657+0000","last_undegraded":"2024-05-08T09:24:37.620657+0000","last_fullsized":"2024-05-08T09:24:37.620657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.320370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993295+0000","last_change":"2024-05-08T09:21:36.969562+0000","last_active":"2024-05-08T09:22:15.993295+0000","last_peered":"2024-05-08T09:22:15.993295+0000","last_clean":"2024-05-08T09:22:15.993295+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:22:15.993295+0000","last_undegraded":"2024-05-08T09:22:15.993295+0000","last_fullsized":"2024-05-08T09:22:15.993295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996115+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:22:15.996115+0000","last_peered":"2024-05-08T09:22:15.996115+0000","last_clean":"2024-05-08T09:22:15.996115+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:22:15.996115+0000","last_undegraded":"2024-05-08T09:22:15.996115+0000","last_fullsized":"2024-05-08T09:22:15.996115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:31:28.662933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247450+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.247450+0000","last_peered":"2024-05-08T09:24:38.247450+0000","last_clean":"2024-05-08T09:24:38.247450+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.247450+0000","last_undegraded":"2024-05-08T09:24:38.247450+0000","last_fullsized":"2024-05-08T09:24:38.247450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:00.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001269+0000","last_change":"2024-05-08T09:21:28.976895+0000","last_active":"2024-05-08T09:22:16.001269+0000","last_peered":"2024-05-08T09:22:16.001269+0000","last_clean":"2024-05-08T09:22:16.001269+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:22:16.001269+0000","last_undegraded":"2024-05-08T09:22:16.001269+0000","last_fullsized":"2024-05-08T09:22:16.001269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993778+0000","last_change":"2024-05-08T09:21:32.953496+0000","last_active":"2024-05-08T09:22:15.993778+0000","last_peered":"2024-05-08T09:22:15.993778+0000","last_clean":"2024-05-08T09:22:15.993778+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:22:15.993778+0000","last_undegraded":"2024-05-08T09:22:15.993778+0000","last_fullsized":"2024-05-08T09:22:15.993778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:32.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'32","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.915996+0000","last_change":"2024-05-08T09:21:34.962303+0000","last_active":"2024-05-08T09:23:58.915996+0000","last_peered":"2024-05-08T09:23:58.915996+0000","last_clean":"2024-05-08T09:23:58.915996+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:23:58.915996+0000","last_undegraded":"2024-05-08T09:23:58.915996+0000","last_fullsized":"2024-05-08T09:23:58.915996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:21.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993777+0000","last_change":"2024-05-08T09:21:36.966752+0000","last_active":"2024-05-08T09:22:15.993777+0000","last_peered":"2024-05-08T09:22:15.993777+0000","last_clean":"2024-05-08T09:22:15.993777+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:22:15.993777+0000","last_undegraded":"2024-05-08T09:22:15.993777+0000","last_fullsized":"2024-05-08T09:22:15.993777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:36.110923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999504+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:22:15.999504+0000","last_peered":"2024-05-08T09:22:15.999504+0000","last_clean":"2024-05-08T09:22:15.999504+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:22:15.999504+0000","last_undegraded":"2024-05-08T09:22:15.999504+0000","last_fullsized":"2024-05-08T09:22:15.999504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:59.893435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992379+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:22:15.992379+0000","last_peered":"2024-05-08T09:22:15.992379+0000","last_clean":"2024-05-08T09:22:15.992379+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:22:15.992379+0000","last_undegraded":"2024-05-08T09:22:15.992379+0000","last_fullsized":"2024-05-08T09:22:15.992379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:04:17.117842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064977+0000","last_change":"2024-05-08T09:21:32.957500+0000","last_active":"2024-05-08T09:22:16.064977+0000","last_peered":"2024-05-08T09:22:16.064977+0000","last_clean":"2024-05-08T09:22:16.064977+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:22:16.064977+0000","last_undegraded":"2024-05-08T09:22:16.064977+0000","last_fullsized":"2024-05-08T09:22:16.064977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:19.794029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.136580+0000","last_change":"2024-05-08T09:21:34.961064+0000","last_active":"2024-05-08T09:23:36.136580+0000","last_peered":"2024-05-08T09:23:36.136580+0000","last_clean":"2024-05-08T09:23:36.136580+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:23:36.136580+0000","last_undegraded":"2024-05-08T09:23:36.136580+0000","last_fullsized":"2024-05-08T09:23:36.136580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:43.140389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000175+0000","last_change":"2024-05-08T09:21:36.964285+0000","last_active":"2024-05-08T09:22:16.000175+0000","last_peered":"2024-05-08T09:22:16.000175+0000","last_clean":"2024-05-08T09:22:16.000175+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:22:16.000175+0000","last_undegraded":"2024-05-08T09:22:16.000175+0000","last_fullsized":"2024-05-08T09:22:16.000175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:48.002782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.961449+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:37.961449+0000","last_peered":"2024-05-08T09:24:37.961449+0000","last_clean":"2024-05-08T09:24:37.961449+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:37.961449+0000","last_undegraded":"2024-05-08T09:24:37.961449+0000","last_fullsized":"2024-05-08T09:24:37.961449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066141+0000","last_change":"2024-05-08T09:21:30.946651+0000","last_active":"2024-05-08T09:22:16.066141+0000","last_peered":"2024-05-08T09:22:16.066141+0000","last_clean":"2024-05-08T09:22:16.066141+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:22:16.066141+0000","last_undegraded":"2024-05-08T09:22:16.066141+0000","last_fullsized":"2024-05-08T09:22:16.066141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915215+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:23:53.915215+0000","last_peered":"2024-05-08T09:23:53.915215+0000","last_clean":"2024-05-08T09:23:53.915215+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:23:53.915215+0000","last_undegraded":"2024-05-08T09:23:53.915215+0000","last_fullsized":"2024-05-08T09:23:53.915215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001089+0000","last_change":"2024-05-08T09:21:32.952239+0000","last_active":"2024-05-08T09:22:16.001089+0000","last_peered":"2024-05-08T09:22:16.001089+0000","last_clean":"2024-05-08T09:22:16.001089+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:22:16.001089+0000","last_undegraded":"2024-05-08T09:22:16.001089+0000","last_fullsized":"2024-05-08T09:22:16.001089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:04.920258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.117028+0000","last_change":"2024-05-08T09:21:34.964379+0000","last_active":"2024-05-08T09:23:36.117028+0000","last_peered":"2024-05-08T09:23:36.117028+0000","last_clean":"2024-05-08T09:23:36.117028+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:23:36.117028+0000","last_undegraded":"2024-05-08T09:23:36.117028+0000","last_fullsized":"2024-05-08T09:23:36.117028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:24.020955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995784+0000","last_change":"2024-05-08T09:21:36.973254+0000","last_active":"2024-05-08T09:22:15.995784+0000","last_peered":"2024-05-08T09:22:15.995784+0000","last_clean":"2024-05-08T09:22:15.995784+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:22:15.995784+0000","last_undegraded":"2024-05-08T09:22:15.995784+0000","last_fullsized":"2024-05-08T09:22:15.995784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.958667+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:22:53.958667+0000","last_peered":"2024-05-08T09:22:53.958667+0000","last_clean":"2024-05-08T09:22:53.958667+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:22:53.958667+0000","last_undegraded":"2024-05-08T09:22:53.958667+0000","last_fullsized":"2024-05-08T09:22:53.958667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:12.192786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917766+0000","last_change":"2024-05-08T09:21:30.961494+0000","last_active":"2024-05-08T09:24:03.917766+0000","last_peered":"2024-05-08T09:24:03.917766+0000","last_clean":"2024-05-08T09:24:03.917766+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:24:03.917766+0000","last_undegraded":"2024-05-08T09:24:03.917766+0000","last_fullsized":"2024-05-08T09:24:03.917766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:52.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993716+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:22:15.993716+0000","last_peered":"2024-05-08T09:22:15.993716+0000","last_clean":"2024-05-08T09:22:15.993716+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:22:15.993716+0000","last_undegraded":"2024-05-08T09:22:15.993716+0000","last_fullsized":"2024-05-08T09:22:15.993716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.006061+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:22:16.006061+0000","last_peered":"2024-05-08T09:22:16.006061+0000","last_clean":"2024-05-08T09:22:16.006061+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:22:16.006061+0000","last_undegraded":"2024-05-08T09:22:16.006061+0000","last_fullsized":"2024-05-08T09:22:16.006061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:34.942749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909160+0000","last_change":"2024-05-08T09:21:34.959330+0000","last_active":"2024-05-08T09:23:43.909160+0000","last_peered":"2024-05-08T09:23:43.909160+0000","last_clean":"2024-05-08T09:23:43.909160+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:23:43.909160+0000","last_undegraded":"2024-05-08T09:23:43.909160+0000","last_fullsized":"2024-05-08T09:23:43.909160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:34.104269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064670+0000","last_change":"2024-05-08T09:21:36.968410+0000","last_active":"2024-05-08T09:22:16.064670+0000","last_peered":"2024-05-08T09:22:16.064670+0000","last_clean":"2024-05-08T09:22:16.064670+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:22:16.064670+0000","last_undegraded":"2024-05-08T09:22:16.064670+0000","last_fullsized":"2024-05-08T09:22:16.064670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:39.210093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.297088+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.297088+0000","last_peered":"2024-05-08T09:24:38.297088+0000","last_clean":"2024-05-08T09:24:38.297088+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.297088+0000","last_undegraded":"2024-05-08T09:24:38.297088+0000","last_fullsized":"2024-05-08T09:24:38.297088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:47.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.912027+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:03.912027+0000","last_peered":"2024-05-08T09:24:03.912027+0000","last_clean":"2024-05-08T09:24:03.912027+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:03.912027+0000","last_undegraded":"2024-05-08T09:24:03.912027+0000","last_fullsized":"2024-05-08T09:24:03.912027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995871+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:22:15.995871+0000","last_peered":"2024-05-08T09:22:15.995871+0000","last_clean":"2024-05-08T09:22:15.995871+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:22:15.995871+0000","last_undegraded":"2024-05-08T09:22:15.995871+0000","last_fullsized":"2024-05-08T09:22:15.995871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:06.064996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.004778+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:22:16.004778+0000","last_peered":"2024-05-08T09:22:16.004778+0000","last_clean":"2024-05-08T09:22:16.004778+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:22:16.004778+0000","last_undegraded":"2024-05-08T09:22:16.004778+0000","last_fullsized":"2024-05-08T09:22:16.004778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:18.151465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998680+0000","last_change":"2024-05-08T09:21:34.967409+0000","last_active":"2024-05-08T09:22:15.998680+0000","last_peered":"2024-05-08T09:22:15.998680+0000","last_clean":"2024-05-08T09:22:15.998680+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:22:15.998680+0000","last_undegraded":"2024-05-08T09:22:15.998680+0000","last_fullsized":"2024-05-08T09:22:15.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:37.791645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043149+0000","last_change":"2024-05-08T09:21:36.975423+0000","last_active":"2024-05-08T09:24:38.043149+0000","last_peered":"2024-05-08T09:24:38.043149+0000","last_clean":"2024-05-08T09:24:38.043149+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:24:38.043149+0000","last_undegraded":"2024-05-08T09:24:38.043149+0000","last_fullsized":"2024-05-08T09:24:38.043149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:51.994196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.991922+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:22:15.991922+0000","last_peered":"2024-05-08T09:22:15.991922+0000","last_clean":"2024-05-08T09:22:15.991922+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:22:15.991922+0000","last_undegraded":"2024-05-08T09:22:15.991922+0000","last_fullsized":"2024-05-08T09:22:15.991922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:40.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207709+0000","last_change":"2024-05-08T09:21:30.952074+0000","last_active":"2024-05-08T09:24:38.207709+0000","last_peered":"2024-05-08T09:24:38.207709+0000","last_clean":"2024-05-08T09:24:38.207709+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:24:38.207709+0000","last_undegraded":"2024-05-08T09:24:38.207709+0000","last_fullsized":"2024-05-08T09:24:38.207709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:54.695384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916234+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:23:58.916234+0000","last_peered":"2024-05-08T09:23:58.916234+0000","last_clean":"2024-05-08T09:23:58.916234+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:23:58.916234+0000","last_undegraded":"2024-05-08T09:23:58.916234+0000","last_fullsized":"2024-05-08T09:23:58.916234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188377+0000","last_change":"2024-05-08T09:21:32.958699+0000","last_active":"2024-05-08T09:23:37.188377+0000","last_peered":"2024-05-08T09:23:37.188377+0000","last_clean":"2024-05-08T09:23:37.188377+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:23:37.188377+0000","last_undegraded":"2024-05-08T09:23:37.188377+0000","last_fullsized":"2024-05-08T09:23:37.188377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:10.206363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917019+0000","last_change":"2024-05-08T09:21:34.964625+0000","last_active":"2024-05-08T09:24:03.917019+0000","last_peered":"2024-05-08T09:24:03.917019+0000","last_clean":"2024-05-08T09:24:03.917019+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:03.917019+0000","last_undegraded":"2024-05-08T09:24:03.917019+0000","last_fullsized":"2024-05-08T09:24:03.917019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:03.907236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062486+0000","last_change":"2024-05-08T09:21:36.973685+0000","last_active":"2024-05-08T09:22:16.062486+0000","last_peered":"2024-05-08T09:22:16.062486+0000","last_clean":"2024-05-08T09:22:16.062486+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:22:16.062486+0000","last_undegraded":"2024-05-08T09:22:16.062486+0000","last_fullsized":"2024-05-08T09:22:16.062486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:41.857456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001765+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:22:16.001765+0000","last_peered":"2024-05-08T09:22:16.001765+0000","last_clean":"2024-05-08T09:22:16.001765+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:22:16.001765+0000","last_undegraded":"2024-05-08T09:22:16.001765+0000","last_fullsized":"2024-05-08T09:22:16.001765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916931+0000","last_change":"2024-05-08T09:21:30.945039+0000","last_active":"2024-05-08T09:24:03.916931+0000","last_peered":"2024-05-08T09:24:03.916931+0000","last_clean":"2024-05-08T09:24:03.916931+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:24:03.916931+0000","last_undegraded":"2024-05-08T09:24:03.916931+0000","last_fullsized":"2024-05-08T09:24:03.916931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997115+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:22:15.997115+0000","last_peered":"2024-05-08T09:22:15.997115+0000","last_clean":"2024-05-08T09:22:15.997115+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:22:15.997115+0000","last_undegraded":"2024-05-08T09:22:15.997115+0000","last_fullsized":"2024-05-08T09:22:15.997115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:05.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998814+0000","last_change":"2024-05-08T09:21:32.956273+0000","last_active":"2024-05-08T09:22:15.998814+0000","last_peered":"2024-05-08T09:22:15.998814+0000","last_clean":"2024-05-08T09:22:15.998814+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:22:15.998814+0000","last_undegraded":"2024-05-08T09:22:15.998814+0000","last_fullsized":"2024-05-08T09:22:15.998814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:53.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.108672+0000","last_change":"2024-05-08T09:21:34.962675+0000","last_active":"2024-05-08T09:23:36.108672+0000","last_peered":"2024-05-08T09:23:36.108672+0000","last_clean":"2024-05-08T09:23:36.108672+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:23:36.108672+0000","last_undegraded":"2024-05-08T09:23:36.108672+0000","last_fullsized":"2024-05-08T09:23:36.108672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:42.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992215+0000","last_change":"2024-05-08T09:21:36.975698+0000","last_active":"2024-05-08T09:22:15.992215+0000","last_peered":"2024-05-08T09:22:15.992215+0000","last_clean":"2024-05-08T09:22:15.992215+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:22:15.992215+0000","last_undegraded":"2024-05-08T09:22:15.992215+0000","last_fullsized":"2024-05-08T09:22:15.992215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:22:04.192857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998833+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:22:15.998833+0000","last_peered":"2024-05-08T09:22:15.998833+0000","last_clean":"2024-05-08T09:22:15.998833+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:22:15.998833+0000","last_undegraded":"2024-05-08T09:22:15.998833+0000","last_fullsized":"2024-05-08T09:22:15.998833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:22:09.958023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994056+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:22:15.994056+0000","last_peered":"2024-05-08T09:22:15.994056+0000","last_clean":"2024-05-08T09:22:15.994056+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:22:15.994056+0000","last_undegraded":"2024-05-08T09:22:15.994056+0000","last_fullsized":"2024-05-08T09:22:15.994056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065163+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:22:16.065163+0000","last_peered":"2024-05-08T09:22:16.065163+0000","last_clean":"2024-05-08T09:22:16.065163+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:22:16.065163+0000","last_undegraded":"2024-05-08T09:22:16.065163+0000","last_fullsized":"2024-05-08T09:22:16.065163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:29.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993524+0000","last_change":"2024-05-08T09:21:32.952670+0000","last_active":"2024-05-08T09:22:15.993524+0000","last_peered":"2024-05-08T09:22:15.993524+0000","last_clean":"2024-05-08T09:22:15.993524+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:22:15.993524+0000","last_undegraded":"2024-05-08T09:22:15.993524+0000","last_fullsized":"2024-05-08T09:22:15.993524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:58.990094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.132233+0000","last_change":"2024-05-08T09:21:34.964514+0000","last_active":"2024-05-08T09:23:36.132233+0000","last_peered":"2024-05-08T09:23:36.132233+0000","last_clean":"2024-05-08T09:23:36.132233+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:23:36.132233+0000","last_undegraded":"2024-05-08T09:23:36.132233+0000","last_fullsized":"2024-05-08T09:23:36.132233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:12.788058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995586+0000","last_change":"2024-05-08T09:21:36.978806+0000","last_active":"2024-05-08T09:22:15.995586+0000","last_peered":"2024-05-08T09:22:15.995586+0000","last_clean":"2024-05-08T09:22:15.995586+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:22:15.995586+0000","last_undegraded":"2024-05-08T09:22:15.995586+0000","last_fullsized":"2024-05-08T09:22:15.995586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:58.108416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.141999+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:23:36.141999+0000","last_peered":"2024-05-08T09:23:36.141999+0000","last_clean":"2024-05-08T09:23:36.141999+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:23:36.141999+0000","last_undegraded":"2024-05-08T09:23:36.141999+0000","last_fullsized":"2024-05-08T09:23:36.141999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:58.409814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241173+0000","last_change":"2024-05-08T09:21:30.945358+0000","last_active":"2024-05-08T09:24:38.241173+0000","last_peered":"2024-05-08T09:24:38.241173+0000","last_clean":"2024-05-08T09:24:38.241173+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:24:38.241173+0000","last_undegraded":"2024-05-08T09:24:38.241173+0000","last_fullsized":"2024-05-08T09:24:38.241173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:35.493172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001565+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:22:16.001565+0000","last_peered":"2024-05-08T09:22:16.001565+0000","last_clean":"2024-05-08T09:22:16.001565+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:22:16.001565+0000","last_undegraded":"2024-05-08T09:22:16.001565+0000","last_fullsized":"2024-05-08T09:22:16.001565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:34.803032+0000","last_change":"2024-05-08T09:21:32.956974+0000","last_active":"2024-05-08T09:23:34.803032+0000","last_peered":"2024-05-08T09:23:34.803032+0000","last_clean":"2024-05-08T09:23:34.803032+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:23:34.803032+0000","last_undegraded":"2024-05-08T09:23:34.803032+0000","last_fullsized":"2024-05-08T09:23:34.803032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:38.938823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.561424+0000","last_change":"2024-05-08T09:21:34.965967+0000","last_active":"2024-05-08T09:24:37.561424+0000","last_peered":"2024-05-08T09:24:37.561424+0000","last_clean":"2024-05-08T09:24:37.561424+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:24:37.561424+0000","last_undegraded":"2024-05-08T09:24:37.561424+0000","last_fullsized":"2024-05-08T09:24:37.561424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:50.441262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063598+0000","last_change":"2024-05-08T09:21:36.973796+0000","last_active":"2024-05-08T09:22:16.063598+0000","last_peered":"2024-05-08T09:22:16.063598+0000","last_clean":"2024-05-08T09:22:16.063598+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:22:16.063598+0000","last_undegraded":"2024-05-08T09:22:16.063598+0000","last_fullsized":"2024-05-08T09:22:16.063598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.144572+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:36.144572+0000","last_peered":"2024-05-08T09:23:36.144572+0000","last_clean":"2024-05-08T09:23:36.144572+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:36.144572+0000","last_undegraded":"2024-05-08T09:23:36.144572+0000","last_fullsized":"2024-05-08T09:23:36.144572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:33.860320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210108+0000","last_change":"2024-05-08T09:21:30.954737+0000","last_active":"2024-05-08T09:24:38.210108+0000","last_peered":"2024-05-08T09:24:38.210108+0000","last_clean":"2024-05-08T09:24:38.210108+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:24:38.210108+0000","last_undegraded":"2024-05-08T09:24:38.210108+0000","last_fullsized":"2024-05-08T09:24:38.210108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:33.918459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993499+0000","last_change":"2024-05-08T09:21:28.974311+0000","last_active":"2024-05-08T09:22:15.993499+0000","last_peered":"2024-05-08T09:22:15.993499+0000","last_clean":"2024-05-08T09:22:15.993499+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:22:15.993499+0000","last_undegraded":"2024-05-08T09:22:15.993499+0000","last_fullsized":"2024-05-08T09:22:15.993499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030984+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.030984+0000","last_peered":"2024-05-08T09:24:38.030984+0000","last_clean":"2024-05-08T09:24:38.030984+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.030984+0000","last_undegraded":"2024-05-08T09:24:38.030984+0000","last_fullsized":"2024-05-08T09:24:38.030984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062507+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:22:16.062507+0000","last_peered":"2024-05-08T09:22:16.062507+0000","last_clean":"2024-05-08T09:22:16.062507+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:22:16.062507+0000","last_undegraded":"2024-05-08T09:22:16.062507+0000","last_fullsized":"2024-05-08T09:22:16.062507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996972+0000","last_change":"2024-05-08T09:21:30.961138+0000","last_active":"2024-05-08T09:22:15.996972+0000","last_peered":"2024-05-08T09:22:15.996972+0000","last_clean":"2024-05-08T09:22:15.996972+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:22:15.996972+0000","last_undegraded":"2024-05-08T09:22:15.996972+0000","last_fullsized":"2024-05-08T09:22:15.996972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:41.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996550+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:22:15.996550+0000","last_peered":"2024-05-08T09:22:15.996550+0000","last_clean":"2024-05-08T09:22:15.996550+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:22:15.996550+0000","last_undegraded":"2024-05-08T09:22:15.996550+0000","last_fullsized":"2024-05-08T09:22:15.996550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:32.580301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241017+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.241017+0000","last_peered":"2024-05-08T09:24:38.241017+0000","last_clean":"2024-05-08T09:24:38.241017+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.241017+0000","last_undegraded":"2024-05-08T09:24:38.241017+0000","last_fullsized":"2024-05-08T09:24:38.241017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064366+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:22:16.064366+0000","last_peered":"2024-05-08T09:22:16.064366+0000","last_clean":"2024-05-08T09:22:16.064366+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:22:16.064366+0000","last_undegraded":"2024-05-08T09:22:16.064366+0000","last_fullsized":"2024-05-08T09:22:16.064366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.943767+0000","last_change":"2024-05-08T09:21:30.953450+0000","last_active":"2024-05-08T09:24:37.943767+0000","last_peered":"2024-05-08T09:24:37.943767+0000","last_clean":"2024-05-08T09:24:37.943767+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:24:37.943767+0000","last_undegraded":"2024-05-08T09:24:37.943767+0000","last_fullsized":"2024-05-08T09:24:37.943767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066265+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:22:16.066265+0000","last_peered":"2024-05-08T09:22:16.066265+0000","last_clean":"2024-05-08T09:22:16.066265+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:22:16.066265+0000","last_undegraded":"2024-05-08T09:22:16.066265+0000","last_fullsized":"2024-05-08T09:22:16.066265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240952+0000","last_change":"2024-05-08T09:21:30.954588+0000","last_active":"2024-05-08T09:24:38.240952+0000","last_peered":"2024-05-08T09:24:38.240952+0000","last_clean":"2024-05-08T09:24:38.240952+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:24:38.240952+0000","last_undegraded":"2024-05-08T09:24:38.240952+0000","last_fullsized":"2024-05-08T09:24:38.240952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997994+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:22:15.997994+0000","last_peered":"2024-05-08T09:22:15.997994+0000","last_clean":"2024-05-08T09:22:15.997994+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:22:15.997994+0000","last_undegraded":"2024-05-08T09:22:15.997994+0000","last_fullsized":"2024-05-08T09:22:15.997994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166509+0000","last_change":"2024-05-08T09:21:30.943875+0000","last_active":"2024-05-08T09:24:38.166509+0000","last_peered":"2024-05-08T09:24:38.166509+0000","last_clean":"2024-05-08T09:24:38.166509+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:24:38.166509+0000","last_undegraded":"2024-05-08T09:24:38.166509+0000","last_fullsized":"2024-05-08T09:24:38.166509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000230+0000","last_change":"2024-05-08T09:21:28.974367+0000","last_active":"2024-05-08T09:22:16.000230+0000","last_peered":"2024-05-08T09:22:16.000230+0000","last_clean":"2024-05-08T09:22:16.000230+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:22:16.000230+0000","last_undegraded":"2024-05-08T09:22:16.000230+0000","last_fullsized":"2024-05-08T09:22:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.172965+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.172965+0000","last_peered":"2024-05-08T09:24:38.172965+0000","last_clean":"2024-05-08T09:24:38.172965+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.172965+0000","last_undegraded":"2024-05-08T09:24:38.172965+0000","last_fullsized":"2024-05-08T09:24:38.172965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:01:34.087796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065749+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:22:16.065749+0000","last_peered":"2024-05-08T09:22:16.065749+0000","last_clean":"2024-05-08T09:22:16.065749+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:22:16.065749+0000","last_undegraded":"2024-05-08T09:22:16.065749+0000","last_fullsized":"2024-05-08T09:22:16.065749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031074+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.031074+0000","last_peered":"2024-05-08T09:24:38.031074+0000","last_clean":"2024-05-08T09:24:38.031074+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.031074+0000","last_undegraded":"2024-05-08T09:24:38.031074+0000","last_fullsized":"2024-05-08T09:24:38.031074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:02.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.492136+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:37.492136+0000","last_peered":"2024-05-08T09:23:37.492136+0000","last_clean":"2024-05-08T09:23:37.492136+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:37.492136+0000","last_undegraded":"2024-05-08T09:23:37.492136+0000","last_fullsized":"2024-05-08T09:23:37.492136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:50.421255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961979+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:22:53.961979+0000","last_peered":"2024-05-08T09:22:53.961979+0000","last_clean":"2024-05-08T09:22:53.961979+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:22:53.961979+0000","last_undegraded":"2024-05-08T09:22:53.961979+0000","last_fullsized":"2024-05-08T09:22:53.961979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:25.908775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062758+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:22:16.062758+0000","last_peered":"2024-05-08T09:22:16.062758+0000","last_clean":"2024-05-08T09:22:16.062758+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:22:16.062758+0000","last_undegraded":"2024-05-08T09:22:16.062758+0000","last_fullsized":"2024-05-08T09:22:16.062758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065639+0000","last_change":"2024-05-08T09:21:30.953222+0000","last_active":"2024-05-08T09:22:16.065639+0000","last_peered":"2024-05-08T09:22:16.065639+0000","last_clean":"2024-05-08T09:22:16.065639+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:22:16.065639+0000","last_undegraded":"2024-05-08T09:22:16.065639+0000","last_fullsized":"2024-05-08T09:22:16.065639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:24.666609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913638+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:23:43.913638+0000","last_peered":"2024-05-08T09:23:43.913638+0000","last_clean":"2024-05-08T09:23:43.913638+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:23:43.913638+0000","last_undegraded":"2024-05-08T09:23:43.913638+0000","last_fullsized":"2024-05-08T09:23:43.913638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:58:40.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218043+0000","last_change":"2024-05-08T09:21:30.943497+0000","last_active":"2024-05-08T09:24:38.218043+0000","last_peered":"2024-05-08T09:24:38.218043+0000","last_clean":"2024-05-08T09:24:38.218043+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:24:38.218043+0000","last_undegraded":"2024-05-08T09:24:38.218043+0000","last_fullsized":"2024-05-08T09:24:38.218043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:59.730012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.925923+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.925923+0000","last_peered":"2024-05-08T09:24:37.925923+0000","last_clean":"2024-05-08T09:24:37.925923+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.925923+0000","last_undegraded":"2024-05-08T09:24:37.925923+0000","last_fullsized":"2024-05-08T09:24:37.925923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207990+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.207990+0000","last_peered":"2024-05-08T09:24:38.207990+0000","last_clean":"2024-05-08T09:24:38.207990+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.207990+0000","last_undegraded":"2024-05-08T09:24:38.207990+0000","last_fullsized":"2024-05-08T09:24:38.207990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:10:35.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998089+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:22:15.998089+0000","last_peered":"2024-05-08T09:22:15.998089+0000","last_clean":"2024-05-08T09:22:15.998089+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:22:15.998089+0000","last_undegraded":"2024-05-08T09:22:15.998089+0000","last_fullsized":"2024-05-08T09:22:15.998089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:04.866945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031169+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.031169+0000","last_peered":"2024-05-08T09:24:38.031169+0000","last_clean":"2024-05-08T09:24:38.031169+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.031169+0000","last_undegraded":"2024-05-08T09:24:38.031169+0000","last_fullsized":"2024-05-08T09:24:38.031169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914130+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:23:43.914130+0000","last_peered":"2024-05-08T09:23:43.914130+0000","last_clean":"2024-05-08T09:23:43.914130+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:23:43.914130+0000","last_undegraded":"2024-05-08T09:23:43.914130+0000","last_fullsized":"2024-05-08T09:23:43.914130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:30.030761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542031+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:37.542031+0000","last_peered":"2024-05-08T09:23:37.542031+0000","last_clean":"2024-05-08T09:23:37.542031+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:37.542031+0000","last_undegraded":"2024-05-08T09:23:37.542031+0000","last_fullsized":"2024-05-08T09:23:37.542031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:36.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158434+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.158434+0000","last_peered":"2024-05-08T09:24:38.158434+0000","last_clean":"2024-05-08T09:24:38.158434+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.158434+0000","last_undegraded":"2024-05-08T09:24:38.158434+0000","last_fullsized":"2024-05-08T09:24:38.158434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166918+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.166918+0000","last_peered":"2024-05-08T09:24:38.166918+0000","last_clean":"2024-05-08T09:24:38.166918+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.166918+0000","last_undegraded":"2024-05-08T09:24:38.166918+0000","last_fullsized":"2024-05-08T09:24:38.166918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:00.681814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998902+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:22:15.998902+0000","last_peered":"2024-05-08T09:22:15.998902+0000","last_clean":"2024-05-08T09:22:15.998902+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:22:15.998902+0000","last_undegraded":"2024-05-08T09:22:15.998902+0000","last_fullsized":"2024-05-08T09:22:15.998902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:39.136609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155448+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.155448+0000","last_peered":"2024-05-08T09:24:38.155448+0000","last_clean":"2024-05-08T09:24:38.155448+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.155448+0000","last_undegraded":"2024-05-08T09:24:38.155448+0000","last_fullsized":"2024-05-08T09:24:38.155448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066842+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:22:16.066842+0000","last_peered":"2024-05-08T09:22:16.066842+0000","last_clean":"2024-05-08T09:22:16.066842+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:22:16.066842+0000","last_undegraded":"2024-05-08T09:22:16.066842+0000","last_fullsized":"2024-05-08T09:22:16.066842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062889+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:22:16.062889+0000","last_peered":"2024-05-08T09:22:16.062889+0000","last_clean":"2024-05-08T09:22:16.062889+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:22:16.062889+0000","last_undegraded":"2024-05-08T09:22:16.062889+0000","last_fullsized":"2024-05-08T09:22:16.062889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218152+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.218152+0000","last_peered":"2024-05-08T09:24:38.218152+0000","last_clean":"2024-05-08T09:24:38.218152+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.218152+0000","last_undegraded":"2024-05-08T09:24:38.218152+0000","last_fullsized":"2024-05-08T09:24:38.218152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44680,"kb_used_data":9344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327160,"statfs":{"total":96636764160,"available":96591011840,"internally_reserved":0,"allocated":9568256,"data_stored":9328984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44716,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327124,"statfs":{"total":96636764160,"available":96590974976,"internally_reserved":0,"allocated":9605120,"data_stored":9331170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8743023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:24:45.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:24:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.437+0000 7fb080ad9640 1 Processor -- start 2024-05-08T09:24:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.437+0000 7fb080ad9640 1 -- start start 2024-05-08T09:24:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb080ad9640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb07c12c5b0 0x7fb07c12c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb080ad9640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb07c113dd0 con 0x7fb07c12ced0 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb080ad9640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fb07c072290 con 0x7fb07c12c5b0 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb07a59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb07c12c5b0 0x7fb07c12c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb079d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb07c12ced0 0x7fb07c06e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46544/0 (socket says 172.21.15.45:46544) 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb079d9b640 1 -- 172.21.15.45:0/2966315719 learned_addr learned my addr 172.21.15.45:0/2966315719 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb07a59c640 1 -- 172.21.15.45:0/2966315719 >> v1:172.21.15.45:6789/0 conn(0x7fb07c12ced0 legacy=0x7fb07c06e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb07a59c640 1 -- 172.21.15.45:0/2966315719 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c12c390 con 0x7fb07c12c5b0 2024-05-08T09:24:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.438+0000 7fb07959a640 1 -- 172.21.15.45:0/2966315719 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953438474 0 0) 0x7fb07c113dd0 con 0x7fb07c12ced0 2024-05-08T09:24:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb07a59c640 1 --2- 172.21.15.45:0/2966315719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c12c990 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009720 tx=0x7fb06c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ecf6f880e45fd4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb07959a640 1 -- 172.21.15.45:0/2966315719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06c0316d0 con 0x7fb07c12c5b0 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb07959a640 1 -- 172.21.15.45:0/2966315719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c037070 con 0x7fb07c12c5b0 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb07959a640 1 -- 172.21.15.45:0/2966315719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06c0319c0 con 0x7fb07c12c5b0 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb080ad9640 1 -- 172.21.15.45:0/2966315719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 msgr2=0x7fb07c12c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.439+0000 7fb080ad9640 1 --2- 172.21.15.45:0/2966315719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c12c990 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009720 tx=0x7fb06c02b840 comp rx=0 tx=0).stop 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.440+0000 7fb080ad9640 1 -- 172.21.15.45:0/2966315719 shutdown_connections 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.440+0000 7fb080ad9640 1 --2- 172.21.15.45:0/2966315719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c12c990 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.440+0000 7fb080ad9640 1 -- 172.21.15.45:0/2966315719 >> 172.21.15.45:0/2966315719 conn(0x7fb07c099380 msgr2=0x7fb07c099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.440+0000 7fb080ad9640 1 -- 172.21.15.45:0/2966315719 shutdown_connections 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.440+0000 7fb080ad9640 1 -- 172.21.15.45:0/2966315719 wait complete. 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb080ad9640 1 Processor -- start 2024-05-08T09:24:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb080ad9640 1 -- start start 2024-05-08T09:24:45.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb080ad9640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb080ad9640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fb07c113b10 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb07a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb07a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46036/0 (socket says 172.21.15.45:46036) 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb07a59c640 1 -- 172.21.15.45:0/639841449 learned_addr learned my addr 172.21.15.45:0/639841449 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb07a59c640 1 -- 172.21.15.45:0/639841449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb07c071c40 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.441+0000 7fb07a59c640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009720 tx=0x7fb06c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.442+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06c032770 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.442+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb06c032910 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.442+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb07c1290f0 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.442+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb06c032bf0 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.442+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb07c118c10 con 0x7fb07c12c5b0 2024-05-08T09:24:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fb06c04d3f0 con 0x7fb07c12c5b0 2024-05-08T09:24:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb07c062e90 con 0x7fb07c12c5b0 2024-05-08T09:24:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb072ffd640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 0x7fb05c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fb06c02f050 con 0x7fb07c12c5b0 2024-05-08T09:24:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb079d9b640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 0x7fb05c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.443+0000 7fb079d9b640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 0x7fb05c03a520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb064007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.447+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fb06c040070 con 0x7fb07c12c5b0 2024-05-08T09:24:45.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.626+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb07c073fd0 con 0x7fb05c038060 2024-05-08T09:24:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.641+0000 7fb072ffd640 1 -- 172.21.15.45:0/639841449 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665914 (secure 0 0 0) 0x7fb07c073fd0 con 0x7fb05c038060 2024-05-08T09:24:45.648 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:24:45.654 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:24:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 msgr2=0x7fb05c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 0x7fb05c03a520 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb064000c00 tx=0x7fb064007970 comp rx=0 tx=0).stop 2024-05-08T09:24:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 msgr2=0x7fb07c122140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009720 tx=0x7fb06c0046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 shutdown_connections 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fb05c038060 0x7fb05c03a520 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 --2- 172.21.15.45:0/639841449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb07c12c5b0 0x7fb07c122140 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 >> 172.21.15.45:0/639841449 conn(0x7fb07c099380 msgr2=0x7fb07c1b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 shutdown_connections 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.646+0000 7fb080ad9640 1 -- 172.21.15.45:0/639841449 wait complete. 2024-05-08T09:24:45.658 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T09:24:44.893774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4884,"num_read_kb":4461,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001076+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:22:16.001076+0000","last_peered":"2024-05-08T09:22:16.001076+0000","last_clean":"2024-05-08T09:22:16.001076+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:22:16.001076+0000","last_undegraded":"2024-05-08T09:22:16.001076+0000","last_fullsized":"2024-05-08T09:22:16.001076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916991+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:03.916991+0000","last_peered":"2024-05-08T09:24:03.916991+0000","last_clean":"2024-05-08T09:24:03.916991+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:03.916991+0000","last_undegraded":"2024-05-08T09:24:03.916991+0000","last_fullsized":"2024-05-08T09:24:03.916991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:23.115981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.375414+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.375414+0000","last_peered":"2024-05-08T09:23:37.375414+0000","last_clean":"2024-05-08T09:23:37.375414+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.375414+0000","last_undegraded":"2024-05-08T09:23:37.375414+0000","last_fullsized":"2024-05-08T09:23:37.375414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:09.233706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166680+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.166680+0000","last_peered":"2024-05-08T09:24:38.166680+0000","last_clean":"2024-05-08T09:24:38.166680+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.166680+0000","last_undegraded":"2024-05-08T09:24:38.166680+0000","last_fullsized":"2024-05-08T09:24:38.166680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:08.198970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997644+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:22:15.997644+0000","last_peered":"2024-05-08T09:22:15.997644+0000","last_clean":"2024-05-08T09:22:15.997644+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:22:15.997644+0000","last_undegraded":"2024-05-08T09:22:15.997644+0000","last_fullsized":"2024-05-08T09:22:15.997644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:15.219028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961300+0000","last_change":"2024-05-08T09:21:30.959732+0000","last_active":"2024-05-08T09:22:53.961300+0000","last_peered":"2024-05-08T09:22:53.961300+0000","last_clean":"2024-05-08T09:22:53.961300+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:22:53.961300+0000","last_undegraded":"2024-05-08T09:22:53.961300+0000","last_fullsized":"2024-05-08T09:22:53.961300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:51.106660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000563+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:22:16.000563+0000","last_peered":"2024-05-08T09:22:16.000563+0000","last_clean":"2024-05-08T09:22:16.000563+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:22:16.000563+0000","last_undegraded":"2024-05-08T09:22:16.000563+0000","last_fullsized":"2024-05-08T09:22:16.000563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944601+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.944601+0000","last_peered":"2024-05-08T09:24:37.944601+0000","last_clean":"2024-05-08T09:24:37.944601+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.944601+0000","last_undegraded":"2024-05-08T09:24:37.944601+0000","last_fullsized":"2024-05-08T09:24:37.944601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:05.452991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996051+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:22:15.996051+0000","last_peered":"2024-05-08T09:22:15.996051+0000","last_clean":"2024-05-08T09:22:15.996051+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:22:15.996051+0000","last_undegraded":"2024-05-08T09:22:15.996051+0000","last_fullsized":"2024-05-08T09:22:15.996051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:33.486446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030810+0000","last_change":"2024-05-08T09:21:30.942925+0000","last_active":"2024-05-08T09:24:38.030810+0000","last_peered":"2024-05-08T09:24:38.030810+0000","last_clean":"2024-05-08T09:24:38.030810+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:24:38.030810+0000","last_undegraded":"2024-05-08T09:24:38.030810+0000","last_fullsized":"2024-05-08T09:24:38.030810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998378+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:22:15.998378+0000","last_peered":"2024-05-08T09:22:15.998378+0000","last_clean":"2024-05-08T09:22:15.998378+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:22:15.998378+0000","last_undegraded":"2024-05-08T09:22:15.998378+0000","last_fullsized":"2024-05-08T09:22:15.998378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.946666+0000","last_change":"2024-05-08T09:21:30.960649+0000","last_active":"2024-05-08T09:24:37.946666+0000","last_peered":"2024-05-08T09:24:37.946666+0000","last_clean":"2024-05-08T09:24:37.946666+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:24:37.946666+0000","last_undegraded":"2024-05-08T09:24:37.946666+0000","last_fullsized":"2024-05-08T09:24:37.946666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:38.405348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995105+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:22:15.995105+0000","last_peered":"2024-05-08T09:22:15.995105+0000","last_clean":"2024-05-08T09:22:15.995105+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:22:15.995105+0000","last_undegraded":"2024-05-08T09:22:15.995105+0000","last_fullsized":"2024-05-08T09:22:15.995105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:05.261094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000928+0000","last_change":"2024-05-08T09:21:30.950639+0000","last_active":"2024-05-08T09:22:16.000928+0000","last_peered":"2024-05-08T09:22:16.000928+0000","last_clean":"2024-05-08T09:22:16.000928+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:22:16.000928+0000","last_undegraded":"2024-05-08T09:22:16.000928+0000","last_fullsized":"2024-05-08T09:22:16.000928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.951539+0000","last_change":"2024-05-08T09:21:28.962227+0000","last_active":"2024-05-08T09:22:53.951539+0000","last_peered":"2024-05-08T09:22:53.951539+0000","last_clean":"2024-05-08T09:22:53.951539+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:22:53.951539+0000","last_undegraded":"2024-05-08T09:22:53.951539+0000","last_fullsized":"2024-05-08T09:22:53.951539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030974+0000","last_change":"2024-05-08T09:21:30.953880+0000","last_active":"2024-05-08T09:24:38.030974+0000","last_peered":"2024-05-08T09:24:38.030974+0000","last_clean":"2024-05-08T09:24:38.030974+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:24:38.030974+0000","last_undegraded":"2024-05-08T09:24:38.030974+0000","last_fullsized":"2024-05-08T09:24:38.030974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166447+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.166447+0000","last_peered":"2024-05-08T09:24:38.166447+0000","last_clean":"2024-05-08T09:24:38.166447+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.166447+0000","last_undegraded":"2024-05-08T09:24:38.166447+0000","last_fullsized":"2024-05-08T09:24:38.166447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:30.090468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915499+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:23:53.915499+0000","last_peered":"2024-05-08T09:23:53.915499+0000","last_clean":"2024-05-08T09:23:53.915499+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:23:53.915499+0000","last_undegraded":"2024-05-08T09:23:53.915499+0000","last_fullsized":"2024-05-08T09:23:53.915499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.772673+0000","last_change":"2024-05-08T09:21:30.945729+0000","last_active":"2024-05-08T09:22:53.772673+0000","last_peered":"2024-05-08T09:22:53.772673+0000","last_clean":"2024-05-08T09:22:53.772673+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:22:53.772673+0000","last_undegraded":"2024-05-08T09:22:53.772673+0000","last_fullsized":"2024-05-08T09:22:53.772673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000634+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:22:16.000634+0000","last_peered":"2024-05-08T09:22:16.000634+0000","last_clean":"2024-05-08T09:22:16.000634+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:22:16.000634+0000","last_undegraded":"2024-05-08T09:22:16.000634+0000","last_fullsized":"2024-05-08T09:22:16.000634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.770379+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:22:53.770379+0000","last_peered":"2024-05-08T09:22:53.770379+0000","last_clean":"2024-05-08T09:22:53.770379+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:22:53.770379+0000","last_undegraded":"2024-05-08T09:22:53.770379+0000","last_fullsized":"2024-05-08T09:22:53.770379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.519313+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:37.519313+0000","last_peered":"2024-05-08T09:23:37.519313+0000","last_clean":"2024-05-08T09:23:37.519313+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:37.519313+0000","last_undegraded":"2024-05-08T09:23:37.519313+0000","last_fullsized":"2024-05-08T09:23:37.519313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542123+0000","last_change":"2024-05-08T09:21:30.955095+0000","last_active":"2024-05-08T09:23:37.542123+0000","last_peered":"2024-05-08T09:23:37.542123+0000","last_clean":"2024-05-08T09:23:37.542123+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:23:37.542123+0000","last_undegraded":"2024-05-08T09:23:37.542123+0000","last_fullsized":"2024-05-08T09:23:37.542123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.760684+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:22:53.760684+0000","last_peered":"2024-05-08T09:22:53.760684+0000","last_clean":"2024-05-08T09:22:53.760684+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:22:53.760684+0000","last_undegraded":"2024-05-08T09:22:53.760684+0000","last_fullsized":"2024-05-08T09:22:53.760684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241110+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.241110+0000","last_peered":"2024-05-08T09:24:38.241110+0000","last_clean":"2024-05-08T09:24:38.241110+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.241110+0000","last_undegraded":"2024-05-08T09:24:38.241110+0000","last_fullsized":"2024-05-08T09:24:38.241110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064683+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:22:16.064683+0000","last_peered":"2024-05-08T09:22:16.064683+0000","last_clean":"2024-05-08T09:22:16.064683+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:22:16.064683+0000","last_undegraded":"2024-05-08T09:22:16.064683+0000","last_fullsized":"2024-05-08T09:22:16.064683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031836+0000","last_change":"2024-05-08T09:21:30.941566+0000","last_active":"2024-05-08T09:24:38.031836+0000","last_peered":"2024-05-08T09:24:38.031836+0000","last_clean":"2024-05-08T09:24:38.031836+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:24:38.031836+0000","last_undegraded":"2024-05-08T09:24:38.031836+0000","last_fullsized":"2024-05-08T09:24:38.031836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:22.230967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996884+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:22:15.996884+0000","last_peered":"2024-05-08T09:22:15.996884+0000","last_clean":"2024-05-08T09:22:15.996884+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:22:15.996884+0000","last_undegraded":"2024-05-08T09:22:15.996884+0000","last_fullsized":"2024-05-08T09:22:15.996884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:06.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.187676+0000","last_change":"2024-05-08T09:21:38.981335+0000","last_active":"2024-05-08T09:24:38.187676+0000","last_peered":"2024-05-08T09:24:38.187676+0000","last_clean":"2024-05-08T09:24:38.187676+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:24:38.187676+0000","last_undegraded":"2024-05-08T09:24:38.187676+0000","last_fullsized":"2024-05-08T09:24:38.187676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:10.950358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218288+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218288+0000","last_peered":"2024-05-08T09:24:38.218288+0000","last_clean":"2024-05-08T09:24:38.218288+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218288+0000","last_undegraded":"2024-05-08T09:24:38.218288+0000","last_fullsized":"2024-05-08T09:24:38.218288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:11.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151832+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.151832+0000","last_peered":"2024-05-08T09:24:38.151832+0000","last_clean":"2024-05-08T09:24:38.151832+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.151832+0000","last_undegraded":"2024-05-08T09:24:38.151832+0000","last_fullsized":"2024-05-08T09:24:38.151832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:46.927060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996807+0000","last_change":"2024-05-08T09:21:32.954624+0000","last_active":"2024-05-08T09:22:15.996807+0000","last_peered":"2024-05-08T09:22:15.996807+0000","last_clean":"2024-05-08T09:22:15.996807+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:22:15.996807+0000","last_undegraded":"2024-05-08T09:22:15.996807+0000","last_fullsized":"2024-05-08T09:22:15.996807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:12.055591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.125390+0000","last_change":"2024-05-08T09:21:34.968612+0000","last_active":"2024-05-08T09:23:36.125390+0000","last_peered":"2024-05-08T09:23:36.125390+0000","last_clean":"2024-05-08T09:23:36.125390+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:23:36.125390+0000","last_undegraded":"2024-05-08T09:23:36.125390+0000","last_fullsized":"2024-05-08T09:23:36.125390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:14.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001471+0000","last_change":"2024-05-08T09:21:36.977259+0000","last_active":"2024-05-08T09:22:16.001471+0000","last_peered":"2024-05-08T09:22:16.001471+0000","last_clean":"2024-05-08T09:22:16.001471+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:22:16.001471+0000","last_undegraded":"2024-05-08T09:22:16.001471+0000","last_fullsized":"2024-05-08T09:22:16.001471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.780267+0000","last_change":"2024-05-08T09:21:38.984125+0000","last_active":"2024-05-08T09:22:53.780267+0000","last_peered":"2024-05-08T09:22:53.780267+0000","last_clean":"2024-05-08T09:22:53.780267+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:22:53.780267+0000","last_undegraded":"2024-05-08T09:22:53.780267+0000","last_fullsized":"2024-05-08T09:22:53.780267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240957+0000","last_change":"2024-05-08T09:21:30.961147+0000","last_active":"2024-05-08T09:24:38.240957+0000","last_peered":"2024-05-08T09:24:38.240957+0000","last_clean":"2024-05-08T09:24:38.240957+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:24:38.240957+0000","last_undegraded":"2024-05-08T09:24:38.240957+0000","last_fullsized":"2024-05-08T09:24:38.240957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:21.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998085+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:22:15.998085+0000","last_peered":"2024-05-08T09:22:15.998085+0000","last_clean":"2024-05-08T09:22:15.998085+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:22:15.998085+0000","last_undegraded":"2024-05-08T09:22:15.998085+0000","last_fullsized":"2024-05-08T09:22:15.998085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065092+0000","last_change":"2024-05-08T09:21:32.957525+0000","last_active":"2024-05-08T09:22:16.065092+0000","last_peered":"2024-05-08T09:22:16.065092+0000","last_clean":"2024-05-08T09:22:16.065092+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:22:16.065092+0000","last_undegraded":"2024-05-08T09:22:16.065092+0000","last_fullsized":"2024-05-08T09:22:16.065092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:36.828402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.963076+0000","last_change":"2024-05-08T09:21:34.968421+0000","last_active":"2024-05-08T09:22:53.963076+0000","last_peered":"2024-05-08T09:22:53.963076+0000","last_clean":"2024-05-08T09:22:53.963076+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:22:53.963076+0000","last_undegraded":"2024-05-08T09:22:53.963076+0000","last_fullsized":"2024-05-08T09:22:53.963076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:49.987542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999400+0000","last_change":"2024-05-08T09:21:36.971614+0000","last_active":"2024-05-08T09:22:15.999400+0000","last_peered":"2024-05-08T09:22:15.999400+0000","last_clean":"2024-05-08T09:22:15.999400+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:22:15.999400+0000","last_undegraded":"2024-05-08T09:22:15.999400+0000","last_fullsized":"2024-05-08T09:22:15.999400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062726+0000","last_change":"2024-05-08T09:21:38.971525+0000","last_active":"2024-05-08T09:22:16.062726+0000","last_peered":"2024-05-08T09:22:16.062726+0000","last_clean":"2024-05-08T09:22:16.062726+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:22:16.062726+0000","last_undegraded":"2024-05-08T09:22:16.062726+0000","last_fullsized":"2024-05-08T09:22:16.062726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.209901+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.209901+0000","last_peered":"2024-05-08T09:24:38.209901+0000","last_clean":"2024-05-08T09:24:38.209901+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.209901+0000","last_undegraded":"2024-05-08T09:24:38.209901+0000","last_fullsized":"2024-05-08T09:24:38.209901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:39.126588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993965+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:22:15.993965+0000","last_peered":"2024-05-08T09:22:15.993965+0000","last_clean":"2024-05-08T09:22:15.993965+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:22:15.993965+0000","last_undegraded":"2024-05-08T09:22:15.993965+0000","last_fullsized":"2024-05-08T09:22:15.993965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:01.393034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:18.900511+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:22:18.900511+0000","last_peered":"2024-05-08T09:22:18.900511+0000","last_clean":"2024-05-08T09:22:18.900511+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:22:18.900511+0000","last_undegraded":"2024-05-08T09:22:18.900511+0000","last_fullsized":"2024-05-08T09:22:18.900511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:52.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000357+0000","last_change":"2024-05-08T09:21:34.970071+0000","last_active":"2024-05-08T09:22:16.000357+0000","last_peered":"2024-05-08T09:22:16.000357+0000","last_clean":"2024-05-08T09:22:16.000357+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:22:16.000357+0000","last_undegraded":"2024-05-08T09:22:16.000357+0000","last_fullsized":"2024-05-08T09:22:16.000357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:24.049898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043550+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:38.043550+0000","last_peered":"2024-05-08T09:24:38.043550+0000","last_clean":"2024-05-08T09:24:38.043550+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:38.043550+0000","last_undegraded":"2024-05-08T09:24:38.043550+0000","last_fullsized":"2024-05-08T09:24:38.043550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:20.146454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993615+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:22:15.993615+0000","last_peered":"2024-05-08T09:22:15.993615+0000","last_clean":"2024-05-08T09:22:15.993615+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:22:15.993615+0000","last_undegraded":"2024-05-08T09:22:15.993615+0000","last_fullsized":"2024-05-08T09:22:15.993615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:43.864633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240927+0000","last_change":"2024-05-08T09:21:30.943637+0000","last_active":"2024-05-08T09:24:38.240927+0000","last_peered":"2024-05-08T09:24:38.240927+0000","last_clean":"2024-05-08T09:24:38.240927+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:24:38.240927+0000","last_undegraded":"2024-05-08T09:24:38.240927+0000","last_fullsized":"2024-05-08T09:24:38.240927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914364+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:23:48.914364+0000","last_peered":"2024-05-08T09:23:48.914364+0000","last_clean":"2024-05-08T09:23:48.914364+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:23:48.914364+0000","last_undegraded":"2024-05-08T09:23:48.914364+0000","last_fullsized":"2024-05-08T09:23:48.914364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:46.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997524+0000","last_change":"2024-05-08T09:21:32.954018+0000","last_active":"2024-05-08T09:22:15.997524+0000","last_peered":"2024-05-08T09:22:15.997524+0000","last_clean":"2024-05-08T09:22:15.997524+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:22:15.997524+0000","last_undegraded":"2024-05-08T09:22:15.997524+0000","last_fullsized":"2024-05-08T09:22:15.997524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:47.581536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.120007+0000","last_change":"2024-05-08T09:21:34.969072+0000","last_active":"2024-05-08T09:23:36.120007+0000","last_peered":"2024-05-08T09:23:36.120007+0000","last_clean":"2024-05-08T09:23:36.120007+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:23:36.120007+0000","last_undegraded":"2024-05-08T09:23:36.120007+0000","last_fullsized":"2024-05-08T09:23:36.120007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:38.834811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.243750+0000","last_change":"2024-05-08T09:21:36.965387+0000","last_active":"2024-05-08T09:24:38.243750+0000","last_peered":"2024-05-08T09:24:38.243750+0000","last_clean":"2024-05-08T09:24:38.243750+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:38.243750+0000","last_undegraded":"2024-05-08T09:24:38.243750+0000","last_fullsized":"2024-05-08T09:24:38.243750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207965+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.207965+0000","last_peered":"2024-05-08T09:24:38.207965+0000","last_clean":"2024-05-08T09:24:38.207965+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.207965+0000","last_undegraded":"2024-05-08T09:24:38.207965+0000","last_fullsized":"2024-05-08T09:24:38.207965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:45.973741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.148771+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.148771+0000","last_peered":"2024-05-08T09:24:38.148771+0000","last_clean":"2024-05-08T09:24:38.148771+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.148771+0000","last_undegraded":"2024-05-08T09:24:38.148771+0000","last_fullsized":"2024-05-08T09:24:38.148771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993880+0000","last_change":"2024-05-08T09:21:32.958870+0000","last_active":"2024-05-08T09:22:15.993880+0000","last_peered":"2024-05-08T09:22:15.993880+0000","last_clean":"2024-05-08T09:22:15.993880+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:22:15.993880+0000","last_undegraded":"2024-05-08T09:22:15.993880+0000","last_fullsized":"2024-05-08T09:22:15.993880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:13.060641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.129369+0000","last_change":"2024-05-08T09:21:34.966604+0000","last_active":"2024-05-08T09:23:36.129369+0000","last_peered":"2024-05-08T09:23:36.129369+0000","last_clean":"2024-05-08T09:23:36.129369+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:23:36.129369+0000","last_undegraded":"2024-05-08T09:23:36.129369+0000","last_fullsized":"2024-05-08T09:23:36.129369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:14:01.043108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064548+0000","last_change":"2024-05-08T09:21:36.964833+0000","last_active":"2024-05-08T09:22:16.064548+0000","last_peered":"2024-05-08T09:22:16.064548+0000","last_clean":"2024-05-08T09:22:16.064548+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:22:16.064548+0000","last_undegraded":"2024-05-08T09:22:16.064548+0000","last_fullsized":"2024-05-08T09:22:16.064548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:51.594598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.782118+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:22:53.782118+0000","last_peered":"2024-05-08T09:22:53.782118+0000","last_clean":"2024-05-08T09:22:53.782118+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:22:53.782118+0000","last_undegraded":"2024-05-08T09:22:53.782118+0000","last_fullsized":"2024-05-08T09:22:53.782118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.051881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240991+0000","last_change":"2024-05-08T09:21:30.942033+0000","last_active":"2024-05-08T09:24:38.240991+0000","last_peered":"2024-05-08T09:24:38.240991+0000","last_clean":"2024-05-08T09:24:38.240991+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:24:38.240991+0000","last_undegraded":"2024-05-08T09:24:38.240991+0000","last_fullsized":"2024-05-08T09:24:38.240991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000003+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:22:16.000003+0000","last_peered":"2024-05-08T09:22:16.000003+0000","last_clean":"2024-05-08T09:22:16.000003+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:22:16.000003+0000","last_undegraded":"2024-05-08T09:22:16.000003+0000","last_fullsized":"2024-05-08T09:22:16.000003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063135+0000","last_change":"2024-05-08T09:21:32.956199+0000","last_active":"2024-05-08T09:22:16.063135+0000","last_peered":"2024-05-08T09:22:16.063135+0000","last_clean":"2024-05-08T09:22:16.063135+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:22:16.063135+0000","last_undegraded":"2024-05-08T09:22:16.063135+0000","last_fullsized":"2024-05-08T09:22:16.063135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:22.043489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.109617+0000","last_change":"2024-05-08T09:21:34.969113+0000","last_active":"2024-05-08T09:23:36.109617+0000","last_peered":"2024-05-08T09:23:36.109617+0000","last_clean":"2024-05-08T09:23:36.109617+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:23:36.109617+0000","last_undegraded":"2024-05-08T09:23:36.109617+0000","last_fullsized":"2024-05-08T09:23:36.109617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:18.664086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063764+0000","last_change":"2024-05-08T09:21:36.966245+0000","last_active":"2024-05-08T09:22:16.063764+0000","last_peered":"2024-05-08T09:22:16.063764+0000","last_clean":"2024-05-08T09:22:16.063764+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:22:16.063764+0000","last_undegraded":"2024-05-08T09:22:16.063764+0000","last_fullsized":"2024-05-08T09:22:16.063764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.539672+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:37.539672+0000","last_peered":"2024-05-08T09:23:37.539672+0000","last_clean":"2024-05-08T09:23:37.539672+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:37.539672+0000","last_undegraded":"2024-05-08T09:23:37.539672+0000","last_fullsized":"2024-05-08T09:23:37.539672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999146+0000","last_change":"2024-05-08T09:21:30.953247+0000","last_active":"2024-05-08T09:22:15.999146+0000","last_peered":"2024-05-08T09:22:15.999146+0000","last_clean":"2024-05-08T09:22:15.999146+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:22:15.999146+0000","last_undegraded":"2024-05-08T09:22:15.999146+0000","last_fullsized":"2024-05-08T09:22:15.999146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:03.399759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997399+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:22:15.997399+0000","last_peered":"2024-05-08T09:22:15.997399+0000","last_clean":"2024-05-08T09:22:15.997399+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:22:15.997399+0000","last_undegraded":"2024-05-08T09:22:15.997399+0000","last_fullsized":"2024-05-08T09:22:15.997399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:56.441900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063881+0000","last_change":"2024-05-08T09:21:32.957626+0000","last_active":"2024-05-08T09:22:16.063881+0000","last_peered":"2024-05-08T09:22:16.063881+0000","last_clean":"2024-05-08T09:22:16.063881+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:22:16.063881+0000","last_undegraded":"2024-05-08T09:22:16.063881+0000","last_fullsized":"2024-05-08T09:22:16.063881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:21:40.755189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914793+0000","last_change":"2024-05-08T09:21:34.962754+0000","last_active":"2024-05-08T09:23:48.914793+0000","last_peered":"2024-05-08T09:23:48.914793+0000","last_clean":"2024-05-08T09:23:48.914793+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:23:48.914793+0000","last_undegraded":"2024-05-08T09:23:48.914793+0000","last_fullsized":"2024-05-08T09:23:48.914793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:25.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.360406+0000","last_change":"2024-05-08T09:21:36.978801+0000","last_active":"2024-05-08T09:24:38.360406+0000","last_peered":"2024-05-08T09:24:38.360406+0000","last_clean":"2024-05-08T09:24:38.360406+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:24:38.360406+0000","last_undegraded":"2024-05-08T09:24:38.360406+0000","last_fullsized":"2024-05-08T09:24:38.360406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064571+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:22:16.064571+0000","last_peered":"2024-05-08T09:22:16.064571+0000","last_clean":"2024-05-08T09:22:16.064571+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:22:16.064571+0000","last_undegraded":"2024-05-08T09:22:16.064571+0000","last_fullsized":"2024-05-08T09:22:16.064571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:29.324457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998301+0000","last_change":"2024-05-08T09:21:30.951955+0000","last_active":"2024-05-08T09:22:15.998301+0000","last_peered":"2024-05-08T09:22:15.998301+0000","last_clean":"2024-05-08T09:22:15.998301+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:22:15.998301+0000","last_undegraded":"2024-05-08T09:22:15.998301+0000","last_fullsized":"2024-05-08T09:22:15.998301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:07.718728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996601+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:22:15.996601+0000","last_peered":"2024-05-08T09:22:15.996601+0000","last_clean":"2024-05-08T09:22:15.996601+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:22:15.996601+0000","last_undegraded":"2024-05-08T09:22:15.996601+0000","last_fullsized":"2024-05-08T09:22:15.996601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:06.582694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063416+0000","last_change":"2024-05-08T09:21:32.957023+0000","last_active":"2024-05-08T09:22:16.063416+0000","last_peered":"2024-05-08T09:22:16.063416+0000","last_clean":"2024-05-08T09:22:16.063416+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:22:16.063416+0000","last_undegraded":"2024-05-08T09:22:16.063416+0000","last_fullsized":"2024-05-08T09:22:16.063416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:40.029960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.133206+0000","last_change":"2024-05-08T09:21:34.966546+0000","last_active":"2024-05-08T09:23:36.133206+0000","last_peered":"2024-05-08T09:23:36.133206+0000","last_clean":"2024-05-08T09:23:36.133206+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:23:36.133206+0000","last_undegraded":"2024-05-08T09:23:36.133206+0000","last_fullsized":"2024-05-08T09:23:36.133206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:29:37.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062735+0000","last_change":"2024-05-08T09:21:36.971385+0000","last_active":"2024-05-08T09:22:16.062735+0000","last_peered":"2024-05-08T09:22:16.062735+0000","last_clean":"2024-05-08T09:22:16.062735+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:22:16.062735+0000","last_undegraded":"2024-05-08T09:22:16.062735+0000","last_fullsized":"2024-05-08T09:22:16.062735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:49.044705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.337428+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.337428+0000","last_peered":"2024-05-08T09:24:38.337428+0000","last_clean":"2024-05-08T09:24:38.337428+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.337428+0000","last_undegraded":"2024-05-08T09:24:38.337428+0000","last_fullsized":"2024-05-08T09:24:38.337428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:53.334530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166739+0000","last_change":"2024-05-08T09:21:30.955072+0000","last_active":"2024-05-08T09:24:38.166739+0000","last_peered":"2024-05-08T09:24:38.166739+0000","last_clean":"2024-05-08T09:24:38.166739+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:24:38.166739+0000","last_undegraded":"2024-05-08T09:24:38.166739+0000","last_fullsized":"2024-05-08T09:24:38.166739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064027+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:22:16.064027+0000","last_peered":"2024-05-08T09:22:16.064027+0000","last_clean":"2024-05-08T09:22:16.064027+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:22:16.064027+0000","last_undegraded":"2024-05-08T09:22:16.064027+0000","last_fullsized":"2024-05-08T09:22:16.064027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995287+0000","last_change":"2024-05-08T09:21:32.958822+0000","last_active":"2024-05-08T09:22:15.995287+0000","last_peered":"2024-05-08T09:22:15.995287+0000","last_clean":"2024-05-08T09:22:15.995287+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:22:15.995287+0000","last_undegraded":"2024-05-08T09:22:15.995287+0000","last_fullsized":"2024-05-08T09:22:15.995287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:35.925851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.113715+0000","last_change":"2024-05-08T09:21:34.965442+0000","last_active":"2024-05-08T09:23:36.113715+0000","last_peered":"2024-05-08T09:23:36.113715+0000","last_clean":"2024-05-08T09:23:36.113715+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:23:36.113715+0000","last_undegraded":"2024-05-08T09:23:36.113715+0000","last_fullsized":"2024-05-08T09:23:36.113715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:19.669692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998369+0000","last_change":"2024-05-08T09:21:36.980935+0000","last_active":"2024-05-08T09:22:15.998369+0000","last_peered":"2024-05-08T09:22:15.998369+0000","last_clean":"2024-05-08T09:22:15.998369+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:22:15.998369+0000","last_undegraded":"2024-05-08T09:22:15.998369+0000","last_fullsized":"2024-05-08T09:22:15.998369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912987+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:23:38.912987+0000","last_peered":"2024-05-08T09:23:38.912987+0000","last_clean":"2024-05-08T09:23:38.912987+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:23:38.912987+0000","last_undegraded":"2024-05-08T09:23:38.912987+0000","last_fullsized":"2024-05-08T09:23:38.912987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:30:24.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999240+0000","last_change":"2024-05-08T09:21:30.961704+0000","last_active":"2024-05-08T09:22:15.999240+0000","last_peered":"2024-05-08T09:22:15.999240+0000","last_clean":"2024-05-08T09:22:15.999240+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:22:15.999240+0000","last_undegraded":"2024-05-08T09:22:15.999240+0000","last_fullsized":"2024-05-08T09:22:15.999240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:15.655892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997331+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:22:15.997331+0000","last_peered":"2024-05-08T09:22:15.997331+0000","last_clean":"2024-05-08T09:22:15.997331+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:22:15.997331+0000","last_undegraded":"2024-05-08T09:22:15.997331+0000","last_fullsized":"2024-05-08T09:22:15.997331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:21.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.177753+0000","last_change":"2024-05-08T09:21:32.957213+0000","last_active":"2024-05-08T09:23:37.177753+0000","last_peered":"2024-05-08T09:23:37.177753+0000","last_clean":"2024-05-08T09:23:37.177753+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:23:37.177753+0000","last_undegraded":"2024-05-08T09:23:37.177753+0000","last_fullsized":"2024-05-08T09:23:37.177753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:46.321295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.139733+0000","last_change":"2024-05-08T09:21:34.958793+0000","last_active":"2024-05-08T09:23:36.139733+0000","last_peered":"2024-05-08T09:23:36.139733+0000","last_clean":"2024-05-08T09:23:36.139733+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:23:36.139733+0000","last_undegraded":"2024-05-08T09:23:36.139733+0000","last_fullsized":"2024-05-08T09:23:36.139733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:15.067049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.341387+0000","last_change":"2024-05-08T09:21:36.971576+0000","last_active":"2024-05-08T09:24:38.341387+0000","last_peered":"2024-05-08T09:24:38.341387+0000","last_clean":"2024-05-08T09:24:38.341387+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:38.341387+0000","last_undegraded":"2024-05-08T09:24:38.341387+0000","last_fullsized":"2024-05-08T09:24:38.341387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:05.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.950071+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:37.950071+0000","last_peered":"2024-05-08T09:24:37.950071+0000","last_clean":"2024-05-08T09:24:37.950071+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:37.950071+0000","last_undegraded":"2024-05-08T09:24:37.950071+0000","last_fullsized":"2024-05-08T09:24:37.950071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001229+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:22:16.001229+0000","last_peered":"2024-05-08T09:22:16.001229+0000","last_clean":"2024-05-08T09:22:16.001229+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:22:16.001229+0000","last_undegraded":"2024-05-08T09:22:16.001229+0000","last_fullsized":"2024-05-08T09:22:16.001229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995509+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:22:15.995509+0000","last_peered":"2024-05-08T09:22:15.995509+0000","last_clean":"2024-05-08T09:22:15.995509+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:22:15.995509+0000","last_undegraded":"2024-05-08T09:22:15.995509+0000","last_fullsized":"2024-05-08T09:22:15.995509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:48.376085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188113+0000","last_change":"2024-05-08T09:21:32.955025+0000","last_active":"2024-05-08T09:23:37.188113+0000","last_peered":"2024-05-08T09:23:37.188113+0000","last_clean":"2024-05-08T09:23:37.188113+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:23:37.188113+0000","last_undegraded":"2024-05-08T09:23:37.188113+0000","last_fullsized":"2024-05-08T09:23:37.188113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:48.868737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999772+0000","last_change":"2024-05-08T09:21:34.969633+0000","last_active":"2024-05-08T09:22:15.999772+0000","last_peered":"2024-05-08T09:22:15.999772+0000","last_clean":"2024-05-08T09:22:15.999772+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:22:15.999772+0000","last_undegraded":"2024-05-08T09:22:15.999772+0000","last_fullsized":"2024-05-08T09:22:15.999772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:12:38.074915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.299223+0000","last_change":"2024-05-08T09:21:36.971697+0000","last_active":"2024-05-08T09:24:38.299223+0000","last_peered":"2024-05-08T09:24:38.299223+0000","last_clean":"2024-05-08T09:24:38.299223+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:38.299223+0000","last_undegraded":"2024-05-08T09:24:38.299223+0000","last_fullsized":"2024-05-08T09:24:38.299223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.321717+0000","last_change":"2024-05-08T09:21:38.969278+0000","last_active":"2024-05-08T09:23:37.321717+0000","last_peered":"2024-05-08T09:23:37.321717+0000","last_clean":"2024-05-08T09:23:37.321717+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:23:37.321717+0000","last_undegraded":"2024-05-08T09:23:37.321717+0000","last_fullsized":"2024-05-08T09:23:37.321717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:06.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210299+0000","last_change":"2024-05-08T09:21:30.955832+0000","last_active":"2024-05-08T09:24:38.210299+0000","last_peered":"2024-05-08T09:24:38.210299+0000","last_clean":"2024-05-08T09:24:38.210299+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:24:38.210299+0000","last_undegraded":"2024-05-08T09:24:38.210299+0000","last_fullsized":"2024-05-08T09:24:38.210299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:51.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992620+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:22:15.992620+0000","last_peered":"2024-05-08T09:22:15.992620+0000","last_clean":"2024-05-08T09:22:15.992620+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:22:15.992620+0000","last_undegraded":"2024-05-08T09:22:15.992620+0000","last_fullsized":"2024-05-08T09:22:15.992620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:26:59.095251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997769+0000","last_change":"2024-05-08T09:21:32.958748+0000","last_active":"2024-05-08T09:22:15.997769+0000","last_peered":"2024-05-08T09:22:15.997769+0000","last_clean":"2024-05-08T09:22:15.997769+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:22:15.997769+0000","last_undegraded":"2024-05-08T09:22:15.997769+0000","last_fullsized":"2024-05-08T09:22:15.997769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:33.281026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.126382+0000","last_change":"2024-05-08T09:21:34.960277+0000","last_active":"2024-05-08T09:23:36.126382+0000","last_peered":"2024-05-08T09:23:36.126382+0000","last_clean":"2024-05-08T09:23:36.126382+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:23:36.126382+0000","last_undegraded":"2024-05-08T09:23:36.126382+0000","last_fullsized":"2024-05-08T09:23:36.126382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:56.211138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001233+0000","last_change":"2024-05-08T09:21:36.975280+0000","last_active":"2024-05-08T09:22:16.001233+0000","last_peered":"2024-05-08T09:22:16.001233+0000","last_clean":"2024-05-08T09:22:16.001233+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:22:16.001233+0000","last_undegraded":"2024-05-08T09:22:16.001233+0000","last_fullsized":"2024-05-08T09:22:16.001233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:48.690526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.274231+0000","last_change":"2024-05-08T09:21:38.977441+0000","last_active":"2024-05-08T09:24:38.274231+0000","last_peered":"2024-05-08T09:24:38.274231+0000","last_clean":"2024-05-08T09:24:38.274231+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:24:38.274231+0000","last_undegraded":"2024-05-08T09:24:38.274231+0000","last_fullsized":"2024-05-08T09:24:38.274231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542061+0000","last_change":"2024-05-08T09:21:30.961518+0000","last_active":"2024-05-08T09:23:37.542061+0000","last_peered":"2024-05-08T09:23:37.542061+0000","last_clean":"2024-05-08T09:23:37.542061+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:23:37.542061+0000","last_undegraded":"2024-05-08T09:23:37.542061+0000","last_fullsized":"2024-05-08T09:23:37.542061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:42.670072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993805+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:22:15.993805+0000","last_peered":"2024-05-08T09:22:15.993805+0000","last_clean":"2024-05-08T09:22:15.993805+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:22:15.993805+0000","last_undegraded":"2024-05-08T09:22:15.993805+0000","last_fullsized":"2024-05-08T09:22:15.993805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996416+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:22:15.996416+0000","last_peered":"2024-05-08T09:22:15.996416+0000","last_clean":"2024-05-08T09:22:15.996416+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:22:15.996416+0000","last_undegraded":"2024-05-08T09:22:15.996416+0000","last_fullsized":"2024-05-08T09:22:15.996416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996694+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:22:15.996694+0000","last_peered":"2024-05-08T09:22:15.996694+0000","last_clean":"2024-05-08T09:22:15.996694+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:22:15.996694+0000","last_undegraded":"2024-05-08T09:22:15.996694+0000","last_fullsized":"2024-05-08T09:22:15.996694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:52.688659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995940+0000","last_change":"2024-05-08T09:21:32.954960+0000","last_active":"2024-05-08T09:22:15.995940+0000","last_peered":"2024-05-08T09:22:15.995940+0000","last_clean":"2024-05-08T09:22:15.995940+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:22:15.995940+0000","last_undegraded":"2024-05-08T09:22:15.995940+0000","last_fullsized":"2024-05-08T09:22:15.995940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:07.460383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.137506+0000","last_change":"2024-05-08T09:21:34.958243+0000","last_active":"2024-05-08T09:23:36.137506+0000","last_peered":"2024-05-08T09:23:36.137506+0000","last_clean":"2024-05-08T09:23:36.137506+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:23:36.137506+0000","last_undegraded":"2024-05-08T09:23:36.137506+0000","last_fullsized":"2024-05-08T09:23:36.137506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:20.157874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064709+0000","last_change":"2024-05-08T09:21:36.973660+0000","last_active":"2024-05-08T09:22:16.064709+0000","last_peered":"2024-05-08T09:22:16.064709+0000","last_clean":"2024-05-08T09:22:16.064709+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:22:16.064709+0000","last_undegraded":"2024-05-08T09:22:16.064709+0000","last_fullsized":"2024-05-08T09:22:16.064709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.251742+0000","last_change":"2024-05-08T09:21:38.970424+0000","last_active":"2024-05-08T09:24:38.251742+0000","last_peered":"2024-05-08T09:24:38.251742+0000","last_clean":"2024-05-08T09:24:38.251742+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:24:38.251742+0000","last_undegraded":"2024-05-08T09:24:38.251742+0000","last_fullsized":"2024-05-08T09:24:38.251742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:39.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914170+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:23:43.914170+0000","last_peered":"2024-05-08T09:23:43.914170+0000","last_clean":"2024-05-08T09:23:43.914170+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:23:43.914170+0000","last_undegraded":"2024-05-08T09:23:43.914170+0000","last_fullsized":"2024-05-08T09:23:43.914170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:41.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992288+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:22:15.992288+0000","last_peered":"2024-05-08T09:22:15.992288+0000","last_clean":"2024-05-08T09:22:15.992288+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:22:15.992288+0000","last_undegraded":"2024-05-08T09:22:15.992288+0000","last_fullsized":"2024-05-08T09:22:15.992288+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.236384+0000","last_change":"2024-05-08T09:21:28.963914+0000","last_active":"2024-05-08T09:24:38.236384+0000","last_peered":"2024-05-08T09:24:38.236384+0000","last_clean":"2024-05-08T09:24:38.236384+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:24:38.236384+0000","last_undegraded":"2024-05-08T09:24:38.236384+0000","last_fullsized":"2024-05-08T09:24:38.236384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998540+0000","last_change":"2024-05-08T09:21:32.956037+0000","last_active":"2024-05-08T09:22:15.998540+0000","last_peered":"2024-05-08T09:22:15.998540+0000","last_clean":"2024-05-08T09:22:15.998540+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:22:15.998540+0000","last_undegraded":"2024-05-08T09:22:15.998540+0000","last_fullsized":"2024-05-08T09:22:15.998540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:35.197031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043243+0000","last_change":"2024-05-08T09:21:34.968703+0000","last_active":"2024-05-08T09:24:38.043243+0000","last_peered":"2024-05-08T09:24:38.043243+0000","last_clean":"2024-05-08T09:24:38.043243+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:38.043243+0000","last_undegraded":"2024-05-08T09:24:38.043243+0000","last_fullsized":"2024-05-08T09:24:38.043243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:23.830443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996211+0000","last_change":"2024-05-08T09:21:36.982457+0000","last_active":"2024-05-08T09:22:15.996211+0000","last_peered":"2024-05-08T09:22:15.996211+0000","last_clean":"2024-05-08T09:22:15.996211+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:22:15.996211+0000","last_undegraded":"2024-05-08T09:22:15.996211+0000","last_fullsized":"2024-05-08T09:22:15.996211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:59.498636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.778538+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:22:53.778538+0000","last_peered":"2024-05-08T09:22:53.778538+0000","last_clean":"2024-05-08T09:22:53.778538+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:22:53.778538+0000","last_undegraded":"2024-05-08T09:22:53.778538+0000","last_fullsized":"2024-05-08T09:22:53.778538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:53.706014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544450+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:37.544450+0000","last_peered":"2024-05-08T09:23:37.544450+0000","last_clean":"2024-05-08T09:23:37.544450+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:37.544450+0000","last_undegraded":"2024-05-08T09:23:37.544450+0000","last_fullsized":"2024-05-08T09:23:37.544450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997429+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:22:15.997429+0000","last_peered":"2024-05-08T09:22:15.997429+0000","last_clean":"2024-05-08T09:22:15.997429+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:22:15.997429+0000","last_undegraded":"2024-05-08T09:22:15.997429+0000","last_fullsized":"2024-05-08T09:22:15.997429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:07.226430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062347+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:22:16.062347+0000","last_peered":"2024-05-08T09:22:16.062347+0000","last_clean":"2024-05-08T09:22:16.062347+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:22:16.062347+0000","last_undegraded":"2024-05-08T09:22:16.062347+0000","last_fullsized":"2024-05-08T09:22:16.062347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999681+0000","last_change":"2024-05-08T09:21:32.954033+0000","last_active":"2024-05-08T09:22:15.999681+0000","last_peered":"2024-05-08T09:22:15.999681+0000","last_clean":"2024-05-08T09:22:15.999681+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:22:15.999681+0000","last_undegraded":"2024-05-08T09:22:15.999681+0000","last_fullsized":"2024-05-08T09:22:15.999681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.238359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043198+0000","last_change":"2024-05-08T09:21:34.961617+0000","last_active":"2024-05-08T09:24:38.043198+0000","last_peered":"2024-05-08T09:24:38.043198+0000","last_clean":"2024-05-08T09:24:38.043198+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:24:38.043198+0000","last_undegraded":"2024-05-08T09:24:38.043198+0000","last_fullsized":"2024-05-08T09:24:38.043198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:00:00.996503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065985+0000","last_change":"2024-05-08T09:21:36.973699+0000","last_active":"2024-05-08T09:22:16.065985+0000","last_peered":"2024-05-08T09:22:16.065985+0000","last_clean":"2024-05-08T09:22:16.065985+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:22:16.065985+0000","last_undegraded":"2024-05-08T09:22:16.065985+0000","last_fullsized":"2024-05-08T09:22:16.065985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:37.294088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994876+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:22:15.994876+0000","last_peered":"2024-05-08T09:22:15.994876+0000","last_clean":"2024-05-08T09:22:15.994876+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:22:15.994876+0000","last_undegraded":"2024-05-08T09:22:15.994876+0000","last_fullsized":"2024-05-08T09:22:15.994876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:58.388645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.541714+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:37.541714+0000","last_peered":"2024-05-08T09:23:37.541714+0000","last_clean":"2024-05-08T09:23:37.541714+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:37.541714+0000","last_undegraded":"2024-05-08T09:23:37.541714+0000","last_fullsized":"2024-05-08T09:23:37.541714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996203+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:22:15.996203+0000","last_peered":"2024-05-08T09:22:15.996203+0000","last_clean":"2024-05-08T09:22:15.996203+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:22:15.996203+0000","last_undegraded":"2024-05-08T09:22:15.996203+0000","last_fullsized":"2024-05-08T09:22:15.996203+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995492+0000","last_change":"2024-05-08T09:21:28.975541+0000","last_active":"2024-05-08T09:22:15.995492+0000","last_peered":"2024-05-08T09:22:15.995492+0000","last_clean":"2024-05-08T09:22:15.995492+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:22:15.995492+0000","last_undegraded":"2024-05-08T09:22:15.995492+0000","last_fullsized":"2024-05-08T09:22:15.995492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064398+0000","last_change":"2024-05-08T09:21:32.958810+0000","last_active":"2024-05-08T09:22:16.064398+0000","last_peered":"2024-05-08T09:22:16.064398+0000","last_clean":"2024-05-08T09:22:16.064398+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:22:16.064398+0000","last_undegraded":"2024-05-08T09:22:16.064398+0000","last_fullsized":"2024-05-08T09:22:16.064398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:13:59.036699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.555805+0000","last_change":"2024-05-08T09:21:34.958674+0000","last_active":"2024-05-08T09:24:37.555805+0000","last_peered":"2024-05-08T09:24:37.555805+0000","last_clean":"2024-05-08T09:24:37.555805+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:37.555805+0000","last_undegraded":"2024-05-08T09:24:37.555805+0000","last_fullsized":"2024-05-08T09:24:37.555805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:51.780853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998784+0000","last_change":"2024-05-08T09:21:36.980954+0000","last_active":"2024-05-08T09:22:15.998784+0000","last_peered":"2024-05-08T09:22:15.998784+0000","last_clean":"2024-05-08T09:22:15.998784+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:22:15.998784+0000","last_undegraded":"2024-05-08T09:22:15.998784+0000","last_fullsized":"2024-05-08T09:22:15.998784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:19.944195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.300793+0000","last_change":"2024-05-08T09:21:38.979327+0000","last_active":"2024-05-08T09:23:37.300793+0000","last_peered":"2024-05-08T09:23:37.300793+0000","last_clean":"2024-05-08T09:23:37.300793+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:23:37.300793+0000","last_undegraded":"2024-05-08T09:23:37.300793+0000","last_fullsized":"2024-05-08T09:23:37.300793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:08.072829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166882+0000","last_change":"2024-05-08T09:21:30.954313+0000","last_active":"2024-05-08T09:24:38.166882+0000","last_peered":"2024-05-08T09:24:38.166882+0000","last_clean":"2024-05-08T09:24:38.166882+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:24:38.166882+0000","last_undegraded":"2024-05-08T09:24:38.166882+0000","last_fullsized":"2024-05-08T09:24:38.166882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.902533+0000","last_change":"2024-05-08T09:21:28.977568+0000","last_active":"2024-05-08T09:24:37.902533+0000","last_peered":"2024-05-08T09:24:37.902533+0000","last_clean":"2024-05-08T09:24:37.902533+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:24:37.902533+0000","last_undegraded":"2024-05-08T09:24:37.902533+0000","last_fullsized":"2024-05-08T09:24:37.902533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065853+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:22:16.065853+0000","last_peered":"2024-05-08T09:22:16.065853+0000","last_clean":"2024-05-08T09:22:16.065853+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:22:16.065853+0000","last_undegraded":"2024-05-08T09:22:16.065853+0000","last_fullsized":"2024-05-08T09:22:16.065853+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:33:18.664257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908099+0000","last_change":"2024-05-08T09:21:32.957975+0000","last_active":"2024-05-08T09:23:38.908099+0000","last_peered":"2024-05-08T09:23:38.908099+0000","last_clean":"2024-05-08T09:23:38.908099+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:23:38.908099+0000","last_undegraded":"2024-05-08T09:23:38.908099+0000","last_fullsized":"2024-05-08T09:23:38.908099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:05:57.275150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'61","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908015+0000","last_change":"2024-05-08T09:21:34.962670+0000","last_active":"2024-05-08T09:23:38.908015+0000","last_peered":"2024-05-08T09:23:38.908015+0000","last_clean":"2024-05-08T09:23:38.908015+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:23:38.908015+0000","last_undegraded":"2024-05-08T09:23:38.908015+0000","last_fullsized":"2024-05-08T09:23:38.908015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:45.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996880+0000","last_change":"2024-05-08T09:21:36.970971+0000","last_active":"2024-05-08T09:22:15.996880+0000","last_peered":"2024-05-08T09:22:15.996880+0000","last_clean":"2024-05-08T09:22:15.996880+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:22:15.996880+0000","last_undegraded":"2024-05-08T09:22:15.996880+0000","last_fullsized":"2024-05-08T09:22:15.996880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:45.147043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.211724+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.211724+0000","last_peered":"2024-05-08T09:24:38.211724+0000","last_clean":"2024-05-08T09:24:38.211724+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.211724+0000","last_undegraded":"2024-05-08T09:24:38.211724+0000","last_fullsized":"2024-05-08T09:24:38.211724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:16.801888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912699+0000","last_change":"2024-05-08T09:21:30.954500+0000","last_active":"2024-05-08T09:23:38.912699+0000","last_peered":"2024-05-08T09:23:38.912699+0000","last_clean":"2024-05-08T09:23:38.912699+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:23:38.912699+0000","last_undegraded":"2024-05-08T09:23:38.912699+0000","last_fullsized":"2024-05-08T09:23:38.912699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:32.782785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066126+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:22:16.066126+0000","last_peered":"2024-05-08T09:22:16.066126+0000","last_clean":"2024-05-08T09:22:16.066126+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:22:16.066126+0000","last_undegraded":"2024-05-08T09:22:16.066126+0000","last_fullsized":"2024-05-08T09:22:16.066126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997047+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:22:15.997047+0000","last_peered":"2024-05-08T09:22:15.997047+0000","last_clean":"2024-05-08T09:22:15.997047+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:22:15.997047+0000","last_undegraded":"2024-05-08T09:22:15.997047+0000","last_fullsized":"2024-05-08T09:22:15.997047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995954+0000","last_change":"2024-05-08T09:21:32.955946+0000","last_active":"2024-05-08T09:22:15.995954+0000","last_peered":"2024-05-08T09:22:15.995954+0000","last_clean":"2024-05-08T09:22:15.995954+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:22:15.995954+0000","last_undegraded":"2024-05-08T09:22:15.995954+0000","last_fullsized":"2024-05-08T09:22:15.995954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:05.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994372+0000","last_change":"2024-05-08T09:21:34.968595+0000","last_active":"2024-05-08T09:22:15.994372+0000","last_peered":"2024-05-08T09:22:15.994372+0000","last_clean":"2024-05-08T09:22:15.994372+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:22:15.994372+0000","last_undegraded":"2024-05-08T09:22:15.994372+0000","last_fullsized":"2024-05-08T09:22:15.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:43.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":356,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350586+0000","last_change":"2024-05-08T09:21:36.971304+0000","last_active":"2024-05-08T09:24:38.350586+0000","last_peered":"2024-05-08T09:24:38.350586+0000","last_clean":"2024-05-08T09:24:38.350586+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:38.350586+0000","last_undegraded":"2024-05-08T09:24:38.350586+0000","last_fullsized":"2024-05-08T09:24:38.350586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998082+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:22:15.998082+0000","last_peered":"2024-05-08T09:22:15.998082+0000","last_clean":"2024-05-08T09:22:15.998082+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:22:15.998082+0000","last_undegraded":"2024-05-08T09:22:15.998082+0000","last_fullsized":"2024-05-08T09:22:15.998082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:56.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.534998+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.534998+0000","last_peered":"2024-05-08T09:23:37.534998+0000","last_clean":"2024-05-08T09:23:37.534998+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.534998+0000","last_undegraded":"2024-05-08T09:23:37.534998+0000","last_fullsized":"2024-05-08T09:23:37.534998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:46.861344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913368+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:23:38.913368+0000","last_peered":"2024-05-08T09:23:38.913368+0000","last_clean":"2024-05-08T09:23:38.913368+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:23:38.913368+0000","last_undegraded":"2024-05-08T09:23:38.913368+0000","last_fullsized":"2024-05-08T09:23:38.913368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:07.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065021+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:22:16.065021+0000","last_peered":"2024-05-08T09:22:16.065021+0000","last_clean":"2024-05-08T09:22:16.065021+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:22:16.065021+0000","last_undegraded":"2024-05-08T09:22:16.065021+0000","last_fullsized":"2024-05-08T09:22:16.065021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:05.319652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993871+0000","last_change":"2024-05-08T09:21:32.953187+0000","last_active":"2024-05-08T09:22:15.993871+0000","last_peered":"2024-05-08T09:22:15.993871+0000","last_clean":"2024-05-08T09:22:15.993871+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:22:15.993871+0000","last_undegraded":"2024-05-08T09:22:15.993871+0000","last_fullsized":"2024-05-08T09:22:15.993871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:55.009101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997211+0000","last_change":"2024-05-08T09:21:34.965238+0000","last_active":"2024-05-08T09:22:15.997211+0000","last_peered":"2024-05-08T09:22:15.997211+0000","last_clean":"2024-05-08T09:22:15.997211+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:22:15.997211+0000","last_undegraded":"2024-05-08T09:22:15.997211+0000","last_fullsized":"2024-05-08T09:22:15.997211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:18.697994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.338025+0000","last_change":"2024-05-08T09:21:36.964762+0000","last_active":"2024-05-08T09:24:38.338025+0000","last_peered":"2024-05-08T09:24:38.338025+0000","last_clean":"2024-05-08T09:24:38.338025+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:38.338025+0000","last_undegraded":"2024-05-08T09:24:38.338025+0000","last_fullsized":"2024-05-08T09:24:38.338025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.195367+0000","last_change":"2024-05-08T09:21:38.976489+0000","last_active":"2024-05-08T09:24:38.195367+0000","last_peered":"2024-05-08T09:24:38.195367+0000","last_clean":"2024-05-08T09:24:38.195367+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:24:38.195367+0000","last_undegraded":"2024-05-08T09:24:38.195367+0000","last_fullsized":"2024-05-08T09:24:38.195367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294339+0000","last_change":"2024-05-08T09:21:30.954521+0000","last_active":"2024-05-08T09:24:38.294339+0000","last_peered":"2024-05-08T09:24:38.294339+0000","last_clean":"2024-05-08T09:24:38.294339+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:24:38.294339+0000","last_undegraded":"2024-05-08T09:24:38.294339+0000","last_fullsized":"2024-05-08T09:24:38.294339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:48.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999497+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:22:15.999497+0000","last_peered":"2024-05-08T09:22:15.999497+0000","last_clean":"2024-05-08T09:22:15.999497+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:22:15.999497+0000","last_undegraded":"2024-05-08T09:22:15.999497+0000","last_fullsized":"2024-05-08T09:22:15.999497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998995+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:22:15.998995+0000","last_peered":"2024-05-08T09:22:15.998995+0000","last_clean":"2024-05-08T09:22:15.998995+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:22:15.998995+0000","last_undegraded":"2024-05-08T09:22:15.998995+0000","last_fullsized":"2024-05-08T09:22:15.998995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992213+0000","last_change":"2024-05-08T09:21:32.951089+0000","last_active":"2024-05-08T09:22:15.992213+0000","last_peered":"2024-05-08T09:22:15.992213+0000","last_clean":"2024-05-08T09:22:15.992213+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:22:15.992213+0000","last_undegraded":"2024-05-08T09:22:15.992213+0000","last_fullsized":"2024-05-08T09:22:15.992213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:27.953425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.124374+0000","last_change":"2024-05-08T09:21:34.967958+0000","last_active":"2024-05-08T09:23:36.124374+0000","last_peered":"2024-05-08T09:23:36.124374+0000","last_clean":"2024-05-08T09:23:36.124374+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:23:36.124374+0000","last_undegraded":"2024-05-08T09:23:36.124374+0000","last_fullsized":"2024-05-08T09:23:36.124374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:48.327703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062871+0000","last_change":"2024-05-08T09:21:36.971440+0000","last_active":"2024-05-08T09:22:16.062871+0000","last_peered":"2024-05-08T09:22:16.062871+0000","last_clean":"2024-05-08T09:22:16.062871+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:22:16.062871+0000","last_undegraded":"2024-05-08T09:22:16.062871+0000","last_fullsized":"2024-05-08T09:22:16.062871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:04.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995443+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:22:15.995443+0000","last_peered":"2024-05-08T09:22:15.995443+0000","last_clean":"2024-05-08T09:22:15.995443+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:22:15.995443+0000","last_undegraded":"2024-05-08T09:22:15.995443+0000","last_fullsized":"2024-05-08T09:22:15.995443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000438+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:22:16.000438+0000","last_peered":"2024-05-08T09:22:16.000438+0000","last_clean":"2024-05-08T09:22:16.000438+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:22:16.000438+0000","last_undegraded":"2024-05-08T09:22:16.000438+0000","last_fullsized":"2024-05-08T09:22:16.000438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:33.973664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247048+0000","last_change":"2024-05-08T09:21:30.956220+0000","last_active":"2024-05-08T09:24:38.247048+0000","last_peered":"2024-05-08T09:24:38.247048+0000","last_clean":"2024-05-08T09:24:38.247048+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:24:38.247048+0000","last_undegraded":"2024-05-08T09:24:38.247048+0000","last_fullsized":"2024-05-08T09:24:38.247048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996735+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:22:15.996735+0000","last_peered":"2024-05-08T09:22:15.996735+0000","last_clean":"2024-05-08T09:22:15.996735+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:22:15.996735+0000","last_undegraded":"2024-05-08T09:22:15.996735+0000","last_fullsized":"2024-05-08T09:22:15.996735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:21.186952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993609+0000","last_change":"2024-05-08T09:21:32.958181+0000","last_active":"2024-05-08T09:22:15.993609+0000","last_peered":"2024-05-08T09:22:15.993609+0000","last_clean":"2024-05-08T09:22:15.993609+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:22:15.993609+0000","last_undegraded":"2024-05-08T09:22:15.993609+0000","last_fullsized":"2024-05-08T09:22:15.993609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:40.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.130334+0000","last_change":"2024-05-08T09:21:34.964839+0000","last_active":"2024-05-08T09:23:36.130334+0000","last_peered":"2024-05-08T09:23:36.130334+0000","last_clean":"2024-05-08T09:23:36.130334+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:23:36.130334+0000","last_undegraded":"2024-05-08T09:23:36.130334+0000","last_fullsized":"2024-05-08T09:23:36.130334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:49.320700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992942+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:22:15.992942+0000","last_peered":"2024-05-08T09:22:15.992942+0000","last_clean":"2024-05-08T09:22:15.992942+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:22:15.992942+0000","last_undegraded":"2024-05-08T09:22:15.992942+0000","last_fullsized":"2024-05-08T09:22:15.992942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:59.583179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.033000+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.033000+0000","last_peered":"2024-05-08T09:24:38.033000+0000","last_clean":"2024-05-08T09:24:38.033000+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.033000+0000","last_undegraded":"2024-05-08T09:24:38.033000+0000","last_fullsized":"2024-05-08T09:24:38.033000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240929+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.240929+0000","last_peered":"2024-05-08T09:24:38.240929+0000","last_clean":"2024-05-08T09:24:38.240929+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.240929+0000","last_undegraded":"2024-05-08T09:24:38.240929+0000","last_fullsized":"2024-05-08T09:24:38.240929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:54:43.535283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993959+0000","last_change":"2024-05-08T09:21:28.977160+0000","last_active":"2024-05-08T09:22:15.993959+0000","last_peered":"2024-05-08T09:22:15.993959+0000","last_clean":"2024-05-08T09:22:15.993959+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:22:15.993959+0000","last_undegraded":"2024-05-08T09:22:15.993959+0000","last_fullsized":"2024-05-08T09:22:15.993959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995252+0000","last_change":"2024-05-08T09:21:32.951442+0000","last_active":"2024-05-08T09:22:15.995252+0000","last_peered":"2024-05-08T09:22:15.995252+0000","last_clean":"2024-05-08T09:22:15.995252+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:22:15.995252+0000","last_undegraded":"2024-05-08T09:22:15.995252+0000","last_fullsized":"2024-05-08T09:22:15.995252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:14.017416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.560512+0000","last_change":"2024-05-08T09:21:34.958618+0000","last_active":"2024-05-08T09:24:37.560512+0000","last_peered":"2024-05-08T09:24:37.560512+0000","last_clean":"2024-05-08T09:24:37.560512+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:24:37.560512+0000","last_undegraded":"2024-05-08T09:24:37.560512+0000","last_fullsized":"2024-05-08T09:24:37.560512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:29.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997200+0000","last_change":"2024-05-08T09:21:36.967739+0000","last_active":"2024-05-08T09:22:15.997200+0000","last_peered":"2024-05-08T09:22:15.997200+0000","last_clean":"2024-05-08T09:22:15.997200+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:22:15.997200+0000","last_undegraded":"2024-05-08T09:22:15.997200+0000","last_fullsized":"2024-05-08T09:22:15.997200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:27.327024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063979+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:22:16.063979+0000","last_peered":"2024-05-08T09:22:16.063979+0000","last_clean":"2024-05-08T09:22:16.063979+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:22:16.063979+0000","last_undegraded":"2024-05-08T09:22:16.063979+0000","last_fullsized":"2024-05-08T09:22:16.063979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944236+0000","last_change":"2024-05-08T09:21:30.953686+0000","last_active":"2024-05-08T09:24:37.944236+0000","last_peered":"2024-05-08T09:24:37.944236+0000","last_clean":"2024-05-08T09:24:37.944236+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:24:37.944236+0000","last_undegraded":"2024-05-08T09:24:37.944236+0000","last_fullsized":"2024-05-08T09:24:37.944236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000191+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:22:16.000191+0000","last_peered":"2024-05-08T09:22:16.000191+0000","last_clean":"2024-05-08T09:22:16.000191+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:22:16.000191+0000","last_undegraded":"2024-05-08T09:22:16.000191+0000","last_fullsized":"2024-05-08T09:22:16.000191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994229+0000","last_change":"2024-05-08T09:21:32.956150+0000","last_active":"2024-05-08T09:22:15.994229+0000","last_peered":"2024-05-08T09:22:15.994229+0000","last_clean":"2024-05-08T09:22:15.994229+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:22:15.994229+0000","last_undegraded":"2024-05-08T09:22:15.994229+0000","last_fullsized":"2024-05-08T09:22:15.994229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:34.790177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.620657+0000","last_change":"2024-05-08T09:21:34.964255+0000","last_active":"2024-05-08T09:24:37.620657+0000","last_peered":"2024-05-08T09:24:37.620657+0000","last_clean":"2024-05-08T09:24:37.620657+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:37.620657+0000","last_undegraded":"2024-05-08T09:24:37.620657+0000","last_fullsized":"2024-05-08T09:24:37.620657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.320370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993295+0000","last_change":"2024-05-08T09:21:36.969562+0000","last_active":"2024-05-08T09:22:15.993295+0000","last_peered":"2024-05-08T09:22:15.993295+0000","last_clean":"2024-05-08T09:22:15.993295+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:22:15.993295+0000","last_undegraded":"2024-05-08T09:22:15.993295+0000","last_fullsized":"2024-05-08T09:22:15.993295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996115+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:22:15.996115+0000","last_peered":"2024-05-08T09:22:15.996115+0000","last_clean":"2024-05-08T09:22:15.996115+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:22:15.996115+0000","last_undegraded":"2024-05-08T09:22:15.996115+0000","last_fullsized":"2024-05-08T09:22:15.996115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:31:28.662933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247450+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.247450+0000","last_peered":"2024-05-08T09:24:38.247450+0000","last_clean":"2024-05-08T09:24:38.247450+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.247450+0000","last_undegraded":"2024-05-08T09:24:38.247450+0000","last_fullsized":"2024-05-08T09:24:38.247450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:00.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001269+0000","last_change":"2024-05-08T09:21:28.976895+0000","last_active":"2024-05-08T09:22:16.001269+0000","last_peered":"2024-05-08T09:22:16.001269+0000","last_clean":"2024-05-08T09:22:16.001269+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:22:16.001269+0000","last_undegraded":"2024-05-08T09:22:16.001269+0000","last_fullsized":"2024-05-08T09:22:16.001269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993778+0000","last_change":"2024-05-08T09:21:32.953496+0000","last_active":"2024-05-08T09:22:15.993778+0000","last_peered":"2024-05-08T09:22:15.993778+0000","last_clean":"2024-05-08T09:22:15.993778+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:22:15.993778+0000","last_undegraded":"2024-05-08T09:22:15.993778+0000","last_fullsized":"2024-05-08T09:22:15.993778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:32.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'32","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.915996+0000","last_change":"2024-05-08T09:21:34.962303+0000","last_active":"2024-05-08T09:23:58.915996+0000","last_peered":"2024-05-08T09:23:58.915996+0000","last_clean":"2024-05-08T09:23:58.915996+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:23:58.915996+0000","last_undegraded":"2024-05-08T09:23:58.915996+0000","last_fullsized":"2024-05-08T09:23:58.915996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:21.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993777+0000","last_change":"2024-05-08T09:21:36.966752+0000","last_active":"2024-05-08T09:22:15.993777+0000","last_peered":"2024-05-08T09:22:15.993777+0000","last_clean":"2024-05-08T09:22:15.993777+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:22:15.993777+0000","last_undegraded":"2024-05-08T09:22:15.993777+0000","last_fullsized":"2024-05-08T09:22:15.993777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:36.110923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999504+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:22:15.999504+0000","last_peered":"2024-05-08T09:22:15.999504+0000","last_clean":"2024-05-08T09:22:15.999504+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:22:15.999504+0000","last_undegraded":"2024-05-08T09:22:15.999504+0000","last_fullsized":"2024-05-08T09:22:15.999504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:59.893435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992379+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:22:15.992379+0000","last_peered":"2024-05-08T09:22:15.992379+0000","last_clean":"2024-05-08T09:22:15.992379+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:22:15.992379+0000","last_undegraded":"2024-05-08T09:22:15.992379+0000","last_fullsized":"2024-05-08T09:22:15.992379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:04:17.117842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064977+0000","last_change":"2024-05-08T09:21:32.957500+0000","last_active":"2024-05-08T09:22:16.064977+0000","last_peered":"2024-05-08T09:22:16.064977+0000","last_clean":"2024-05-08T09:22:16.064977+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:22:16.064977+0000","last_undegraded":"2024-05-08T09:22:16.064977+0000","last_fullsized":"2024-05-08T09:22:16.064977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:19.794029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.136580+0000","last_change":"2024-05-08T09:21:34.961064+0000","last_active":"2024-05-08T09:23:36.136580+0000","last_peered":"2024-05-08T09:23:36.136580+0000","last_clean":"2024-05-08T09:23:36.136580+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:23:36.136580+0000","last_undegraded":"2024-05-08T09:23:36.136580+0000","last_fullsized":"2024-05-08T09:23:36.136580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:43.140389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000175+0000","last_change":"2024-05-08T09:21:36.964285+0000","last_active":"2024-05-08T09:22:16.000175+0000","last_peered":"2024-05-08T09:22:16.000175+0000","last_clean":"2024-05-08T09:22:16.000175+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:22:16.000175+0000","last_undegraded":"2024-05-08T09:22:16.000175+0000","last_fullsized":"2024-05-08T09:22:16.000175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:48.002782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.961449+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:37.961449+0000","last_peered":"2024-05-08T09:24:37.961449+0000","last_clean":"2024-05-08T09:24:37.961449+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:37.961449+0000","last_undegraded":"2024-05-08T09:24:37.961449+0000","last_fullsized":"2024-05-08T09:24:37.961449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066141+0000","last_change":"2024-05-08T09:21:30.946651+0000","last_active":"2024-05-08T09:22:16.066141+0000","last_peered":"2024-05-08T09:22:16.066141+0000","last_clean":"2024-05-08T09:22:16.066141+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:22:16.066141+0000","last_undegraded":"2024-05-08T09:22:16.066141+0000","last_fullsized":"2024-05-08T09:22:16.066141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915215+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:23:53.915215+0000","last_peered":"2024-05-08T09:23:53.915215+0000","last_clean":"2024-05-08T09:23:53.915215+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:23:53.915215+0000","last_undegraded":"2024-05-08T09:23:53.915215+0000","last_fullsized":"2024-05-08T09:23:53.915215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001089+0000","last_change":"2024-05-08T09:21:32.952239+0000","last_active":"2024-05-08T09:22:16.001089+0000","last_peered":"2024-05-08T09:22:16.001089+0000","last_clean":"2024-05-08T09:22:16.001089+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:22:16.001089+0000","last_undegraded":"2024-05-08T09:22:16.001089+0000","last_fullsized":"2024-05-08T09:22:16.001089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:04.920258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.117028+0000","last_change":"2024-05-08T09:21:34.964379+0000","last_active":"2024-05-08T09:23:36.117028+0000","last_peered":"2024-05-08T09:23:36.117028+0000","last_clean":"2024-05-08T09:23:36.117028+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:23:36.117028+0000","last_undegraded":"2024-05-08T09:23:36.117028+0000","last_fullsized":"2024-05-08T09:23:36.117028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:24.020955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995784+0000","last_change":"2024-05-08T09:21:36.973254+0000","last_active":"2024-05-08T09:22:15.995784+0000","last_peered":"2024-05-08T09:22:15.995784+0000","last_clean":"2024-05-08T09:22:15.995784+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:22:15.995784+0000","last_undegraded":"2024-05-08T09:22:15.995784+0000","last_fullsized":"2024-05-08T09:22:15.995784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.958667+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:22:53.958667+0000","last_peered":"2024-05-08T09:22:53.958667+0000","last_clean":"2024-05-08T09:22:53.958667+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:22:53.958667+0000","last_undegraded":"2024-05-08T09:22:53.958667+0000","last_fullsized":"2024-05-08T09:22:53.958667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:12.192786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917766+0000","last_change":"2024-05-08T09:21:30.961494+0000","last_active":"2024-05-08T09:24:03.917766+0000","last_peered":"2024-05-08T09:24:03.917766+0000","last_clean":"2024-05-08T09:24:03.917766+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:24:03.917766+0000","last_undegraded":"2024-05-08T09:24:03.917766+0000","last_fullsized":"2024-05-08T09:24:03.917766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:52.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993716+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:22:15.993716+0000","last_peered":"2024-05-08T09:22:15.993716+0000","last_clean":"2024-05-08T09:22:15.993716+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:22:15.993716+0000","last_undegraded":"2024-05-08T09:22:15.993716+0000","last_fullsized":"2024-05-08T09:22:15.993716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.006061+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:22:16.006061+0000","last_peered":"2024-05-08T09:22:16.006061+0000","last_clean":"2024-05-08T09:22:16.006061+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:22:16.006061+0000","last_undegraded":"2024-05-08T09:22:16.006061+0000","last_fullsized":"2024-05-08T09:22:16.006061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:34.942749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909160+0000","last_change":"2024-05-08T09:21:34.959330+0000","last_active":"2024-05-08T09:23:43.909160+0000","last_peered":"2024-05-08T09:23:43.909160+0000","last_clean":"2024-05-08T09:23:43.909160+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:23:43.909160+0000","last_undegraded":"2024-05-08T09:23:43.909160+0000","last_fullsized":"2024-05-08T09:23:43.909160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:34.104269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064670+0000","last_change":"2024-05-08T09:21:36.968410+0000","last_active":"2024-05-08T09:22:16.064670+0000","last_peered":"2024-05-08T09:22:16.064670+0000","last_clean":"2024-05-08T09:22:16.064670+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:22:16.064670+0000","last_undegraded":"2024-05-08T09:22:16.064670+0000","last_fullsized":"2024-05-08T09:22:16.064670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:39.210093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.297088+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.297088+0000","last_peered":"2024-05-08T09:24:38.297088+0000","last_clean":"2024-05-08T09:24:38.297088+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.297088+0000","last_undegraded":"2024-05-08T09:24:38.297088+0000","last_fullsized":"2024-05-08T09:24:38.297088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:47.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.912027+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:03.912027+0000","last_peered":"2024-05-08T09:24:03.912027+0000","last_clean":"2024-05-08T09:24:03.912027+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:03.912027+0000","last_undegraded":"2024-05-08T09:24:03.912027+0000","last_fullsized":"2024-05-08T09:24:03.912027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995871+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:22:15.995871+0000","last_peered":"2024-05-08T09:22:15.995871+0000","last_clean":"2024-05-08T09:22:15.995871+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:22:15.995871+0000","last_undegraded":"2024-05-08T09:22:15.995871+0000","last_fullsized":"2024-05-08T09:22:15.995871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:06.064996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.004778+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:22:16.004778+0000","last_peered":"2024-05-08T09:22:16.004778+0000","last_clean":"2024-05-08T09:22:16.004778+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:22:16.004778+0000","last_undegraded":"2024-05-08T09:22:16.004778+0000","last_fullsized":"2024-05-08T09:22:16.004778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:18.151465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998680+0000","last_change":"2024-05-08T09:21:34.967409+0000","last_active":"2024-05-08T09:22:15.998680+0000","last_peered":"2024-05-08T09:22:15.998680+0000","last_clean":"2024-05-08T09:22:15.998680+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:22:15.998680+0000","last_undegraded":"2024-05-08T09:22:15.998680+0000","last_fullsized":"2024-05-08T09:22:15.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:37.791645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043149+0000","last_change":"2024-05-08T09:21:36.975423+0000","last_active":"2024-05-08T09:24:38.043149+0000","last_peered":"2024-05-08T09:24:38.043149+0000","last_clean":"2024-05-08T09:24:38.043149+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:24:38.043149+0000","last_undegraded":"2024-05-08T09:24:38.043149+0000","last_fullsized":"2024-05-08T09:24:38.043149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:51.994196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.991922+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:22:15.991922+0000","last_peered":"2024-05-08T09:22:15.991922+0000","last_clean":"2024-05-08T09:22:15.991922+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:22:15.991922+0000","last_undegraded":"2024-05-08T09:22:15.991922+0000","last_fullsized":"2024-05-08T09:22:15.991922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:40.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207709+0000","last_change":"2024-05-08T09:21:30.952074+0000","last_active":"2024-05-08T09:24:38.207709+0000","last_peered":"2024-05-08T09:24:38.207709+0000","last_clean":"2024-05-08T09:24:38.207709+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:24:38.207709+0000","last_undegraded":"2024-05-08T09:24:38.207709+0000","last_fullsized":"2024-05-08T09:24:38.207709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:54.695384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916234+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:23:58.916234+0000","last_peered":"2024-05-08T09:23:58.916234+0000","last_clean":"2024-05-08T09:23:58.916234+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:23:58.916234+0000","last_undegraded":"2024-05-08T09:23:58.916234+0000","last_fullsized":"2024-05-08T09:23:58.916234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188377+0000","last_change":"2024-05-08T09:21:32.958699+0000","last_active":"2024-05-08T09:23:37.188377+0000","last_peered":"2024-05-08T09:23:37.188377+0000","last_clean":"2024-05-08T09:23:37.188377+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:23:37.188377+0000","last_undegraded":"2024-05-08T09:23:37.188377+0000","last_fullsized":"2024-05-08T09:23:37.188377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:10.206363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917019+0000","last_change":"2024-05-08T09:21:34.964625+0000","last_active":"2024-05-08T09:24:03.917019+0000","last_peered":"2024-05-08T09:24:03.917019+0000","last_clean":"2024-05-08T09:24:03.917019+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:03.917019+0000","last_undegraded":"2024-05-08T09:24:03.917019+0000","last_fullsized":"2024-05-08T09:24:03.917019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:03.907236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062486+0000","last_change":"2024-05-08T09:21:36.973685+0000","last_active":"2024-05-08T09:22:16.062486+0000","last_peered":"2024-05-08T09:22:16.062486+0000","last_clean":"2024-05-08T09:22:16.062486+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:22:16.062486+0000","last_undegraded":"2024-05-08T09:22:16.062486+0000","last_fullsized":"2024-05-08T09:22:16.062486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:41.857456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001765+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:22:16.001765+0000","last_peered":"2024-05-08T09:22:16.001765+0000","last_clean":"2024-05-08T09:22:16.001765+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:22:16.001765+0000","last_undegraded":"2024-05-08T09:22:16.001765+0000","last_fullsized":"2024-05-08T09:22:16.001765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916931+0000","last_change":"2024-05-08T09:21:30.945039+0000","last_active":"2024-05-08T09:24:03.916931+0000","last_peered":"2024-05-08T09:24:03.916931+0000","last_clean":"2024-05-08T09:24:03.916931+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:24:03.916931+0000","last_undegraded":"2024-05-08T09:24:03.916931+0000","last_fullsized":"2024-05-08T09:24:03.916931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997115+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:22:15.997115+0000","last_peered":"2024-05-08T09:22:15.997115+0000","last_clean":"2024-05-08T09:22:15.997115+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:22:15.997115+0000","last_undegraded":"2024-05-08T09:22:15.997115+0000","last_fullsized":"2024-05-08T09:22:15.997115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:05.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998814+0000","last_change":"2024-05-08T09:21:32.956273+0000","last_active":"2024-05-08T09:22:15.998814+0000","last_peered":"2024-05-08T09:22:15.998814+0000","last_clean":"2024-05-08T09:22:15.998814+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:22:15.998814+0000","last_undegraded":"2024-05-08T09:22:15.998814+0000","last_fullsized":"2024-05-08T09:22:15.998814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:53.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.108672+0000","last_change":"2024-05-08T09:21:34.962675+0000","last_active":"2024-05-08T09:23:36.108672+0000","last_peered":"2024-05-08T09:23:36.108672+0000","last_clean":"2024-05-08T09:23:36.108672+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:23:36.108672+0000","last_undegraded":"2024-05-08T09:23:36.108672+0000","last_fullsized":"2024-05-08T09:23:36.108672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:42.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992215+0000","last_change":"2024-05-08T09:21:36.975698+0000","last_active":"2024-05-08T09:22:15.992215+0000","last_peered":"2024-05-08T09:22:15.992215+0000","last_clean":"2024-05-08T09:22:15.992215+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:22:15.992215+0000","last_undegraded":"2024-05-08T09:22:15.992215+0000","last_fullsized":"2024-05-08T09:22:15.992215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:22:04.192857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998833+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:22:15.998833+0000","last_peered":"2024-05-08T09:22:15.998833+0000","last_clean":"2024-05-08T09:22:15.998833+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:22:15.998833+0000","last_undegraded":"2024-05-08T09:22:15.998833+0000","last_fullsized":"2024-05-08T09:22:15.998833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:22:09.958023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994056+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:22:15.994056+0000","last_peered":"2024-05-08T09:22:15.994056+0000","last_clean":"2024-05-08T09:22:15.994056+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:22:15.994056+0000","last_undegraded":"2024-05-08T09:22:15.994056+0000","last_fullsized":"2024-05-08T09:22:15.994056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065163+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:22:16.065163+0000","last_peered":"2024-05-08T09:22:16.065163+0000","last_clean":"2024-05-08T09:22:16.065163+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:22:16.065163+0000","last_undegraded":"2024-05-08T09:22:16.065163+0000","last_fullsized":"2024-05-08T09:22:16.065163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:29.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993524+0000","last_change":"2024-05-08T09:21:32.952670+0000","last_active":"2024-05-08T09:22:15.993524+0000","last_peered":"2024-05-08T09:22:15.993524+0000","last_clean":"2024-05-08T09:22:15.993524+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:22:15.993524+0000","last_undegraded":"2024-05-08T09:22:15.993524+0000","last_fullsized":"2024-05-08T09:22:15.993524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:58.990094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.132233+0000","last_change":"2024-05-08T09:21:34.964514+0000","last_active":"2024-05-08T09:23:36.132233+0000","last_peered":"2024-05-08T09:23:36.132233+0000","last_clean":"2024-05-08T09:23:36.132233+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:23:36.132233+0000","last_undegraded":"2024-05-08T09:23:36.132233+0000","last_fullsized":"2024-05-08T09:23:36.132233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:12.788058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995586+0000","last_change":"2024-05-08T09:21:36.978806+0000","last_active":"2024-05-08T09:22:15.995586+0000","last_peered":"2024-05-08T09:22:15.995586+0000","last_clean":"2024-05-08T09:22:15.995586+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:22:15.995586+0000","last_undegraded":"2024-05-08T09:22:15.995586+0000","last_fullsized":"2024-05-08T09:22:15.995586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:58.108416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.141999+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:23:36.141999+0000","last_peered":"2024-05-08T09:23:36.141999+0000","last_clean":"2024-05-08T09:23:36.141999+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:23:36.141999+0000","last_undegraded":"2024-05-08T09:23:36.141999+0000","last_fullsized":"2024-05-08T09:23:36.141999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:58.409814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241173+0000","last_change":"2024-05-08T09:21:30.945358+0000","last_active":"2024-05-08T09:24:38.241173+0000","last_peered":"2024-05-08T09:24:38.241173+0000","last_clean":"2024-05-08T09:24:38.241173+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:24:38.241173+0000","last_undegraded":"2024-05-08T09:24:38.241173+0000","last_fullsized":"2024-05-08T09:24:38.241173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:35.493172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001565+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:22:16.001565+0000","last_peered":"2024-05-08T09:22:16.001565+0000","last_clean":"2024-05-08T09:22:16.001565+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:22:16.001565+0000","last_undegraded":"2024-05-08T09:22:16.001565+0000","last_fullsized":"2024-05-08T09:22:16.001565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:34.803032+0000","last_change":"2024-05-08T09:21:32.956974+0000","last_active":"2024-05-08T09:23:34.803032+0000","last_peered":"2024-05-08T09:23:34.803032+0000","last_clean":"2024-05-08T09:23:34.803032+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:23:34.803032+0000","last_undegraded":"2024-05-08T09:23:34.803032+0000","last_fullsized":"2024-05-08T09:23:34.803032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:38.938823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.561424+0000","last_change":"2024-05-08T09:21:34.965967+0000","last_active":"2024-05-08T09:24:37.561424+0000","last_peered":"2024-05-08T09:24:37.561424+0000","last_clean":"2024-05-08T09:24:37.561424+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:24:37.561424+0000","last_undegraded":"2024-05-08T09:24:37.561424+0000","last_fullsized":"2024-05-08T09:24:37.561424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:50.441262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063598+0000","last_change":"2024-05-08T09:21:36.973796+0000","last_active":"2024-05-08T09:22:16.063598+0000","last_peered":"2024-05-08T09:22:16.063598+0000","last_clean":"2024-05-08T09:22:16.063598+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:22:16.063598+0000","last_undegraded":"2024-05-08T09:22:16.063598+0000","last_fullsized":"2024-05-08T09:22:16.063598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.144572+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:36.144572+0000","last_peered":"2024-05-08T09:23:36.144572+0000","last_clean":"2024-05-08T09:23:36.144572+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:36.144572+0000","last_undegraded":"2024-05-08T09:23:36.144572+0000","last_fullsized":"2024-05-08T09:23:36.144572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:33.860320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210108+0000","last_change":"2024-05-08T09:21:30.954737+0000","last_active":"2024-05-08T09:24:38.210108+0000","last_peered":"2024-05-08T09:24:38.210108+0000","last_clean":"2024-05-08T09:24:38.210108+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:24:38.210108+0000","last_undegraded":"2024-05-08T09:24:38.210108+0000","last_fullsized":"2024-05-08T09:24:38.210108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:33.918459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993499+0000","last_change":"2024-05-08T09:21:28.974311+0000","last_active":"2024-05-08T09:22:15.993499+0000","last_peered":"2024-05-08T09:22:15.993499+0000","last_clean":"2024-05-08T09:22:15.993499+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:22:15.993499+0000","last_undegraded":"2024-05-08T09:22:15.993499+0000","last_fullsized":"2024-05-08T09:22:15.993499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030984+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.030984+0000","last_peered":"2024-05-08T09:24:38.030984+0000","last_clean":"2024-05-08T09:24:38.030984+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.030984+0000","last_undegraded":"2024-05-08T09:24:38.030984+0000","last_fullsized":"2024-05-08T09:24:38.030984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062507+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:22:16.062507+0000","last_peered":"2024-05-08T09:22:16.062507+0000","last_clean":"2024-05-08T09:22:16.062507+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:22:16.062507+0000","last_undegraded":"2024-05-08T09:22:16.062507+0000","last_fullsized":"2024-05-08T09:22:16.062507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996972+0000","last_change":"2024-05-08T09:21:30.961138+0000","last_active":"2024-05-08T09:22:15.996972+0000","last_peered":"2024-05-08T09:22:15.996972+0000","last_clean":"2024-05-08T09:22:15.996972+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:22:15.996972+0000","last_undegraded":"2024-05-08T09:22:15.996972+0000","last_fullsized":"2024-05-08T09:22:15.996972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:41.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996550+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:22:15.996550+0000","last_peered":"2024-05-08T09:22:15.996550+0000","last_clean":"2024-05-08T09:22:15.996550+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:22:15.996550+0000","last_undegraded":"2024-05-08T09:22:15.996550+0000","last_fullsized":"2024-05-08T09:22:15.996550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:32.580301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241017+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.241017+0000","last_peered":"2024-05-08T09:24:38.241017+0000","last_clean":"2024-05-08T09:24:38.241017+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.241017+0000","last_undegraded":"2024-05-08T09:24:38.241017+0000","last_fullsized":"2024-05-08T09:24:38.241017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064366+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:22:16.064366+0000","last_peered":"2024-05-08T09:22:16.064366+0000","last_clean":"2024-05-08T09:22:16.064366+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:22:16.064366+0000","last_undegraded":"2024-05-08T09:22:16.064366+0000","last_fullsized":"2024-05-08T09:22:16.064366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.943767+0000","last_change":"2024-05-08T09:21:30.953450+0000","last_active":"2024-05-08T09:24:37.943767+0000","last_peered":"2024-05-08T09:24:37.943767+0000","last_clean":"2024-05-08T09:24:37.943767+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:24:37.943767+0000","last_undegraded":"2024-05-08T09:24:37.943767+0000","last_fullsized":"2024-05-08T09:24:37.943767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066265+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:22:16.066265+0000","last_peered":"2024-05-08T09:22:16.066265+0000","last_clean":"2024-05-08T09:22:16.066265+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:22:16.066265+0000","last_undegraded":"2024-05-08T09:22:16.066265+0000","last_fullsized":"2024-05-08T09:22:16.066265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240952+0000","last_change":"2024-05-08T09:21:30.954588+0000","last_active":"2024-05-08T09:24:38.240952+0000","last_peered":"2024-05-08T09:24:38.240952+0000","last_clean":"2024-05-08T09:24:38.240952+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:24:38.240952+0000","last_undegraded":"2024-05-08T09:24:38.240952+0000","last_fullsized":"2024-05-08T09:24:38.240952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997994+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:22:15.997994+0000","last_peered":"2024-05-08T09:22:15.997994+0000","last_clean":"2024-05-08T09:22:15.997994+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:22:15.997994+0000","last_undegraded":"2024-05-08T09:22:15.997994+0000","last_fullsized":"2024-05-08T09:22:15.997994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166509+0000","last_change":"2024-05-08T09:21:30.943875+0000","last_active":"2024-05-08T09:24:38.166509+0000","last_peered":"2024-05-08T09:24:38.166509+0000","last_clean":"2024-05-08T09:24:38.166509+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:24:38.166509+0000","last_undegraded":"2024-05-08T09:24:38.166509+0000","last_fullsized":"2024-05-08T09:24:38.166509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000230+0000","last_change":"2024-05-08T09:21:28.974367+0000","last_active":"2024-05-08T09:22:16.000230+0000","last_peered":"2024-05-08T09:22:16.000230+0000","last_clean":"2024-05-08T09:22:16.000230+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:22:16.000230+0000","last_undegraded":"2024-05-08T09:22:16.000230+0000","last_fullsized":"2024-05-08T09:22:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.172965+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.172965+0000","last_peered":"2024-05-08T09:24:38.172965+0000","last_clean":"2024-05-08T09:24:38.172965+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.172965+0000","last_undegraded":"2024-05-08T09:24:38.172965+0000","last_fullsized":"2024-05-08T09:24:38.172965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:01:34.087796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065749+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:22:16.065749+0000","last_peered":"2024-05-08T09:22:16.065749+0000","last_clean":"2024-05-08T09:22:16.065749+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:22:16.065749+0000","last_undegraded":"2024-05-08T09:22:16.065749+0000","last_fullsized":"2024-05-08T09:22:16.065749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031074+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.031074+0000","last_peered":"2024-05-08T09:24:38.031074+0000","last_clean":"2024-05-08T09:24:38.031074+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.031074+0000","last_undegraded":"2024-05-08T09:24:38.031074+0000","last_fullsized":"2024-05-08T09:24:38.031074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:02.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.492136+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:37.492136+0000","last_peered":"2024-05-08T09:23:37.492136+0000","last_clean":"2024-05-08T09:23:37.492136+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:37.492136+0000","last_undegraded":"2024-05-08T09:23:37.492136+0000","last_fullsized":"2024-05-08T09:23:37.492136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:50.421255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961979+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:22:53.961979+0000","last_peered":"2024-05-08T09:22:53.961979+0000","last_clean":"2024-05-08T09:22:53.961979+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:22:53.961979+0000","last_undegraded":"2024-05-08T09:22:53.961979+0000","last_fullsized":"2024-05-08T09:22:53.961979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:25.908775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062758+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:22:16.062758+0000","last_peered":"2024-05-08T09:22:16.062758+0000","last_clean":"2024-05-08T09:22:16.062758+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:22:16.062758+0000","last_undegraded":"2024-05-08T09:22:16.062758+0000","last_fullsized":"2024-05-08T09:22:16.062758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065639+0000","last_change":"2024-05-08T09:21:30.953222+0000","last_active":"2024-05-08T09:22:16.065639+0000","last_peered":"2024-05-08T09:22:16.065639+0000","last_clean":"2024-05-08T09:22:16.065639+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:22:16.065639+0000","last_undegraded":"2024-05-08T09:22:16.065639+0000","last_fullsized":"2024-05-08T09:22:16.065639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:24.666609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913638+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:23:43.913638+0000","last_peered":"2024-05-08T09:23:43.913638+0000","last_clean":"2024-05-08T09:23:43.913638+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:23:43.913638+0000","last_undegraded":"2024-05-08T09:23:43.913638+0000","last_fullsized":"2024-05-08T09:23:43.913638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:58:40.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218043+0000","last_change":"2024-05-08T09:21:30.943497+0000","last_active":"2024-05-08T09:24:38.218043+0000","last_peered":"2024-05-08T09:24:38.218043+0000","last_clean":"2024-05-08T09:24:38.218043+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:24:38.218043+0000","last_undegraded":"2024-05-08T09:24:38.218043+0000","last_fullsized":"2024-05-08T09:24:38.218043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:59.730012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.925923+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.925923+0000","last_peered":"2024-05-08T09:24:37.925923+0000","last_clean":"2024-05-08T09:24:37.925923+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.925923+0000","last_undegraded":"2024-05-08T09:24:37.925923+0000","last_fullsized":"2024-05-08T09:24:37.925923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207990+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.207990+0000","last_peered":"2024-05-08T09:24:38.207990+0000","last_clean":"2024-05-08T09:24:38.207990+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.207990+0000","last_undegraded":"2024-05-08T09:24:38.207990+0000","last_fullsized":"2024-05-08T09:24:38.207990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:10:35.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998089+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:22:15.998089+0000","last_peered":"2024-05-08T09:22:15.998089+0000","last_clean":"2024-05-08T09:22:15.998089+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:22:15.998089+0000","last_undegraded":"2024-05-08T09:22:15.998089+0000","last_fullsized":"2024-05-08T09:22:15.998089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:04.866945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031169+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.031169+0000","last_peered":"2024-05-08T09:24:38.031169+0000","last_clean":"2024-05-08T09:24:38.031169+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.031169+0000","last_undegraded":"2024-05-08T09:24:38.031169+0000","last_fullsized":"2024-05-08T09:24:38.031169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914130+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:23:43.914130+0000","last_peered":"2024-05-08T09:23:43.914130+0000","last_clean":"2024-05-08T09:23:43.914130+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:23:43.914130+0000","last_undegraded":"2024-05-08T09:23:43.914130+0000","last_fullsized":"2024-05-08T09:23:43.914130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:30.030761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542031+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:37.542031+0000","last_peered":"2024-05-08T09:23:37.542031+0000","last_clean":"2024-05-08T09:23:37.542031+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:37.542031+0000","last_undegraded":"2024-05-08T09:23:37.542031+0000","last_fullsized":"2024-05-08T09:23:37.542031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:36.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158434+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.158434+0000","last_peered":"2024-05-08T09:24:38.158434+0000","last_clean":"2024-05-08T09:24:38.158434+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.158434+0000","last_undegraded":"2024-05-08T09:24:38.158434+0000","last_fullsized":"2024-05-08T09:24:38.158434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166918+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.166918+0000","last_peered":"2024-05-08T09:24:38.166918+0000","last_clean":"2024-05-08T09:24:38.166918+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.166918+0000","last_undegraded":"2024-05-08T09:24:38.166918+0000","last_fullsized":"2024-05-08T09:24:38.166918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:00.681814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998902+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:22:15.998902+0000","last_peered":"2024-05-08T09:22:15.998902+0000","last_clean":"2024-05-08T09:22:15.998902+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:22:15.998902+0000","last_undegraded":"2024-05-08T09:22:15.998902+0000","last_fullsized":"2024-05-08T09:22:15.998902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:39.136609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155448+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.155448+0000","last_peered":"2024-05-08T09:24:38.155448+0000","last_clean":"2024-05-08T09:24:38.155448+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.155448+0000","last_undegraded":"2024-05-08T09:24:38.155448+0000","last_fullsized":"2024-05-08T09:24:38.155448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066842+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:22:16.066842+0000","last_peered":"2024-05-08T09:22:16.066842+0000","last_clean":"2024-05-08T09:22:16.066842+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:22:16.066842+0000","last_undegraded":"2024-05-08T09:22:16.066842+0000","last_fullsized":"2024-05-08T09:22:16.066842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062889+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:22:16.062889+0000","last_peered":"2024-05-08T09:22:16.062889+0000","last_clean":"2024-05-08T09:22:16.062889+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:22:16.062889+0000","last_undegraded":"2024-05-08T09:22:16.062889+0000","last_fullsized":"2024-05-08T09:22:16.062889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218152+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.218152+0000","last_peered":"2024-05-08T09:24:38.218152+0000","last_clean":"2024-05-08T09:24:38.218152+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.218152+0000","last_undegraded":"2024-05-08T09:24:38.218152+0000","last_fullsized":"2024-05-08T09:24:38.218152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44680,"kb_used_data":9344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327160,"statfs":{"total":96636764160,"available":96591011840,"internally_reserved":0,"allocated":9568256,"data_stored":9328984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44716,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327124,"statfs":{"total":96636764160,"available":96590974976,"internally_reserved":0,"allocated":9605120,"data_stored":9331170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8743023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:24:45.668 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-08T09:24:45.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.798+0000 7fbba30ac640 1 Processor -- start 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.798+0000 7fbba30ac640 1 -- start start 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbba30ac640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c0700c0 0x7fbb9c1339a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbba30ac640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c070620 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbba30ac640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9c0720d0 con 0x7fbb9c0700c0 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbb9bfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb9c0700c0 0x7fbb9c1339a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbba0e48640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb9c06f5d0 0x7fbb9c06f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46560/0 (socket says 172.21.15.45:46560) 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbba0e48640 1 -- 172.21.15.45:0/1789868759 learned_addr learned my addr 172.21.15.45:0/1789868759 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbb9bfff640 1 -- 172.21.15.45:0/1789868759 >> v1:172.21.15.45:6789/0 conn(0x7fbb9c06f5d0 legacy=0x7fbb9c06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbb9b7fe640 1 -- 172.21.15.45:0/1789868759 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 62758300 0 0) 0x7fbb9c070620 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.799+0000 7fbb9bfff640 1 -- 172.21.15.45:0/1789868759 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c09d7b0 con 0x7fbb9c0700c0 2024-05-08T09:24:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.800+0000 7fbb9bfff640 1 --2- 172.21.15.45:0/1789868759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0700c0 0x7fbb9c1339a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009720 tx=0x7fbb8802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26379c6b011ea26e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.800+0000 7fbb9b7fe640 1 -- 172.21.15.45:0/1789868759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb880316d0 con 0x7fbb9c0700c0 2024-05-08T09:24:45.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.800+0000 7fbb9b7fe640 1 -- 172.21.15.45:0/1789868759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88037070 con 0x7fbb9c0700c0 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.800+0000 7fbb9b7fe640 1 -- 172.21.15.45:0/1789868759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb880319c0 con 0x7fbb9c0700c0 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 -- 172.21.15.45:0/1789868759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0700c0 msgr2=0x7fbb9c1339a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 --2- 172.21.15.45:0/1789868759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0700c0 0x7fbb9c1339a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009720 tx=0x7fbb8802b840 comp rx=0 tx=0).stop 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 -- 172.21.15.45:0/1789868759 shutdown_connections 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 --2- 172.21.15.45:0/1789868759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c0700c0 0x7fbb9c1339a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 -- 172.21.15.45:0/1789868759 >> 172.21.15.45:0/1789868759 conn(0x7fbb9c09e9b0 msgr2=0x7fbb9c09ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 -- 172.21.15.45:0/1789868759 shutdown_connections 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.801+0000 7fbba30ac640 1 -- 172.21.15.45:0/1789868759 wait complete. 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba30ac640 1 Processor -- start 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba30ac640 1 -- start start 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba30ac640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba30ac640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c133ee0 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba0e48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba0e48640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46058/0 (socket says 172.21.15.45:46058) 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.802+0000 7fbba0e48640 1 -- 172.21.15.45:0/3763561233 learned_addr learned my addr 172.21.15.45:0/3763561233 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbba0e48640 1 -- 172.21.15.45:0/3763561233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c121d90 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbba0e48640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c420 tx=0x7fbb9000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb90018070 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb900074d0 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c1227e0 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbb90004950 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.803+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c130160 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.804+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbb9001b070 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.804+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c062e90 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.804+0000 7fbb997fa640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 0x7fbb8003a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:45.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.804+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbb9004ae10 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.804+0000 7fbb9bfff640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 0x7fbb8003a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:45.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.805+0000 7fbb9bfff640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 0x7fbb8003a4d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb88036000 tx=0x7fbb88008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:45.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.809+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbb90011950 con 0x7fbb9c06f5d0 2024-05-08T09:24:45.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:45.986+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb9c1216b0 con 0x7fbb80038010 2024-05-08T09:24:46.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.001+0000 7fbb997fa640 1 -- 172.21.15.45:0/3763561233 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665914 (secure 0 0 0) 0x7fbb88037040 con 0x7fbb80038010 2024-05-08T09:24:46.008 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:24:46.014 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 msgr2=0x7fbb8003a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 0x7fbb8003a4d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbb88036000 tx=0x7fbb88008030 comp rx=0 tx=0).stop 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 msgr2=0x7fbb9c12fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fbb9000c420 tx=0x7fbb9000c8e0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 shutdown_connections 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbb80038010 0x7fbb8003a4d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 --2- 172.21.15.45:0/3763561233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9c06f5d0 0x7fbb9c12fa40 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 >> 172.21.15.45:0/3763561233 conn(0x7fbb9c09e9b0 msgr2=0x7fbb9c118c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 shutdown_connections 2024-05-08T09:24:46.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.006+0000 7fbba30ac640 1 -- 172.21.15.45:0/3763561233 wait complete. 2024-05-08T09:24:46.018 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2024-05-08T09:24:44.893774+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4884,"num_read_kb":4461,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001076+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:22:16.001076+0000","last_peered":"2024-05-08T09:22:16.001076+0000","last_clean":"2024-05-08T09:22:16.001076+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:22:16.001076+0000","last_undegraded":"2024-05-08T09:22:16.001076+0000","last_fullsized":"2024-05-08T09:22:16.001076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916991+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:03.916991+0000","last_peered":"2024-05-08T09:24:03.916991+0000","last_clean":"2024-05-08T09:24:03.916991+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:03.916991+0000","last_undegraded":"2024-05-08T09:24:03.916991+0000","last_fullsized":"2024-05-08T09:24:03.916991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:23.115981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.375414+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.375414+0000","last_peered":"2024-05-08T09:23:37.375414+0000","last_clean":"2024-05-08T09:23:37.375414+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.375414+0000","last_undegraded":"2024-05-08T09:23:37.375414+0000","last_fullsized":"2024-05-08T09:23:37.375414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:09.233706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166680+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.166680+0000","last_peered":"2024-05-08T09:24:38.166680+0000","last_clean":"2024-05-08T09:24:38.166680+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.166680+0000","last_undegraded":"2024-05-08T09:24:38.166680+0000","last_fullsized":"2024-05-08T09:24:38.166680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:08.198970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997644+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:22:15.997644+0000","last_peered":"2024-05-08T09:22:15.997644+0000","last_clean":"2024-05-08T09:22:15.997644+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:22:15.997644+0000","last_undegraded":"2024-05-08T09:22:15.997644+0000","last_fullsized":"2024-05-08T09:22:15.997644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:15.219028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961300+0000","last_change":"2024-05-08T09:21:30.959732+0000","last_active":"2024-05-08T09:22:53.961300+0000","last_peered":"2024-05-08T09:22:53.961300+0000","last_clean":"2024-05-08T09:22:53.961300+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:22:53.961300+0000","last_undegraded":"2024-05-08T09:22:53.961300+0000","last_fullsized":"2024-05-08T09:22:53.961300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:51.106660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000563+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:22:16.000563+0000","last_peered":"2024-05-08T09:22:16.000563+0000","last_clean":"2024-05-08T09:22:16.000563+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:22:16.000563+0000","last_undegraded":"2024-05-08T09:22:16.000563+0000","last_fullsized":"2024-05-08T09:22:16.000563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944601+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.944601+0000","last_peered":"2024-05-08T09:24:37.944601+0000","last_clean":"2024-05-08T09:24:37.944601+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.944601+0000","last_undegraded":"2024-05-08T09:24:37.944601+0000","last_fullsized":"2024-05-08T09:24:37.944601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:05.452991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996051+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:22:15.996051+0000","last_peered":"2024-05-08T09:22:15.996051+0000","last_clean":"2024-05-08T09:22:15.996051+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:22:15.996051+0000","last_undegraded":"2024-05-08T09:22:15.996051+0000","last_fullsized":"2024-05-08T09:22:15.996051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:33.486446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030810+0000","last_change":"2024-05-08T09:21:30.942925+0000","last_active":"2024-05-08T09:24:38.030810+0000","last_peered":"2024-05-08T09:24:38.030810+0000","last_clean":"2024-05-08T09:24:38.030810+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:24:38.030810+0000","last_undegraded":"2024-05-08T09:24:38.030810+0000","last_fullsized":"2024-05-08T09:24:38.030810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998378+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:22:15.998378+0000","last_peered":"2024-05-08T09:22:15.998378+0000","last_clean":"2024-05-08T09:22:15.998378+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:22:15.998378+0000","last_undegraded":"2024-05-08T09:22:15.998378+0000","last_fullsized":"2024-05-08T09:22:15.998378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.946666+0000","last_change":"2024-05-08T09:21:30.960649+0000","last_active":"2024-05-08T09:24:37.946666+0000","last_peered":"2024-05-08T09:24:37.946666+0000","last_clean":"2024-05-08T09:24:37.946666+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:24:37.946666+0000","last_undegraded":"2024-05-08T09:24:37.946666+0000","last_fullsized":"2024-05-08T09:24:37.946666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:38.405348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995105+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:22:15.995105+0000","last_peered":"2024-05-08T09:22:15.995105+0000","last_clean":"2024-05-08T09:22:15.995105+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:22:15.995105+0000","last_undegraded":"2024-05-08T09:22:15.995105+0000","last_fullsized":"2024-05-08T09:22:15.995105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:05.261094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000928+0000","last_change":"2024-05-08T09:21:30.950639+0000","last_active":"2024-05-08T09:22:16.000928+0000","last_peered":"2024-05-08T09:22:16.000928+0000","last_clean":"2024-05-08T09:22:16.000928+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:22:16.000928+0000","last_undegraded":"2024-05-08T09:22:16.000928+0000","last_fullsized":"2024-05-08T09:22:16.000928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.951539+0000","last_change":"2024-05-08T09:21:28.962227+0000","last_active":"2024-05-08T09:22:53.951539+0000","last_peered":"2024-05-08T09:22:53.951539+0000","last_clean":"2024-05-08T09:22:53.951539+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:22:53.951539+0000","last_undegraded":"2024-05-08T09:22:53.951539+0000","last_fullsized":"2024-05-08T09:22:53.951539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030974+0000","last_change":"2024-05-08T09:21:30.953880+0000","last_active":"2024-05-08T09:24:38.030974+0000","last_peered":"2024-05-08T09:24:38.030974+0000","last_clean":"2024-05-08T09:24:38.030974+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:24:38.030974+0000","last_undegraded":"2024-05-08T09:24:38.030974+0000","last_fullsized":"2024-05-08T09:24:38.030974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166447+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.166447+0000","last_peered":"2024-05-08T09:24:38.166447+0000","last_clean":"2024-05-08T09:24:38.166447+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.166447+0000","last_undegraded":"2024-05-08T09:24:38.166447+0000","last_fullsized":"2024-05-08T09:24:38.166447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:30.090468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915499+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:23:53.915499+0000","last_peered":"2024-05-08T09:23:53.915499+0000","last_clean":"2024-05-08T09:23:53.915499+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:23:53.915499+0000","last_undegraded":"2024-05-08T09:23:53.915499+0000","last_fullsized":"2024-05-08T09:23:53.915499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.772673+0000","last_change":"2024-05-08T09:21:30.945729+0000","last_active":"2024-05-08T09:22:53.772673+0000","last_peered":"2024-05-08T09:22:53.772673+0000","last_clean":"2024-05-08T09:22:53.772673+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:22:53.772673+0000","last_undegraded":"2024-05-08T09:22:53.772673+0000","last_fullsized":"2024-05-08T09:22:53.772673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000634+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:22:16.000634+0000","last_peered":"2024-05-08T09:22:16.000634+0000","last_clean":"2024-05-08T09:22:16.000634+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:22:16.000634+0000","last_undegraded":"2024-05-08T09:22:16.000634+0000","last_fullsized":"2024-05-08T09:22:16.000634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.770379+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:22:53.770379+0000","last_peered":"2024-05-08T09:22:53.770379+0000","last_clean":"2024-05-08T09:22:53.770379+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:22:53.770379+0000","last_undegraded":"2024-05-08T09:22:53.770379+0000","last_fullsized":"2024-05-08T09:22:53.770379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.519313+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:37.519313+0000","last_peered":"2024-05-08T09:23:37.519313+0000","last_clean":"2024-05-08T09:23:37.519313+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:37.519313+0000","last_undegraded":"2024-05-08T09:23:37.519313+0000","last_fullsized":"2024-05-08T09:23:37.519313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542123+0000","last_change":"2024-05-08T09:21:30.955095+0000","last_active":"2024-05-08T09:23:37.542123+0000","last_peered":"2024-05-08T09:23:37.542123+0000","last_clean":"2024-05-08T09:23:37.542123+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:23:37.542123+0000","last_undegraded":"2024-05-08T09:23:37.542123+0000","last_fullsized":"2024-05-08T09:23:37.542123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.760684+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:22:53.760684+0000","last_peered":"2024-05-08T09:22:53.760684+0000","last_clean":"2024-05-08T09:22:53.760684+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:22:53.760684+0000","last_undegraded":"2024-05-08T09:22:53.760684+0000","last_fullsized":"2024-05-08T09:22:53.760684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241110+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.241110+0000","last_peered":"2024-05-08T09:24:38.241110+0000","last_clean":"2024-05-08T09:24:38.241110+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.241110+0000","last_undegraded":"2024-05-08T09:24:38.241110+0000","last_fullsized":"2024-05-08T09:24:38.241110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064683+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:22:16.064683+0000","last_peered":"2024-05-08T09:22:16.064683+0000","last_clean":"2024-05-08T09:22:16.064683+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:22:16.064683+0000","last_undegraded":"2024-05-08T09:22:16.064683+0000","last_fullsized":"2024-05-08T09:22:16.064683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031836+0000","last_change":"2024-05-08T09:21:30.941566+0000","last_active":"2024-05-08T09:24:38.031836+0000","last_peered":"2024-05-08T09:24:38.031836+0000","last_clean":"2024-05-08T09:24:38.031836+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:24:38.031836+0000","last_undegraded":"2024-05-08T09:24:38.031836+0000","last_fullsized":"2024-05-08T09:24:38.031836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:22.230967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996884+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:22:15.996884+0000","last_peered":"2024-05-08T09:22:15.996884+0000","last_clean":"2024-05-08T09:22:15.996884+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:22:15.996884+0000","last_undegraded":"2024-05-08T09:22:15.996884+0000","last_fullsized":"2024-05-08T09:22:15.996884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:06.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.187676+0000","last_change":"2024-05-08T09:21:38.981335+0000","last_active":"2024-05-08T09:24:38.187676+0000","last_peered":"2024-05-08T09:24:38.187676+0000","last_clean":"2024-05-08T09:24:38.187676+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:24:38.187676+0000","last_undegraded":"2024-05-08T09:24:38.187676+0000","last_fullsized":"2024-05-08T09:24:38.187676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:10.950358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218288+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218288+0000","last_peered":"2024-05-08T09:24:38.218288+0000","last_clean":"2024-05-08T09:24:38.218288+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218288+0000","last_undegraded":"2024-05-08T09:24:38.218288+0000","last_fullsized":"2024-05-08T09:24:38.218288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:11.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151832+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.151832+0000","last_peered":"2024-05-08T09:24:38.151832+0000","last_clean":"2024-05-08T09:24:38.151832+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.151832+0000","last_undegraded":"2024-05-08T09:24:38.151832+0000","last_fullsized":"2024-05-08T09:24:38.151832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:46.927060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996807+0000","last_change":"2024-05-08T09:21:32.954624+0000","last_active":"2024-05-08T09:22:15.996807+0000","last_peered":"2024-05-08T09:22:15.996807+0000","last_clean":"2024-05-08T09:22:15.996807+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:22:15.996807+0000","last_undegraded":"2024-05-08T09:22:15.996807+0000","last_fullsized":"2024-05-08T09:22:15.996807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:12.055591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.125390+0000","last_change":"2024-05-08T09:21:34.968612+0000","last_active":"2024-05-08T09:23:36.125390+0000","last_peered":"2024-05-08T09:23:36.125390+0000","last_clean":"2024-05-08T09:23:36.125390+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:23:36.125390+0000","last_undegraded":"2024-05-08T09:23:36.125390+0000","last_fullsized":"2024-05-08T09:23:36.125390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:14.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001471+0000","last_change":"2024-05-08T09:21:36.977259+0000","last_active":"2024-05-08T09:22:16.001471+0000","last_peered":"2024-05-08T09:22:16.001471+0000","last_clean":"2024-05-08T09:22:16.001471+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:22:16.001471+0000","last_undegraded":"2024-05-08T09:22:16.001471+0000","last_fullsized":"2024-05-08T09:22:16.001471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.780267+0000","last_change":"2024-05-08T09:21:38.984125+0000","last_active":"2024-05-08T09:22:53.780267+0000","last_peered":"2024-05-08T09:22:53.780267+0000","last_clean":"2024-05-08T09:22:53.780267+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:22:53.780267+0000","last_undegraded":"2024-05-08T09:22:53.780267+0000","last_fullsized":"2024-05-08T09:22:53.780267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240957+0000","last_change":"2024-05-08T09:21:30.961147+0000","last_active":"2024-05-08T09:24:38.240957+0000","last_peered":"2024-05-08T09:24:38.240957+0000","last_clean":"2024-05-08T09:24:38.240957+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:24:38.240957+0000","last_undegraded":"2024-05-08T09:24:38.240957+0000","last_fullsized":"2024-05-08T09:24:38.240957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:21.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998085+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:22:15.998085+0000","last_peered":"2024-05-08T09:22:15.998085+0000","last_clean":"2024-05-08T09:22:15.998085+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:22:15.998085+0000","last_undegraded":"2024-05-08T09:22:15.998085+0000","last_fullsized":"2024-05-08T09:22:15.998085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065092+0000","last_change":"2024-05-08T09:21:32.957525+0000","last_active":"2024-05-08T09:22:16.065092+0000","last_peered":"2024-05-08T09:22:16.065092+0000","last_clean":"2024-05-08T09:22:16.065092+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:22:16.065092+0000","last_undegraded":"2024-05-08T09:22:16.065092+0000","last_fullsized":"2024-05-08T09:22:16.065092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:36.828402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.963076+0000","last_change":"2024-05-08T09:21:34.968421+0000","last_active":"2024-05-08T09:22:53.963076+0000","last_peered":"2024-05-08T09:22:53.963076+0000","last_clean":"2024-05-08T09:22:53.963076+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:22:53.963076+0000","last_undegraded":"2024-05-08T09:22:53.963076+0000","last_fullsized":"2024-05-08T09:22:53.963076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:49.987542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999400+0000","last_change":"2024-05-08T09:21:36.971614+0000","last_active":"2024-05-08T09:22:15.999400+0000","last_peered":"2024-05-08T09:22:15.999400+0000","last_clean":"2024-05-08T09:22:15.999400+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:22:15.999400+0000","last_undegraded":"2024-05-08T09:22:15.999400+0000","last_fullsized":"2024-05-08T09:22:15.999400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062726+0000","last_change":"2024-05-08T09:21:38.971525+0000","last_active":"2024-05-08T09:22:16.062726+0000","last_peered":"2024-05-08T09:22:16.062726+0000","last_clean":"2024-05-08T09:22:16.062726+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:22:16.062726+0000","last_undegraded":"2024-05-08T09:22:16.062726+0000","last_fullsized":"2024-05-08T09:22:16.062726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.209901+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.209901+0000","last_peered":"2024-05-08T09:24:38.209901+0000","last_clean":"2024-05-08T09:24:38.209901+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.209901+0000","last_undegraded":"2024-05-08T09:24:38.209901+0000","last_fullsized":"2024-05-08T09:24:38.209901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:39.126588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993965+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:22:15.993965+0000","last_peered":"2024-05-08T09:22:15.993965+0000","last_clean":"2024-05-08T09:22:15.993965+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:22:15.993965+0000","last_undegraded":"2024-05-08T09:22:15.993965+0000","last_fullsized":"2024-05-08T09:22:15.993965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:01.393034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:18.900511+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:22:18.900511+0000","last_peered":"2024-05-08T09:22:18.900511+0000","last_clean":"2024-05-08T09:22:18.900511+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:22:18.900511+0000","last_undegraded":"2024-05-08T09:22:18.900511+0000","last_fullsized":"2024-05-08T09:22:18.900511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:52.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000357+0000","last_change":"2024-05-08T09:21:34.970071+0000","last_active":"2024-05-08T09:22:16.000357+0000","last_peered":"2024-05-08T09:22:16.000357+0000","last_clean":"2024-05-08T09:22:16.000357+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:22:16.000357+0000","last_undegraded":"2024-05-08T09:22:16.000357+0000","last_fullsized":"2024-05-08T09:22:16.000357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:24.049898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043550+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:38.043550+0000","last_peered":"2024-05-08T09:24:38.043550+0000","last_clean":"2024-05-08T09:24:38.043550+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:38.043550+0000","last_undegraded":"2024-05-08T09:24:38.043550+0000","last_fullsized":"2024-05-08T09:24:38.043550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:20.146454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993615+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:22:15.993615+0000","last_peered":"2024-05-08T09:22:15.993615+0000","last_clean":"2024-05-08T09:22:15.993615+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:22:15.993615+0000","last_undegraded":"2024-05-08T09:22:15.993615+0000","last_fullsized":"2024-05-08T09:22:15.993615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:43.864633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240927+0000","last_change":"2024-05-08T09:21:30.943637+0000","last_active":"2024-05-08T09:24:38.240927+0000","last_peered":"2024-05-08T09:24:38.240927+0000","last_clean":"2024-05-08T09:24:38.240927+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:24:38.240927+0000","last_undegraded":"2024-05-08T09:24:38.240927+0000","last_fullsized":"2024-05-08T09:24:38.240927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914364+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:23:48.914364+0000","last_peered":"2024-05-08T09:23:48.914364+0000","last_clean":"2024-05-08T09:23:48.914364+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:23:48.914364+0000","last_undegraded":"2024-05-08T09:23:48.914364+0000","last_fullsized":"2024-05-08T09:23:48.914364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:46.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997524+0000","last_change":"2024-05-08T09:21:32.954018+0000","last_active":"2024-05-08T09:22:15.997524+0000","last_peered":"2024-05-08T09:22:15.997524+0000","last_clean":"2024-05-08T09:22:15.997524+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:22:15.997524+0000","last_undegraded":"2024-05-08T09:22:15.997524+0000","last_fullsized":"2024-05-08T09:22:15.997524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:47.581536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.120007+0000","last_change":"2024-05-08T09:21:34.969072+0000","last_active":"2024-05-08T09:23:36.120007+0000","last_peered":"2024-05-08T09:23:36.120007+0000","last_clean":"2024-05-08T09:23:36.120007+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:23:36.120007+0000","last_undegraded":"2024-05-08T09:23:36.120007+0000","last_fullsized":"2024-05-08T09:23:36.120007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:38.834811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.243750+0000","last_change":"2024-05-08T09:21:36.965387+0000","last_active":"2024-05-08T09:24:38.243750+0000","last_peered":"2024-05-08T09:24:38.243750+0000","last_clean":"2024-05-08T09:24:38.243750+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:38.243750+0000","last_undegraded":"2024-05-08T09:24:38.243750+0000","last_fullsized":"2024-05-08T09:24:38.243750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207965+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.207965+0000","last_peered":"2024-05-08T09:24:38.207965+0000","last_clean":"2024-05-08T09:24:38.207965+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.207965+0000","last_undegraded":"2024-05-08T09:24:38.207965+0000","last_fullsized":"2024-05-08T09:24:38.207965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:45.973741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.148771+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.148771+0000","last_peered":"2024-05-08T09:24:38.148771+0000","last_clean":"2024-05-08T09:24:38.148771+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.148771+0000","last_undegraded":"2024-05-08T09:24:38.148771+0000","last_fullsized":"2024-05-08T09:24:38.148771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993880+0000","last_change":"2024-05-08T09:21:32.958870+0000","last_active":"2024-05-08T09:22:15.993880+0000","last_peered":"2024-05-08T09:22:15.993880+0000","last_clean":"2024-05-08T09:22:15.993880+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:22:15.993880+0000","last_undegraded":"2024-05-08T09:22:15.993880+0000","last_fullsized":"2024-05-08T09:22:15.993880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:13.060641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.129369+0000","last_change":"2024-05-08T09:21:34.966604+0000","last_active":"2024-05-08T09:23:36.129369+0000","last_peered":"2024-05-08T09:23:36.129369+0000","last_clean":"2024-05-08T09:23:36.129369+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:23:36.129369+0000","last_undegraded":"2024-05-08T09:23:36.129369+0000","last_fullsized":"2024-05-08T09:23:36.129369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:14:01.043108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064548+0000","last_change":"2024-05-08T09:21:36.964833+0000","last_active":"2024-05-08T09:22:16.064548+0000","last_peered":"2024-05-08T09:22:16.064548+0000","last_clean":"2024-05-08T09:22:16.064548+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:22:16.064548+0000","last_undegraded":"2024-05-08T09:22:16.064548+0000","last_fullsized":"2024-05-08T09:22:16.064548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:51.594598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.782118+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:22:53.782118+0000","last_peered":"2024-05-08T09:22:53.782118+0000","last_clean":"2024-05-08T09:22:53.782118+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:22:53.782118+0000","last_undegraded":"2024-05-08T09:22:53.782118+0000","last_fullsized":"2024-05-08T09:22:53.782118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.051881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240991+0000","last_change":"2024-05-08T09:21:30.942033+0000","last_active":"2024-05-08T09:24:38.240991+0000","last_peered":"2024-05-08T09:24:38.240991+0000","last_clean":"2024-05-08T09:24:38.240991+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:24:38.240991+0000","last_undegraded":"2024-05-08T09:24:38.240991+0000","last_fullsized":"2024-05-08T09:24:38.240991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000003+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:22:16.000003+0000","last_peered":"2024-05-08T09:22:16.000003+0000","last_clean":"2024-05-08T09:22:16.000003+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:22:16.000003+0000","last_undegraded":"2024-05-08T09:22:16.000003+0000","last_fullsized":"2024-05-08T09:22:16.000003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063135+0000","last_change":"2024-05-08T09:21:32.956199+0000","last_active":"2024-05-08T09:22:16.063135+0000","last_peered":"2024-05-08T09:22:16.063135+0000","last_clean":"2024-05-08T09:22:16.063135+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:22:16.063135+0000","last_undegraded":"2024-05-08T09:22:16.063135+0000","last_fullsized":"2024-05-08T09:22:16.063135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:22.043489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.109617+0000","last_change":"2024-05-08T09:21:34.969113+0000","last_active":"2024-05-08T09:23:36.109617+0000","last_peered":"2024-05-08T09:23:36.109617+0000","last_clean":"2024-05-08T09:23:36.109617+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:23:36.109617+0000","last_undegraded":"2024-05-08T09:23:36.109617+0000","last_fullsized":"2024-05-08T09:23:36.109617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:18.664086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063764+0000","last_change":"2024-05-08T09:21:36.966245+0000","last_active":"2024-05-08T09:22:16.063764+0000","last_peered":"2024-05-08T09:22:16.063764+0000","last_clean":"2024-05-08T09:22:16.063764+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:22:16.063764+0000","last_undegraded":"2024-05-08T09:22:16.063764+0000","last_fullsized":"2024-05-08T09:22:16.063764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.539672+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:37.539672+0000","last_peered":"2024-05-08T09:23:37.539672+0000","last_clean":"2024-05-08T09:23:37.539672+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:37.539672+0000","last_undegraded":"2024-05-08T09:23:37.539672+0000","last_fullsized":"2024-05-08T09:23:37.539672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999146+0000","last_change":"2024-05-08T09:21:30.953247+0000","last_active":"2024-05-08T09:22:15.999146+0000","last_peered":"2024-05-08T09:22:15.999146+0000","last_clean":"2024-05-08T09:22:15.999146+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:22:15.999146+0000","last_undegraded":"2024-05-08T09:22:15.999146+0000","last_fullsized":"2024-05-08T09:22:15.999146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:03.399759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997399+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:22:15.997399+0000","last_peered":"2024-05-08T09:22:15.997399+0000","last_clean":"2024-05-08T09:22:15.997399+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:22:15.997399+0000","last_undegraded":"2024-05-08T09:22:15.997399+0000","last_fullsized":"2024-05-08T09:22:15.997399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:56.441900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063881+0000","last_change":"2024-05-08T09:21:32.957626+0000","last_active":"2024-05-08T09:22:16.063881+0000","last_peered":"2024-05-08T09:22:16.063881+0000","last_clean":"2024-05-08T09:22:16.063881+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:22:16.063881+0000","last_undegraded":"2024-05-08T09:22:16.063881+0000","last_fullsized":"2024-05-08T09:22:16.063881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:21:40.755189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914793+0000","last_change":"2024-05-08T09:21:34.962754+0000","last_active":"2024-05-08T09:23:48.914793+0000","last_peered":"2024-05-08T09:23:48.914793+0000","last_clean":"2024-05-08T09:23:48.914793+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:23:48.914793+0000","last_undegraded":"2024-05-08T09:23:48.914793+0000","last_fullsized":"2024-05-08T09:23:48.914793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:25.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.360406+0000","last_change":"2024-05-08T09:21:36.978801+0000","last_active":"2024-05-08T09:24:38.360406+0000","last_peered":"2024-05-08T09:24:38.360406+0000","last_clean":"2024-05-08T09:24:38.360406+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:24:38.360406+0000","last_undegraded":"2024-05-08T09:24:38.360406+0000","last_fullsized":"2024-05-08T09:24:38.360406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064571+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:22:16.064571+0000","last_peered":"2024-05-08T09:22:16.064571+0000","last_clean":"2024-05-08T09:22:16.064571+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:22:16.064571+0000","last_undegraded":"2024-05-08T09:22:16.064571+0000","last_fullsized":"2024-05-08T09:22:16.064571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:29.324457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998301+0000","last_change":"2024-05-08T09:21:30.951955+0000","last_active":"2024-05-08T09:22:15.998301+0000","last_peered":"2024-05-08T09:22:15.998301+0000","last_clean":"2024-05-08T09:22:15.998301+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:22:15.998301+0000","last_undegraded":"2024-05-08T09:22:15.998301+0000","last_fullsized":"2024-05-08T09:22:15.998301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:07.718728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996601+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:22:15.996601+0000","last_peered":"2024-05-08T09:22:15.996601+0000","last_clean":"2024-05-08T09:22:15.996601+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:22:15.996601+0000","last_undegraded":"2024-05-08T09:22:15.996601+0000","last_fullsized":"2024-05-08T09:22:15.996601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:06.582694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063416+0000","last_change":"2024-05-08T09:21:32.957023+0000","last_active":"2024-05-08T09:22:16.063416+0000","last_peered":"2024-05-08T09:22:16.063416+0000","last_clean":"2024-05-08T09:22:16.063416+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:22:16.063416+0000","last_undegraded":"2024-05-08T09:22:16.063416+0000","last_fullsized":"2024-05-08T09:22:16.063416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:40.029960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.133206+0000","last_change":"2024-05-08T09:21:34.966546+0000","last_active":"2024-05-08T09:23:36.133206+0000","last_peered":"2024-05-08T09:23:36.133206+0000","last_clean":"2024-05-08T09:23:36.133206+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:23:36.133206+0000","last_undegraded":"2024-05-08T09:23:36.133206+0000","last_fullsized":"2024-05-08T09:23:36.133206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:29:37.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062735+0000","last_change":"2024-05-08T09:21:36.971385+0000","last_active":"2024-05-08T09:22:16.062735+0000","last_peered":"2024-05-08T09:22:16.062735+0000","last_clean":"2024-05-08T09:22:16.062735+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:22:16.062735+0000","last_undegraded":"2024-05-08T09:22:16.062735+0000","last_fullsized":"2024-05-08T09:22:16.062735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:49.044705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.337428+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.337428+0000","last_peered":"2024-05-08T09:24:38.337428+0000","last_clean":"2024-05-08T09:24:38.337428+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.337428+0000","last_undegraded":"2024-05-08T09:24:38.337428+0000","last_fullsized":"2024-05-08T09:24:38.337428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:53.334530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166739+0000","last_change":"2024-05-08T09:21:30.955072+0000","last_active":"2024-05-08T09:24:38.166739+0000","last_peered":"2024-05-08T09:24:38.166739+0000","last_clean":"2024-05-08T09:24:38.166739+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:24:38.166739+0000","last_undegraded":"2024-05-08T09:24:38.166739+0000","last_fullsized":"2024-05-08T09:24:38.166739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064027+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:22:16.064027+0000","last_peered":"2024-05-08T09:22:16.064027+0000","last_clean":"2024-05-08T09:22:16.064027+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:22:16.064027+0000","last_undegraded":"2024-05-08T09:22:16.064027+0000","last_fullsized":"2024-05-08T09:22:16.064027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995287+0000","last_change":"2024-05-08T09:21:32.958822+0000","last_active":"2024-05-08T09:22:15.995287+0000","last_peered":"2024-05-08T09:22:15.995287+0000","last_clean":"2024-05-08T09:22:15.995287+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:22:15.995287+0000","last_undegraded":"2024-05-08T09:22:15.995287+0000","last_fullsized":"2024-05-08T09:22:15.995287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:35.925851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.113715+0000","last_change":"2024-05-08T09:21:34.965442+0000","last_active":"2024-05-08T09:23:36.113715+0000","last_peered":"2024-05-08T09:23:36.113715+0000","last_clean":"2024-05-08T09:23:36.113715+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:23:36.113715+0000","last_undegraded":"2024-05-08T09:23:36.113715+0000","last_fullsized":"2024-05-08T09:23:36.113715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:19.669692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998369+0000","last_change":"2024-05-08T09:21:36.980935+0000","last_active":"2024-05-08T09:22:15.998369+0000","last_peered":"2024-05-08T09:22:15.998369+0000","last_clean":"2024-05-08T09:22:15.998369+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:22:15.998369+0000","last_undegraded":"2024-05-08T09:22:15.998369+0000","last_fullsized":"2024-05-08T09:22:15.998369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912987+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:23:38.912987+0000","last_peered":"2024-05-08T09:23:38.912987+0000","last_clean":"2024-05-08T09:23:38.912987+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:23:38.912987+0000","last_undegraded":"2024-05-08T09:23:38.912987+0000","last_fullsized":"2024-05-08T09:23:38.912987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:30:24.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999240+0000","last_change":"2024-05-08T09:21:30.961704+0000","last_active":"2024-05-08T09:22:15.999240+0000","last_peered":"2024-05-08T09:22:15.999240+0000","last_clean":"2024-05-08T09:22:15.999240+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:22:15.999240+0000","last_undegraded":"2024-05-08T09:22:15.999240+0000","last_fullsized":"2024-05-08T09:22:15.999240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:15.655892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997331+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:22:15.997331+0000","last_peered":"2024-05-08T09:22:15.997331+0000","last_clean":"2024-05-08T09:22:15.997331+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:22:15.997331+0000","last_undegraded":"2024-05-08T09:22:15.997331+0000","last_fullsized":"2024-05-08T09:22:15.997331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:21.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.177753+0000","last_change":"2024-05-08T09:21:32.957213+0000","last_active":"2024-05-08T09:23:37.177753+0000","last_peered":"2024-05-08T09:23:37.177753+0000","last_clean":"2024-05-08T09:23:37.177753+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:23:37.177753+0000","last_undegraded":"2024-05-08T09:23:37.177753+0000","last_fullsized":"2024-05-08T09:23:37.177753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:46.321295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.139733+0000","last_change":"2024-05-08T09:21:34.958793+0000","last_active":"2024-05-08T09:23:36.139733+0000","last_peered":"2024-05-08T09:23:36.139733+0000","last_clean":"2024-05-08T09:23:36.139733+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:23:36.139733+0000","last_undegraded":"2024-05-08T09:23:36.139733+0000","last_fullsized":"2024-05-08T09:23:36.139733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:15.067049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.341387+0000","last_change":"2024-05-08T09:21:36.971576+0000","last_active":"2024-05-08T09:24:38.341387+0000","last_peered":"2024-05-08T09:24:38.341387+0000","last_clean":"2024-05-08T09:24:38.341387+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:38.341387+0000","last_undegraded":"2024-05-08T09:24:38.341387+0000","last_fullsized":"2024-05-08T09:24:38.341387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:05.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.950071+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:37.950071+0000","last_peered":"2024-05-08T09:24:37.950071+0000","last_clean":"2024-05-08T09:24:37.950071+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:37.950071+0000","last_undegraded":"2024-05-08T09:24:37.950071+0000","last_fullsized":"2024-05-08T09:24:37.950071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001229+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:22:16.001229+0000","last_peered":"2024-05-08T09:22:16.001229+0000","last_clean":"2024-05-08T09:22:16.001229+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:22:16.001229+0000","last_undegraded":"2024-05-08T09:22:16.001229+0000","last_fullsized":"2024-05-08T09:22:16.001229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995509+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:22:15.995509+0000","last_peered":"2024-05-08T09:22:15.995509+0000","last_clean":"2024-05-08T09:22:15.995509+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:22:15.995509+0000","last_undegraded":"2024-05-08T09:22:15.995509+0000","last_fullsized":"2024-05-08T09:22:15.995509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:48.376085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188113+0000","last_change":"2024-05-08T09:21:32.955025+0000","last_active":"2024-05-08T09:23:37.188113+0000","last_peered":"2024-05-08T09:23:37.188113+0000","last_clean":"2024-05-08T09:23:37.188113+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:23:37.188113+0000","last_undegraded":"2024-05-08T09:23:37.188113+0000","last_fullsized":"2024-05-08T09:23:37.188113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:48.868737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999772+0000","last_change":"2024-05-08T09:21:34.969633+0000","last_active":"2024-05-08T09:22:15.999772+0000","last_peered":"2024-05-08T09:22:15.999772+0000","last_clean":"2024-05-08T09:22:15.999772+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:22:15.999772+0000","last_undegraded":"2024-05-08T09:22:15.999772+0000","last_fullsized":"2024-05-08T09:22:15.999772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:12:38.074915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.299223+0000","last_change":"2024-05-08T09:21:36.971697+0000","last_active":"2024-05-08T09:24:38.299223+0000","last_peered":"2024-05-08T09:24:38.299223+0000","last_clean":"2024-05-08T09:24:38.299223+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:38.299223+0000","last_undegraded":"2024-05-08T09:24:38.299223+0000","last_fullsized":"2024-05-08T09:24:38.299223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.321717+0000","last_change":"2024-05-08T09:21:38.969278+0000","last_active":"2024-05-08T09:23:37.321717+0000","last_peered":"2024-05-08T09:23:37.321717+0000","last_clean":"2024-05-08T09:23:37.321717+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:23:37.321717+0000","last_undegraded":"2024-05-08T09:23:37.321717+0000","last_fullsized":"2024-05-08T09:23:37.321717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:06.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210299+0000","last_change":"2024-05-08T09:21:30.955832+0000","last_active":"2024-05-08T09:24:38.210299+0000","last_peered":"2024-05-08T09:24:38.210299+0000","last_clean":"2024-05-08T09:24:38.210299+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:24:38.210299+0000","last_undegraded":"2024-05-08T09:24:38.210299+0000","last_fullsized":"2024-05-08T09:24:38.210299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:51.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992620+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:22:15.992620+0000","last_peered":"2024-05-08T09:22:15.992620+0000","last_clean":"2024-05-08T09:22:15.992620+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:22:15.992620+0000","last_undegraded":"2024-05-08T09:22:15.992620+0000","last_fullsized":"2024-05-08T09:22:15.992620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:26:59.095251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997769+0000","last_change":"2024-05-08T09:21:32.958748+0000","last_active":"2024-05-08T09:22:15.997769+0000","last_peered":"2024-05-08T09:22:15.997769+0000","last_clean":"2024-05-08T09:22:15.997769+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:22:15.997769+0000","last_undegraded":"2024-05-08T09:22:15.997769+0000","last_fullsized":"2024-05-08T09:22:15.997769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:33.281026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.126382+0000","last_change":"2024-05-08T09:21:34.960277+0000","last_active":"2024-05-08T09:23:36.126382+0000","last_peered":"2024-05-08T09:23:36.126382+0000","last_clean":"2024-05-08T09:23:36.126382+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:23:36.126382+0000","last_undegraded":"2024-05-08T09:23:36.126382+0000","last_fullsized":"2024-05-08T09:23:36.126382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:56.211138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001233+0000","last_change":"2024-05-08T09:21:36.975280+0000","last_active":"2024-05-08T09:22:16.001233+0000","last_peered":"2024-05-08T09:22:16.001233+0000","last_clean":"2024-05-08T09:22:16.001233+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:22:16.001233+0000","last_undegraded":"2024-05-08T09:22:16.001233+0000","last_fullsized":"2024-05-08T09:22:16.001233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:48.690526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.274231+0000","last_change":"2024-05-08T09:21:38.977441+0000","last_active":"2024-05-08T09:24:38.274231+0000","last_peered":"2024-05-08T09:24:38.274231+0000","last_clean":"2024-05-08T09:24:38.274231+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:24:38.274231+0000","last_undegraded":"2024-05-08T09:24:38.274231+0000","last_fullsized":"2024-05-08T09:24:38.274231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542061+0000","last_change":"2024-05-08T09:21:30.961518+0000","last_active":"2024-05-08T09:23:37.542061+0000","last_peered":"2024-05-08T09:23:37.542061+0000","last_clean":"2024-05-08T09:23:37.542061+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:23:37.542061+0000","last_undegraded":"2024-05-08T09:23:37.542061+0000","last_fullsized":"2024-05-08T09:23:37.542061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:42.670072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993805+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:22:15.993805+0000","last_peered":"2024-05-08T09:22:15.993805+0000","last_clean":"2024-05-08T09:22:15.993805+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:22:15.993805+0000","last_undegraded":"2024-05-08T09:22:15.993805+0000","last_fullsized":"2024-05-08T09:22:15.993805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996416+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:22:15.996416+0000","last_peered":"2024-05-08T09:22:15.996416+0000","last_clean":"2024-05-08T09:22:15.996416+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:22:15.996416+0000","last_undegraded":"2024-05-08T09:22:15.996416+0000","last_fullsized":"2024-05-08T09:22:15.996416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996694+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:22:15.996694+0000","last_peered":"2024-05-08T09:22:15.996694+0000","last_clean":"2024-05-08T09:22:15.996694+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:22:15.996694+0000","last_undegraded":"2024-05-08T09:22:15.996694+0000","last_fullsized":"2024-05-08T09:22:15.996694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:52.688659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995940+0000","last_change":"2024-05-08T09:21:32.954960+0000","last_active":"2024-05-08T09:22:15.995940+0000","last_peered":"2024-05-08T09:22:15.995940+0000","last_clean":"2024-05-08T09:22:15.995940+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:22:15.995940+0000","last_undegraded":"2024-05-08T09:22:15.995940+0000","last_fullsized":"2024-05-08T09:22:15.995940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:07.460383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.137506+0000","last_change":"2024-05-08T09:21:34.958243+0000","last_active":"2024-05-08T09:23:36.137506+0000","last_peered":"2024-05-08T09:23:36.137506+0000","last_clean":"2024-05-08T09:23:36.137506+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:23:36.137506+0000","last_undegraded":"2024-05-08T09:23:36.137506+0000","last_fullsized":"2024-05-08T09:23:36.137506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:20.157874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064709+0000","last_change":"2024-05-08T09:21:36.973660+0000","last_active":"2024-05-08T09:22:16.064709+0000","last_peered":"2024-05-08T09:22:16.064709+0000","last_clean":"2024-05-08T09:22:16.064709+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:22:16.064709+0000","last_undegraded":"2024-05-08T09:22:16.064709+0000","last_fullsized":"2024-05-08T09:22:16.064709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.251742+0000","last_change":"2024-05-08T09:21:38.970424+0000","last_active":"2024-05-08T09:24:38.251742+0000","last_peered":"2024-05-08T09:24:38.251742+0000","last_clean":"2024-05-08T09:24:38.251742+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:24:38.251742+0000","last_undegraded":"2024-05-08T09:24:38.251742+0000","last_fullsized":"2024-05-08T09:24:38.251742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:39.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914170+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:23:43.914170+0000","last_peered":"2024-05-08T09:23:43.914170+0000","last_clean":"2024-05-08T09:23:43.914170+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:23:43.914170+0000","last_undegraded":"2024-05-08T09:23:43.914170+0000","last_fullsized":"2024-05-08T09:23:43.914170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:41.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992288+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:22:15.992288+0000","last_peered":"2024-05-08T09:22:15.992288+0000","last_clean":"2024-05-08T09:22:15.992288+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:22:15.992288+0000","last_undegraded":"2024-05-08T09:22:15.992288+0000","last_fullsized":"2024-05-08T09:22:15.992288+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.236384+0000","last_change":"2024-05-08T09:21:28.963914+0000","last_active":"2024-05-08T09:24:38.236384+0000","last_peered":"2024-05-08T09:24:38.236384+0000","last_clean":"2024-05-08T09:24:38.236384+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:24:38.236384+0000","last_undegraded":"2024-05-08T09:24:38.236384+0000","last_fullsized":"2024-05-08T09:24:38.236384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998540+0000","last_change":"2024-05-08T09:21:32.956037+0000","last_active":"2024-05-08T09:22:15.998540+0000","last_peered":"2024-05-08T09:22:15.998540+0000","last_clean":"2024-05-08T09:22:15.998540+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:22:15.998540+0000","last_undegraded":"2024-05-08T09:22:15.998540+0000","last_fullsized":"2024-05-08T09:22:15.998540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:35.197031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043243+0000","last_change":"2024-05-08T09:21:34.968703+0000","last_active":"2024-05-08T09:24:38.043243+0000","last_peered":"2024-05-08T09:24:38.043243+0000","last_clean":"2024-05-08T09:24:38.043243+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:38.043243+0000","last_undegraded":"2024-05-08T09:24:38.043243+0000","last_fullsized":"2024-05-08T09:24:38.043243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:23.830443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996211+0000","last_change":"2024-05-08T09:21:36.982457+0000","last_active":"2024-05-08T09:22:15.996211+0000","last_peered":"2024-05-08T09:22:15.996211+0000","last_clean":"2024-05-08T09:22:15.996211+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:22:15.996211+0000","last_undegraded":"2024-05-08T09:22:15.996211+0000","last_fullsized":"2024-05-08T09:22:15.996211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:59.498636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.778538+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:22:53.778538+0000","last_peered":"2024-05-08T09:22:53.778538+0000","last_clean":"2024-05-08T09:22:53.778538+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:22:53.778538+0000","last_undegraded":"2024-05-08T09:22:53.778538+0000","last_fullsized":"2024-05-08T09:22:53.778538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:53.706014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544450+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:37.544450+0000","last_peered":"2024-05-08T09:23:37.544450+0000","last_clean":"2024-05-08T09:23:37.544450+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:37.544450+0000","last_undegraded":"2024-05-08T09:23:37.544450+0000","last_fullsized":"2024-05-08T09:23:37.544450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997429+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:22:15.997429+0000","last_peered":"2024-05-08T09:22:15.997429+0000","last_clean":"2024-05-08T09:22:15.997429+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:22:15.997429+0000","last_undegraded":"2024-05-08T09:22:15.997429+0000","last_fullsized":"2024-05-08T09:22:15.997429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:07.226430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062347+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:22:16.062347+0000","last_peered":"2024-05-08T09:22:16.062347+0000","last_clean":"2024-05-08T09:22:16.062347+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:22:16.062347+0000","last_undegraded":"2024-05-08T09:22:16.062347+0000","last_fullsized":"2024-05-08T09:22:16.062347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999681+0000","last_change":"2024-05-08T09:21:32.954033+0000","last_active":"2024-05-08T09:22:15.999681+0000","last_peered":"2024-05-08T09:22:15.999681+0000","last_clean":"2024-05-08T09:22:15.999681+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:22:15.999681+0000","last_undegraded":"2024-05-08T09:22:15.999681+0000","last_fullsized":"2024-05-08T09:22:15.999681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.238359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043198+0000","last_change":"2024-05-08T09:21:34.961617+0000","last_active":"2024-05-08T09:24:38.043198+0000","last_peered":"2024-05-08T09:24:38.043198+0000","last_clean":"2024-05-08T09:24:38.043198+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:24:38.043198+0000","last_undegraded":"2024-05-08T09:24:38.043198+0000","last_fullsized":"2024-05-08T09:24:38.043198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:00:00.996503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065985+0000","last_change":"2024-05-08T09:21:36.973699+0000","last_active":"2024-05-08T09:22:16.065985+0000","last_peered":"2024-05-08T09:22:16.065985+0000","last_clean":"2024-05-08T09:22:16.065985+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:22:16.065985+0000","last_undegraded":"2024-05-08T09:22:16.065985+0000","last_fullsized":"2024-05-08T09:22:16.065985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:37.294088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994876+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:22:15.994876+0000","last_peered":"2024-05-08T09:22:15.994876+0000","last_clean":"2024-05-08T09:22:15.994876+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:22:15.994876+0000","last_undegraded":"2024-05-08T09:22:15.994876+0000","last_fullsized":"2024-05-08T09:22:15.994876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:58.388645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.541714+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:37.541714+0000","last_peered":"2024-05-08T09:23:37.541714+0000","last_clean":"2024-05-08T09:23:37.541714+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:37.541714+0000","last_undegraded":"2024-05-08T09:23:37.541714+0000","last_fullsized":"2024-05-08T09:23:37.541714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996203+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:22:15.996203+0000","last_peered":"2024-05-08T09:22:15.996203+0000","last_clean":"2024-05-08T09:22:15.996203+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:22:15.996203+0000","last_undegraded":"2024-05-08T09:22:15.996203+0000","last_fullsized":"2024-05-08T09:22:15.996203+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995492+0000","last_change":"2024-05-08T09:21:28.975541+0000","last_active":"2024-05-08T09:22:15.995492+0000","last_peered":"2024-05-08T09:22:15.995492+0000","last_clean":"2024-05-08T09:22:15.995492+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:22:15.995492+0000","last_undegraded":"2024-05-08T09:22:15.995492+0000","last_fullsized":"2024-05-08T09:22:15.995492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064398+0000","last_change":"2024-05-08T09:21:32.958810+0000","last_active":"2024-05-08T09:22:16.064398+0000","last_peered":"2024-05-08T09:22:16.064398+0000","last_clean":"2024-05-08T09:22:16.064398+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:22:16.064398+0000","last_undegraded":"2024-05-08T09:22:16.064398+0000","last_fullsized":"2024-05-08T09:22:16.064398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:13:59.036699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.555805+0000","last_change":"2024-05-08T09:21:34.958674+0000","last_active":"2024-05-08T09:24:37.555805+0000","last_peered":"2024-05-08T09:24:37.555805+0000","last_clean":"2024-05-08T09:24:37.555805+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:37.555805+0000","last_undegraded":"2024-05-08T09:24:37.555805+0000","last_fullsized":"2024-05-08T09:24:37.555805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:51.780853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998784+0000","last_change":"2024-05-08T09:21:36.980954+0000","last_active":"2024-05-08T09:22:15.998784+0000","last_peered":"2024-05-08T09:22:15.998784+0000","last_clean":"2024-05-08T09:22:15.998784+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:22:15.998784+0000","last_undegraded":"2024-05-08T09:22:15.998784+0000","last_fullsized":"2024-05-08T09:22:15.998784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:19.944195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.300793+0000","last_change":"2024-05-08T09:21:38.979327+0000","last_active":"2024-05-08T09:23:37.300793+0000","last_peered":"2024-05-08T09:23:37.300793+0000","last_clean":"2024-05-08T09:23:37.300793+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:23:37.300793+0000","last_undegraded":"2024-05-08T09:23:37.300793+0000","last_fullsized":"2024-05-08T09:23:37.300793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:08.072829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166882+0000","last_change":"2024-05-08T09:21:30.954313+0000","last_active":"2024-05-08T09:24:38.166882+0000","last_peered":"2024-05-08T09:24:38.166882+0000","last_clean":"2024-05-08T09:24:38.166882+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:24:38.166882+0000","last_undegraded":"2024-05-08T09:24:38.166882+0000","last_fullsized":"2024-05-08T09:24:38.166882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.902533+0000","last_change":"2024-05-08T09:21:28.977568+0000","last_active":"2024-05-08T09:24:37.902533+0000","last_peered":"2024-05-08T09:24:37.902533+0000","last_clean":"2024-05-08T09:24:37.902533+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:24:37.902533+0000","last_undegraded":"2024-05-08T09:24:37.902533+0000","last_fullsized":"2024-05-08T09:24:37.902533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065853+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:22:16.065853+0000","last_peered":"2024-05-08T09:22:16.065853+0000","last_clean":"2024-05-08T09:22:16.065853+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:22:16.065853+0000","last_undegraded":"2024-05-08T09:22:16.065853+0000","last_fullsized":"2024-05-08T09:22:16.065853+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:33:18.664257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908099+0000","last_change":"2024-05-08T09:21:32.957975+0000","last_active":"2024-05-08T09:23:38.908099+0000","last_peered":"2024-05-08T09:23:38.908099+0000","last_clean":"2024-05-08T09:23:38.908099+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:23:38.908099+0000","last_undegraded":"2024-05-08T09:23:38.908099+0000","last_fullsized":"2024-05-08T09:23:38.908099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:05:57.275150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'61","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908015+0000","last_change":"2024-05-08T09:21:34.962670+0000","last_active":"2024-05-08T09:23:38.908015+0000","last_peered":"2024-05-08T09:23:38.908015+0000","last_clean":"2024-05-08T09:23:38.908015+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:23:38.908015+0000","last_undegraded":"2024-05-08T09:23:38.908015+0000","last_fullsized":"2024-05-08T09:23:38.908015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:45.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996880+0000","last_change":"2024-05-08T09:21:36.970971+0000","last_active":"2024-05-08T09:22:15.996880+0000","last_peered":"2024-05-08T09:22:15.996880+0000","last_clean":"2024-05-08T09:22:15.996880+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:22:15.996880+0000","last_undegraded":"2024-05-08T09:22:15.996880+0000","last_fullsized":"2024-05-08T09:22:15.996880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:45.147043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.211724+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.211724+0000","last_peered":"2024-05-08T09:24:38.211724+0000","last_clean":"2024-05-08T09:24:38.211724+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.211724+0000","last_undegraded":"2024-05-08T09:24:38.211724+0000","last_fullsized":"2024-05-08T09:24:38.211724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:16.801888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912699+0000","last_change":"2024-05-08T09:21:30.954500+0000","last_active":"2024-05-08T09:23:38.912699+0000","last_peered":"2024-05-08T09:23:38.912699+0000","last_clean":"2024-05-08T09:23:38.912699+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:23:38.912699+0000","last_undegraded":"2024-05-08T09:23:38.912699+0000","last_fullsized":"2024-05-08T09:23:38.912699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:32.782785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066126+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:22:16.066126+0000","last_peered":"2024-05-08T09:22:16.066126+0000","last_clean":"2024-05-08T09:22:16.066126+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:22:16.066126+0000","last_undegraded":"2024-05-08T09:22:16.066126+0000","last_fullsized":"2024-05-08T09:22:16.066126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997047+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:22:15.997047+0000","last_peered":"2024-05-08T09:22:15.997047+0000","last_clean":"2024-05-08T09:22:15.997047+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:22:15.997047+0000","last_undegraded":"2024-05-08T09:22:15.997047+0000","last_fullsized":"2024-05-08T09:22:15.997047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995954+0000","last_change":"2024-05-08T09:21:32.955946+0000","last_active":"2024-05-08T09:22:15.995954+0000","last_peered":"2024-05-08T09:22:15.995954+0000","last_clean":"2024-05-08T09:22:15.995954+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:22:15.995954+0000","last_undegraded":"2024-05-08T09:22:15.995954+0000","last_fullsized":"2024-05-08T09:22:15.995954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:05.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994372+0000","last_change":"2024-05-08T09:21:34.968595+0000","last_active":"2024-05-08T09:22:15.994372+0000","last_peered":"2024-05-08T09:22:15.994372+0000","last_clean":"2024-05-08T09:22:15.994372+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:22:15.994372+0000","last_undegraded":"2024-05-08T09:22:15.994372+0000","last_fullsized":"2024-05-08T09:22:15.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:43.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":356,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350586+0000","last_change":"2024-05-08T09:21:36.971304+0000","last_active":"2024-05-08T09:24:38.350586+0000","last_peered":"2024-05-08T09:24:38.350586+0000","last_clean":"2024-05-08T09:24:38.350586+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:38.350586+0000","last_undegraded":"2024-05-08T09:24:38.350586+0000","last_fullsized":"2024-05-08T09:24:38.350586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998082+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:22:15.998082+0000","last_peered":"2024-05-08T09:22:15.998082+0000","last_clean":"2024-05-08T09:22:15.998082+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:22:15.998082+0000","last_undegraded":"2024-05-08T09:22:15.998082+0000","last_fullsized":"2024-05-08T09:22:15.998082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:56.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.534998+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.534998+0000","last_peered":"2024-05-08T09:23:37.534998+0000","last_clean":"2024-05-08T09:23:37.534998+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.534998+0000","last_undegraded":"2024-05-08T09:23:37.534998+0000","last_fullsized":"2024-05-08T09:23:37.534998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:46.861344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913368+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:23:38.913368+0000","last_peered":"2024-05-08T09:23:38.913368+0000","last_clean":"2024-05-08T09:23:38.913368+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:23:38.913368+0000","last_undegraded":"2024-05-08T09:23:38.913368+0000","last_fullsized":"2024-05-08T09:23:38.913368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:07.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065021+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:22:16.065021+0000","last_peered":"2024-05-08T09:22:16.065021+0000","last_clean":"2024-05-08T09:22:16.065021+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:22:16.065021+0000","last_undegraded":"2024-05-08T09:22:16.065021+0000","last_fullsized":"2024-05-08T09:22:16.065021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:05.319652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993871+0000","last_change":"2024-05-08T09:21:32.953187+0000","last_active":"2024-05-08T09:22:15.993871+0000","last_peered":"2024-05-08T09:22:15.993871+0000","last_clean":"2024-05-08T09:22:15.993871+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:22:15.993871+0000","last_undegraded":"2024-05-08T09:22:15.993871+0000","last_fullsized":"2024-05-08T09:22:15.993871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:55.009101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997211+0000","last_change":"2024-05-08T09:21:34.965238+0000","last_active":"2024-05-08T09:22:15.997211+0000","last_peered":"2024-05-08T09:22:15.997211+0000","last_clean":"2024-05-08T09:22:15.997211+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:22:15.997211+0000","last_undegraded":"2024-05-08T09:22:15.997211+0000","last_fullsized":"2024-05-08T09:22:15.997211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:18.697994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.338025+0000","last_change":"2024-05-08T09:21:36.964762+0000","last_active":"2024-05-08T09:24:38.338025+0000","last_peered":"2024-05-08T09:24:38.338025+0000","last_clean":"2024-05-08T09:24:38.338025+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:38.338025+0000","last_undegraded":"2024-05-08T09:24:38.338025+0000","last_fullsized":"2024-05-08T09:24:38.338025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.195367+0000","last_change":"2024-05-08T09:21:38.976489+0000","last_active":"2024-05-08T09:24:38.195367+0000","last_peered":"2024-05-08T09:24:38.195367+0000","last_clean":"2024-05-08T09:24:38.195367+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:24:38.195367+0000","last_undegraded":"2024-05-08T09:24:38.195367+0000","last_fullsized":"2024-05-08T09:24:38.195367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294339+0000","last_change":"2024-05-08T09:21:30.954521+0000","last_active":"2024-05-08T09:24:38.294339+0000","last_peered":"2024-05-08T09:24:38.294339+0000","last_clean":"2024-05-08T09:24:38.294339+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:24:38.294339+0000","last_undegraded":"2024-05-08T09:24:38.294339+0000","last_fullsized":"2024-05-08T09:24:38.294339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:48.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999497+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:22:15.999497+0000","last_peered":"2024-05-08T09:22:15.999497+0000","last_clean":"2024-05-08T09:22:15.999497+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:22:15.999497+0000","last_undegraded":"2024-05-08T09:22:15.999497+0000","last_fullsized":"2024-05-08T09:22:15.999497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998995+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:22:15.998995+0000","last_peered":"2024-05-08T09:22:15.998995+0000","last_clean":"2024-05-08T09:22:15.998995+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:22:15.998995+0000","last_undegraded":"2024-05-08T09:22:15.998995+0000","last_fullsized":"2024-05-08T09:22:15.998995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992213+0000","last_change":"2024-05-08T09:21:32.951089+0000","last_active":"2024-05-08T09:22:15.992213+0000","last_peered":"2024-05-08T09:22:15.992213+0000","last_clean":"2024-05-08T09:22:15.992213+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:22:15.992213+0000","last_undegraded":"2024-05-08T09:22:15.992213+0000","last_fullsized":"2024-05-08T09:22:15.992213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:27.953425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.124374+0000","last_change":"2024-05-08T09:21:34.967958+0000","last_active":"2024-05-08T09:23:36.124374+0000","last_peered":"2024-05-08T09:23:36.124374+0000","last_clean":"2024-05-08T09:23:36.124374+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:23:36.124374+0000","last_undegraded":"2024-05-08T09:23:36.124374+0000","last_fullsized":"2024-05-08T09:23:36.124374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:48.327703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062871+0000","last_change":"2024-05-08T09:21:36.971440+0000","last_active":"2024-05-08T09:22:16.062871+0000","last_peered":"2024-05-08T09:22:16.062871+0000","last_clean":"2024-05-08T09:22:16.062871+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:22:16.062871+0000","last_undegraded":"2024-05-08T09:22:16.062871+0000","last_fullsized":"2024-05-08T09:22:16.062871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:04.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995443+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:22:15.995443+0000","last_peered":"2024-05-08T09:22:15.995443+0000","last_clean":"2024-05-08T09:22:15.995443+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:22:15.995443+0000","last_undegraded":"2024-05-08T09:22:15.995443+0000","last_fullsized":"2024-05-08T09:22:15.995443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000438+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:22:16.000438+0000","last_peered":"2024-05-08T09:22:16.000438+0000","last_clean":"2024-05-08T09:22:16.000438+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:22:16.000438+0000","last_undegraded":"2024-05-08T09:22:16.000438+0000","last_fullsized":"2024-05-08T09:22:16.000438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:33.973664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247048+0000","last_change":"2024-05-08T09:21:30.956220+0000","last_active":"2024-05-08T09:24:38.247048+0000","last_peered":"2024-05-08T09:24:38.247048+0000","last_clean":"2024-05-08T09:24:38.247048+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:24:38.247048+0000","last_undegraded":"2024-05-08T09:24:38.247048+0000","last_fullsized":"2024-05-08T09:24:38.247048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996735+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:22:15.996735+0000","last_peered":"2024-05-08T09:22:15.996735+0000","last_clean":"2024-05-08T09:22:15.996735+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:22:15.996735+0000","last_undegraded":"2024-05-08T09:22:15.996735+0000","last_fullsized":"2024-05-08T09:22:15.996735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:21.186952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993609+0000","last_change":"2024-05-08T09:21:32.958181+0000","last_active":"2024-05-08T09:22:15.993609+0000","last_peered":"2024-05-08T09:22:15.993609+0000","last_clean":"2024-05-08T09:22:15.993609+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:22:15.993609+0000","last_undegraded":"2024-05-08T09:22:15.993609+0000","last_fullsized":"2024-05-08T09:22:15.993609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:40.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.130334+0000","last_change":"2024-05-08T09:21:34.964839+0000","last_active":"2024-05-08T09:23:36.130334+0000","last_peered":"2024-05-08T09:23:36.130334+0000","last_clean":"2024-05-08T09:23:36.130334+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:23:36.130334+0000","last_undegraded":"2024-05-08T09:23:36.130334+0000","last_fullsized":"2024-05-08T09:23:36.130334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:49.320700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992942+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:22:15.992942+0000","last_peered":"2024-05-08T09:22:15.992942+0000","last_clean":"2024-05-08T09:22:15.992942+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:22:15.992942+0000","last_undegraded":"2024-05-08T09:22:15.992942+0000","last_fullsized":"2024-05-08T09:22:15.992942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:59.583179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.033000+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.033000+0000","last_peered":"2024-05-08T09:24:38.033000+0000","last_clean":"2024-05-08T09:24:38.033000+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.033000+0000","last_undegraded":"2024-05-08T09:24:38.033000+0000","last_fullsized":"2024-05-08T09:24:38.033000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240929+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.240929+0000","last_peered":"2024-05-08T09:24:38.240929+0000","last_clean":"2024-05-08T09:24:38.240929+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.240929+0000","last_undegraded":"2024-05-08T09:24:38.240929+0000","last_fullsized":"2024-05-08T09:24:38.240929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:54:43.535283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993959+0000","last_change":"2024-05-08T09:21:28.977160+0000","last_active":"2024-05-08T09:22:15.993959+0000","last_peered":"2024-05-08T09:22:15.993959+0000","last_clean":"2024-05-08T09:22:15.993959+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:22:15.993959+0000","last_undegraded":"2024-05-08T09:22:15.993959+0000","last_fullsized":"2024-05-08T09:22:15.993959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995252+0000","last_change":"2024-05-08T09:21:32.951442+0000","last_active":"2024-05-08T09:22:15.995252+0000","last_peered":"2024-05-08T09:22:15.995252+0000","last_clean":"2024-05-08T09:22:15.995252+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:22:15.995252+0000","last_undegraded":"2024-05-08T09:22:15.995252+0000","last_fullsized":"2024-05-08T09:22:15.995252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:14.017416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.560512+0000","last_change":"2024-05-08T09:21:34.958618+0000","last_active":"2024-05-08T09:24:37.560512+0000","last_peered":"2024-05-08T09:24:37.560512+0000","last_clean":"2024-05-08T09:24:37.560512+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:24:37.560512+0000","last_undegraded":"2024-05-08T09:24:37.560512+0000","last_fullsized":"2024-05-08T09:24:37.560512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:29.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997200+0000","last_change":"2024-05-08T09:21:36.967739+0000","last_active":"2024-05-08T09:22:15.997200+0000","last_peered":"2024-05-08T09:22:15.997200+0000","last_clean":"2024-05-08T09:22:15.997200+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:22:15.997200+0000","last_undegraded":"2024-05-08T09:22:15.997200+0000","last_fullsized":"2024-05-08T09:22:15.997200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:27.327024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063979+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:22:16.063979+0000","last_peered":"2024-05-08T09:22:16.063979+0000","last_clean":"2024-05-08T09:22:16.063979+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:22:16.063979+0000","last_undegraded":"2024-05-08T09:22:16.063979+0000","last_fullsized":"2024-05-08T09:22:16.063979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944236+0000","last_change":"2024-05-08T09:21:30.953686+0000","last_active":"2024-05-08T09:24:37.944236+0000","last_peered":"2024-05-08T09:24:37.944236+0000","last_clean":"2024-05-08T09:24:37.944236+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:24:37.944236+0000","last_undegraded":"2024-05-08T09:24:37.944236+0000","last_fullsized":"2024-05-08T09:24:37.944236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000191+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:22:16.000191+0000","last_peered":"2024-05-08T09:22:16.000191+0000","last_clean":"2024-05-08T09:22:16.000191+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:22:16.000191+0000","last_undegraded":"2024-05-08T09:22:16.000191+0000","last_fullsized":"2024-05-08T09:22:16.000191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994229+0000","last_change":"2024-05-08T09:21:32.956150+0000","last_active":"2024-05-08T09:22:15.994229+0000","last_peered":"2024-05-08T09:22:15.994229+0000","last_clean":"2024-05-08T09:22:15.994229+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:22:15.994229+0000","last_undegraded":"2024-05-08T09:22:15.994229+0000","last_fullsized":"2024-05-08T09:22:15.994229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:34.790177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.620657+0000","last_change":"2024-05-08T09:21:34.964255+0000","last_active":"2024-05-08T09:24:37.620657+0000","last_peered":"2024-05-08T09:24:37.620657+0000","last_clean":"2024-05-08T09:24:37.620657+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:37.620657+0000","last_undegraded":"2024-05-08T09:24:37.620657+0000","last_fullsized":"2024-05-08T09:24:37.620657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.320370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993295+0000","last_change":"2024-05-08T09:21:36.969562+0000","last_active":"2024-05-08T09:22:15.993295+0000","last_peered":"2024-05-08T09:22:15.993295+0000","last_clean":"2024-05-08T09:22:15.993295+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:22:15.993295+0000","last_undegraded":"2024-05-08T09:22:15.993295+0000","last_fullsized":"2024-05-08T09:22:15.993295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996115+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:22:15.996115+0000","last_peered":"2024-05-08T09:22:15.996115+0000","last_clean":"2024-05-08T09:22:15.996115+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:22:15.996115+0000","last_undegraded":"2024-05-08T09:22:15.996115+0000","last_fullsized":"2024-05-08T09:22:15.996115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:31:28.662933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247450+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.247450+0000","last_peered":"2024-05-08T09:24:38.247450+0000","last_clean":"2024-05-08T09:24:38.247450+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.247450+0000","last_undegraded":"2024-05-08T09:24:38.247450+0000","last_fullsized":"2024-05-08T09:24:38.247450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:00.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001269+0000","last_change":"2024-05-08T09:21:28.976895+0000","last_active":"2024-05-08T09:22:16.001269+0000","last_peered":"2024-05-08T09:22:16.001269+0000","last_clean":"2024-05-08T09:22:16.001269+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:22:16.001269+0000","last_undegraded":"2024-05-08T09:22:16.001269+0000","last_fullsized":"2024-05-08T09:22:16.001269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993778+0000","last_change":"2024-05-08T09:21:32.953496+0000","last_active":"2024-05-08T09:22:15.993778+0000","last_peered":"2024-05-08T09:22:15.993778+0000","last_clean":"2024-05-08T09:22:15.993778+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:22:15.993778+0000","last_undegraded":"2024-05-08T09:22:15.993778+0000","last_fullsized":"2024-05-08T09:22:15.993778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:32.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'32","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.915996+0000","last_change":"2024-05-08T09:21:34.962303+0000","last_active":"2024-05-08T09:23:58.915996+0000","last_peered":"2024-05-08T09:23:58.915996+0000","last_clean":"2024-05-08T09:23:58.915996+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:23:58.915996+0000","last_undegraded":"2024-05-08T09:23:58.915996+0000","last_fullsized":"2024-05-08T09:23:58.915996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:21.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993777+0000","last_change":"2024-05-08T09:21:36.966752+0000","last_active":"2024-05-08T09:22:15.993777+0000","last_peered":"2024-05-08T09:22:15.993777+0000","last_clean":"2024-05-08T09:22:15.993777+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:22:15.993777+0000","last_undegraded":"2024-05-08T09:22:15.993777+0000","last_fullsized":"2024-05-08T09:22:15.993777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:36.110923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999504+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:22:15.999504+0000","last_peered":"2024-05-08T09:22:15.999504+0000","last_clean":"2024-05-08T09:22:15.999504+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:22:15.999504+0000","last_undegraded":"2024-05-08T09:22:15.999504+0000","last_fullsized":"2024-05-08T09:22:15.999504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:59.893435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992379+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:22:15.992379+0000","last_peered":"2024-05-08T09:22:15.992379+0000","last_clean":"2024-05-08T09:22:15.992379+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:22:15.992379+0000","last_undegraded":"2024-05-08T09:22:15.992379+0000","last_fullsized":"2024-05-08T09:22:15.992379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:04:17.117842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064977+0000","last_change":"2024-05-08T09:21:32.957500+0000","last_active":"2024-05-08T09:22:16.064977+0000","last_peered":"2024-05-08T09:22:16.064977+0000","last_clean":"2024-05-08T09:22:16.064977+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:22:16.064977+0000","last_undegraded":"2024-05-08T09:22:16.064977+0000","last_fullsized":"2024-05-08T09:22:16.064977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:19.794029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.136580+0000","last_change":"2024-05-08T09:21:34.961064+0000","last_active":"2024-05-08T09:23:36.136580+0000","last_peered":"2024-05-08T09:23:36.136580+0000","last_clean":"2024-05-08T09:23:36.136580+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:23:36.136580+0000","last_undegraded":"2024-05-08T09:23:36.136580+0000","last_fullsized":"2024-05-08T09:23:36.136580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:43.140389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000175+0000","last_change":"2024-05-08T09:21:36.964285+0000","last_active":"2024-05-08T09:22:16.000175+0000","last_peered":"2024-05-08T09:22:16.000175+0000","last_clean":"2024-05-08T09:22:16.000175+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:22:16.000175+0000","last_undegraded":"2024-05-08T09:22:16.000175+0000","last_fullsized":"2024-05-08T09:22:16.000175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:48.002782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.961449+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:37.961449+0000","last_peered":"2024-05-08T09:24:37.961449+0000","last_clean":"2024-05-08T09:24:37.961449+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:37.961449+0000","last_undegraded":"2024-05-08T09:24:37.961449+0000","last_fullsized":"2024-05-08T09:24:37.961449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066141+0000","last_change":"2024-05-08T09:21:30.946651+0000","last_active":"2024-05-08T09:22:16.066141+0000","last_peered":"2024-05-08T09:22:16.066141+0000","last_clean":"2024-05-08T09:22:16.066141+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:22:16.066141+0000","last_undegraded":"2024-05-08T09:22:16.066141+0000","last_fullsized":"2024-05-08T09:22:16.066141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915215+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:23:53.915215+0000","last_peered":"2024-05-08T09:23:53.915215+0000","last_clean":"2024-05-08T09:23:53.915215+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:23:53.915215+0000","last_undegraded":"2024-05-08T09:23:53.915215+0000","last_fullsized":"2024-05-08T09:23:53.915215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001089+0000","last_change":"2024-05-08T09:21:32.952239+0000","last_active":"2024-05-08T09:22:16.001089+0000","last_peered":"2024-05-08T09:22:16.001089+0000","last_clean":"2024-05-08T09:22:16.001089+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:22:16.001089+0000","last_undegraded":"2024-05-08T09:22:16.001089+0000","last_fullsized":"2024-05-08T09:22:16.001089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:04.920258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.117028+0000","last_change":"2024-05-08T09:21:34.964379+0000","last_active":"2024-05-08T09:23:36.117028+0000","last_peered":"2024-05-08T09:23:36.117028+0000","last_clean":"2024-05-08T09:23:36.117028+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:23:36.117028+0000","last_undegraded":"2024-05-08T09:23:36.117028+0000","last_fullsized":"2024-05-08T09:23:36.117028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:24.020955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995784+0000","last_change":"2024-05-08T09:21:36.973254+0000","last_active":"2024-05-08T09:22:15.995784+0000","last_peered":"2024-05-08T09:22:15.995784+0000","last_clean":"2024-05-08T09:22:15.995784+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:22:15.995784+0000","last_undegraded":"2024-05-08T09:22:15.995784+0000","last_fullsized":"2024-05-08T09:22:15.995784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.958667+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:22:53.958667+0000","last_peered":"2024-05-08T09:22:53.958667+0000","last_clean":"2024-05-08T09:22:53.958667+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:22:53.958667+0000","last_undegraded":"2024-05-08T09:22:53.958667+0000","last_fullsized":"2024-05-08T09:22:53.958667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:12.192786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917766+0000","last_change":"2024-05-08T09:21:30.961494+0000","last_active":"2024-05-08T09:24:03.917766+0000","last_peered":"2024-05-08T09:24:03.917766+0000","last_clean":"2024-05-08T09:24:03.917766+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:24:03.917766+0000","last_undegraded":"2024-05-08T09:24:03.917766+0000","last_fullsized":"2024-05-08T09:24:03.917766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:52.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993716+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:22:15.993716+0000","last_peered":"2024-05-08T09:22:15.993716+0000","last_clean":"2024-05-08T09:22:15.993716+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:22:15.993716+0000","last_undegraded":"2024-05-08T09:22:15.993716+0000","last_fullsized":"2024-05-08T09:22:15.993716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.006061+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:22:16.006061+0000","last_peered":"2024-05-08T09:22:16.006061+0000","last_clean":"2024-05-08T09:22:16.006061+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:22:16.006061+0000","last_undegraded":"2024-05-08T09:22:16.006061+0000","last_fullsized":"2024-05-08T09:22:16.006061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:34.942749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909160+0000","last_change":"2024-05-08T09:21:34.959330+0000","last_active":"2024-05-08T09:23:43.909160+0000","last_peered":"2024-05-08T09:23:43.909160+0000","last_clean":"2024-05-08T09:23:43.909160+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:23:43.909160+0000","last_undegraded":"2024-05-08T09:23:43.909160+0000","last_fullsized":"2024-05-08T09:23:43.909160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:34.104269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064670+0000","last_change":"2024-05-08T09:21:36.968410+0000","last_active":"2024-05-08T09:22:16.064670+0000","last_peered":"2024-05-08T09:22:16.064670+0000","last_clean":"2024-05-08T09:22:16.064670+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:22:16.064670+0000","last_undegraded":"2024-05-08T09:22:16.064670+0000","last_fullsized":"2024-05-08T09:22:16.064670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:39.210093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.297088+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.297088+0000","last_peered":"2024-05-08T09:24:38.297088+0000","last_clean":"2024-05-08T09:24:38.297088+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.297088+0000","last_undegraded":"2024-05-08T09:24:38.297088+0000","last_fullsized":"2024-05-08T09:24:38.297088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:47.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.912027+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:03.912027+0000","last_peered":"2024-05-08T09:24:03.912027+0000","last_clean":"2024-05-08T09:24:03.912027+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:03.912027+0000","last_undegraded":"2024-05-08T09:24:03.912027+0000","last_fullsized":"2024-05-08T09:24:03.912027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995871+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:22:15.995871+0000","last_peered":"2024-05-08T09:22:15.995871+0000","last_clean":"2024-05-08T09:22:15.995871+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:22:15.995871+0000","last_undegraded":"2024-05-08T09:22:15.995871+0000","last_fullsized":"2024-05-08T09:22:15.995871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:06.064996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.004778+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:22:16.004778+0000","last_peered":"2024-05-08T09:22:16.004778+0000","last_clean":"2024-05-08T09:22:16.004778+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:22:16.004778+0000","last_undegraded":"2024-05-08T09:22:16.004778+0000","last_fullsized":"2024-05-08T09:22:16.004778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:18.151465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998680+0000","last_change":"2024-05-08T09:21:34.967409+0000","last_active":"2024-05-08T09:22:15.998680+0000","last_peered":"2024-05-08T09:22:15.998680+0000","last_clean":"2024-05-08T09:22:15.998680+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:22:15.998680+0000","last_undegraded":"2024-05-08T09:22:15.998680+0000","last_fullsized":"2024-05-08T09:22:15.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:37.791645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043149+0000","last_change":"2024-05-08T09:21:36.975423+0000","last_active":"2024-05-08T09:24:38.043149+0000","last_peered":"2024-05-08T09:24:38.043149+0000","last_clean":"2024-05-08T09:24:38.043149+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:24:38.043149+0000","last_undegraded":"2024-05-08T09:24:38.043149+0000","last_fullsized":"2024-05-08T09:24:38.043149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:51.994196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.991922+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:22:15.991922+0000","last_peered":"2024-05-08T09:22:15.991922+0000","last_clean":"2024-05-08T09:22:15.991922+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:22:15.991922+0000","last_undegraded":"2024-05-08T09:22:15.991922+0000","last_fullsized":"2024-05-08T09:22:15.991922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:40.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207709+0000","last_change":"2024-05-08T09:21:30.952074+0000","last_active":"2024-05-08T09:24:38.207709+0000","last_peered":"2024-05-08T09:24:38.207709+0000","last_clean":"2024-05-08T09:24:38.207709+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:24:38.207709+0000","last_undegraded":"2024-05-08T09:24:38.207709+0000","last_fullsized":"2024-05-08T09:24:38.207709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:54.695384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916234+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:23:58.916234+0000","last_peered":"2024-05-08T09:23:58.916234+0000","last_clean":"2024-05-08T09:23:58.916234+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:23:58.916234+0000","last_undegraded":"2024-05-08T09:23:58.916234+0000","last_fullsized":"2024-05-08T09:23:58.916234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188377+0000","last_change":"2024-05-08T09:21:32.958699+0000","last_active":"2024-05-08T09:23:37.188377+0000","last_peered":"2024-05-08T09:23:37.188377+0000","last_clean":"2024-05-08T09:23:37.188377+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:23:37.188377+0000","last_undegraded":"2024-05-08T09:23:37.188377+0000","last_fullsized":"2024-05-08T09:23:37.188377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:10.206363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917019+0000","last_change":"2024-05-08T09:21:34.964625+0000","last_active":"2024-05-08T09:24:03.917019+0000","last_peered":"2024-05-08T09:24:03.917019+0000","last_clean":"2024-05-08T09:24:03.917019+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:03.917019+0000","last_undegraded":"2024-05-08T09:24:03.917019+0000","last_fullsized":"2024-05-08T09:24:03.917019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:03.907236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062486+0000","last_change":"2024-05-08T09:21:36.973685+0000","last_active":"2024-05-08T09:22:16.062486+0000","last_peered":"2024-05-08T09:22:16.062486+0000","last_clean":"2024-05-08T09:22:16.062486+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:22:16.062486+0000","last_undegraded":"2024-05-08T09:22:16.062486+0000","last_fullsized":"2024-05-08T09:22:16.062486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:41.857456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001765+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:22:16.001765+0000","last_peered":"2024-05-08T09:22:16.001765+0000","last_clean":"2024-05-08T09:22:16.001765+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:22:16.001765+0000","last_undegraded":"2024-05-08T09:22:16.001765+0000","last_fullsized":"2024-05-08T09:22:16.001765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916931+0000","last_change":"2024-05-08T09:21:30.945039+0000","last_active":"2024-05-08T09:24:03.916931+0000","last_peered":"2024-05-08T09:24:03.916931+0000","last_clean":"2024-05-08T09:24:03.916931+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:24:03.916931+0000","last_undegraded":"2024-05-08T09:24:03.916931+0000","last_fullsized":"2024-05-08T09:24:03.916931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997115+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:22:15.997115+0000","last_peered":"2024-05-08T09:22:15.997115+0000","last_clean":"2024-05-08T09:22:15.997115+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:22:15.997115+0000","last_undegraded":"2024-05-08T09:22:15.997115+0000","last_fullsized":"2024-05-08T09:22:15.997115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:05.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998814+0000","last_change":"2024-05-08T09:21:32.956273+0000","last_active":"2024-05-08T09:22:15.998814+0000","last_peered":"2024-05-08T09:22:15.998814+0000","last_clean":"2024-05-08T09:22:15.998814+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:22:15.998814+0000","last_undegraded":"2024-05-08T09:22:15.998814+0000","last_fullsized":"2024-05-08T09:22:15.998814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:53.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.108672+0000","last_change":"2024-05-08T09:21:34.962675+0000","last_active":"2024-05-08T09:23:36.108672+0000","last_peered":"2024-05-08T09:23:36.108672+0000","last_clean":"2024-05-08T09:23:36.108672+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:23:36.108672+0000","last_undegraded":"2024-05-08T09:23:36.108672+0000","last_fullsized":"2024-05-08T09:23:36.108672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:42.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992215+0000","last_change":"2024-05-08T09:21:36.975698+0000","last_active":"2024-05-08T09:22:15.992215+0000","last_peered":"2024-05-08T09:22:15.992215+0000","last_clean":"2024-05-08T09:22:15.992215+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:22:15.992215+0000","last_undegraded":"2024-05-08T09:22:15.992215+0000","last_fullsized":"2024-05-08T09:22:15.992215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:22:04.192857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998833+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:22:15.998833+0000","last_peered":"2024-05-08T09:22:15.998833+0000","last_clean":"2024-05-08T09:22:15.998833+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:22:15.998833+0000","last_undegraded":"2024-05-08T09:22:15.998833+0000","last_fullsized":"2024-05-08T09:22:15.998833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:22:09.958023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994056+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:22:15.994056+0000","last_peered":"2024-05-08T09:22:15.994056+0000","last_clean":"2024-05-08T09:22:15.994056+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:22:15.994056+0000","last_undegraded":"2024-05-08T09:22:15.994056+0000","last_fullsized":"2024-05-08T09:22:15.994056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065163+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:22:16.065163+0000","last_peered":"2024-05-08T09:22:16.065163+0000","last_clean":"2024-05-08T09:22:16.065163+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:22:16.065163+0000","last_undegraded":"2024-05-08T09:22:16.065163+0000","last_fullsized":"2024-05-08T09:22:16.065163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:29.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993524+0000","last_change":"2024-05-08T09:21:32.952670+0000","last_active":"2024-05-08T09:22:15.993524+0000","last_peered":"2024-05-08T09:22:15.993524+0000","last_clean":"2024-05-08T09:22:15.993524+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:22:15.993524+0000","last_undegraded":"2024-05-08T09:22:15.993524+0000","last_fullsized":"2024-05-08T09:22:15.993524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:58.990094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.132233+0000","last_change":"2024-05-08T09:21:34.964514+0000","last_active":"2024-05-08T09:23:36.132233+0000","last_peered":"2024-05-08T09:23:36.132233+0000","last_clean":"2024-05-08T09:23:36.132233+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:23:36.132233+0000","last_undegraded":"2024-05-08T09:23:36.132233+0000","last_fullsized":"2024-05-08T09:23:36.132233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:12.788058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995586+0000","last_change":"2024-05-08T09:21:36.978806+0000","last_active":"2024-05-08T09:22:15.995586+0000","last_peered":"2024-05-08T09:22:15.995586+0000","last_clean":"2024-05-08T09:22:15.995586+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:22:15.995586+0000","last_undegraded":"2024-05-08T09:22:15.995586+0000","last_fullsized":"2024-05-08T09:22:15.995586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:58.108416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.141999+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:23:36.141999+0000","last_peered":"2024-05-08T09:23:36.141999+0000","last_clean":"2024-05-08T09:23:36.141999+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:23:36.141999+0000","last_undegraded":"2024-05-08T09:23:36.141999+0000","last_fullsized":"2024-05-08T09:23:36.141999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:58.409814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241173+0000","last_change":"2024-05-08T09:21:30.945358+0000","last_active":"2024-05-08T09:24:38.241173+0000","last_peered":"2024-05-08T09:24:38.241173+0000","last_clean":"2024-05-08T09:24:38.241173+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:24:38.241173+0000","last_undegraded":"2024-05-08T09:24:38.241173+0000","last_fullsized":"2024-05-08T09:24:38.241173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:35.493172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001565+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:22:16.001565+0000","last_peered":"2024-05-08T09:22:16.001565+0000","last_clean":"2024-05-08T09:22:16.001565+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:22:16.001565+0000","last_undegraded":"2024-05-08T09:22:16.001565+0000","last_fullsized":"2024-05-08T09:22:16.001565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:34.803032+0000","last_change":"2024-05-08T09:21:32.956974+0000","last_active":"2024-05-08T09:23:34.803032+0000","last_peered":"2024-05-08T09:23:34.803032+0000","last_clean":"2024-05-08T09:23:34.803032+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:23:34.803032+0000","last_undegraded":"2024-05-08T09:23:34.803032+0000","last_fullsized":"2024-05-08T09:23:34.803032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:38.938823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.561424+0000","last_change":"2024-05-08T09:21:34.965967+0000","last_active":"2024-05-08T09:24:37.561424+0000","last_peered":"2024-05-08T09:24:37.561424+0000","last_clean":"2024-05-08T09:24:37.561424+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:24:37.561424+0000","last_undegraded":"2024-05-08T09:24:37.561424+0000","last_fullsized":"2024-05-08T09:24:37.561424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:50.441262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063598+0000","last_change":"2024-05-08T09:21:36.973796+0000","last_active":"2024-05-08T09:22:16.063598+0000","last_peered":"2024-05-08T09:22:16.063598+0000","last_clean":"2024-05-08T09:22:16.063598+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:22:16.063598+0000","last_undegraded":"2024-05-08T09:22:16.063598+0000","last_fullsized":"2024-05-08T09:22:16.063598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.144572+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:36.144572+0000","last_peered":"2024-05-08T09:23:36.144572+0000","last_clean":"2024-05-08T09:23:36.144572+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:36.144572+0000","last_undegraded":"2024-05-08T09:23:36.144572+0000","last_fullsized":"2024-05-08T09:23:36.144572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:33.860320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210108+0000","last_change":"2024-05-08T09:21:30.954737+0000","last_active":"2024-05-08T09:24:38.210108+0000","last_peered":"2024-05-08T09:24:38.210108+0000","last_clean":"2024-05-08T09:24:38.210108+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:24:38.210108+0000","last_undegraded":"2024-05-08T09:24:38.210108+0000","last_fullsized":"2024-05-08T09:24:38.210108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:33.918459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993499+0000","last_change":"2024-05-08T09:21:28.974311+0000","last_active":"2024-05-08T09:22:15.993499+0000","last_peered":"2024-05-08T09:22:15.993499+0000","last_clean":"2024-05-08T09:22:15.993499+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:22:15.993499+0000","last_undegraded":"2024-05-08T09:22:15.993499+0000","last_fullsized":"2024-05-08T09:22:15.993499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030984+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.030984+0000","last_peered":"2024-05-08T09:24:38.030984+0000","last_clean":"2024-05-08T09:24:38.030984+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.030984+0000","last_undegraded":"2024-05-08T09:24:38.030984+0000","last_fullsized":"2024-05-08T09:24:38.030984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062507+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:22:16.062507+0000","last_peered":"2024-05-08T09:22:16.062507+0000","last_clean":"2024-05-08T09:22:16.062507+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:22:16.062507+0000","last_undegraded":"2024-05-08T09:22:16.062507+0000","last_fullsized":"2024-05-08T09:22:16.062507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996972+0000","last_change":"2024-05-08T09:21:30.961138+0000","last_active":"2024-05-08T09:22:15.996972+0000","last_peered":"2024-05-08T09:22:15.996972+0000","last_clean":"2024-05-08T09:22:15.996972+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:22:15.996972+0000","last_undegraded":"2024-05-08T09:22:15.996972+0000","last_fullsized":"2024-05-08T09:22:15.996972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:41.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996550+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:22:15.996550+0000","last_peered":"2024-05-08T09:22:15.996550+0000","last_clean":"2024-05-08T09:22:15.996550+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:22:15.996550+0000","last_undegraded":"2024-05-08T09:22:15.996550+0000","last_fullsized":"2024-05-08T09:22:15.996550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:32.580301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241017+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.241017+0000","last_peered":"2024-05-08T09:24:38.241017+0000","last_clean":"2024-05-08T09:24:38.241017+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.241017+0000","last_undegraded":"2024-05-08T09:24:38.241017+0000","last_fullsized":"2024-05-08T09:24:38.241017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064366+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:22:16.064366+0000","last_peered":"2024-05-08T09:22:16.064366+0000","last_clean":"2024-05-08T09:22:16.064366+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:22:16.064366+0000","last_undegraded":"2024-05-08T09:22:16.064366+0000","last_fullsized":"2024-05-08T09:22:16.064366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.943767+0000","last_change":"2024-05-08T09:21:30.953450+0000","last_active":"2024-05-08T09:24:37.943767+0000","last_peered":"2024-05-08T09:24:37.943767+0000","last_clean":"2024-05-08T09:24:37.943767+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:24:37.943767+0000","last_undegraded":"2024-05-08T09:24:37.943767+0000","last_fullsized":"2024-05-08T09:24:37.943767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066265+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:22:16.066265+0000","last_peered":"2024-05-08T09:22:16.066265+0000","last_clean":"2024-05-08T09:22:16.066265+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:22:16.066265+0000","last_undegraded":"2024-05-08T09:22:16.066265+0000","last_fullsized":"2024-05-08T09:22:16.066265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240952+0000","last_change":"2024-05-08T09:21:30.954588+0000","last_active":"2024-05-08T09:24:38.240952+0000","last_peered":"2024-05-08T09:24:38.240952+0000","last_clean":"2024-05-08T09:24:38.240952+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:24:38.240952+0000","last_undegraded":"2024-05-08T09:24:38.240952+0000","last_fullsized":"2024-05-08T09:24:38.240952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997994+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:22:15.997994+0000","last_peered":"2024-05-08T09:22:15.997994+0000","last_clean":"2024-05-08T09:22:15.997994+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:22:15.997994+0000","last_undegraded":"2024-05-08T09:22:15.997994+0000","last_fullsized":"2024-05-08T09:22:15.997994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166509+0000","last_change":"2024-05-08T09:21:30.943875+0000","last_active":"2024-05-08T09:24:38.166509+0000","last_peered":"2024-05-08T09:24:38.166509+0000","last_clean":"2024-05-08T09:24:38.166509+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:24:38.166509+0000","last_undegraded":"2024-05-08T09:24:38.166509+0000","last_fullsized":"2024-05-08T09:24:38.166509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000230+0000","last_change":"2024-05-08T09:21:28.974367+0000","last_active":"2024-05-08T09:22:16.000230+0000","last_peered":"2024-05-08T09:22:16.000230+0000","last_clean":"2024-05-08T09:22:16.000230+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:22:16.000230+0000","last_undegraded":"2024-05-08T09:22:16.000230+0000","last_fullsized":"2024-05-08T09:22:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.172965+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.172965+0000","last_peered":"2024-05-08T09:24:38.172965+0000","last_clean":"2024-05-08T09:24:38.172965+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.172965+0000","last_undegraded":"2024-05-08T09:24:38.172965+0000","last_fullsized":"2024-05-08T09:24:38.172965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:01:34.087796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065749+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:22:16.065749+0000","last_peered":"2024-05-08T09:22:16.065749+0000","last_clean":"2024-05-08T09:22:16.065749+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:22:16.065749+0000","last_undegraded":"2024-05-08T09:22:16.065749+0000","last_fullsized":"2024-05-08T09:22:16.065749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031074+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.031074+0000","last_peered":"2024-05-08T09:24:38.031074+0000","last_clean":"2024-05-08T09:24:38.031074+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.031074+0000","last_undegraded":"2024-05-08T09:24:38.031074+0000","last_fullsized":"2024-05-08T09:24:38.031074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:02.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.492136+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:37.492136+0000","last_peered":"2024-05-08T09:23:37.492136+0000","last_clean":"2024-05-08T09:23:37.492136+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:37.492136+0000","last_undegraded":"2024-05-08T09:23:37.492136+0000","last_fullsized":"2024-05-08T09:23:37.492136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:50.421255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961979+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:22:53.961979+0000","last_peered":"2024-05-08T09:22:53.961979+0000","last_clean":"2024-05-08T09:22:53.961979+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:22:53.961979+0000","last_undegraded":"2024-05-08T09:22:53.961979+0000","last_fullsized":"2024-05-08T09:22:53.961979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:25.908775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062758+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:22:16.062758+0000","last_peered":"2024-05-08T09:22:16.062758+0000","last_clean":"2024-05-08T09:22:16.062758+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:22:16.062758+0000","last_undegraded":"2024-05-08T09:22:16.062758+0000","last_fullsized":"2024-05-08T09:22:16.062758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065639+0000","last_change":"2024-05-08T09:21:30.953222+0000","last_active":"2024-05-08T09:22:16.065639+0000","last_peered":"2024-05-08T09:22:16.065639+0000","last_clean":"2024-05-08T09:22:16.065639+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:22:16.065639+0000","last_undegraded":"2024-05-08T09:22:16.065639+0000","last_fullsized":"2024-05-08T09:22:16.065639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:24.666609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913638+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:23:43.913638+0000","last_peered":"2024-05-08T09:23:43.913638+0000","last_clean":"2024-05-08T09:23:43.913638+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:23:43.913638+0000","last_undegraded":"2024-05-08T09:23:43.913638+0000","last_fullsized":"2024-05-08T09:23:43.913638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:58:40.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218043+0000","last_change":"2024-05-08T09:21:30.943497+0000","last_active":"2024-05-08T09:24:38.218043+0000","last_peered":"2024-05-08T09:24:38.218043+0000","last_clean":"2024-05-08T09:24:38.218043+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:24:38.218043+0000","last_undegraded":"2024-05-08T09:24:38.218043+0000","last_fullsized":"2024-05-08T09:24:38.218043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:59.730012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.925923+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.925923+0000","last_peered":"2024-05-08T09:24:37.925923+0000","last_clean":"2024-05-08T09:24:37.925923+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.925923+0000","last_undegraded":"2024-05-08T09:24:37.925923+0000","last_fullsized":"2024-05-08T09:24:37.925923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207990+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.207990+0000","last_peered":"2024-05-08T09:24:38.207990+0000","last_clean":"2024-05-08T09:24:38.207990+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.207990+0000","last_undegraded":"2024-05-08T09:24:38.207990+0000","last_fullsized":"2024-05-08T09:24:38.207990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:10:35.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998089+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:22:15.998089+0000","last_peered":"2024-05-08T09:22:15.998089+0000","last_clean":"2024-05-08T09:22:15.998089+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:22:15.998089+0000","last_undegraded":"2024-05-08T09:22:15.998089+0000","last_fullsized":"2024-05-08T09:22:15.998089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:04.866945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031169+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.031169+0000","last_peered":"2024-05-08T09:24:38.031169+0000","last_clean":"2024-05-08T09:24:38.031169+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.031169+0000","last_undegraded":"2024-05-08T09:24:38.031169+0000","last_fullsized":"2024-05-08T09:24:38.031169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914130+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:23:43.914130+0000","last_peered":"2024-05-08T09:23:43.914130+0000","last_clean":"2024-05-08T09:23:43.914130+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:23:43.914130+0000","last_undegraded":"2024-05-08T09:23:43.914130+0000","last_fullsized":"2024-05-08T09:23:43.914130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:30.030761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542031+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:37.542031+0000","last_peered":"2024-05-08T09:23:37.542031+0000","last_clean":"2024-05-08T09:23:37.542031+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:37.542031+0000","last_undegraded":"2024-05-08T09:23:37.542031+0000","last_fullsized":"2024-05-08T09:23:37.542031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:36.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158434+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.158434+0000","last_peered":"2024-05-08T09:24:38.158434+0000","last_clean":"2024-05-08T09:24:38.158434+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.158434+0000","last_undegraded":"2024-05-08T09:24:38.158434+0000","last_fullsized":"2024-05-08T09:24:38.158434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166918+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.166918+0000","last_peered":"2024-05-08T09:24:38.166918+0000","last_clean":"2024-05-08T09:24:38.166918+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.166918+0000","last_undegraded":"2024-05-08T09:24:38.166918+0000","last_fullsized":"2024-05-08T09:24:38.166918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:00.681814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998902+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:22:15.998902+0000","last_peered":"2024-05-08T09:22:15.998902+0000","last_clean":"2024-05-08T09:22:15.998902+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:22:15.998902+0000","last_undegraded":"2024-05-08T09:22:15.998902+0000","last_fullsized":"2024-05-08T09:22:15.998902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:39.136609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155448+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.155448+0000","last_peered":"2024-05-08T09:24:38.155448+0000","last_clean":"2024-05-08T09:24:38.155448+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.155448+0000","last_undegraded":"2024-05-08T09:24:38.155448+0000","last_fullsized":"2024-05-08T09:24:38.155448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066842+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:22:16.066842+0000","last_peered":"2024-05-08T09:22:16.066842+0000","last_clean":"2024-05-08T09:22:16.066842+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:22:16.066842+0000","last_undegraded":"2024-05-08T09:22:16.066842+0000","last_fullsized":"2024-05-08T09:22:16.066842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062889+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:22:16.062889+0000","last_peered":"2024-05-08T09:22:16.062889+0000","last_clean":"2024-05-08T09:22:16.062889+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:22:16.062889+0000","last_undegraded":"2024-05-08T09:22:16.062889+0000","last_fullsized":"2024-05-08T09:22:16.062889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218152+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.218152+0000","last_peered":"2024-05-08T09:24:38.218152+0000","last_clean":"2024-05-08T09:24:38.218152+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.218152+0000","last_undegraded":"2024-05-08T09:24:38.218152+0000","last_fullsized":"2024-05-08T09:24:38.218152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44680,"kb_used_data":9344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327160,"statfs":{"total":96636764160,"available":96591011840,"internally_reserved":0,"allocated":9568256,"data_stored":9328984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44716,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327124,"statfs":{"total":96636764160,"available":96590974976,"internally_reserved":0,"allocated":9605120,"data_stored":9331170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8743023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:24:46.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T09:24:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f92157ed640 1 Processor -- start 2024-05-08T09:24:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f92157ed640 1 -- start start 2024-05-08T09:24:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f92157ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9210127ea0 0x7f9210128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f92157ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9210071020 con 0x7f92101287c0 2024-05-08T09:24:46.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f92157ed640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f9210071780 con 0x7f9210127ea0 2024-05-08T09:24:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f920effd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9210127ea0 0x7f9210128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f920e7fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92101287c0 0x7f921012b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46564/0 (socket says 172.21.15.45:46564) 2024-05-08T09:24:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.161+0000 7f920e7fc640 1 -- 172.21.15.45:0/1474124157 learned_addr learned my addr 172.21.15.45:0/1474124157 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.162+0000 7f920effd640 1 -- 172.21.15.45:0/1474124157 >> v1:172.21.15.45:6789/0 conn(0x7f92101287c0 legacy=0x7f921012b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.162+0000 7f920effd640 1 -- 172.21.15.45:0/1474124157 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f921006e6e0 con 0x7f9210127ea0 2024-05-08T09:24:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.162+0000 7f920effd640 1 --2- 172.21.15.45:0/1474124157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f9210128280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9200009720 tx=0x7f920002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e73b73de45efd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f920dffb640 1 -- 172.21.15.45:0/1474124157 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9200035020 con 0x7f9210127ea0 2024-05-08T09:24:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f920dffb640 1 -- 172.21.15.45:0/1474124157 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200031760 con 0x7f9210127ea0 2024-05-08T09:24:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f920dffb640 1 -- 172.21.15.45:0/1474124157 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9200031a60 con 0x7f9210127ea0 2024-05-08T09:24:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 -- 172.21.15.45:0/1474124157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 msgr2=0x7f9210128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 --2- 172.21.15.45:0/1474124157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f9210128280 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f9200009720 tx=0x7f920002b8d0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 -- 172.21.15.45:0/1474124157 shutdown_connections 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 --2- 172.21.15.45:0/1474124157 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f9210128280 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 -- 172.21.15.45:0/1474124157 >> 172.21.15.45:0/1474124157 conn(0x7f9210099380 msgr2=0x7f9210099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 -- 172.21.15.45:0/1474124157 shutdown_connections 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.163+0000 7f92157ed640 1 -- 172.21.15.45:0/1474124157 wait complete. 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.164+0000 7f92157ed640 1 Processor -- start 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.164+0000 7f92157ed640 1 -- start start 2024-05-08T09:24:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.164+0000 7f92157ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.164+0000 7f92157ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f921012b800 con 0x7f9210127ea0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f920effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f920effd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46084/0 (socket says 172.21.15.45:46084) 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f920effd640 1 -- 172.21.15.45:0/1776914173 learned_addr learned my addr 172.21.15.45:0/1776914173 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f920effd640 1 -- 172.21.15.45:0/1776914173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9210119b80 con 0x7f9210127ea0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f920effd640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9200009720 tx=0x7f92000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f920003b980 con 0x7f9210127ea0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920003bb40 con 0x7f9210127ea0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f920003be60 con 0x7f9210127ea0 2024-05-08T09:24:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f921011a2d0 con 0x7f9210127ea0 2024-05-08T09:24:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.165+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f921011a5e0 con 0x7f9210127ea0 2024-05-08T09:24:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.166+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f920004c060 con 0x7f9210127ea0 2024-05-08T09:24:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.166+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9210062e90 con 0x7f9210127ea0 2024-05-08T09:24:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.167+0000 7f91f77fe640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 0x7f91fc03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.167+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f920006d7f0 con 0x7f9210127ea0 2024-05-08T09:24:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.167+0000 7f920e7fc640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 0x7f91fc03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.168+0000 7f920e7fc640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 0x7f91fc03a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9204007fd0 tx=0x7f9204007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.171+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f9200040070 con 0x7f9210127ea0 2024-05-08T09:24:46.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.355+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f921006eae0 con 0x7f9210127ea0 2024-05-08T09:24:46.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.357+0000 7f91f77fe640 1 -- 172.21.15.45:0/1776914173 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) ==== 74+0+20996 (secure 0 0 0) 0x7f9200030380 con 0x7f9210127ea0 2024-05-08T09:24:46.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:24:46.357 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"fsid":"57dabfa9-0c4c-41b5-8694-d94716898a33","created":"2024-05-08T09:21:10.474808+0000","modified":"2024-05-08T09:22:15.986821+0000","last_up_change":"2024-05-08T09:21:18.662327+0000","last_in_change":"2024-05-08T09:21:11.578003+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T09:21:18.874472+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-05-08T09:21:19.426995+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-05-08T09:21:26.954754+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-05-08T09:21:29.288509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-05-08T09:21:31.274620+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-05-08T09:21:33.052714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-05-08T09:21:35.002562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-05-08T09:21:37.084396+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0e23c86d-f1e4-406d-a723-e8c11567fdac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6801","nonce":2579517728}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6803","nonce":2579517728}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6807","nonce":2579517728}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":2579517728},{"type":"v1","addr":"172.21.15.45:6805","nonce":2579517728}]},"public_addr":"172.21.15.45:6801/2579517728","cluster_addr":"172.21.15.45:6803/2579517728","heartbeat_back_addr":"172.21.15.45:6807/2579517728","heartbeat_front_addr":"172.21.15.45:6805/2579517728","state":["exists","up"]},{"osd":1,"uuid":"08fc9bb7-d840-43f5-b921-9c83c643eb02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6801","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6803","nonce":4188235102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6809","nonce":4188235102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6820","nonce":4188235102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":4188235102},{"type":"v1","addr":"172.21.15.161:6815","nonce":4188235102}]},"public_addr":"172.21.15.161:6803/4188235102","cluster_addr":"172.21.15.161:6809/4188235102","heartbeat_back_addr":"172.21.15.161:6820/4188235102","heartbeat_front_addr":"172.21.15.161:6815/4188235102","state":["exists","up"]},{"osd":2,"uuid":"147190f8-36ff-4d5d-82c1-fb9b52d383c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6802","nonce":1967789976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6805","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6808","nonce":1967789976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6819","nonce":1967789976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":1967789976},{"type":"v1","addr":"172.21.15.161:6813","nonce":1967789976}]},"public_addr":"172.21.15.161:6802/1967789976","cluster_addr":"172.21.15.161:6808/1967789976","heartbeat_back_addr":"172.21.15.161:6819/1967789976","heartbeat_front_addr":"172.21.15.161:6813/1967789976","state":["exists","up"]},{"osd":3,"uuid":"249c3077-a292-4c01-893d-d51d0ea978b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6807","nonce":1879099265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6810","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6814","nonce":1879099265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6823","nonce":1879099265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":1879099265},{"type":"v1","addr":"172.21.15.161:6821","nonce":1879099265}]},"public_addr":"172.21.15.161:6807/1879099265","cluster_addr":"172.21.15.161:6814/1879099265","heartbeat_back_addr":"172.21.15.161:6823/1879099265","heartbeat_front_addr":"172.21.15.161:6821/1879099265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.625802+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.742080+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.733406+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T09:21:16.710305+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.10","mappings":[{"from":3,"to":2}]},{"pgid":"4.12","mappings":[{"from":3,"to":0}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.36","mappings":[{"from":3,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]},{"pgid":"5.1c","mappings":[{"from":0,"to":1}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 msgr2=0x7f91fc03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 0x7f91fc03a520 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9204007fd0 tx=0x7f9204007ac0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 msgr2=0x7f92101291c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f9200009720 tx=0x7f92000046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 shutdown_connections 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f91fc038060 0x7f91fc03a520 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 --2- 172.21.15.45:0/1776914173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9210127ea0 0x7f92101291c0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 >> 172.21.15.45:0/1776914173 conn(0x7f9210099380 msgr2=0x7f921006ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 shutdown_connections 2024-05-08T09:24:46.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:46.359+0000 7f92157ed640 1 -- 172.21.15.45:0/1776914173 wait complete. 2024-05-08T09:24:46.481 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-05-08T09:24:47.370 INFO:tasks.ceph:Scrubbing osd.0 2024-05-08T09:24:47.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-08T09:24:47.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.492+0000 7f7b2e9bd640 1 Processor -- start 2024-05-08T09:24:47.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.492+0000 7f7b2e9bd640 1 -- start start 2024-05-08T09:24:47.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b2e9bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b2812f340 0x7f7b28131730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b2e9bd640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b281230b0 con 0x7f7b28128f40 2024-05-08T09:24:47.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b2e9bd640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f7b280722f0 con 0x7f7b2812f340 2024-05-08T09:24:47.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b277fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b2812f340 0x7f7b28131730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b27fff640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b28128f40 0x7f7b28129320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46566/0 (socket says 172.21.15.45:46566) 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b27fff640 1 -- 172.21.15.45:0/2587415425 learned_addr learned my addr 172.21.15.45:0/2587415425 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b277fe640 1 -- 172.21.15.45:0/2587415425 >> v1:172.21.15.45:6789/0 conn(0x7f7b28128f40 legacy=0x7f7b28129320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b277fe640 1 -- 172.21.15.45:0/2587415425 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2806f970 con 0x7f7b2812f340 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.493+0000 7f7b26ffd640 1 -- 172.21.15.45:0/2587415425 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1370101569 0 0) 0x7f7b281230b0 con 0x7f7b28128f40 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.494+0000 7f7b277fe640 1 --2- 172.21.15.45:0/2587415425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2812f340 0x7f7b28131730 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009750 tx=0x7f7b1c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1beba5b027e794d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.494+0000 7f7b26ffd640 1 -- 172.21.15.45:0/2587415425 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c0316d0 con 0x7f7b2812f340 2024-05-08T09:24:47.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.494+0000 7f7b26ffd640 1 -- 172.21.15.45:0/2587415425 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b1c037070 con 0x7f7b2812f340 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.494+0000 7f7b26ffd640 1 -- 172.21.15.45:0/2587415425 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c0319c0 con 0x7f7b2812f340 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/2587415425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2812f340 msgr2=0x7f7b28131730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/2587415425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2812f340 0x7f7b28131730 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009750 tx=0x7f7b1c02b840 comp rx=0 tx=0).stop 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/2587415425 shutdown_connections 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/2587415425 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b2812f340 0x7f7b28131730 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/2587415425 >> 172.21.15.45:0/2587415425 conn(0x7f7b280991a0 msgr2=0x7f7b280995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/2587415425 shutdown_connections 2024-05-08T09:24:47.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/2587415425 wait complete. 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.495+0000 7f7b2e9bd640 1 Processor -- start 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b2e9bd640 1 -- start start 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b2e9bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b2e9bd640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28113160 con 0x7f7b28128f40 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46100/0 (socket says 172.21.15.45:46100) 2024-05-08T09:24:47.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.496+0000 7f7b27fff640 1 -- 172.21.15.45:0/1224681101 learned_addr learned my addr 172.21.15.45:0/1224681101 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b27fff640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281c0d90 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b27fff640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c420 tx=0x7f7b1800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b18018070 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b180074d0 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b18004950 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2812c850 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.497+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281150d0 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b28122960 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7b1801b070 con 0x7f7b28128f40 2024-05-08T09:24:47.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 0x7f7b1403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b1804ada0 con 0x7f7b28128f40 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 0x7f7b14046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b18006e50 con 0x7f7b140444d0 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7b1804d450 con 0x7f7b28128f40 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b2cf5a640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 0x7f7b14046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.498+0000 7f7b277fe640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 0x7f7b1403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.499+0000 7f7b2cf5a640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 0x7f7b14046970 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.499+0000 7f7b277fe640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 0x7f7b1403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c036000 tx=0x7f7b1c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.499+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== osd.0 v2:172.21.15.45:6800/2579517728 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b18006e50 con 0x7f7b140444d0 2024-05-08T09:24:47.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 --> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b28062e90 con 0x7f7b140444d0 2024-05-08T09:24:47.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b24ff9640 1 -- 172.21.15.45:0/1224681101 <== osd.0 v2:172.21.15.45:6800/2579517728 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b28062e90 con 0x7f7b140444d0 2024-05-08T09:24:47.513 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-08T09:24:47.513 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T09:24:47.513 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-08T09:24:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 msgr2=0x7f7b14046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 0x7f7b14046970 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 msgr2=0x7f7b1403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 0x7f7b1403a520 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c036000 tx=0x7f7b1c008030 comp rx=0 tx=0).stop 2024-05-08T09:24:47.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 msgr2=0x7f7b281c11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800c420 tx=0x7f7b1800c8e0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 shutdown_connections 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:6800/2579517728,v1:172.21.15.45:6801/2579517728] conn(0x7f7b140444d0 0x7f7b14046970 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b14038060 0x7f7b1403a520 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.513+0000 7f7b2e9bd640 1 --2- 172.21.15.45:0/1224681101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b28128f40 0x7f7b281c11d0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.514+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 >> 172.21.15.45:0/1224681101 conn(0x7f7b280991a0 msgr2=0x7f7b281276a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.514+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 shutdown_connections 2024-05-08T09:24:47.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.514+0000 7f7b2e9bd640 1 -- 172.21.15.45:0/1224681101 wait complete. 2024-05-08T09:24:47.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-08T09:24:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.628+0000 7f2c083a4640 1 Processor -- start 2024-05-08T09:24:47.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.628+0000 7f2c083a4640 1 -- start start 2024-05-08T09:24:47.628 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c083a4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c0006df70 0x7f2c001316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c083a4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c00098840 con 0x7f2c0006d480 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c083a4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f2c00072040 con 0x7f2c0006df70 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c0593f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c0006df70 0x7f2c001316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c06140640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2c0006d480 0x7f2c0006d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46580/0 (socket says 172.21.15.45:46580) 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c06140640 1 -- 172.21.15.45:0/1942681462 learned_addr learned my addr 172.21.15.45:0/1942681462 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c0593f640 1 -- 172.21.15.45:0/1942681462 >> v1:172.21.15.45:6789/0 conn(0x7f2c0006d480 legacy=0x7f2c0006d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c0513e640 1 -- 172.21.15.45:0/1942681462 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858831773 0 0) 0x7f2c00098840 con 0x7f2c0006d480 2024-05-08T09:24:47.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.629+0000 7f2c0593f640 1 -- 172.21.15.45:0/1942681462 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c00070b20 con 0x7f2c0006df70 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.630+0000 7f2c0593f640 1 --2- 172.21.15.45:0/1942681462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006df70 0x7f2c001316a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009720 tx=0x7f2bf002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cd7b88e1a12d8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.630+0000 7f2c0513e640 1 -- 172.21.15.45:0/1942681462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf00316d0 con 0x7f2c0006df70 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.630+0000 7f2c0513e640 1 -- 172.21.15.45:0/1942681462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf0037070 con 0x7f2c0006df70 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.630+0000 7f2c0513e640 1 -- 172.21.15.45:0/1942681462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bf00319c0 con 0x7f2c0006df70 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 -- 172.21.15.45:0/1942681462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006df70 msgr2=0x7f2c001316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1942681462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006df70 0x7f2c001316a0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0009720 tx=0x7f2bf002b840 comp rx=0 tx=0).stop 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 -- 172.21.15.45:0/1942681462 shutdown_connections 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1942681462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006df70 0x7f2c001316a0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 -- 172.21.15.45:0/1942681462 >> 172.21.15.45:0/1942681462 conn(0x7f2c000996c0 msgr2=0x7f2c00099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 -- 172.21.15.45:0/1942681462 shutdown_connections 2024-05-08T09:24:47.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.631+0000 7f2c083a4640 1 -- 172.21.15.45:0/1942681462 wait complete. 2024-05-08T09:24:47.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c083a4640 1 Processor -- start 2024-05-08T09:24:47.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c083a4640 1 -- start start 2024-05-08T09:24:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c083a4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c083a4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2c00071270 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c06140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c06140640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46110/0 (socket says 172.21.15.45:46110) 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c06140640 1 -- 172.21.15.45:0/1610639014 learned_addr learned my addr 172.21.15.45:0/1610639014 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.632+0000 7f2c06140640 1 -- 172.21.15.45:0/1610639014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c00070060 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2c06140640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c420 tx=0x7f2bfc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc018070 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0074d0 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0012d1d0 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2bfc004950 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.633+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0012d8b0 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.634+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f2bfc01b070 con 0x7f2c0006d480 2024-05-08T09:24:47.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.634+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c00062e90 con 0x7f2c0006d480 2024-05-08T09:24:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.634+0000 7f2bf6ffd640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 0x7f2be403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.634+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f2bfc04ada0 con 0x7f2c0006d480 2024-05-08T09:24:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.634+0000 7f2c0593f640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 0x7f2be403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.635+0000 7f2c0593f640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 0x7f2be403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf0008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.638+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2bfc011980 con 0x7f2c0006d480 2024-05-08T09:24:47.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.821+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f2c0012dd30 con 0x7f2be4038060 2024-05-08T09:24:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.822+0000 7f2bf6ffd640 1 -- 172.21.15.45:0/1610639014 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c0012dd30 con 0x7f2be4038060 2024-05-08T09:24:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 msgr2=0x7f2be403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 0x7f2be403a520 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2bf0036000 tx=0x7f2bf0008030 comp rx=0 tx=0).stop 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 msgr2=0x7f2c00096700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc00c420 tx=0x7f2bfc00c8e0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 shutdown_connections 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2be4038060 0x7f2be403a520 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 --2- 172.21.15.45:0/1610639014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c0006d480 0x7f2c00096700 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 >> 172.21.15.45:0/1610639014 conn(0x7f2c000996c0 msgr2=0x7f2c0009b530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 shutdown_connections 2024-05-08T09:24:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.824+0000 7f2c083a4640 1 -- 172.21.15.45:0/1610639014 wait complete. 2024-05-08T09:24:47.834 INFO:tasks.ceph:Scrubbing osd.1 2024-05-08T09:24:47.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-08T09:24:47.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.942+0000 7f6f8498a640 1 Processor -- start 2024-05-08T09:24:47.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.942+0000 7f6f8498a640 1 -- start start 2024-05-08T09:24:47.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.942+0000 7f6f8498a640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f80127ee0 0x7f6f801282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.942+0000 7f6f8498a640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8006e6e0 con 0x7f6f8012af70 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.942+0000 7f6f8498a640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f6f80127a90 con 0x7f6f80127ee0 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.943+0000 7f6f7e59c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f80127ee0 0x7f6f801282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.943+0000 7f6f7dd9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f8012af70 0x7f6f8012b3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46592/0 (socket says 172.21.15.45:46592) 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.943+0000 7f6f7dd9b640 1 -- 172.21.15.45:0/81617542 learned_addr learned my addr 172.21.15.45:0/81617542 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.943+0000 7f6f7e59c640 1 -- 172.21.15.45:0/81617542 >> v1:172.21.15.45:6789/0 conn(0x7f6f8012af70 legacy=0x7f6f8012b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.943+0000 7f6f7e59c640 1 -- 172.21.15.45:0/81617542 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f80128800 con 0x7f6f80127ee0 2024-05-08T09:24:47.943 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f7e59c640 1 --2- 172.21.15.45:0/81617542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801282c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009720 tx=0x7f6f7002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a86097ba1b2e18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f7d59a640 1 -- 172.21.15.45:0/81617542 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f700316d0 con 0x7f6f80127ee0 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f7d59a640 1 -- 172.21.15.45:0/81617542 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f70037070 con 0x7f6f80127ee0 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f7d59a640 1 -- 172.21.15.45:0/81617542 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f700319c0 con 0x7f6f80127ee0 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 -- 172.21.15.45:0/81617542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 msgr2=0x7f6f801282c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 --2- 172.21.15.45:0/81617542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801282c0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f6f70009720 tx=0x7f6f7002b840 comp rx=0 tx=0).stop 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 -- 172.21.15.45:0/81617542 shutdown_connections 2024-05-08T09:24:47.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 --2- 172.21.15.45:0/81617542 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801282c0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 -- 172.21.15.45:0/81617542 >> 172.21.15.45:0/81617542 conn(0x7f6f800991a0 msgr2=0x7f6f800995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.944+0000 7f6f8498a640 1 -- 172.21.15.45:0/81617542 shutdown_connections 2024-05-08T09:24:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.945+0000 7f6f8498a640 1 -- 172.21.15.45:0/81617542 wait complete. 2024-05-08T09:24:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.945+0000 7f6f8498a640 1 Processor -- start 2024-05-08T09:24:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f8498a640 1 -- start start 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f8498a640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f8498a640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6f80071e90 con 0x7f6f80127ee0 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f7e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f7e59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46128/0 (socket says 172.21.15.45:46128) 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f7e59c640 1 -- 172.21.15.45:0/1162222765 learned_addr learned my addr 172.21.15.45:0/1162222765 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f7e59c640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f80119490 con 0x7f6f80127ee0 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.946+0000 7f6f7e59c640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6f70034040 tx=0x7f6f700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f70032770 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f70032930 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f80116b90 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f70032c50 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f80119ec0 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.947+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f80118680 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6f7004c060 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 0x7f6f6003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6f7002f050 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 0x7f6f60046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f70007e60 con 0x7f6f600444d0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6f70074050 con 0x7f6f80127ee0 2024-05-08T09:24:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f7dd9b640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 0x7f6f6003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.948+0000 7f6f7ed9d640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 0x7f6f60046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.949+0000 7f6f7dd9b640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 0x7f6f6003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f74007fd0 tx=0x7f6f74007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.949+0000 7f6f7ed9d640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 0x7f6f60046970 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.949+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== osd.1 v2:172.21.15.161:6801/4188235102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6f70007e60 con 0x7f6f600444d0 2024-05-08T09:24:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 --> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f80062e90 con 0x7f6f600444d0 2024-05-08T09:24:47.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f6effd640 1 -- 172.21.15.45:0/1162222765 <== osd.1 v2:172.21.15.161:6801/4188235102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6f80062e90 con 0x7f6f600444d0 2024-05-08T09:24:47.963 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-08T09:24:47.963 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T09:24:47.963 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 msgr2=0x7f6f60046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 0x7f6f60046970 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 msgr2=0x7f6f6003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.963+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 0x7f6f6003a520 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6f74007fd0 tx=0x7f6f74007ac0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 msgr2=0x7f6f801c0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f6f70034040 tx=0x7f6f700046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 shutdown_connections 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6801/4188235102,v1:172.21.15.161:6803/4188235102] conn(0x7f6f600444d0 0x7f6f60046970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6f60038060 0x7f6f6003a520 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 --2- 172.21.15.45:0/1162222765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f80127ee0 0x7f6f801c0fb0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 >> 172.21.15.45:0/1162222765 conn(0x7f6f800991a0 msgr2=0x7f6f8006f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 shutdown_connections 2024-05-08T09:24:47.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:47.964+0000 7f6f8498a640 1 -- 172.21.15.45:0/1162222765 wait complete. 2024-05-08T09:24:47.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f950e1ed640 1 Processor -- start 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f950e1ed640 1 -- start start 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f950e1ed640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f950812e340 0x7f9508130730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f950e1ed640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9508098840 con 0x7f950812b2e0 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f950e1ed640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f950806f9a0 con 0x7f950812e340 2024-05-08T09:24:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f9506ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f950812e340 0x7f9508130730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f95077fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f950812b2e0 0x7f950812b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46596/0 (socket says 172.21.15.45:46596) 2024-05-08T09:24:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.078+0000 7f95077fe640 1 -- 172.21.15.45:0/251517976 learned_addr learned my addr 172.21.15.45:0/251517976 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.079+0000 7f9506ffd640 1 -- 172.21.15.45:0/251517976 >> v1:172.21.15.45:6789/0 conn(0x7f950812b2e0 legacy=0x7f950812b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.079+0000 7f9506ffd640 1 -- 172.21.15.45:0/251517976 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950812bdd0 con 0x7f950812e340 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.079+0000 7f9506ffd640 1 --2- 172.21.15.45:0/251517976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812e340 0x7f9508130730 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009750 tx=0x7f94fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb5d6f0ad92111 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f95067fc640 1 -- 172.21.15.45:0/251517976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94fc0316d0 con 0x7f950812e340 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f95067fc640 1 -- 172.21.15.45:0/251517976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94fc037070 con 0x7f950812e340 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f95067fc640 1 -- 172.21.15.45:0/251517976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94fc0319c0 con 0x7f950812e340 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 -- 172.21.15.45:0/251517976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812e340 msgr2=0x7f9508130730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 --2- 172.21.15.45:0/251517976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812e340 0x7f9508130730 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009750 tx=0x7f94fc02b840 comp rx=0 tx=0).stop 2024-05-08T09:24:48.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 -- 172.21.15.45:0/251517976 shutdown_connections 2024-05-08T09:24:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 --2- 172.21.15.45:0/251517976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812e340 0x7f9508130730 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 -- 172.21.15.45:0/251517976 >> 172.21.15.45:0/251517976 conn(0x7f95080996c0 msgr2=0x7f9508099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.080+0000 7f950e1ed640 1 -- 172.21.15.45:0/251517976 shutdown_connections 2024-05-08T09:24:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.081+0000 7f950e1ed640 1 -- 172.21.15.45:0/251517976 wait complete. 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f950e1ed640 1 Processor -- start 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f950e1ed640 1 -- start start 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f950e1ed640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f950e1ed640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f9508070190 con 0x7f950812b2e0 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f95077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f95077fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46156/0 (socket says 172.21.15.45:46156) 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.082+0000 7f95077fe640 1 -- 172.21.15.45:0/1503781960 learned_addr learned my addr 172.21.15.45:0/1503781960 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f95077fe640 1 -- 172.21.15.45:0/1503781960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950806d6f0 con 0x7f950812b2e0 2024-05-08T09:24:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f95077fe640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c4a0 tx=0x7f94f800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8017070 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f8005c10 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94f8007070 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f950808a2b0 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.083+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9508127ea0 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.084+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f94f801a070 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.084+0000 7f94effff640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 0x7f94f403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.084+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f94f804aca0 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.084+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9508062e90 con 0x7f950812b2e0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.084+0000 7f9506ffd640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 0x7f94f403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.085+0000 7f9506ffd640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 0x7f94f403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009750 tx=0x7f94fc008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.089+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f94f801b3b0 con 0x7f950812b2e0 2024-05-08T09:24:48.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.274+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f950808a840 con 0x7f94f4038060 2024-05-08T09:24:48.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.275+0000 7f94effff640 1 -- 172.21.15.45:0/1503781960 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f94fc037040 con 0x7f94f4038060 2024-05-08T09:24:48.274 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 msgr2=0x7f94f403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 0x7f94f403a520 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009750 tx=0x7f94fc008030 comp rx=0 tx=0).stop 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 msgr2=0x7f9508096000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f94f800c4a0 tx=0x7f94f800c960 comp rx=0 tx=0).stop 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 shutdown_connections 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f94f4038060 0x7f94f403a520 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 --2- 172.21.15.45:0/1503781960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f950812b2e0 0x7f9508096000 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 >> 172.21.15.45:0/1503781960 conn(0x7f95080996c0 msgr2=0x7f950812e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 shutdown_connections 2024-05-08T09:24:48.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.277+0000 7f950e1ed640 1 -- 172.21.15.45:0/1503781960 wait complete. 2024-05-08T09:24:48.287 INFO:tasks.ceph:Scrubbing osd.2 2024-05-08T09:24:48.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-08T09:24:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.395+0000 7f6eb889d640 1 Processor -- start 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.395+0000 7f6eb889d640 1 -- start start 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eb889d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6eb4071470 0x7f6eb412fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eb889d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb4070e00 con 0x7f6eb412a8f0 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eb889d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb4072330 con 0x7f6eb4071470 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6eb4071470 0x7f6eb412fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eb259c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6eb412a8f0 0x7f6eb412acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46608/0 (socket says 172.21.15.45:46608) 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eabfff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6eb4071470 0x7f6eb412fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46160/0 (socket says 172.21.15.45:46160) 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eb259c640 1 -- 172.21.15.45:0/2827892505 learned_addr learned my addr 172.21.15.45:0/2827892505 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eabfff640 1 -- 172.21.15.45:0/2827892505 >> v1:172.21.15.45:6789/0 conn(0x7f6eb412a8f0 legacy=0x7f6eb412acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.396+0000 7f6eabfff640 1 -- 172.21.15.45:0/2827892505 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb412b3e0 con 0x7f6eb4071470 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.397+0000 7f6eabfff640 1 --2- 172.21.15.45:0/2827892505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb412fa00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b9c0 tx=0x7f6e9c02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e920302ddbf93890 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.397+0000 7f6eb1d9b640 1 -- 172.21.15.45:0/2827892505 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c03b070 con 0x7f6eb4071470 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.397+0000 7f6eb1d9b640 1 -- 172.21.15.45:0/2827892505 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c02ecf0 con 0x7f6eb4071470 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.397+0000 7f6eb1d9b640 1 -- 172.21.15.45:0/2827892505 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e9c036440 con 0x7f6eb4071470 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 -- 172.21.15.45:0/2827892505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 msgr2=0x7f6eb412fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2827892505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb412fa00 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00b9c0 tx=0x7f6e9c02e010 comp rx=0 tx=0).stop 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 -- 172.21.15.45:0/2827892505 shutdown_connections 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2827892505 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb412fa00 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 -- 172.21.15.45:0/2827892505 >> 172.21.15.45:0/2827892505 conn(0x7f6eb40991a0 msgr2=0x7f6eb40995b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 -- 172.21.15.45:0/2827892505 shutdown_connections 2024-05-08T09:24:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.398+0000 7f6eb889d640 1 -- 172.21.15.45:0/2827892505 wait complete. 2024-05-08T09:24:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb889d640 1 Processor -- start 2024-05-08T09:24:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb889d640 1 -- start start 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb889d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb889d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb406e5f0 con 0x7f6eb4071470 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46166/0 (socket says 172.21.15.45:46166) 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.399+0000 7f6eb259c640 1 -- 172.21.15.45:0/2280168222 learned_addr learned my addr 172.21.15.45:0/2280168222 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eb259c640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb411e500 con 0x7f6eb4071470 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eb259c640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c4a0 tx=0x7f6ea400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea4017070 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea4005c10 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb411e940 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6ea4007070 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.400+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb411b890 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6eb4062e90 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f6ea401a070 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 0x7f6e9403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f6ea404ad00 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 0x7f6e94046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e94047040 con 0x7f6e940444d0 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6ea404d350 con 0x7f6eb4071470 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eabfff640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 0x7f6e9403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.401+0000 7f6eb2d9d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 0x7f6e94046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.402+0000 7f6eb2d9d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 0x7f6e94046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.402+0000 7f6eabfff640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 0x7f6e9403a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c038000 tx=0x7f6e9c032000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.403+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== osd.2 v2:172.21.15.161:6800/1967789976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e94047040 con 0x7f6e940444d0 2024-05-08T09:24:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.416+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 --> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6eb411df20 con 0x7f6e940444d0 2024-05-08T09:24:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.416+0000 7f6eaaffd640 1 -- 172.21.15.45:0/2280168222 <== osd.2 v2:172.21.15.161:6800/1967789976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6eac00ad10 con 0x7f6e940444d0 2024-05-08T09:24:48.416 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-08T09:24:48.416 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T09:24:48.416 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 msgr2=0x7f6e94046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 0x7f6e94046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 msgr2=0x7f6e9403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 0x7f6e9403a520 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c038000 tx=0x7f6e9c032000 comp rx=0 tx=0).stop 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 msgr2=0x7f6eb411b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f6ea400c4a0 tx=0x7f6ea400c960 comp rx=0 tx=0).stop 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 shutdown_connections 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6800/1967789976,v1:172.21.15.161:6802/1967789976] conn(0x7f6e940444d0 0x7f6e94046970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f6e94038060 0x7f6e9403a520 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 --2- 172.21.15.45:0/2280168222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6eb4071470 0x7f6eb411b350 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 >> 172.21.15.45:0/2280168222 conn(0x7f6eb40991a0 msgr2=0x7f6eb409a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 shutdown_connections 2024-05-08T09:24:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.417+0000 7f6eb889d640 1 -- 172.21.15.45:0/2280168222 wait complete. 2024-05-08T09:24:48.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.531+0000 7fe49083e640 1 Processor -- start 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.531+0000 7fe49083e640 1 -- start start 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.531+0000 7fe49083e640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe48c06df70 0x7fe48c1316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.531+0000 7fe49083e640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48c098840 con 0x7fe48c06d480 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.531+0000 7fe49083e640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe48c072040 con 0x7fe48c06df70 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.532+0000 7fe489d9b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe48c06df70 0x7fe48c1316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.532+0000 7fe48a59c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe48c06d480 0x7fe48c06d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46622/0 (socket says 172.21.15.45:46622) 2024-05-08T09:24:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.532+0000 7fe48a59c640 1 -- 172.21.15.45:0/3968376851 learned_addr learned my addr 172.21.15.45:0/3968376851 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.532+0000 7fe489d9b640 1 -- 172.21.15.45:0/3968376851 >> v1:172.21.15.45:6789/0 conn(0x7fe48c06d480 legacy=0x7fe48c06d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.532+0000 7fe489d9b640 1 -- 172.21.15.45:0/3968376851 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c070b20 con 0x7fe48c06df70 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe489d9b640 1 --2- 172.21.15.45:0/3968376851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06df70 0x7fe48c1316a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe480009720 tx=0x7fe48002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe0366b3aa8da2b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe48959a640 1 -- 172.21.15.45:0/3968376851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800316d0 con 0x7fe48c06df70 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe48959a640 1 -- 172.21.15.45:0/3968376851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe480037070 con 0x7fe48c06df70 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe48959a640 1 -- 172.21.15.45:0/3968376851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4800319c0 con 0x7fe48c06df70 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 -- 172.21.15.45:0/3968376851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06df70 msgr2=0x7fe48c1316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 --2- 172.21.15.45:0/3968376851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06df70 0x7fe48c1316a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fe480009720 tx=0x7fe48002b840 comp rx=0 tx=0).stop 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 -- 172.21.15.45:0/3968376851 shutdown_connections 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 --2- 172.21.15.45:0/3968376851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06df70 0x7fe48c1316a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 -- 172.21.15.45:0/3968376851 >> 172.21.15.45:0/3968376851 conn(0x7fe48c0996c0 msgr2=0x7fe48c099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 -- 172.21.15.45:0/3968376851 shutdown_connections 2024-05-08T09:24:48.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.533+0000 7fe49083e640 1 -- 172.21.15.45:0/3968376851 wait complete. 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.534+0000 7fe49083e640 1 Processor -- start 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.534+0000 7fe49083e640 1 -- start start 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe49083e640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe49083e640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe48c071270 con 0x7fe48c06d480 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe48a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe48a59c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46194/0 (socket says 172.21.15.45:46194) 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe48a59c640 1 -- 172.21.15.45:0/2295112578 learned_addr learned my addr 172.21.15.45:0/2295112578 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe48a59c640 1 -- 172.21.15.45:0/2295112578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48c12f750 con 0x7fe48c06d480 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe48a59c640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c4a0 tx=0x7fe47c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.535+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe47c017070 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47c005c10 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe47c007070 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe48c12d0d0 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe48c12d5a0 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe47c01a070 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.536+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48c062e90 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.537+0000 7fe47affd640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 0x7fe46c03a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.537+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe47c04adc0 con 0x7fe48c06d480 2024-05-08T09:24:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.537+0000 7fe489d9b640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 0x7fe46c03a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.538+0000 7fe489d9b640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 0x7fe46c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe480036000 tx=0x7fe480008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.541+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe47c049190 con 0x7fe48c06d480 2024-05-08T09:24:48.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.723+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe48c12fa30 con 0x7fe46c038060 2024-05-08T09:24:48.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.724+0000 7fe47affd640 1 -- 172.21.15.45:0/2295112578 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe480037040 con 0x7fe46c038060 2024-05-08T09:24:48.723 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2024-05-08T09:24:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 msgr2=0x7fe46c03a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 0x7fe46c03a520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe480036000 tx=0x7fe480008030 comp rx=0 tx=0).stop 2024-05-08T09:24:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 msgr2=0x7fe48c12cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fe47c00c4a0 tx=0x7fe47c00c960 comp rx=0 tx=0).stop 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 shutdown_connections 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe46c038060 0x7fe46c03a520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 --2- 172.21.15.45:0/2295112578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe48c06d480 0x7fe48c12cb90 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 >> 172.21.15.45:0/2295112578 conn(0x7fe48c0996c0 msgr2=0x7fe48c1289d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 shutdown_connections 2024-05-08T09:24:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.727+0000 7fe49083e640 1 -- 172.21.15.45:0/2295112578 wait complete. 2024-05-08T09:24:48.736 INFO:tasks.ceph:Scrubbing osd.3 2024-05-08T09:24:48.737 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-08T09:24:48.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.845+0000 7f8cb699f640 1 Processor -- start 2024-05-08T09:24:48.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.845+0000 7f8cb699f640 1 -- start start 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb699f640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cb012e5a0 0x7f8cb012e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb699f640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cb009df70 con 0x7f8cb0098cd0 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb699f640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f8cb0074620 con 0x7f8cb012e5a0 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb599d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cb012e5a0 0x7f8cb012e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb519c640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8cb0098cd0 0x7f8cb0099110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46628/0 (socket says 172.21.15.45:46628) 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb519c640 1 -- 172.21.15.45:0/1800448570 learned_addr learned my addr 172.21.15.45:0/1800448570 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb599d640 1 -- 172.21.15.45:0/1800448570 >> v1:172.21.15.45:6789/0 conn(0x7f8cb0098cd0 legacy=0x7f8cb0099110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb599d640 1 -- 172.21.15.45:0/1800448570 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb009dc40 con 0x7f8cb012e5a0 2024-05-08T09:24:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.846+0000 7f8cb499b640 1 -- 172.21.15.45:0/1800448570 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941645760 0 0) 0x7f8cb009df70 con 0x7f8cb0098cd0 2024-05-08T09:24:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.847+0000 7f8cb599d640 1 --2- 172.21.15.45:0/1800448570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb012e5a0 0x7f8cb012e980 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009720 tx=0x7f8cac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62787c1a1e56dac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.847+0000 7f8cb499b640 1 -- 172.21.15.45:0/1800448570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac0316d0 con 0x7f8cb012e5a0 2024-05-08T09:24:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.847+0000 7f8cb499b640 1 -- 172.21.15.45:0/1800448570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac037070 con 0x7f8cb012e5a0 2024-05-08T09:24:48.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.847+0000 7f8cb499b640 1 -- 172.21.15.45:0/1800448570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac0319c0 con 0x7f8cb012e5a0 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 -- 172.21.15.45:0/1800448570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb012e5a0 msgr2=0x7f8cb012e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 --2- 172.21.15.45:0/1800448570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb012e5a0 0x7f8cb012e980 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009720 tx=0x7f8cac02b840 comp rx=0 tx=0).stop 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 -- 172.21.15.45:0/1800448570 shutdown_connections 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 --2- 172.21.15.45:0/1800448570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb012e5a0 0x7f8cb012e980 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 -- 172.21.15.45:0/1800448570 >> 172.21.15.45:0/1800448570 conn(0x7f8cb00a0df0 msgr2=0x7f8cb009d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 -- 172.21.15.45:0/1800448570 shutdown_connections 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.848+0000 7f8cb699f640 1 -- 172.21.15.45:0/1800448570 wait complete. 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb699f640 1 Processor -- start 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb699f640 1 -- start start 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb699f640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb699f640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb009a8d0 con 0x7f8cb0098cd0 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb599d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb599d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46216/0 (socket says 172.21.15.45:46216) 2024-05-08T09:24:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb599d640 1 -- 172.21.15.45:0/637383676 learned_addr learned my addr 172.21.15.45:0/637383676 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.849+0000 7f8cb599d640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb012b510 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8cb599d640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034040 tx=0x7f8cac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac032770 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cac032930 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb012d6d0 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8cac032c50 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.850+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb012ae80 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f8cac04c060 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cb012b110 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 0x7f8c9403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f8cac02f050 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 0x7f8c94046970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8cac048ec0 con 0x7f8c940444d0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8cac074050 con 0x7f8cb0098cd0 2024-05-08T09:24:48.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8cb519c640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 0x7f8c9403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.851+0000 7f8cb619e640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 0x7f8c94046970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.852+0000 7f8cb619e640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 0x7f8c94046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.852+0000 7f8cb519c640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 0x7f8c9403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0000c00 tx=0x7f8ca0007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.852+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== osd.3 v2:172.21.15.161:6804/1879099265 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8cac048ec0 con 0x7f8c940444d0 2024-05-08T09:24:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.865+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 --> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8cb0062e90 con 0x7f8c940444d0 2024-05-08T09:24:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.866+0000 7f8ca67fc640 1 -- 172.21.15.45:0/637383676 <== osd.3 v2:172.21.15.161:6804/1879099265 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8cb0062e90 con 0x7f8c940444d0 2024-05-08T09:24:48.865 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-05-08T09:24:48.866 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-08T09:24:48.866 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 msgr2=0x7f8c94046970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 0x7f8c94046970 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 msgr2=0x7f8c9403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 0x7f8c9403a520 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0000c00 tx=0x7f8ca0007910 comp rx=0 tx=0).stop 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 msgr2=0x7f8cb0128b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f8cac034040 tx=0x7f8cac0046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 shutdown_connections 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6804/1879099265,v1:172.21.15.161:6807/1879099265] conn(0x7f8c940444d0 0x7f8c94046970 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f8c94038060 0x7f8c9403a520 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 --2- 172.21.15.45:0/637383676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cb0098cd0 0x7f8cb0128b30 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 >> 172.21.15.45:0/637383676 conn(0x7f8cb00a0df0 msgr2=0x7f8cb009b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 shutdown_connections 2024-05-08T09:24:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.867+0000 7f8cb699f640 1 -- 172.21.15.45:0/637383676 wait complete. 2024-05-08T09:24:48.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-08T09:24:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f292207b640 1 Processor -- start 2024-05-08T09:24:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f292207b640 1 -- start start 2024-05-08T09:24:48.983 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f292207b640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f291c06d6f0 0x7f291c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f292207b640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f291c06f120 con 0x7f291c06e010 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f292207b640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f291c06e800 con 0x7f291c06d6f0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f291b7fe640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f291c06d6f0 0x7f291c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f291affd640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f291c06e010 0x7f291c070650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46640/0 (socket says 172.21.15.45:46640) 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.983+0000 7f291affd640 1 -- 172.21.15.45:0/1831032187 learned_addr learned my addr 172.21.15.45:0/1831032187 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.984+0000 7f291b7fe640 1 -- 172.21.15.45:0/1831032187 >> v1:172.21.15.45:6789/0 conn(0x7f291c06e010 legacy=0x7f291c070650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.984+0000 7f291b7fe640 1 -- 172.21.15.45:0/1831032187 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c071b20 con 0x7f291c06d6f0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.984+0000 7f291b7fe640 1 --2- 172.21.15.45:0/1831032187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c06dad0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b9c0 tx=0x7f290c02e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9a56b174fa41c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.984+0000 7f291a7fc640 1 -- 172.21.15.45:0/1831032187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c03b070 con 0x7f291c06d6f0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f291a7fc640 1 -- 172.21.15.45:0/1831032187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c02ecf0 con 0x7f291c06d6f0 2024-05-08T09:24:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f291a7fc640 1 -- 172.21.15.45:0/1831032187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c036440 con 0x7f291c06d6f0 2024-05-08T09:24:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 -- 172.21.15.45:0/1831032187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 msgr2=0x7f291c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 --2- 172.21.15.45:0/1831032187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c06dad0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f290c00b9c0 tx=0x7f290c02e010 comp rx=0 tx=0).stop 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 -- 172.21.15.45:0/1831032187 shutdown_connections 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 --2- 172.21.15.45:0/1831032187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c06dad0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 -- 172.21.15.45:0/1831032187 >> 172.21.15.45:0/1831032187 conn(0x7f291c0996c0 msgr2=0x7f291c099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 -- 172.21.15.45:0/1831032187 shutdown_connections 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.985+0000 7f292207b640 1 -- 172.21.15.45:0/1831032187 wait complete. 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.986+0000 7f292207b640 1 Processor -- start 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.986+0000 7f292207b640 1 -- start start 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f292207b640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f292207b640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f291c0985d0 con 0x7f291c06d6f0 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f291b7fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46240/0 (socket says 172.21.15.45:46240) 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f291b7fe640 1 -- 172.21.15.45:0/3616682461 learned_addr learned my addr 172.21.15.45:0/3616682461 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f291b7fe640 1 -- 172.21.15.45:0/3616682461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c1aaf00 con 0x7f291c06d6f0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f291b7fe640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f290c039040 tx=0x7f290c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c046070 con 0x7f291c06d6f0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f290c041560 con 0x7f291c06d6f0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c096d10 con 0x7f291c06d6f0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f290c03b040 con 0x7f291c06d6f0 2024-05-08T09:24:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.987+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c0964c0 con 0x7f291c06d6f0 2024-05-08T09:24:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.988+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f290c049070 con 0x7f291c06d6f0 2024-05-08T09:24:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.988+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291c062e90 con 0x7f291c06d6f0 2024-05-08T09:24:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.988+0000 7f2903fff640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 0x7f290803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.988+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f290c06d830 con 0x7f291c06d6f0 2024-05-08T09:24:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.989+0000 7f291affd640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 0x7f290803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.989+0000 7f291affd640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 0x7f290803a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2910007fd0 tx=0x7f2910007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:48.993+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f291c1aaf00 con 0x7f291c06d6f0 2024-05-08T09:24:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.176+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f291c096020 con 0x7f2908038060 2024-05-08T09:24:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.177+0000 7f2903fff640 1 -- 172.21.15.45:0/3616682461 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f291c096020 con 0x7f2908038060 2024-05-08T09:24:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2024-05-08T09:24:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 msgr2=0x7f290803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 0x7f290803a520 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f2910007fd0 tx=0x7f2910007ac0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 msgr2=0x7f291c1bfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f290c039040 tx=0x7f290c0046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 shutdown_connections 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2908038060 0x7f290803a520 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 --2- 172.21.15.45:0/3616682461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291c06d6f0 0x7f291c1bfc90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 >> 172.21.15.45:0/3616682461 conn(0x7f291c0996c0 msgr2=0x7f291c08c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 shutdown_connections 2024-05-08T09:24:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.179+0000 7f292207b640 1 -- 172.21.15.45:0/3616682461 wait complete. 2024-05-08T09:24:49.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:24:49.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.292+0000 7f2128d21640 1 Processor -- start 2024-05-08T09:24:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.292+0000 7f2128d21640 1 -- start start 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f2128d21640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f212406e6d0 0x7f212406eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f2128d21640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f212406cfa0 con 0x7f212406eff0 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f2128d21640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f212406fe00 con 0x7f212406e6d0 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f212259c640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f212406e6d0 0x7f212406eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f2121d9b640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f212406eff0 0x7f212412e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46648/0 (socket says 172.21.15.45:46648) 2024-05-08T09:24:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f2121d9b640 1 -- 172.21.15.45:0/1525414346 learned_addr learned my addr 172.21.15.45:0/1525414346 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f212259c640 1 -- 172.21.15.45:0/1525414346 >> v1:172.21.15.45:6789/0 conn(0x7f212406eff0 legacy=0x7f212412e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.293+0000 7f212259c640 1 -- 172.21.15.45:0/1525414346 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f212406f9c0 con 0x7f212406e6d0 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.294+0000 7f212259c640 1 --2- 172.21.15.45:0/1525414346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f212406eab0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2114009720 tx=0x7f211402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b6ad9f99a82905 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.294+0000 7f212159a640 1 -- 172.21.15.45:0/1525414346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2114035020 con 0x7f212406e6d0 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.294+0000 7f212159a640 1 -- 172.21.15.45:0/1525414346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2114031760 con 0x7f212406e6d0 2024-05-08T09:24:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.294+0000 7f212159a640 1 -- 172.21.15.45:0/1525414346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2114031a60 con 0x7f212406e6d0 2024-05-08T09:24:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 -- 172.21.15.45:0/1525414346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 msgr2=0x7f212406eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 --2- 172.21.15.45:0/1525414346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f212406eab0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f2114009720 tx=0x7f211402b8d0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 -- 172.21.15.45:0/1525414346 shutdown_connections 2024-05-08T09:24:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 --2- 172.21.15.45:0/1525414346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f212406eab0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 -- 172.21.15.45:0/1525414346 >> 172.21.15.45:0/1525414346 conn(0x7f212409da30 msgr2=0x7f212409de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 -- 172.21.15.45:0/1525414346 shutdown_connections 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.295+0000 7f2128d21640 1 -- 172.21.15.45:0/1525414346 wait complete. 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f2128d21640 1 Processor -- start 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f2128d21640 1 -- start start 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f2128d21640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f2128d21640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f2124072450 con 0x7f212406e6d0 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f212259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f212259c640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46270/0 (socket says 172.21.15.45:46270) 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f212259c640 1 -- 172.21.15.45:0/2412568890 learned_addr learned my addr 172.21.15.45:0/2412568890 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.296+0000 7f212259c640 1 -- 172.21.15.45:0/2412568890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124096800 con 0x7f212406e6d0 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f212259c640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2114009840 tx=0x7f21140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f211403b930 con 0x7f212406e6d0 2024-05-08T09:24:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f211403baf0 con 0x7f212406e6d0 2024-05-08T09:24:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21241a89c0 con 0x7f212406e6d0 2024-05-08T09:24:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f211403be10 con 0x7f212406e6d0 2024-05-08T09:24:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.297+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21241a9980 con 0x7f212406e6d0 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.298+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f211404c060 con 0x7f212406e6d0 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.298+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2124062e90 con 0x7f212406e6d0 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.298+0000 7f2112ffd640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 0x7f210403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.298+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f211406d7f0 con 0x7f212406e6d0 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.298+0000 7f2121d9b640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 0x7f210403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:24:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.299+0000 7f2121d9b640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 0x7f210403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2118007fd0 tx=0x7f2118007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:24:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.303+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f2114040070 con 0x7f212406e6d0 2024-05-08T09:24:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.483+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f212406d550 con 0x7f2104038060 2024-05-08T09:24:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.498+0000 7f2112ffd640 1 -- 172.21.15.45:0/2412568890 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+665914 (secure 0 0 0) 0x7f212406d550 con 0x7f2104038060 2024-05-08T09:24:49.505 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:24:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 msgr2=0x7f210403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 0x7f210403a520 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2118007fd0 tx=0x7f2118007ac0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 msgr2=0x7f21241c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2114009840 tx=0x7f21140046c0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 shutdown_connections 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f2104038060 0x7f210403a520 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 --2- 172.21.15.45:0/2412568890 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f212406e6d0 0x7f21241c2fe0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 >> 172.21.15.45:0/2412568890 conn(0x7f212409da30 msgr2=0x7f21241b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 shutdown_connections 2024-05-08T09:24:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:24:49.503+0000 7f2128d21640 1 -- 172.21.15.45:0/2412568890 wait complete. 2024-05-08T09:24:49.518 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-05-08T09:24:48.895124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416886,"num_objects":227,"num_object_clones":0,"num_object_copies":468,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":4884,"num_read_kb":4461,"num_write":2104,"num_write_kb":61372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4476,"ondisk_log_size":4476,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":173552,"kb_used_data":36368,"kb_used_omap":6,"kb_used_meta":137145,"kb_avail":377313808,"statfs":{"total":386547056640,"available":386369339392,"internally_reserved":0,"allocated":37240832,"data_stored":36146188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":140437271},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":497,"num_read_kb":452,"num_write":384,"num_write_kb":29371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003426"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001076+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:22:16.001076+0000","last_peered":"2024-05-08T09:22:16.001076+0000","last_clean":"2024-05-08T09:22:16.001076+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:22:16.001076+0000","last_undegraded":"2024-05-08T09:22:16.001076+0000","last_fullsized":"2024-05-08T09:22:16.001076+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916991+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:03.916991+0000","last_peered":"2024-05-08T09:24:03.916991+0000","last_clean":"2024-05-08T09:24:03.916991+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:03.916991+0000","last_undegraded":"2024-05-08T09:24:03.916991+0000","last_fullsized":"2024-05-08T09:24:03.916991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:23.115981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.375414+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.375414+0000","last_peered":"2024-05-08T09:23:37.375414+0000","last_clean":"2024-05-08T09:23:37.375414+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.375414+0000","last_undegraded":"2024-05-08T09:23:37.375414+0000","last_fullsized":"2024-05-08T09:23:37.375414+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:25:09.233706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166680+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.166680+0000","last_peered":"2024-05-08T09:24:38.166680+0000","last_clean":"2024-05-08T09:24:38.166680+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.166680+0000","last_undegraded":"2024-05-08T09:24:38.166680+0000","last_fullsized":"2024-05-08T09:24:38.166680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:08.198970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997644+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:22:15.997644+0000","last_peered":"2024-05-08T09:22:15.997644+0000","last_clean":"2024-05-08T09:22:15.997644+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:22:15.997644+0000","last_undegraded":"2024-05-08T09:22:15.997644+0000","last_fullsized":"2024-05-08T09:22:15.997644+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:15.219028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961300+0000","last_change":"2024-05-08T09:21:30.959732+0000","last_active":"2024-05-08T09:22:53.961300+0000","last_peered":"2024-05-08T09:22:53.961300+0000","last_clean":"2024-05-08T09:22:53.961300+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:22:53.961300+0000","last_undegraded":"2024-05-08T09:22:53.961300+0000","last_fullsized":"2024-05-08T09:22:53.961300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:51.106660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000563+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:22:16.000563+0000","last_peered":"2024-05-08T09:22:16.000563+0000","last_clean":"2024-05-08T09:22:16.000563+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:22:16.000563+0000","last_undegraded":"2024-05-08T09:22:16.000563+0000","last_fullsized":"2024-05-08T09:22:16.000563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944601+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.944601+0000","last_peered":"2024-05-08T09:24:37.944601+0000","last_clean":"2024-05-08T09:24:37.944601+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.944601+0000","last_undegraded":"2024-05-08T09:24:37.944601+0000","last_fullsized":"2024-05-08T09:24:37.944601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:05.452991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996051+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:22:15.996051+0000","last_peered":"2024-05-08T09:22:15.996051+0000","last_clean":"2024-05-08T09:22:15.996051+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:22:15.996051+0000","last_undegraded":"2024-05-08T09:22:15.996051+0000","last_fullsized":"2024-05-08T09:22:15.996051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:33.486446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030810+0000","last_change":"2024-05-08T09:21:30.942925+0000","last_active":"2024-05-08T09:24:38.030810+0000","last_peered":"2024-05-08T09:24:38.030810+0000","last_clean":"2024-05-08T09:24:38.030810+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:24:38.030810+0000","last_undegraded":"2024-05-08T09:24:38.030810+0000","last_fullsized":"2024-05-08T09:24:38.030810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998378+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:22:15.998378+0000","last_peered":"2024-05-08T09:22:15.998378+0000","last_clean":"2024-05-08T09:22:15.998378+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:22:15.998378+0000","last_undegraded":"2024-05-08T09:22:15.998378+0000","last_fullsized":"2024-05-08T09:22:15.998378+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.946666+0000","last_change":"2024-05-08T09:21:30.960649+0000","last_active":"2024-05-08T09:24:37.946666+0000","last_peered":"2024-05-08T09:24:37.946666+0000","last_clean":"2024-05-08T09:24:37.946666+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:24:37.946666+0000","last_undegraded":"2024-05-08T09:24:37.946666+0000","last_fullsized":"2024-05-08T09:24:37.946666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:38.405348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995105+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:22:15.995105+0000","last_peered":"2024-05-08T09:22:15.995105+0000","last_clean":"2024-05-08T09:22:15.995105+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:22:15.995105+0000","last_undegraded":"2024-05-08T09:22:15.995105+0000","last_fullsized":"2024-05-08T09:22:15.995105+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:44:05.261094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000928+0000","last_change":"2024-05-08T09:21:30.950639+0000","last_active":"2024-05-08T09:22:16.000928+0000","last_peered":"2024-05-08T09:22:16.000928+0000","last_clean":"2024-05-08T09:22:16.000928+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:22:16.000928+0000","last_undegraded":"2024-05-08T09:22:16.000928+0000","last_fullsized":"2024-05-08T09:22:16.000928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.951539+0000","last_change":"2024-05-08T09:21:28.962227+0000","last_active":"2024-05-08T09:22:53.951539+0000","last_peered":"2024-05-08T09:22:53.951539+0000","last_clean":"2024-05-08T09:22:53.951539+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:22:53.951539+0000","last_undegraded":"2024-05-08T09:22:53.951539+0000","last_fullsized":"2024-05-08T09:22:53.951539+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030974+0000","last_change":"2024-05-08T09:21:30.953880+0000","last_active":"2024-05-08T09:24:38.030974+0000","last_peered":"2024-05-08T09:24:38.030974+0000","last_clean":"2024-05-08T09:24:38.030974+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:24:38.030974+0000","last_undegraded":"2024-05-08T09:24:38.030974+0000","last_fullsized":"2024-05-08T09:24:38.030974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166447+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.166447+0000","last_peered":"2024-05-08T09:24:38.166447+0000","last_clean":"2024-05-08T09:24:38.166447+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.166447+0000","last_undegraded":"2024-05-08T09:24:38.166447+0000","last_fullsized":"2024-05-08T09:24:38.166447+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:30.090468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915499+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:23:53.915499+0000","last_peered":"2024-05-08T09:23:53.915499+0000","last_clean":"2024-05-08T09:23:53.915499+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:23:53.915499+0000","last_undegraded":"2024-05-08T09:23:53.915499+0000","last_fullsized":"2024-05-08T09:23:53.915499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.772673+0000","last_change":"2024-05-08T09:21:30.945729+0000","last_active":"2024-05-08T09:22:53.772673+0000","last_peered":"2024-05-08T09:22:53.772673+0000","last_clean":"2024-05-08T09:22:53.772673+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:22:53.772673+0000","last_undegraded":"2024-05-08T09:22:53.772673+0000","last_fullsized":"2024-05-08T09:22:53.772673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000634+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:22:16.000634+0000","last_peered":"2024-05-08T09:22:16.000634+0000","last_clean":"2024-05-08T09:22:16.000634+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:22:16.000634+0000","last_undegraded":"2024-05-08T09:22:16.000634+0000","last_fullsized":"2024-05-08T09:22:16.000634+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.770379+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:22:53.770379+0000","last_peered":"2024-05-08T09:22:53.770379+0000","last_clean":"2024-05-08T09:22:53.770379+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:22:53.770379+0000","last_undegraded":"2024-05-08T09:22:53.770379+0000","last_fullsized":"2024-05-08T09:22:53.770379+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.519313+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:37.519313+0000","last_peered":"2024-05-08T09:23:37.519313+0000","last_clean":"2024-05-08T09:23:37.519313+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:37.519313+0000","last_undegraded":"2024-05-08T09:23:37.519313+0000","last_fullsized":"2024-05-08T09:23:37.519313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542123+0000","last_change":"2024-05-08T09:21:30.955095+0000","last_active":"2024-05-08T09:23:37.542123+0000","last_peered":"2024-05-08T09:23:37.542123+0000","last_clean":"2024-05-08T09:23:37.542123+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:23:37.542123+0000","last_undegraded":"2024-05-08T09:23:37.542123+0000","last_fullsized":"2024-05-08T09:23:37.542123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:58.448626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.760684+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:22:53.760684+0000","last_peered":"2024-05-08T09:22:53.760684+0000","last_clean":"2024-05-08T09:22:53.760684+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:22:53.760684+0000","last_undegraded":"2024-05-08T09:22:53.760684+0000","last_fullsized":"2024-05-08T09:22:53.760684+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241110+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.241110+0000","last_peered":"2024-05-08T09:24:38.241110+0000","last_clean":"2024-05-08T09:24:38.241110+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.241110+0000","last_undegraded":"2024-05-08T09:24:38.241110+0000","last_fullsized":"2024-05-08T09:24:38.241110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064683+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:22:16.064683+0000","last_peered":"2024-05-08T09:22:16.064683+0000","last_clean":"2024-05-08T09:22:16.064683+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:22:16.064683+0000","last_undegraded":"2024-05-08T09:22:16.064683+0000","last_fullsized":"2024-05-08T09:22:16.064683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031836+0000","last_change":"2024-05-08T09:21:30.941566+0000","last_active":"2024-05-08T09:24:38.031836+0000","last_peered":"2024-05-08T09:24:38.031836+0000","last_clean":"2024-05-08T09:24:38.031836+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:24:38.031836+0000","last_undegraded":"2024-05-08T09:24:38.031836+0000","last_fullsized":"2024-05-08T09:24:38.031836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:22.230967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996884+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:22:15.996884+0000","last_peered":"2024-05-08T09:22:15.996884+0000","last_clean":"2024-05-08T09:22:15.996884+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:22:15.996884+0000","last_undegraded":"2024-05-08T09:22:15.996884+0000","last_fullsized":"2024-05-08T09:22:15.996884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:46:06.371186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.187676+0000","last_change":"2024-05-08T09:21:38.981335+0000","last_active":"2024-05-08T09:24:38.187676+0000","last_peered":"2024-05-08T09:24:38.187676+0000","last_clean":"2024-05-08T09:24:38.187676+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:24:38.187676+0000","last_undegraded":"2024-05-08T09:24:38.187676+0000","last_fullsized":"2024-05-08T09:24:38.187676+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:10.950358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218288+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218288+0000","last_peered":"2024-05-08T09:24:38.218288+0000","last_clean":"2024-05-08T09:24:38.218288+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218288+0000","last_undegraded":"2024-05-08T09:24:38.218288+0000","last_fullsized":"2024-05-08T09:24:38.218288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:11.053249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151832+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.151832+0000","last_peered":"2024-05-08T09:24:38.151832+0000","last_clean":"2024-05-08T09:24:38.151832+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.151832+0000","last_undegraded":"2024-05-08T09:24:38.151832+0000","last_fullsized":"2024-05-08T09:24:38.151832+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:46.927060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996807+0000","last_change":"2024-05-08T09:21:32.954624+0000","last_active":"2024-05-08T09:22:15.996807+0000","last_peered":"2024-05-08T09:22:15.996807+0000","last_clean":"2024-05-08T09:22:15.996807+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:22:15.996807+0000","last_undegraded":"2024-05-08T09:22:15.996807+0000","last_fullsized":"2024-05-08T09:22:15.996807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:12.055591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.125390+0000","last_change":"2024-05-08T09:21:34.968612+0000","last_active":"2024-05-08T09:23:36.125390+0000","last_peered":"2024-05-08T09:23:36.125390+0000","last_clean":"2024-05-08T09:23:36.125390+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:23:36.125390+0000","last_undegraded":"2024-05-08T09:23:36.125390+0000","last_fullsized":"2024-05-08T09:23:36.125390+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:39:14.717002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001471+0000","last_change":"2024-05-08T09:21:36.977259+0000","last_active":"2024-05-08T09:22:16.001471+0000","last_peered":"2024-05-08T09:22:16.001471+0000","last_clean":"2024-05-08T09:22:16.001471+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:22:16.001471+0000","last_undegraded":"2024-05-08T09:22:16.001471+0000","last_fullsized":"2024-05-08T09:22:16.001471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.780267+0000","last_change":"2024-05-08T09:21:38.984125+0000","last_active":"2024-05-08T09:22:53.780267+0000","last_peered":"2024-05-08T09:22:53.780267+0000","last_clean":"2024-05-08T09:22:53.780267+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:22:53.780267+0000","last_undegraded":"2024-05-08T09:22:53.780267+0000","last_fullsized":"2024-05-08T09:22:53.780267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240957+0000","last_change":"2024-05-08T09:21:30.961147+0000","last_active":"2024-05-08T09:24:38.240957+0000","last_peered":"2024-05-08T09:24:38.240957+0000","last_clean":"2024-05-08T09:24:38.240957+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:24:38.240957+0000","last_undegraded":"2024-05-08T09:24:38.240957+0000","last_fullsized":"2024-05-08T09:24:38.240957+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:21.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998085+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:22:15.998085+0000","last_peered":"2024-05-08T09:22:15.998085+0000","last_clean":"2024-05-08T09:22:15.998085+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:22:15.998085+0000","last_undegraded":"2024-05-08T09:22:15.998085+0000","last_fullsized":"2024-05-08T09:22:15.998085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065092+0000","last_change":"2024-05-08T09:21:32.957525+0000","last_active":"2024-05-08T09:22:16.065092+0000","last_peered":"2024-05-08T09:22:16.065092+0000","last_clean":"2024-05-08T09:22:16.065092+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:22:16.065092+0000","last_undegraded":"2024-05-08T09:22:16.065092+0000","last_fullsized":"2024-05-08T09:22:16.065092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:36.828402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.963076+0000","last_change":"2024-05-08T09:21:34.968421+0000","last_active":"2024-05-08T09:22:53.963076+0000","last_peered":"2024-05-08T09:22:53.963076+0000","last_clean":"2024-05-08T09:22:53.963076+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:22:53.963076+0000","last_undegraded":"2024-05-08T09:22:53.963076+0000","last_fullsized":"2024-05-08T09:22:53.963076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:49.987542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999400+0000","last_change":"2024-05-08T09:21:36.971614+0000","last_active":"2024-05-08T09:22:15.999400+0000","last_peered":"2024-05-08T09:22:15.999400+0000","last_clean":"2024-05-08T09:22:15.999400+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:22:15.999400+0000","last_undegraded":"2024-05-08T09:22:15.999400+0000","last_fullsized":"2024-05-08T09:22:15.999400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062726+0000","last_change":"2024-05-08T09:21:38.971525+0000","last_active":"2024-05-08T09:22:16.062726+0000","last_peered":"2024-05-08T09:22:16.062726+0000","last_clean":"2024-05-08T09:22:16.062726+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:22:16.062726+0000","last_undegraded":"2024-05-08T09:22:16.062726+0000","last_fullsized":"2024-05-08T09:22:16.062726+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.209901+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.209901+0000","last_peered":"2024-05-08T09:24:38.209901+0000","last_clean":"2024-05-08T09:24:38.209901+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.209901+0000","last_undegraded":"2024-05-08T09:24:38.209901+0000","last_fullsized":"2024-05-08T09:24:38.209901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:39.126588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993965+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:22:15.993965+0000","last_peered":"2024-05-08T09:22:15.993965+0000","last_clean":"2024-05-08T09:22:15.993965+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:22:15.993965+0000","last_undegraded":"2024-05-08T09:22:15.993965+0000","last_fullsized":"2024-05-08T09:22:15.993965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:01.393034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:18.900511+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:22:18.900511+0000","last_peered":"2024-05-08T09:22:18.900511+0000","last_clean":"2024-05-08T09:22:18.900511+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:22:18.900511+0000","last_undegraded":"2024-05-08T09:22:18.900511+0000","last_fullsized":"2024-05-08T09:22:18.900511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:52.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000357+0000","last_change":"2024-05-08T09:21:34.970071+0000","last_active":"2024-05-08T09:22:16.000357+0000","last_peered":"2024-05-08T09:22:16.000357+0000","last_clean":"2024-05-08T09:22:16.000357+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:22:16.000357+0000","last_undegraded":"2024-05-08T09:22:16.000357+0000","last_fullsized":"2024-05-08T09:22:16.000357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:24.049898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'282","reported_seq":421,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043550+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:38.043550+0000","last_peered":"2024-05-08T09:24:38.043550+0000","last_clean":"2024-05-08T09:24:38.043550+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:38.043550+0000","last_undegraded":"2024-05-08T09:24:38.043550+0000","last_fullsized":"2024-05-08T09:24:38.043550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:20.146454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993615+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:22:15.993615+0000","last_peered":"2024-05-08T09:22:15.993615+0000","last_clean":"2024-05-08T09:22:15.993615+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:22:15.993615+0000","last_undegraded":"2024-05-08T09:22:15.993615+0000","last_fullsized":"2024-05-08T09:22:15.993615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:43.864633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240927+0000","last_change":"2024-05-08T09:21:30.943637+0000","last_active":"2024-05-08T09:24:38.240927+0000","last_peered":"2024-05-08T09:24:38.240927+0000","last_clean":"2024-05-08T09:24:38.240927+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:24:38.240927+0000","last_undegraded":"2024-05-08T09:24:38.240927+0000","last_fullsized":"2024-05-08T09:24:38.240927+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:08.589419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914364+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:23:48.914364+0000","last_peered":"2024-05-08T09:23:48.914364+0000","last_clean":"2024-05-08T09:23:48.914364+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:23:48.914364+0000","last_undegraded":"2024-05-08T09:23:48.914364+0000","last_fullsized":"2024-05-08T09:23:48.914364+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:46.705283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997524+0000","last_change":"2024-05-08T09:21:32.954018+0000","last_active":"2024-05-08T09:22:15.997524+0000","last_peered":"2024-05-08T09:22:15.997524+0000","last_clean":"2024-05-08T09:22:15.997524+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:22:15.997524+0000","last_undegraded":"2024-05-08T09:22:15.997524+0000","last_fullsized":"2024-05-08T09:22:15.997524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:47.581536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.120007+0000","last_change":"2024-05-08T09:21:34.969072+0000","last_active":"2024-05-08T09:23:36.120007+0000","last_peered":"2024-05-08T09:23:36.120007+0000","last_clean":"2024-05-08T09:23:36.120007+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:23:36.120007+0000","last_undegraded":"2024-05-08T09:23:36.120007+0000","last_fullsized":"2024-05-08T09:23:36.120007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:38.834811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'282","reported_seq":401,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.243750+0000","last_change":"2024-05-08T09:21:36.965387+0000","last_active":"2024-05-08T09:24:38.243750+0000","last_peered":"2024-05-08T09:24:38.243750+0000","last_clean":"2024-05-08T09:24:38.243750+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:38.243750+0000","last_undegraded":"2024-05-08T09:24:38.243750+0000","last_fullsized":"2024-05-08T09:24:38.243750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:18.030479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207965+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.207965+0000","last_peered":"2024-05-08T09:24:38.207965+0000","last_clean":"2024-05-08T09:24:38.207965+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.207965+0000","last_undegraded":"2024-05-08T09:24:38.207965+0000","last_fullsized":"2024-05-08T09:24:38.207965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:45.973741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.148771+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.148771+0000","last_peered":"2024-05-08T09:24:38.148771+0000","last_clean":"2024-05-08T09:24:38.148771+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.148771+0000","last_undegraded":"2024-05-08T09:24:38.148771+0000","last_fullsized":"2024-05-08T09:24:38.148771+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993880+0000","last_change":"2024-05-08T09:21:32.958870+0000","last_active":"2024-05-08T09:22:15.993880+0000","last_peered":"2024-05-08T09:22:15.993880+0000","last_clean":"2024-05-08T09:22:15.993880+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:22:15.993880+0000","last_undegraded":"2024-05-08T09:22:15.993880+0000","last_fullsized":"2024-05-08T09:22:15.993880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:13.060641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'40","reported_seq":87,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.129369+0000","last_change":"2024-05-08T09:21:34.966604+0000","last_active":"2024-05-08T09:23:36.129369+0000","last_peered":"2024-05-08T09:23:36.129369+0000","last_clean":"2024-05-08T09:23:36.129369+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:23:36.129369+0000","last_undegraded":"2024-05-08T09:23:36.129369+0000","last_fullsized":"2024-05-08T09:23:36.129369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:14:01.043108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064548+0000","last_change":"2024-05-08T09:21:36.964833+0000","last_active":"2024-05-08T09:22:16.064548+0000","last_peered":"2024-05-08T09:22:16.064548+0000","last_clean":"2024-05-08T09:22:16.064548+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:22:16.064548+0000","last_undegraded":"2024-05-08T09:22:16.064548+0000","last_fullsized":"2024-05-08T09:22:16.064548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:42:51.594598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.782118+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:22:53.782118+0000","last_peered":"2024-05-08T09:22:53.782118+0000","last_clean":"2024-05-08T09:22:53.782118+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:22:53.782118+0000","last_undegraded":"2024-05-08T09:22:53.782118+0000","last_fullsized":"2024-05-08T09:22:53.782118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.051881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240991+0000","last_change":"2024-05-08T09:21:30.942033+0000","last_active":"2024-05-08T09:24:38.240991+0000","last_peered":"2024-05-08T09:24:38.240991+0000","last_clean":"2024-05-08T09:24:38.240991+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:24:38.240991+0000","last_undegraded":"2024-05-08T09:24:38.240991+0000","last_fullsized":"2024-05-08T09:24:38.240991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000003+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:22:16.000003+0000","last_peered":"2024-05-08T09:22:16.000003+0000","last_clean":"2024-05-08T09:22:16.000003+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:22:16.000003+0000","last_undegraded":"2024-05-08T09:22:16.000003+0000","last_fullsized":"2024-05-08T09:22:16.000003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063135+0000","last_change":"2024-05-08T09:21:32.956199+0000","last_active":"2024-05-08T09:22:16.063135+0000","last_peered":"2024-05-08T09:22:16.063135+0000","last_clean":"2024-05-08T09:22:16.063135+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:22:16.063135+0000","last_undegraded":"2024-05-08T09:22:16.063135+0000","last_fullsized":"2024-05-08T09:22:16.063135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:22.043489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'31","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.109617+0000","last_change":"2024-05-08T09:21:34.969113+0000","last_active":"2024-05-08T09:23:36.109617+0000","last_peered":"2024-05-08T09:23:36.109617+0000","last_clean":"2024-05-08T09:23:36.109617+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:23:36.109617+0000","last_undegraded":"2024-05-08T09:23:36.109617+0000","last_fullsized":"2024-05-08T09:23:36.109617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:18.664086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063764+0000","last_change":"2024-05-08T09:21:36.966245+0000","last_active":"2024-05-08T09:22:16.063764+0000","last_peered":"2024-05-08T09:22:16.063764+0000","last_clean":"2024-05-08T09:22:16.063764+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:22:16.063764+0000","last_undegraded":"2024-05-08T09:22:16.063764+0000","last_fullsized":"2024-05-08T09:22:16.063764+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.539672+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:37.539672+0000","last_peered":"2024-05-08T09:23:37.539672+0000","last_clean":"2024-05-08T09:23:37.539672+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:37.539672+0000","last_undegraded":"2024-05-08T09:23:37.539672+0000","last_fullsized":"2024-05-08T09:23:37.539672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999146+0000","last_change":"2024-05-08T09:21:30.953247+0000","last_active":"2024-05-08T09:22:15.999146+0000","last_peered":"2024-05-08T09:22:15.999146+0000","last_clean":"2024-05-08T09:22:15.999146+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:22:15.999146+0000","last_undegraded":"2024-05-08T09:22:15.999146+0000","last_fullsized":"2024-05-08T09:22:15.999146+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:03.399759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997399+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:22:15.997399+0000","last_peered":"2024-05-08T09:22:15.997399+0000","last_clean":"2024-05-08T09:22:15.997399+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:22:15.997399+0000","last_undegraded":"2024-05-08T09:22:15.997399+0000","last_fullsized":"2024-05-08T09:22:15.997399+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:27:56.441900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063881+0000","last_change":"2024-05-08T09:21:32.957626+0000","last_active":"2024-05-08T09:22:16.063881+0000","last_peered":"2024-05-08T09:22:16.063881+0000","last_clean":"2024-05-08T09:22:16.063881+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:22:16.063881+0000","last_undegraded":"2024-05-08T09:22:16.063881+0000","last_fullsized":"2024-05-08T09:22:16.063881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:21:40.755189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'37","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914793+0000","last_change":"2024-05-08T09:21:34.962754+0000","last_active":"2024-05-08T09:23:48.914793+0000","last_peered":"2024-05-08T09:23:48.914793+0000","last_clean":"2024-05-08T09:23:48.914793+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:23:48.914793+0000","last_undegraded":"2024-05-08T09:23:48.914793+0000","last_fullsized":"2024-05-08T09:23:48.914793+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:25.310627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'282","reported_seq":376,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.360406+0000","last_change":"2024-05-08T09:21:36.978801+0000","last_active":"2024-05-08T09:24:38.360406+0000","last_peered":"2024-05-08T09:24:38.360406+0000","last_clean":"2024-05-08T09:24:38.360406+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:24:38.360406+0000","last_undegraded":"2024-05-08T09:24:38.360406+0000","last_fullsized":"2024-05-08T09:24:38.360406+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064571+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:22:16.064571+0000","last_peered":"2024-05-08T09:22:16.064571+0000","last_clean":"2024-05-08T09:22:16.064571+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:22:16.064571+0000","last_undegraded":"2024-05-08T09:22:16.064571+0000","last_fullsized":"2024-05-08T09:22:16.064571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:29.324457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998301+0000","last_change":"2024-05-08T09:21:30.951955+0000","last_active":"2024-05-08T09:22:15.998301+0000","last_peered":"2024-05-08T09:22:15.998301+0000","last_clean":"2024-05-08T09:22:15.998301+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:22:15.998301+0000","last_undegraded":"2024-05-08T09:22:15.998301+0000","last_fullsized":"2024-05-08T09:22:15.998301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:07.718728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996601+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:22:15.996601+0000","last_peered":"2024-05-08T09:22:15.996601+0000","last_clean":"2024-05-08T09:22:15.996601+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:22:15.996601+0000","last_undegraded":"2024-05-08T09:22:15.996601+0000","last_fullsized":"2024-05-08T09:22:15.996601+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:36:06.582694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063416+0000","last_change":"2024-05-08T09:21:32.957023+0000","last_active":"2024-05-08T09:22:16.063416+0000","last_peered":"2024-05-08T09:22:16.063416+0000","last_clean":"2024-05-08T09:22:16.063416+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:22:16.063416+0000","last_undegraded":"2024-05-08T09:22:16.063416+0000","last_fullsized":"2024-05-08T09:22:16.063416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:40.029960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'55","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.133206+0000","last_change":"2024-05-08T09:21:34.966546+0000","last_active":"2024-05-08T09:23:36.133206+0000","last_peered":"2024-05-08T09:23:36.133206+0000","last_clean":"2024-05-08T09:23:36.133206+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:23:36.133206+0000","last_undegraded":"2024-05-08T09:23:36.133206+0000","last_fullsized":"2024-05-08T09:23:36.133206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:29:37.118159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062735+0000","last_change":"2024-05-08T09:21:36.971385+0000","last_active":"2024-05-08T09:22:16.062735+0000","last_peered":"2024-05-08T09:22:16.062735+0000","last_clean":"2024-05-08T09:22:16.062735+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:22:16.062735+0000","last_undegraded":"2024-05-08T09:22:16.062735+0000","last_fullsized":"2024-05-08T09:22:16.062735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:49.044705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.337428+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.337428+0000","last_peered":"2024-05-08T09:24:38.337428+0000","last_clean":"2024-05-08T09:24:38.337428+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.337428+0000","last_undegraded":"2024-05-08T09:24:38.337428+0000","last_fullsized":"2024-05-08T09:24:38.337428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:53.334530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166739+0000","last_change":"2024-05-08T09:21:30.955072+0000","last_active":"2024-05-08T09:24:38.166739+0000","last_peered":"2024-05-08T09:24:38.166739+0000","last_clean":"2024-05-08T09:24:38.166739+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:24:38.166739+0000","last_undegraded":"2024-05-08T09:24:38.166739+0000","last_fullsized":"2024-05-08T09:24:38.166739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064027+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:22:16.064027+0000","last_peered":"2024-05-08T09:22:16.064027+0000","last_clean":"2024-05-08T09:22:16.064027+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:22:16.064027+0000","last_undegraded":"2024-05-08T09:22:16.064027+0000","last_fullsized":"2024-05-08T09:22:16.064027+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995287+0000","last_change":"2024-05-08T09:21:32.958822+0000","last_active":"2024-05-08T09:22:15.995287+0000","last_peered":"2024-05-08T09:22:15.995287+0000","last_clean":"2024-05-08T09:22:15.995287+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:22:15.995287+0000","last_undegraded":"2024-05-08T09:22:15.995287+0000","last_fullsized":"2024-05-08T09:22:15.995287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:35.925851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'33","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.113715+0000","last_change":"2024-05-08T09:21:34.965442+0000","last_active":"2024-05-08T09:23:36.113715+0000","last_peered":"2024-05-08T09:23:36.113715+0000","last_clean":"2024-05-08T09:23:36.113715+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:23:36.113715+0000","last_undegraded":"2024-05-08T09:23:36.113715+0000","last_fullsized":"2024-05-08T09:23:36.113715+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:19.669692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998369+0000","last_change":"2024-05-08T09:21:36.980935+0000","last_active":"2024-05-08T09:22:15.998369+0000","last_peered":"2024-05-08T09:22:15.998369+0000","last_clean":"2024-05-08T09:22:15.998369+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:22:15.998369+0000","last_undegraded":"2024-05-08T09:22:15.998369+0000","last_fullsized":"2024-05-08T09:22:15.998369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.104077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912987+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:23:38.912987+0000","last_peered":"2024-05-08T09:23:38.912987+0000","last_clean":"2024-05-08T09:23:38.912987+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:23:38.912987+0000","last_undegraded":"2024-05-08T09:23:38.912987+0000","last_fullsized":"2024-05-08T09:23:38.912987+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:30:24.812134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999240+0000","last_change":"2024-05-08T09:21:30.961704+0000","last_active":"2024-05-08T09:22:15.999240+0000","last_peered":"2024-05-08T09:22:15.999240+0000","last_clean":"2024-05-08T09:22:15.999240+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:22:15.999240+0000","last_undegraded":"2024-05-08T09:22:15.999240+0000","last_fullsized":"2024-05-08T09:22:15.999240+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:20:15.655892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997331+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:22:15.997331+0000","last_peered":"2024-05-08T09:22:15.997331+0000","last_clean":"2024-05-08T09:22:15.997331+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:22:15.997331+0000","last_undegraded":"2024-05-08T09:22:15.997331+0000","last_fullsized":"2024-05-08T09:22:15.997331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:26:21.927441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'4","reported_seq":226,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.177753+0000","last_change":"2024-05-08T09:21:32.957213+0000","last_active":"2024-05-08T09:23:37.177753+0000","last_peered":"2024-05-08T09:23:37.177753+0000","last_clean":"2024-05-08T09:23:37.177753+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:23:37.177753+0000","last_undegraded":"2024-05-08T09:23:37.177753+0000","last_fullsized":"2024-05-08T09:23:37.177753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:46.321295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.139733+0000","last_change":"2024-05-08T09:21:34.958793+0000","last_active":"2024-05-08T09:23:36.139733+0000","last_peered":"2024-05-08T09:23:36.139733+0000","last_clean":"2024-05-08T09:23:36.139733+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:23:36.139733+0000","last_undegraded":"2024-05-08T09:23:36.139733+0000","last_fullsized":"2024-05-08T09:23:36.139733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:15.067049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'282","reported_seq":403,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.341387+0000","last_change":"2024-05-08T09:21:36.971576+0000","last_active":"2024-05-08T09:24:38.341387+0000","last_peered":"2024-05-08T09:24:38.341387+0000","last_clean":"2024-05-08T09:24:38.341387+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:38.341387+0000","last_undegraded":"2024-05-08T09:24:38.341387+0000","last_fullsized":"2024-05-08T09:24:38.341387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:05.913890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.950071+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:37.950071+0000","last_peered":"2024-05-08T09:24:37.950071+0000","last_clean":"2024-05-08T09:24:37.950071+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:37.950071+0000","last_undegraded":"2024-05-08T09:24:37.950071+0000","last_fullsized":"2024-05-08T09:24:37.950071+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:38.039219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001229+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:22:16.001229+0000","last_peered":"2024-05-08T09:22:16.001229+0000","last_clean":"2024-05-08T09:22:16.001229+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:22:16.001229+0000","last_undegraded":"2024-05-08T09:22:16.001229+0000","last_fullsized":"2024-05-08T09:22:16.001229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995509+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:22:15.995509+0000","last_peered":"2024-05-08T09:22:15.995509+0000","last_clean":"2024-05-08T09:22:15.995509+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:22:15.995509+0000","last_undegraded":"2024-05-08T09:22:15.995509+0000","last_fullsized":"2024-05-08T09:22:15.995509+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:48.376085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188113+0000","last_change":"2024-05-08T09:21:32.955025+0000","last_active":"2024-05-08T09:23:37.188113+0000","last_peered":"2024-05-08T09:23:37.188113+0000","last_clean":"2024-05-08T09:23:37.188113+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:23:37.188113+0000","last_undegraded":"2024-05-08T09:23:37.188113+0000","last_fullsized":"2024-05-08T09:23:37.188113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:48.868737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999772+0000","last_change":"2024-05-08T09:21:34.969633+0000","last_active":"2024-05-08T09:22:15.999772+0000","last_peered":"2024-05-08T09:22:15.999772+0000","last_clean":"2024-05-08T09:22:15.999772+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:22:15.999772+0000","last_undegraded":"2024-05-08T09:22:15.999772+0000","last_fullsized":"2024-05-08T09:22:15.999772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:12:38.074915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'282","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.299223+0000","last_change":"2024-05-08T09:21:36.971697+0000","last_active":"2024-05-08T09:24:38.299223+0000","last_peered":"2024-05-08T09:24:38.299223+0000","last_clean":"2024-05-08T09:24:38.299223+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:38.299223+0000","last_undegraded":"2024-05-08T09:24:38.299223+0000","last_fullsized":"2024-05-08T09:24:38.299223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.321717+0000","last_change":"2024-05-08T09:21:38.969278+0000","last_active":"2024-05-08T09:23:37.321717+0000","last_peered":"2024-05-08T09:23:37.321717+0000","last_clean":"2024-05-08T09:23:37.321717+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:23:37.321717+0000","last_undegraded":"2024-05-08T09:23:37.321717+0000","last_fullsized":"2024-05-08T09:23:37.321717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:06.177520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210299+0000","last_change":"2024-05-08T09:21:30.955832+0000","last_active":"2024-05-08T09:24:38.210299+0000","last_peered":"2024-05-08T09:24:38.210299+0000","last_clean":"2024-05-08T09:24:38.210299+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:24:38.210299+0000","last_undegraded":"2024-05-08T09:24:38.210299+0000","last_fullsized":"2024-05-08T09:24:38.210299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:51.290568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992620+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:22:15.992620+0000","last_peered":"2024-05-08T09:22:15.992620+0000","last_clean":"2024-05-08T09:22:15.992620+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:22:15.992620+0000","last_undegraded":"2024-05-08T09:22:15.992620+0000","last_fullsized":"2024-05-08T09:22:15.992620+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:26:59.095251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997769+0000","last_change":"2024-05-08T09:21:32.958748+0000","last_active":"2024-05-08T09:22:15.997769+0000","last_peered":"2024-05-08T09:22:15.997769+0000","last_clean":"2024-05-08T09:22:15.997769+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:22:15.997769+0000","last_undegraded":"2024-05-08T09:22:15.997769+0000","last_fullsized":"2024-05-08T09:22:15.997769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:33.281026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'38","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.126382+0000","last_change":"2024-05-08T09:21:34.960277+0000","last_active":"2024-05-08T09:23:36.126382+0000","last_peered":"2024-05-08T09:23:36.126382+0000","last_clean":"2024-05-08T09:23:36.126382+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:23:36.126382+0000","last_undegraded":"2024-05-08T09:23:36.126382+0000","last_fullsized":"2024-05-08T09:23:36.126382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:56.211138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001233+0000","last_change":"2024-05-08T09:21:36.975280+0000","last_active":"2024-05-08T09:22:16.001233+0000","last_peered":"2024-05-08T09:22:16.001233+0000","last_clean":"2024-05-08T09:22:16.001233+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:22:16.001233+0000","last_undegraded":"2024-05-08T09:22:16.001233+0000","last_fullsized":"2024-05-08T09:22:16.001233+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:48.690526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.274231+0000","last_change":"2024-05-08T09:21:38.977441+0000","last_active":"2024-05-08T09:24:38.274231+0000","last_peered":"2024-05-08T09:24:38.274231+0000","last_clean":"2024-05-08T09:24:38.274231+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:24:38.274231+0000","last_undegraded":"2024-05-08T09:24:38.274231+0000","last_fullsized":"2024-05-08T09:24:38.274231+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:36:26.997054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542061+0000","last_change":"2024-05-08T09:21:30.961518+0000","last_active":"2024-05-08T09:23:37.542061+0000","last_peered":"2024-05-08T09:23:37.542061+0000","last_clean":"2024-05-08T09:23:37.542061+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:23:37.542061+0000","last_undegraded":"2024-05-08T09:23:37.542061+0000","last_fullsized":"2024-05-08T09:23:37.542061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:42.670072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":196,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993805+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:22:15.993805+0000","last_peered":"2024-05-08T09:22:15.993805+0000","last_clean":"2024-05-08T09:22:15.993805+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:22:15.993805+0000","last_undegraded":"2024-05-08T09:22:15.993805+0000","last_fullsized":"2024-05-08T09:22:15.993805+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:26:10.686760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996416+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:22:15.996416+0000","last_peered":"2024-05-08T09:22:15.996416+0000","last_clean":"2024-05-08T09:22:15.996416+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:22:15.996416+0000","last_undegraded":"2024-05-08T09:22:15.996416+0000","last_fullsized":"2024-05-08T09:22:15.996416+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:31:35.612974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996694+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:22:15.996694+0000","last_peered":"2024-05-08T09:22:15.996694+0000","last_clean":"2024-05-08T09:22:15.996694+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:22:15.996694+0000","last_undegraded":"2024-05-08T09:22:15.996694+0000","last_fullsized":"2024-05-08T09:22:15.996694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:52.688659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995940+0000","last_change":"2024-05-08T09:21:32.954960+0000","last_active":"2024-05-08T09:22:15.995940+0000","last_peered":"2024-05-08T09:22:15.995940+0000","last_clean":"2024-05-08T09:22:15.995940+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:22:15.995940+0000","last_undegraded":"2024-05-08T09:22:15.995940+0000","last_fullsized":"2024-05-08T09:22:15.995940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:50:07.460383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'76","reported_seq":145,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.137506+0000","last_change":"2024-05-08T09:21:34.958243+0000","last_active":"2024-05-08T09:23:36.137506+0000","last_peered":"2024-05-08T09:23:36.137506+0000","last_clean":"2024-05-08T09:23:36.137506+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:23:36.137506+0000","last_undegraded":"2024-05-08T09:23:36.137506+0000","last_fullsized":"2024-05-08T09:23:36.137506+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:20.157874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064709+0000","last_change":"2024-05-08T09:21:36.973660+0000","last_active":"2024-05-08T09:22:16.064709+0000","last_peered":"2024-05-08T09:22:16.064709+0000","last_clean":"2024-05-08T09:22:16.064709+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:22:16.064709+0000","last_undegraded":"2024-05-08T09:22:16.064709+0000","last_fullsized":"2024-05-08T09:22:16.064709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:14:16.068653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":162,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.251742+0000","last_change":"2024-05-08T09:21:38.970424+0000","last_active":"2024-05-08T09:24:38.251742+0000","last_peered":"2024-05-08T09:24:38.251742+0000","last_clean":"2024-05-08T09:24:38.251742+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:24:38.251742+0000","last_undegraded":"2024-05-08T09:24:38.251742+0000","last_fullsized":"2024-05-08T09:24:38.251742+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:39.075238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914170+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:23:43.914170+0000","last_peered":"2024-05-08T09:23:43.914170+0000","last_clean":"2024-05-08T09:23:43.914170+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:23:43.914170+0000","last_undegraded":"2024-05-08T09:23:43.914170+0000","last_fullsized":"2024-05-08T09:23:43.914170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:41.982328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992288+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:22:15.992288+0000","last_peered":"2024-05-08T09:22:15.992288+0000","last_clean":"2024-05-08T09:22:15.992288+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:22:15.992288+0000","last_undegraded":"2024-05-08T09:22:15.992288+0000","last_fullsized":"2024-05-08T09:22:15.992288+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:32:00.850631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.236384+0000","last_change":"2024-05-08T09:21:28.963914+0000","last_active":"2024-05-08T09:24:38.236384+0000","last_peered":"2024-05-08T09:24:38.236384+0000","last_clean":"2024-05-08T09:24:38.236384+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:24:38.236384+0000","last_undegraded":"2024-05-08T09:24:38.236384+0000","last_fullsized":"2024-05-08T09:24:38.236384+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998540+0000","last_change":"2024-05-08T09:21:32.956037+0000","last_active":"2024-05-08T09:22:15.998540+0000","last_peered":"2024-05-08T09:22:15.998540+0000","last_clean":"2024-05-08T09:22:15.998540+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:22:15.998540+0000","last_undegraded":"2024-05-08T09:22:15.998540+0000","last_fullsized":"2024-05-08T09:22:15.998540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:35.197031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'273","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043243+0000","last_change":"2024-05-08T09:21:34.968703+0000","last_active":"2024-05-08T09:24:38.043243+0000","last_peered":"2024-05-08T09:24:38.043243+0000","last_clean":"2024-05-08T09:24:38.043243+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:38.043243+0000","last_undegraded":"2024-05-08T09:24:38.043243+0000","last_fullsized":"2024-05-08T09:24:38.043243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:00:23.830443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996211+0000","last_change":"2024-05-08T09:21:36.982457+0000","last_active":"2024-05-08T09:22:15.996211+0000","last_peered":"2024-05-08T09:22:15.996211+0000","last_clean":"2024-05-08T09:22:15.996211+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:22:15.996211+0000","last_undegraded":"2024-05-08T09:22:15.996211+0000","last_fullsized":"2024-05-08T09:22:15.996211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:53:59.498636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.778538+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:22:53.778538+0000","last_peered":"2024-05-08T09:22:53.778538+0000","last_clean":"2024-05-08T09:22:53.778538+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:22:53.778538+0000","last_undegraded":"2024-05-08T09:22:53.778538+0000","last_fullsized":"2024-05-08T09:22:53.778538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:55:53.706014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544450+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:37.544450+0000","last_peered":"2024-05-08T09:23:37.544450+0000","last_clean":"2024-05-08T09:23:37.544450+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:37.544450+0000","last_undegraded":"2024-05-08T09:23:37.544450+0000","last_fullsized":"2024-05-08T09:23:37.544450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997429+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:22:15.997429+0000","last_peered":"2024-05-08T09:22:15.997429+0000","last_clean":"2024-05-08T09:22:15.997429+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:22:15.997429+0000","last_undegraded":"2024-05-08T09:22:15.997429+0000","last_fullsized":"2024-05-08T09:22:15.997429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:29:07.226430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062347+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:22:16.062347+0000","last_peered":"2024-05-08T09:22:16.062347+0000","last_clean":"2024-05-08T09:22:16.062347+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:22:16.062347+0000","last_undegraded":"2024-05-08T09:22:16.062347+0000","last_fullsized":"2024-05-08T09:22:16.062347+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999681+0000","last_change":"2024-05-08T09:21:32.954033+0000","last_active":"2024-05-08T09:22:15.999681+0000","last_peered":"2024-05-08T09:22:15.999681+0000","last_clean":"2024-05-08T09:22:15.999681+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:22:15.999681+0000","last_undegraded":"2024-05-08T09:22:15.999681+0000","last_fullsized":"2024-05-08T09:22:15.999681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:42:24.238359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'16","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043198+0000","last_change":"2024-05-08T09:21:34.961617+0000","last_active":"2024-05-08T09:24:38.043198+0000","last_peered":"2024-05-08T09:24:38.043198+0000","last_clean":"2024-05-08T09:24:38.043198+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:24:38.043198+0000","last_undegraded":"2024-05-08T09:24:38.043198+0000","last_fullsized":"2024-05-08T09:24:38.043198+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:00:00.996503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065985+0000","last_change":"2024-05-08T09:21:36.973699+0000","last_active":"2024-05-08T09:22:16.065985+0000","last_peered":"2024-05-08T09:22:16.065985+0000","last_clean":"2024-05-08T09:22:16.065985+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:22:16.065985+0000","last_undegraded":"2024-05-08T09:22:16.065985+0000","last_fullsized":"2024-05-08T09:22:16.065985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:37.294088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994876+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:22:15.994876+0000","last_peered":"2024-05-08T09:22:15.994876+0000","last_clean":"2024-05-08T09:22:15.994876+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:22:15.994876+0000","last_undegraded":"2024-05-08T09:22:15.994876+0000","last_fullsized":"2024-05-08T09:22:15.994876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:36:58.388645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.541714+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:37.541714+0000","last_peered":"2024-05-08T09:23:37.541714+0000","last_clean":"2024-05-08T09:23:37.541714+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:37.541714+0000","last_undegraded":"2024-05-08T09:23:37.541714+0000","last_fullsized":"2024-05-08T09:23:37.541714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996203+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:22:15.996203+0000","last_peered":"2024-05-08T09:22:15.996203+0000","last_clean":"2024-05-08T09:22:15.996203+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:22:15.996203+0000","last_undegraded":"2024-05-08T09:22:15.996203+0000","last_fullsized":"2024-05-08T09:22:15.996203+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:07.724890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995492+0000","last_change":"2024-05-08T09:21:28.975541+0000","last_active":"2024-05-08T09:22:15.995492+0000","last_peered":"2024-05-08T09:22:15.995492+0000","last_clean":"2024-05-08T09:22:15.995492+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:22:15.995492+0000","last_undegraded":"2024-05-08T09:22:15.995492+0000","last_fullsized":"2024-05-08T09:22:15.995492+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:14.707120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064398+0000","last_change":"2024-05-08T09:21:32.958810+0000","last_active":"2024-05-08T09:22:16.064398+0000","last_peered":"2024-05-08T09:22:16.064398+0000","last_clean":"2024-05-08T09:22:16.064398+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:22:16.064398+0000","last_undegraded":"2024-05-08T09:22:16.064398+0000","last_fullsized":"2024-05-08T09:22:16.064398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:13:59.036699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.555805+0000","last_change":"2024-05-08T09:21:34.958674+0000","last_active":"2024-05-08T09:24:37.555805+0000","last_peered":"2024-05-08T09:24:37.555805+0000","last_clean":"2024-05-08T09:24:37.555805+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:37.555805+0000","last_undegraded":"2024-05-08T09:24:37.555805+0000","last_fullsized":"2024-05-08T09:24:37.555805+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:51.780853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998784+0000","last_change":"2024-05-08T09:21:36.980954+0000","last_active":"2024-05-08T09:22:15.998784+0000","last_peered":"2024-05-08T09:22:15.998784+0000","last_clean":"2024-05-08T09:22:15.998784+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:22:15.998784+0000","last_undegraded":"2024-05-08T09:22:15.998784+0000","last_fullsized":"2024-05-08T09:22:15.998784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:56:19.944195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.300793+0000","last_change":"2024-05-08T09:21:38.979327+0000","last_active":"2024-05-08T09:23:37.300793+0000","last_peered":"2024-05-08T09:23:37.300793+0000","last_clean":"2024-05-08T09:23:37.300793+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:23:37.300793+0000","last_undegraded":"2024-05-08T09:23:37.300793+0000","last_fullsized":"2024-05-08T09:23:37.300793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:08.072829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166882+0000","last_change":"2024-05-08T09:21:30.954313+0000","last_active":"2024-05-08T09:24:38.166882+0000","last_peered":"2024-05-08T09:24:38.166882+0000","last_clean":"2024-05-08T09:24:38.166882+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:24:38.166882+0000","last_undegraded":"2024-05-08T09:24:38.166882+0000","last_fullsized":"2024-05-08T09:24:38.166882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.902533+0000","last_change":"2024-05-08T09:21:28.977568+0000","last_active":"2024-05-08T09:24:37.902533+0000","last_peered":"2024-05-08T09:24:37.902533+0000","last_clean":"2024-05-08T09:24:37.902533+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:24:37.902533+0000","last_undegraded":"2024-05-08T09:24:37.902533+0000","last_fullsized":"2024-05-08T09:24:37.902533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065853+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:22:16.065853+0000","last_peered":"2024-05-08T09:22:16.065853+0000","last_clean":"2024-05-08T09:22:16.065853+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:22:16.065853+0000","last_undegraded":"2024-05-08T09:22:16.065853+0000","last_fullsized":"2024-05-08T09:22:16.065853+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:33:18.664257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908099+0000","last_change":"2024-05-08T09:21:32.957975+0000","last_active":"2024-05-08T09:23:38.908099+0000","last_peered":"2024-05-08T09:23:38.908099+0000","last_clean":"2024-05-08T09:23:38.908099+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:23:38.908099+0000","last_undegraded":"2024-05-08T09:23:38.908099+0000","last_fullsized":"2024-05-08T09:23:38.908099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:05:57.275150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'61","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908015+0000","last_change":"2024-05-08T09:21:34.962670+0000","last_active":"2024-05-08T09:23:38.908015+0000","last_peered":"2024-05-08T09:23:38.908015+0000","last_clean":"2024-05-08T09:23:38.908015+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:23:38.908015+0000","last_undegraded":"2024-05-08T09:23:38.908015+0000","last_fullsized":"2024-05-08T09:23:38.908015+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:45.614688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":47,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996880+0000","last_change":"2024-05-08T09:21:36.970971+0000","last_active":"2024-05-08T09:22:15.996880+0000","last_peered":"2024-05-08T09:22:15.996880+0000","last_clean":"2024-05-08T09:22:15.996880+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:22:15.996880+0000","last_undegraded":"2024-05-08T09:22:15.996880+0000","last_fullsized":"2024-05-08T09:22:15.996880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:45.147043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.211724+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.211724+0000","last_peered":"2024-05-08T09:24:38.211724+0000","last_clean":"2024-05-08T09:24:38.211724+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.211724+0000","last_undegraded":"2024-05-08T09:24:38.211724+0000","last_fullsized":"2024-05-08T09:24:38.211724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:16.801888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'3","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912699+0000","last_change":"2024-05-08T09:21:30.954500+0000","last_active":"2024-05-08T09:23:38.912699+0000","last_peered":"2024-05-08T09:23:38.912699+0000","last_clean":"2024-05-08T09:23:38.912699+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:23:38.912699+0000","last_undegraded":"2024-05-08T09:23:38.912699+0000","last_fullsized":"2024-05-08T09:23:38.912699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:32.782785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066126+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:22:16.066126+0000","last_peered":"2024-05-08T09:22:16.066126+0000","last_clean":"2024-05-08T09:22:16.066126+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:22:16.066126+0000","last_undegraded":"2024-05-08T09:22:16.066126+0000","last_fullsized":"2024-05-08T09:22:16.066126+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:55:53.886048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997047+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:22:15.997047+0000","last_peered":"2024-05-08T09:22:15.997047+0000","last_clean":"2024-05-08T09:22:15.997047+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:22:15.997047+0000","last_undegraded":"2024-05-08T09:22:15.997047+0000","last_fullsized":"2024-05-08T09:22:15.997047+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:23:39.215695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995954+0000","last_change":"2024-05-08T09:21:32.955946+0000","last_active":"2024-05-08T09:22:15.995954+0000","last_peered":"2024-05-08T09:22:15.995954+0000","last_clean":"2024-05-08T09:22:15.995954+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:22:15.995954+0000","last_undegraded":"2024-05-08T09:22:15.995954+0000","last_fullsized":"2024-05-08T09:22:15.995954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:05.051226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"27'15","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994372+0000","last_change":"2024-05-08T09:21:34.968595+0000","last_active":"2024-05-08T09:22:15.994372+0000","last_peered":"2024-05-08T09:22:15.994372+0000","last_clean":"2024-05-08T09:22:15.994372+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:22:15.994372+0000","last_undegraded":"2024-05-08T09:22:15.994372+0000","last_fullsized":"2024-05-08T09:22:15.994372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:43.176478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'282","reported_seq":356,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350586+0000","last_change":"2024-05-08T09:21:36.971304+0000","last_active":"2024-05-08T09:24:38.350586+0000","last_peered":"2024-05-08T09:24:38.350586+0000","last_clean":"2024-05-08T09:24:38.350586+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:38.350586+0000","last_undegraded":"2024-05-08T09:24:38.350586+0000","last_fullsized":"2024-05-08T09:24:38.350586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:59.022163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998082+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:22:15.998082+0000","last_peered":"2024-05-08T09:22:15.998082+0000","last_clean":"2024-05-08T09:22:15.998082+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:22:15.998082+0000","last_undegraded":"2024-05-08T09:22:15.998082+0000","last_fullsized":"2024-05-08T09:22:15.998082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:48:56.349806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.534998+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.534998+0000","last_peered":"2024-05-08T09:23:37.534998+0000","last_clean":"2024-05-08T09:23:37.534998+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.534998+0000","last_undegraded":"2024-05-08T09:23:37.534998+0000","last_fullsized":"2024-05-08T09:23:37.534998+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:40:46.861344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913368+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:23:38.913368+0000","last_peered":"2024-05-08T09:23:38.913368+0000","last_clean":"2024-05-08T09:23:38.913368+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:23:38.913368+0000","last_undegraded":"2024-05-08T09:23:38.913368+0000","last_fullsized":"2024-05-08T09:23:38.913368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:07.973732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065021+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:22:16.065021+0000","last_peered":"2024-05-08T09:22:16.065021+0000","last_clean":"2024-05-08T09:22:16.065021+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:22:16.065021+0000","last_undegraded":"2024-05-08T09:22:16.065021+0000","last_fullsized":"2024-05-08T09:22:16.065021+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:50:05.319652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993871+0000","last_change":"2024-05-08T09:21:32.953187+0000","last_active":"2024-05-08T09:22:15.993871+0000","last_peered":"2024-05-08T09:22:15.993871+0000","last_clean":"2024-05-08T09:22:15.993871+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:22:15.993871+0000","last_undegraded":"2024-05-08T09:22:15.993871+0000","last_fullsized":"2024-05-08T09:22:15.993871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:04:55.009101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997211+0000","last_change":"2024-05-08T09:21:34.965238+0000","last_active":"2024-05-08T09:22:15.997211+0000","last_peered":"2024-05-08T09:22:15.997211+0000","last_clean":"2024-05-08T09:22:15.997211+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:22:15.997211+0000","last_undegraded":"2024-05-08T09:22:15.997211+0000","last_fullsized":"2024-05-08T09:22:15.997211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:34:18.697994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'282","reported_seq":412,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.338025+0000","last_change":"2024-05-08T09:21:36.964762+0000","last_active":"2024-05-08T09:24:38.338025+0000","last_peered":"2024-05-08T09:24:38.338025+0000","last_clean":"2024-05-08T09:24:38.338025+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:38.338025+0000","last_undegraded":"2024-05-08T09:24:38.338025+0000","last_fullsized":"2024-05-08T09:24:38.338025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:09.064288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.195367+0000","last_change":"2024-05-08T09:21:38.976489+0000","last_active":"2024-05-08T09:24:38.195367+0000","last_peered":"2024-05-08T09:24:38.195367+0000","last_clean":"2024-05-08T09:24:38.195367+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:24:38.195367+0000","last_undegraded":"2024-05-08T09:24:38.195367+0000","last_fullsized":"2024-05-08T09:24:38.195367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'14","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294339+0000","last_change":"2024-05-08T09:21:30.954521+0000","last_active":"2024-05-08T09:24:38.294339+0000","last_peered":"2024-05-08T09:24:38.294339+0000","last_clean":"2024-05-08T09:24:38.294339+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:24:38.294339+0000","last_undegraded":"2024-05-08T09:24:38.294339+0000","last_fullsized":"2024-05-08T09:24:38.294339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:05:48.933785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999497+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:22:15.999497+0000","last_peered":"2024-05-08T09:22:15.999497+0000","last_clean":"2024-05-08T09:22:15.999497+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:22:15.999497+0000","last_undegraded":"2024-05-08T09:22:15.999497+0000","last_fullsized":"2024-05-08T09:22:15.999497+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998995+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:22:15.998995+0000","last_peered":"2024-05-08T09:22:15.998995+0000","last_clean":"2024-05-08T09:22:15.998995+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:22:15.998995+0000","last_undegraded":"2024-05-08T09:22:15.998995+0000","last_fullsized":"2024-05-08T09:22:15.998995+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:09:08.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992213+0000","last_change":"2024-05-08T09:21:32.951089+0000","last_active":"2024-05-08T09:22:15.992213+0000","last_peered":"2024-05-08T09:22:15.992213+0000","last_clean":"2024-05-08T09:22:15.992213+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:22:15.992213+0000","last_undegraded":"2024-05-08T09:22:15.992213+0000","last_fullsized":"2024-05-08T09:22:15.992213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:27.953425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'82","reported_seq":154,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.124374+0000","last_change":"2024-05-08T09:21:34.967958+0000","last_active":"2024-05-08T09:23:36.124374+0000","last_peered":"2024-05-08T09:23:36.124374+0000","last_clean":"2024-05-08T09:23:36.124374+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:23:36.124374+0000","last_undegraded":"2024-05-08T09:23:36.124374+0000","last_fullsized":"2024-05-08T09:23:36.124374+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:48.327703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062871+0000","last_change":"2024-05-08T09:21:36.971440+0000","last_active":"2024-05-08T09:22:16.062871+0000","last_peered":"2024-05-08T09:22:16.062871+0000","last_clean":"2024-05-08T09:22:16.062871+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:22:16.062871+0000","last_undegraded":"2024-05-08T09:22:16.062871+0000","last_fullsized":"2024-05-08T09:22:16.062871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:04.170344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995443+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:22:15.995443+0000","last_peered":"2024-05-08T09:22:15.995443+0000","last_clean":"2024-05-08T09:22:15.995443+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:22:15.995443+0000","last_undegraded":"2024-05-08T09:22:15.995443+0000","last_fullsized":"2024-05-08T09:22:15.995443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:38.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000438+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:22:16.000438+0000","last_peered":"2024-05-08T09:22:16.000438+0000","last_clean":"2024-05-08T09:22:16.000438+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:22:16.000438+0000","last_undegraded":"2024-05-08T09:22:16.000438+0000","last_fullsized":"2024-05-08T09:22:16.000438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:33.973664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247048+0000","last_change":"2024-05-08T09:21:30.956220+0000","last_active":"2024-05-08T09:24:38.247048+0000","last_peered":"2024-05-08T09:24:38.247048+0000","last_clean":"2024-05-08T09:24:38.247048+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:24:38.247048+0000","last_undegraded":"2024-05-08T09:24:38.247048+0000","last_fullsized":"2024-05-08T09:24:38.247048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996735+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:22:15.996735+0000","last_peered":"2024-05-08T09:22:15.996735+0000","last_clean":"2024-05-08T09:22:15.996735+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:22:15.996735+0000","last_undegraded":"2024-05-08T09:22:15.996735+0000","last_fullsized":"2024-05-08T09:22:15.996735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:21.186952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993609+0000","last_change":"2024-05-08T09:21:32.958181+0000","last_active":"2024-05-08T09:22:15.993609+0000","last_peered":"2024-05-08T09:22:15.993609+0000","last_clean":"2024-05-08T09:22:15.993609+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:22:15.993609+0000","last_undegraded":"2024-05-08T09:22:15.993609+0000","last_fullsized":"2024-05-08T09:22:15.993609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:40.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.130334+0000","last_change":"2024-05-08T09:21:34.964839+0000","last_active":"2024-05-08T09:23:36.130334+0000","last_peered":"2024-05-08T09:23:36.130334+0000","last_clean":"2024-05-08T09:23:36.130334+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:23:36.130334+0000","last_undegraded":"2024-05-08T09:23:36.130334+0000","last_fullsized":"2024-05-08T09:23:36.130334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:37:49.320700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992942+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:22:15.992942+0000","last_peered":"2024-05-08T09:22:15.992942+0000","last_clean":"2024-05-08T09:22:15.992942+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:22:15.992942+0000","last_undegraded":"2024-05-08T09:22:15.992942+0000","last_fullsized":"2024-05-08T09:22:15.992942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:59.583179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.033000+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.033000+0000","last_peered":"2024-05-08T09:24:38.033000+0000","last_clean":"2024-05-08T09:24:38.033000+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.033000+0000","last_undegraded":"2024-05-08T09:24:38.033000+0000","last_fullsized":"2024-05-08T09:24:38.033000+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240929+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.240929+0000","last_peered":"2024-05-08T09:24:38.240929+0000","last_clean":"2024-05-08T09:24:38.240929+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.240929+0000","last_undegraded":"2024-05-08T09:24:38.240929+0000","last_fullsized":"2024-05-08T09:24:38.240929+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:54:43.535283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993959+0000","last_change":"2024-05-08T09:21:28.977160+0000","last_active":"2024-05-08T09:22:15.993959+0000","last_peered":"2024-05-08T09:22:15.993959+0000","last_clean":"2024-05-08T09:22:15.993959+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:22:15.993959+0000","last_undegraded":"2024-05-08T09:22:15.993959+0000","last_fullsized":"2024-05-08T09:22:15.993959+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995252+0000","last_change":"2024-05-08T09:21:32.951442+0000","last_active":"2024-05-08T09:22:15.995252+0000","last_peered":"2024-05-08T09:22:15.995252+0000","last_clean":"2024-05-08T09:22:15.995252+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:22:15.995252+0000","last_undegraded":"2024-05-08T09:22:15.995252+0000","last_fullsized":"2024-05-08T09:22:15.995252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:14.017416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"27'5","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.560512+0000","last_change":"2024-05-08T09:21:34.958618+0000","last_active":"2024-05-08T09:24:37.560512+0000","last_peered":"2024-05-08T09:24:37.560512+0000","last_clean":"2024-05-08T09:24:37.560512+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:24:37.560512+0000","last_undegraded":"2024-05-08T09:24:37.560512+0000","last_fullsized":"2024-05-08T09:24:37.560512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:29.922576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997200+0000","last_change":"2024-05-08T09:21:36.967739+0000","last_active":"2024-05-08T09:22:15.997200+0000","last_peered":"2024-05-08T09:22:15.997200+0000","last_clean":"2024-05-08T09:22:15.997200+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:22:15.997200+0000","last_undegraded":"2024-05-08T09:22:15.997200+0000","last_fullsized":"2024-05-08T09:22:15.997200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:27.327024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063979+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:22:16.063979+0000","last_peered":"2024-05-08T09:22:16.063979+0000","last_clean":"2024-05-08T09:22:16.063979+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:22:16.063979+0000","last_undegraded":"2024-05-08T09:22:16.063979+0000","last_fullsized":"2024-05-08T09:22:16.063979+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:00.309491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.944236+0000","last_change":"2024-05-08T09:21:30.953686+0000","last_active":"2024-05-08T09:24:37.944236+0000","last_peered":"2024-05-08T09:24:37.944236+0000","last_clean":"2024-05-08T09:24:37.944236+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:24:37.944236+0000","last_undegraded":"2024-05-08T09:24:37.944236+0000","last_fullsized":"2024-05-08T09:24:37.944236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000191+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:22:16.000191+0000","last_peered":"2024-05-08T09:22:16.000191+0000","last_clean":"2024-05-08T09:22:16.000191+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:22:16.000191+0000","last_undegraded":"2024-05-08T09:22:16.000191+0000","last_fullsized":"2024-05-08T09:22:16.000191+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:21.670358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994229+0000","last_change":"2024-05-08T09:21:32.956150+0000","last_active":"2024-05-08T09:22:15.994229+0000","last_peered":"2024-05-08T09:22:15.994229+0000","last_clean":"2024-05-08T09:22:15.994229+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:22:15.994229+0000","last_undegraded":"2024-05-08T09:22:15.994229+0000","last_fullsized":"2024-05-08T09:22:15.994229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:34.790177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'40","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.620657+0000","last_change":"2024-05-08T09:21:34.964255+0000","last_active":"2024-05-08T09:24:37.620657+0000","last_peered":"2024-05-08T09:24:37.620657+0000","last_clean":"2024-05-08T09:24:37.620657+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:37.620657+0000","last_undegraded":"2024-05-08T09:24:37.620657+0000","last_fullsized":"2024-05-08T09:24:37.620657+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:25.320370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":61,"num_read_kb":64,"num_write":46,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993295+0000","last_change":"2024-05-08T09:21:36.969562+0000","last_active":"2024-05-08T09:22:15.993295+0000","last_peered":"2024-05-08T09:22:15.993295+0000","last_clean":"2024-05-08T09:22:15.993295+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:22:15.993295+0000","last_undegraded":"2024-05-08T09:22:15.993295+0000","last_fullsized":"2024-05-08T09:22:15.993295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996115+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:22:15.996115+0000","last_peered":"2024-05-08T09:22:15.996115+0000","last_clean":"2024-05-08T09:22:15.996115+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:22:15.996115+0000","last_undegraded":"2024-05-08T09:22:15.996115+0000","last_fullsized":"2024-05-08T09:22:15.996115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:31:28.662933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247450+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.247450+0000","last_peered":"2024-05-08T09:24:38.247450+0000","last_clean":"2024-05-08T09:24:38.247450+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.247450+0000","last_undegraded":"2024-05-08T09:24:38.247450+0000","last_fullsized":"2024-05-08T09:24:38.247450+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:24:00.045198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001269+0000","last_change":"2024-05-08T09:21:28.976895+0000","last_active":"2024-05-08T09:22:16.001269+0000","last_peered":"2024-05-08T09:22:16.001269+0000","last_clean":"2024-05-08T09:22:16.001269+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:22:16.001269+0000","last_undegraded":"2024-05-08T09:22:16.001269+0000","last_fullsized":"2024-05-08T09:22:16.001269+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993778+0000","last_change":"2024-05-08T09:21:32.953496+0000","last_active":"2024-05-08T09:22:15.993778+0000","last_peered":"2024-05-08T09:22:15.993778+0000","last_clean":"2024-05-08T09:22:15.993778+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:22:15.993778+0000","last_undegraded":"2024-05-08T09:22:15.993778+0000","last_fullsized":"2024-05-08T09:22:15.993778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:32.891213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'32","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.915996+0000","last_change":"2024-05-08T09:21:34.962303+0000","last_active":"2024-05-08T09:23:58.915996+0000","last_peered":"2024-05-08T09:23:58.915996+0000","last_clean":"2024-05-08T09:23:58.915996+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:23:58.915996+0000","last_undegraded":"2024-05-08T09:23:58.915996+0000","last_fullsized":"2024-05-08T09:23:58.915996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:21.800437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993777+0000","last_change":"2024-05-08T09:21:36.966752+0000","last_active":"2024-05-08T09:22:15.993777+0000","last_peered":"2024-05-08T09:22:15.993777+0000","last_clean":"2024-05-08T09:22:15.993777+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:22:15.993777+0000","last_undegraded":"2024-05-08T09:22:15.993777+0000","last_fullsized":"2024-05-08T09:22:15.993777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:36.110923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.999504+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:22:15.999504+0000","last_peered":"2024-05-08T09:22:15.999504+0000","last_clean":"2024-05-08T09:22:15.999504+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:22:15.999504+0000","last_undegraded":"2024-05-08T09:22:15.999504+0000","last_fullsized":"2024-05-08T09:22:15.999504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:59.893435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992379+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:22:15.992379+0000","last_peered":"2024-05-08T09:22:15.992379+0000","last_clean":"2024-05-08T09:22:15.992379+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:22:15.992379+0000","last_undegraded":"2024-05-08T09:22:15.992379+0000","last_fullsized":"2024-05-08T09:22:15.992379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:04:17.117842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064977+0000","last_change":"2024-05-08T09:21:32.957500+0000","last_active":"2024-05-08T09:22:16.064977+0000","last_peered":"2024-05-08T09:22:16.064977+0000","last_clean":"2024-05-08T09:22:16.064977+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:22:16.064977+0000","last_undegraded":"2024-05-08T09:22:16.064977+0000","last_fullsized":"2024-05-08T09:22:16.064977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:47:19.794029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'54","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.136580+0000","last_change":"2024-05-08T09:21:34.961064+0000","last_active":"2024-05-08T09:23:36.136580+0000","last_peered":"2024-05-08T09:23:36.136580+0000","last_clean":"2024-05-08T09:23:36.136580+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:23:36.136580+0000","last_undegraded":"2024-05-08T09:23:36.136580+0000","last_fullsized":"2024-05-08T09:23:36.136580+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:55:43.140389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000175+0000","last_change":"2024-05-08T09:21:36.964285+0000","last_active":"2024-05-08T09:22:16.000175+0000","last_peered":"2024-05-08T09:22:16.000175+0000","last_clean":"2024-05-08T09:22:16.000175+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:22:16.000175+0000","last_undegraded":"2024-05-08T09:22:16.000175+0000","last_fullsized":"2024-05-08T09:22:16.000175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:04:48.002782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.961449+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:37.961449+0000","last_peered":"2024-05-08T09:24:37.961449+0000","last_clean":"2024-05-08T09:24:37.961449+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:37.961449+0000","last_undegraded":"2024-05-08T09:24:37.961449+0000","last_fullsized":"2024-05-08T09:24:37.961449+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:39.434861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066141+0000","last_change":"2024-05-08T09:21:30.946651+0000","last_active":"2024-05-08T09:22:16.066141+0000","last_peered":"2024-05-08T09:22:16.066141+0000","last_clean":"2024-05-08T09:22:16.066141+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:22:16.066141+0000","last_undegraded":"2024-05-08T09:22:16.066141+0000","last_fullsized":"2024-05-08T09:22:16.066141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:30.648286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915215+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:23:53.915215+0000","last_peered":"2024-05-08T09:23:53.915215+0000","last_clean":"2024-05-08T09:23:53.915215+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:23:53.915215+0000","last_undegraded":"2024-05-08T09:23:53.915215+0000","last_fullsized":"2024-05-08T09:23:53.915215+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:19:47.714238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001089+0000","last_change":"2024-05-08T09:21:32.952239+0000","last_active":"2024-05-08T09:22:16.001089+0000","last_peered":"2024-05-08T09:22:16.001089+0000","last_clean":"2024-05-08T09:22:16.001089+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:22:16.001089+0000","last_undegraded":"2024-05-08T09:22:16.001089+0000","last_fullsized":"2024-05-08T09:22:16.001089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:04.920258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'36","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.117028+0000","last_change":"2024-05-08T09:21:34.964379+0000","last_active":"2024-05-08T09:23:36.117028+0000","last_peered":"2024-05-08T09:23:36.117028+0000","last_clean":"2024-05-08T09:23:36.117028+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:23:36.117028+0000","last_undegraded":"2024-05-08T09:23:36.117028+0000","last_fullsized":"2024-05-08T09:23:36.117028+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:24.020955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995784+0000","last_change":"2024-05-08T09:21:36.973254+0000","last_active":"2024-05-08T09:22:15.995784+0000","last_peered":"2024-05-08T09:22:15.995784+0000","last_clean":"2024-05-08T09:22:15.995784+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:22:15.995784+0000","last_undegraded":"2024-05-08T09:22:15.995784+0000","last_fullsized":"2024-05-08T09:22:15.995784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:26:31.966487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.958667+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:22:53.958667+0000","last_peered":"2024-05-08T09:22:53.958667+0000","last_clean":"2024-05-08T09:22:53.958667+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:22:53.958667+0000","last_undegraded":"2024-05-08T09:22:53.958667+0000","last_fullsized":"2024-05-08T09:22:53.958667+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:31:12.192786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917766+0000","last_change":"2024-05-08T09:21:30.961494+0000","last_active":"2024-05-08T09:24:03.917766+0000","last_peered":"2024-05-08T09:24:03.917766+0000","last_clean":"2024-05-08T09:24:03.917766+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:24:03.917766+0000","last_undegraded":"2024-05-08T09:24:03.917766+0000","last_fullsized":"2024-05-08T09:24:03.917766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:17:52.197337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993716+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:22:15.993716+0000","last_peered":"2024-05-08T09:22:15.993716+0000","last_clean":"2024-05-08T09:22:15.993716+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:22:15.993716+0000","last_undegraded":"2024-05-08T09:22:15.993716+0000","last_fullsized":"2024-05-08T09:22:15.993716+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.006061+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:22:16.006061+0000","last_peered":"2024-05-08T09:22:16.006061+0000","last_clean":"2024-05-08T09:22:16.006061+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:22:16.006061+0000","last_undegraded":"2024-05-08T09:22:16.006061+0000","last_fullsized":"2024-05-08T09:22:16.006061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:31:34.942749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'34","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909160+0000","last_change":"2024-05-08T09:21:34.959330+0000","last_active":"2024-05-08T09:23:43.909160+0000","last_peered":"2024-05-08T09:23:43.909160+0000","last_clean":"2024-05-08T09:23:43.909160+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:23:43.909160+0000","last_undegraded":"2024-05-08T09:23:43.909160+0000","last_fullsized":"2024-05-08T09:23:43.909160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:50:34.104269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5807,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":27,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064670+0000","last_change":"2024-05-08T09:21:36.968410+0000","last_active":"2024-05-08T09:22:16.064670+0000","last_peered":"2024-05-08T09:22:16.064670+0000","last_clean":"2024-05-08T09:22:16.064670+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:22:16.064670+0000","last_undegraded":"2024-05-08T09:22:16.064670+0000","last_fullsized":"2024-05-08T09:22:16.064670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:39:39.210093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.297088+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.297088+0000","last_peered":"2024-05-08T09:24:38.297088+0000","last_clean":"2024-05-08T09:24:38.297088+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.297088+0000","last_undegraded":"2024-05-08T09:24:38.297088+0000","last_fullsized":"2024-05-08T09:24:38.297088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:47.889435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.912027+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:03.912027+0000","last_peered":"2024-05-08T09:24:03.912027+0000","last_clean":"2024-05-08T09:24:03.912027+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:03.912027+0000","last_undegraded":"2024-05-08T09:24:03.912027+0000","last_fullsized":"2024-05-08T09:24:03.912027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:28:17.225753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995871+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:22:15.995871+0000","last_peered":"2024-05-08T09:22:15.995871+0000","last_clean":"2024-05-08T09:22:15.995871+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:22:15.995871+0000","last_undegraded":"2024-05-08T09:22:15.995871+0000","last_fullsized":"2024-05-08T09:22:15.995871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:06.064996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.004778+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:22:16.004778+0000","last_peered":"2024-05-08T09:22:16.004778+0000","last_clean":"2024-05-08T09:22:16.004778+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:22:16.004778+0000","last_undegraded":"2024-05-08T09:22:16.004778+0000","last_fullsized":"2024-05-08T09:22:16.004778+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:07:18.151465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998680+0000","last_change":"2024-05-08T09:21:34.967409+0000","last_active":"2024-05-08T09:22:15.998680+0000","last_peered":"2024-05-08T09:22:15.998680+0000","last_clean":"2024-05-08T09:22:15.998680+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:22:15.998680+0000","last_undegraded":"2024-05-08T09:22:15.998680+0000","last_fullsized":"2024-05-08T09:22:15.998680+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:22:37.791645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'282","reported_seq":375,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.043149+0000","last_change":"2024-05-08T09:21:36.975423+0000","last_active":"2024-05-08T09:24:38.043149+0000","last_peered":"2024-05-08T09:24:38.043149+0000","last_clean":"2024-05-08T09:24:38.043149+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:24:38.043149+0000","last_undegraded":"2024-05-08T09:24:38.043149+0000","last_fullsized":"2024-05-08T09:24:38.043149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:30:51.994196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.991922+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:22:15.991922+0000","last_peered":"2024-05-08T09:22:15.991922+0000","last_clean":"2024-05-08T09:22:15.991922+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:22:15.991922+0000","last_undegraded":"2024-05-08T09:22:15.991922+0000","last_fullsized":"2024-05-08T09:22:15.991922+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:40.548638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207709+0000","last_change":"2024-05-08T09:21:30.952074+0000","last_active":"2024-05-08T09:24:38.207709+0000","last_peered":"2024-05-08T09:24:38.207709+0000","last_clean":"2024-05-08T09:24:38.207709+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:24:38.207709+0000","last_undegraded":"2024-05-08T09:24:38.207709+0000","last_fullsized":"2024-05-08T09:24:38.207709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:59:54.695384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'5","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916234+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:23:58.916234+0000","last_peered":"2024-05-08T09:23:58.916234+0000","last_clean":"2024-05-08T09:23:58.916234+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:23:58.916234+0000","last_undegraded":"2024-05-08T09:23:58.916234+0000","last_fullsized":"2024-05-08T09:23:58.916234+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":29,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"20'1","reported_seq":218,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.188377+0000","last_change":"2024-05-08T09:21:32.958699+0000","last_active":"2024-05-08T09:23:37.188377+0000","last_peered":"2024-05-08T09:23:37.188377+0000","last_clean":"2024-05-08T09:23:37.188377+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:23:37.188377+0000","last_undegraded":"2024-05-08T09:23:37.188377+0000","last_fullsized":"2024-05-08T09:23:37.188377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:10.206363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'38","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917019+0000","last_change":"2024-05-08T09:21:34.964625+0000","last_active":"2024-05-08T09:24:03.917019+0000","last_peered":"2024-05-08T09:24:03.917019+0000","last_clean":"2024-05-08T09:24:03.917019+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:03.917019+0000","last_undegraded":"2024-05-08T09:24:03.917019+0000","last_fullsized":"2024-05-08T09:24:03.917019+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:03.907236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062486+0000","last_change":"2024-05-08T09:21:36.973685+0000","last_active":"2024-05-08T09:22:16.062486+0000","last_peered":"2024-05-08T09:22:16.062486+0000","last_clean":"2024-05-08T09:22:16.062486+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:22:16.062486+0000","last_undegraded":"2024-05-08T09:22:16.062486+0000","last_fullsized":"2024-05-08T09:22:16.062486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:03:41.857456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001765+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:22:16.001765+0000","last_peered":"2024-05-08T09:22:16.001765+0000","last_clean":"2024-05-08T09:22:16.001765+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:22:16.001765+0000","last_undegraded":"2024-05-08T09:22:16.001765+0000","last_fullsized":"2024-05-08T09:22:16.001765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:54:36.232685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.916931+0000","last_change":"2024-05-08T09:21:30.945039+0000","last_active":"2024-05-08T09:24:03.916931+0000","last_peered":"2024-05-08T09:24:03.916931+0000","last_clean":"2024-05-08T09:24:03.916931+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:24:03.916931+0000","last_undegraded":"2024-05-08T09:24:03.916931+0000","last_fullsized":"2024-05-08T09:24:03.916931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:06.873670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997115+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:22:15.997115+0000","last_peered":"2024-05-08T09:22:15.997115+0000","last_clean":"2024-05-08T09:22:15.997115+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:22:15.997115+0000","last_undegraded":"2024-05-08T09:22:15.997115+0000","last_fullsized":"2024-05-08T09:22:15.997115+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:17:05.712002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998814+0000","last_change":"2024-05-08T09:21:32.956273+0000","last_active":"2024-05-08T09:22:15.998814+0000","last_peered":"2024-05-08T09:22:15.998814+0000","last_clean":"2024-05-08T09:22:15.998814+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:22:15.998814+0000","last_undegraded":"2024-05-08T09:22:15.998814+0000","last_fullsized":"2024-05-08T09:22:15.998814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:53.297960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'30","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.108672+0000","last_change":"2024-05-08T09:21:34.962675+0000","last_active":"2024-05-08T09:23:36.108672+0000","last_peered":"2024-05-08T09:23:36.108672+0000","last_clean":"2024-05-08T09:23:36.108672+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:23:36.108672+0000","last_undegraded":"2024-05-08T09:23:36.108672+0000","last_fullsized":"2024-05-08T09:23:36.108672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:51:42.419149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.992215+0000","last_change":"2024-05-08T09:21:36.975698+0000","last_active":"2024-05-08T09:22:15.992215+0000","last_peered":"2024-05-08T09:22:15.992215+0000","last_clean":"2024-05-08T09:22:15.992215+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:22:15.992215+0000","last_undegraded":"2024-05-08T09:22:15.992215+0000","last_fullsized":"2024-05-08T09:22:15.992215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:22:04.192857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998833+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:22:15.998833+0000","last_peered":"2024-05-08T09:22:15.998833+0000","last_clean":"2024-05-08T09:22:15.998833+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:22:15.998833+0000","last_undegraded":"2024-05-08T09:22:15.998833+0000","last_fullsized":"2024-05-08T09:22:15.998833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:22:09.958023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.994056+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:22:15.994056+0000","last_peered":"2024-05-08T09:22:15.994056+0000","last_clean":"2024-05-08T09:22:15.994056+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:22:15.994056+0000","last_undegraded":"2024-05-08T09:22:15.994056+0000","last_fullsized":"2024-05-08T09:22:15.994056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:56.982702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065163+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:22:16.065163+0000","last_peered":"2024-05-08T09:22:16.065163+0000","last_clean":"2024-05-08T09:22:16.065163+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:22:16.065163+0000","last_undegraded":"2024-05-08T09:22:16.065163+0000","last_fullsized":"2024-05-08T09:22:16.065163+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:38:29.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993524+0000","last_change":"2024-05-08T09:21:32.952670+0000","last_active":"2024-05-08T09:22:15.993524+0000","last_peered":"2024-05-08T09:22:15.993524+0000","last_clean":"2024-05-08T09:22:15.993524+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:22:15.993524+0000","last_undegraded":"2024-05-08T09:22:15.993524+0000","last_fullsized":"2024-05-08T09:22:15.993524+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:59:58.990094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'26","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.132233+0000","last_change":"2024-05-08T09:21:34.964514+0000","last_active":"2024-05-08T09:23:36.132233+0000","last_peered":"2024-05-08T09:23:36.132233+0000","last_clean":"2024-05-08T09:23:36.132233+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:23:36.132233+0000","last_undegraded":"2024-05-08T09:23:36.132233+0000","last_fullsized":"2024-05-08T09:23:36.132233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:52:12.788058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.995586+0000","last_change":"2024-05-08T09:21:36.978806+0000","last_active":"2024-05-08T09:22:15.995586+0000","last_peered":"2024-05-08T09:22:15.995586+0000","last_clean":"2024-05-08T09:22:15.995586+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:22:15.995586+0000","last_undegraded":"2024-05-08T09:22:15.995586+0000","last_fullsized":"2024-05-08T09:22:15.995586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:35:58.108416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.141999+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:23:36.141999+0000","last_peered":"2024-05-08T09:23:36.141999+0000","last_clean":"2024-05-08T09:23:36.141999+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:23:36.141999+0000","last_undegraded":"2024-05-08T09:23:36.141999+0000","last_fullsized":"2024-05-08T09:23:36.141999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:16:58.409814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241173+0000","last_change":"2024-05-08T09:21:30.945358+0000","last_active":"2024-05-08T09:24:38.241173+0000","last_peered":"2024-05-08T09:24:38.241173+0000","last_clean":"2024-05-08T09:24:38.241173+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:24:38.241173+0000","last_undegraded":"2024-05-08T09:24:38.241173+0000","last_fullsized":"2024-05-08T09:24:38.241173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:35.493172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.001565+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:22:16.001565+0000","last_peered":"2024-05-08T09:22:16.001565+0000","last_clean":"2024-05-08T09:22:16.001565+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:22:16.001565+0000","last_undegraded":"2024-05-08T09:22:16.001565+0000","last_fullsized":"2024-05-08T09:22:16.001565+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:43.997529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:34.803032+0000","last_change":"2024-05-08T09:21:32.956974+0000","last_active":"2024-05-08T09:23:34.803032+0000","last_peered":"2024-05-08T09:23:34.803032+0000","last_clean":"2024-05-08T09:23:34.803032+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:23:34.803032+0000","last_undegraded":"2024-05-08T09:23:34.803032+0000","last_fullsized":"2024-05-08T09:23:34.803032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:38.938823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'32","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.561424+0000","last_change":"2024-05-08T09:21:34.965967+0000","last_active":"2024-05-08T09:24:37.561424+0000","last_peered":"2024-05-08T09:24:37.561424+0000","last_clean":"2024-05-08T09:24:37.561424+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:24:37.561424+0000","last_undegraded":"2024-05-08T09:24:37.561424+0000","last_fullsized":"2024-05-08T09:24:37.561424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:27:50.441262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.063598+0000","last_change":"2024-05-08T09:21:36.973796+0000","last_active":"2024-05-08T09:22:16.063598+0000","last_peered":"2024-05-08T09:22:16.063598+0000","last_clean":"2024-05-08T09:22:16.063598+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:22:16.063598+0000","last_undegraded":"2024-05-08T09:22:16.063598+0000","last_fullsized":"2024-05-08T09:22:16.063598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:04:36.904276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:36.144572+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:36.144572+0000","last_peered":"2024-05-08T09:23:36.144572+0000","last_clean":"2024-05-08T09:23:36.144572+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:36.144572+0000","last_undegraded":"2024-05-08T09:23:36.144572+0000","last_fullsized":"2024-05-08T09:23:36.144572+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:33.860320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.210108+0000","last_change":"2024-05-08T09:21:30.954737+0000","last_active":"2024-05-08T09:24:38.210108+0000","last_peered":"2024-05-08T09:24:38.210108+0000","last_clean":"2024-05-08T09:24:38.210108+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:24:38.210108+0000","last_undegraded":"2024-05-08T09:24:38.210108+0000","last_fullsized":"2024-05-08T09:24:38.210108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:47:33.918459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.993499+0000","last_change":"2024-05-08T09:21:28.974311+0000","last_active":"2024-05-08T09:22:15.993499+0000","last_peered":"2024-05-08T09:22:15.993499+0000","last_clean":"2024-05-08T09:22:15.993499+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:22:15.993499+0000","last_undegraded":"2024-05-08T09:22:15.993499+0000","last_fullsized":"2024-05-08T09:22:15.993499+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:59:52.239058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.030984+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.030984+0000","last_peered":"2024-05-08T09:24:38.030984+0000","last_clean":"2024-05-08T09:24:38.030984+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.030984+0000","last_undegraded":"2024-05-08T09:24:38.030984+0000","last_fullsized":"2024-05-08T09:24:38.030984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:41.143334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062507+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:22:16.062507+0000","last_peered":"2024-05-08T09:22:16.062507+0000","last_clean":"2024-05-08T09:22:16.062507+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:22:16.062507+0000","last_undegraded":"2024-05-08T09:22:16.062507+0000","last_fullsized":"2024-05-08T09:22:16.062507+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:18:41.342872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996972+0000","last_change":"2024-05-08T09:21:30.961138+0000","last_active":"2024-05-08T09:22:15.996972+0000","last_peered":"2024-05-08T09:22:15.996972+0000","last_clean":"2024-05-08T09:22:15.996972+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:22:15.996972+0000","last_undegraded":"2024-05-08T09:22:15.996972+0000","last_fullsized":"2024-05-08T09:22:15.996972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:41.600887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.996550+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:22:15.996550+0000","last_peered":"2024-05-08T09:22:15.996550+0000","last_clean":"2024-05-08T09:22:15.996550+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:22:15.996550+0000","last_undegraded":"2024-05-08T09:22:15.996550+0000","last_fullsized":"2024-05-08T09:22:15.996550+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:41:32.580301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.241017+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.241017+0000","last_peered":"2024-05-08T09:24:38.241017+0000","last_clean":"2024-05-08T09:24:38.241017+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.241017+0000","last_undegraded":"2024-05-08T09:24:38.241017+0000","last_fullsized":"2024-05-08T09:24:38.241017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:09.980457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.064366+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:22:16.064366+0000","last_peered":"2024-05-08T09:22:16.064366+0000","last_clean":"2024-05-08T09:22:16.064366+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:22:16.064366+0000","last_undegraded":"2024-05-08T09:22:16.064366+0000","last_fullsized":"2024-05-08T09:22:16.064366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.943767+0000","last_change":"2024-05-08T09:21:30.953450+0000","last_active":"2024-05-08T09:24:37.943767+0000","last_peered":"2024-05-08T09:24:37.943767+0000","last_clean":"2024-05-08T09:24:37.943767+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:24:37.943767+0000","last_undegraded":"2024-05-08T09:24:37.943767+0000","last_fullsized":"2024-05-08T09:24:37.943767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:32.037486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066265+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:22:16.066265+0000","last_peered":"2024-05-08T09:22:16.066265+0000","last_clean":"2024-05-08T09:22:16.066265+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:22:16.066265+0000","last_undegraded":"2024-05-08T09:22:16.066265+0000","last_fullsized":"2024-05-08T09:22:16.066265+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:26:30.054819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.240952+0000","last_change":"2024-05-08T09:21:30.954588+0000","last_active":"2024-05-08T09:24:38.240952+0000","last_peered":"2024-05-08T09:24:38.240952+0000","last_clean":"2024-05-08T09:24:38.240952+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:24:38.240952+0000","last_undegraded":"2024-05-08T09:24:38.240952+0000","last_fullsized":"2024-05-08T09:24:38.240952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:50.382810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.997994+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:22:15.997994+0000","last_peered":"2024-05-08T09:22:15.997994+0000","last_clean":"2024-05-08T09:22:15.997994+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:22:15.997994+0000","last_undegraded":"2024-05-08T09:22:15.997994+0000","last_fullsized":"2024-05-08T09:22:15.997994+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:16:35.165596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166509+0000","last_change":"2024-05-08T09:21:30.943875+0000","last_active":"2024-05-08T09:24:38.166509+0000","last_peered":"2024-05-08T09:24:38.166509+0000","last_clean":"2024-05-08T09:24:38.166509+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:24:38.166509+0000","last_undegraded":"2024-05-08T09:24:38.166509+0000","last_fullsized":"2024-05-08T09:24:38.166509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:07:23.193678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.000230+0000","last_change":"2024-05-08T09:21:28.974367+0000","last_active":"2024-05-08T09:22:16.000230+0000","last_peered":"2024-05-08T09:22:16.000230+0000","last_clean":"2024-05-08T09:22:16.000230+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:22:16.000230+0000","last_undegraded":"2024-05-08T09:22:16.000230+0000","last_fullsized":"2024-05-08T09:22:16.000230+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:51:02.862350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.172965+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.172965+0000","last_peered":"2024-05-08T09:24:38.172965+0000","last_clean":"2024-05-08T09:24:38.172965+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.172965+0000","last_undegraded":"2024-05-08T09:24:38.172965+0000","last_fullsized":"2024-05-08T09:24:38.172965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:01:34.087796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065749+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:22:16.065749+0000","last_peered":"2024-05-08T09:22:16.065749+0000","last_clean":"2024-05-08T09:22:16.065749+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:22:16.065749+0000","last_undegraded":"2024-05-08T09:22:16.065749+0000","last_fullsized":"2024-05-08T09:22:16.065749+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031074+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.031074+0000","last_peered":"2024-05-08T09:24:38.031074+0000","last_clean":"2024-05-08T09:24:38.031074+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.031074+0000","last_undegraded":"2024-05-08T09:24:38.031074+0000","last_fullsized":"2024-05-08T09:24:38.031074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:56:02.912865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.492136+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:37.492136+0000","last_peered":"2024-05-08T09:23:37.492136+0000","last_clean":"2024-05-08T09:23:37.492136+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:37.492136+0000","last_undegraded":"2024-05-08T09:23:37.492136+0000","last_fullsized":"2024-05-08T09:23:37.492136+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:35:50.421255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:53.961979+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:22:53.961979+0000","last_peered":"2024-05-08T09:22:53.961979+0000","last_clean":"2024-05-08T09:22:53.961979+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:22:53.961979+0000","last_undegraded":"2024-05-08T09:22:53.961979+0000","last_fullsized":"2024-05-08T09:22:53.961979+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:17:25.908775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062758+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:22:16.062758+0000","last_peered":"2024-05-08T09:22:16.062758+0000","last_clean":"2024-05-08T09:22:16.062758+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:22:16.062758+0000","last_undegraded":"2024-05-08T09:22:16.062758+0000","last_fullsized":"2024-05-08T09:22:16.062758+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:55.366425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.065639+0000","last_change":"2024-05-08T09:21:30.953222+0000","last_active":"2024-05-08T09:22:16.065639+0000","last_peered":"2024-05-08T09:22:16.065639+0000","last_clean":"2024-05-08T09:22:16.065639+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:22:16.065639+0000","last_undegraded":"2024-05-08T09:22:16.065639+0000","last_fullsized":"2024-05-08T09:22:16.065639+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:24.666609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913638+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:23:43.913638+0000","last_peered":"2024-05-08T09:23:43.913638+0000","last_clean":"2024-05-08T09:23:43.913638+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:23:43.913638+0000","last_undegraded":"2024-05-08T09:23:43.913638+0000","last_fullsized":"2024-05-08T09:23:43.913638+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:58:40.098606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218043+0000","last_change":"2024-05-08T09:21:30.943497+0000","last_active":"2024-05-08T09:24:38.218043+0000","last_peered":"2024-05-08T09:24:38.218043+0000","last_clean":"2024-05-08T09:24:38.218043+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:24:38.218043+0000","last_undegraded":"2024-05-08T09:24:38.218043+0000","last_fullsized":"2024-05-08T09:24:38.218043+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:59.730012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.925923+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.925923+0000","last_peered":"2024-05-08T09:24:37.925923+0000","last_clean":"2024-05-08T09:24:37.925923+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.925923+0000","last_undegraded":"2024-05-08T09:24:37.925923+0000","last_fullsized":"2024-05-08T09:24:37.925923+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:32:02.189984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.207990+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.207990+0000","last_peered":"2024-05-08T09:24:38.207990+0000","last_clean":"2024-05-08T09:24:38.207990+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.207990+0000","last_undegraded":"2024-05-08T09:24:38.207990+0000","last_fullsized":"2024-05-08T09:24:38.207990+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:10:35.124433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998089+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:22:15.998089+0000","last_peered":"2024-05-08T09:22:15.998089+0000","last_clean":"2024-05-08T09:22:15.998089+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:22:15.998089+0000","last_undegraded":"2024-05-08T09:22:15.998089+0000","last_fullsized":"2024-05-08T09:22:15.998089+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:37:04.866945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.031169+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.031169+0000","last_peered":"2024-05-08T09:24:38.031169+0000","last_clean":"2024-05-08T09:24:38.031169+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.031169+0000","last_undegraded":"2024-05-08T09:24:38.031169+0000","last_fullsized":"2024-05-08T09:24:38.031169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:18:25.324860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914130+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:23:43.914130+0000","last_peered":"2024-05-08T09:23:43.914130+0000","last_clean":"2024-05-08T09:23:43.914130+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:23:43.914130+0000","last_undegraded":"2024-05-08T09:23:43.914130+0000","last_fullsized":"2024-05-08T09:23:43.914130+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:30.030761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.542031+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:37.542031+0000","last_peered":"2024-05-08T09:23:37.542031+0000","last_clean":"2024-05-08T09:23:37.542031+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:37.542031+0000","last_undegraded":"2024-05-08T09:23:37.542031+0000","last_fullsized":"2024-05-08T09:23:37.542031+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:43:36.931430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158434+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.158434+0000","last_peered":"2024-05-08T09:24:38.158434+0000","last_clean":"2024-05-08T09:24:38.158434+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.158434+0000","last_undegraded":"2024-05-08T09:24:38.158434+0000","last_fullsized":"2024-05-08T09:24:38.158434+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:19.854504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.166918+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.166918+0000","last_peered":"2024-05-08T09:24:38.166918+0000","last_clean":"2024-05-08T09:24:38.166918+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.166918+0000","last_undegraded":"2024-05-08T09:24:38.166918+0000","last_fullsized":"2024-05-08T09:24:38.166918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:07:00.681814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:15.998902+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:22:15.998902+0000","last_peered":"2024-05-08T09:22:15.998902+0000","last_clean":"2024-05-08T09:22:15.998902+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:22:15.998902+0000","last_undegraded":"2024-05-08T09:22:15.998902+0000","last_fullsized":"2024-05-08T09:22:15.998902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:47:39.136609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155448+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.155448+0000","last_peered":"2024-05-08T09:24:38.155448+0000","last_clean":"2024-05-08T09:24:38.155448+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.155448+0000","last_undegraded":"2024-05-08T09:24:38.155448+0000","last_fullsized":"2024-05-08T09:24:38.155448+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:24:39.542618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.066842+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:22:16.066842+0000","last_peered":"2024-05-08T09:22:16.066842+0000","last_clean":"2024-05-08T09:22:16.066842+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:22:16.066842+0000","last_undegraded":"2024-05-08T09:22:16.066842+0000","last_fullsized":"2024-05-08T09:22:16.066842+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:24:18.416626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:22:16.062889+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:22:16.062889+0000","last_peered":"2024-05-08T09:22:16.062889+0000","last_clean":"2024-05-08T09:22:16.062889+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:22:16.062889+0000","last_undegraded":"2024-05-08T09:22:16.062889+0000","last_fullsized":"2024-05-08T09:22:16.062889+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:53:54.331479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218152+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.218152+0000","last_peered":"2024-05-08T09:24:38.218152+0000","last_clean":"2024-05-08T09:24:38.218152+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.218152+0000","last_undegraded":"2024-05-08T09:24:38.218152+0000","last_fullsized":"2024-05-08T09:24:38.218152+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:33:27.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1402,"num_read_kb":1188,"num_write":531,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1275,"ondisk_log_size":1275,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":138,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705709,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44172,"kb_used_data":8836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327668,"statfs":{"total":96636764160,"available":96591532032,"internally_reserved":0,"allocated":9048064,"data_stored":8743011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705708,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44680,"kb_used_data":9344,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327160,"statfs":{"total":96636764160,"available":96591011840,"internally_reserved":0,"allocated":9568256,"data_stored":9328984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705708,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44716,"kb_used_data":9380,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327124,"statfs":{"total":96636764160,"available":96590974976,"internally_reserved":0,"allocated":9605120,"data_stored":9331170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705709,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39984,"kb_used_data":8808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94331856,"statfs":{"total":96636764160,"available":96595820544,"internally_reserved":0,"allocated":9019392,"data_stored":8743023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:24:49.529 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.530 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.531 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.532 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.533 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.534 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.535 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.536 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.537 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.538 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.539 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.540 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.541 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.542 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.543 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.544 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.545 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.546 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.547 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.548 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.549 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.550 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.551 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.552 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.553 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.554 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.555 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.556 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.557 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:24:49.558 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T09:25:09.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:25:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b8c152640 1 Processor -- start 2024-05-08T09:25:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b8c152640 1 -- start start 2024-05-08T09:25:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b8c152640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7b8412f580 0x7f7b84131970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b8c152640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b84113dd0 con 0x7f7b8412c5b0 2024-05-08T09:25:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b8c152640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f7b84072290 con 0x7f7b8412f580 2024-05-08T09:25:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b89eee640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7b8412c5b0 0x7f7b8412c990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37394/0 (socket says 172.21.15.45:37394) 2024-05-08T09:25:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b89eee640 1 -- 172.21.15.45:0/1300116220 learned_addr learned my addr 172.21.15.45:0/1300116220 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:25:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.675+0000 7f7b896ed640 1 --2- 172.21.15.45:0/1300116220 >> v2:172.21.15.45:3300/0 conn(0x7f7b8412f580 0x7f7b84131970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.676+0000 7f7b88eec640 1 -- 172.21.15.45:0/1300116220 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243535578 0 0) 0x7f7b84113dd0 con 0x7f7b8412c5b0 2024-05-08T09:25:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.676+0000 7f7b88eec640 1 -- 172.21.15.45:0/1300116220 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b70003520 con 0x7f7b8412c5b0 2024-05-08T09:25:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.676+0000 7f7b896ed640 1 -- 172.21.15.45:0/1300116220 >> v1:172.21.15.45:6789/0 conn(0x7f7b8412c5b0 legacy=0x7f7b8412c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.676+0000 7f7b896ed640 1 -- 172.21.15.45:0/1300116220 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b8412c390 con 0x7f7b8412f580 2024-05-08T09:25:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b896ed640 1 --2- 172.21.15.45:0/1300116220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412f580 0x7f7b84131970 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009720 tx=0x7f7b7402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01e6fca7c03b1e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b88eec640 1 -- 172.21.15.45:0/1300116220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740316d0 con 0x7f7b8412f580 2024-05-08T09:25:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b88eec640 1 -- 172.21.15.45:0/1300116220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74037070 con 0x7f7b8412f580 2024-05-08T09:25:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b88eec640 1 -- 172.21.15.45:0/1300116220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b740319c0 con 0x7f7b8412f580 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 -- 172.21.15.45:0/1300116220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412f580 msgr2=0x7f7b84131970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 --2- 172.21.15.45:0/1300116220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412f580 0x7f7b84131970 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009720 tx=0x7f7b7402b840 comp rx=0 tx=0).stop 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 -- 172.21.15.45:0/1300116220 shutdown_connections 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 --2- 172.21.15.45:0/1300116220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412f580 0x7f7b84131970 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 -- 172.21.15.45:0/1300116220 >> 172.21.15.45:0/1300116220 conn(0x7f7b84099380 msgr2=0x7f7b84099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.677+0000 7f7b8c152640 1 -- 172.21.15.45:0/1300116220 shutdown_connections 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.678+0000 7f7b8c152640 1 -- 172.21.15.45:0/1300116220 wait complete. 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.678+0000 7f7b8c152640 1 Processor -- start 2024-05-08T09:25:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.678+0000 7f7b8c152640 1 -- start start 2024-05-08T09:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b8c152640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b8c152640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f7b84113990 con 0x7f7b8412c5b0 2024-05-08T09:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b89eee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b89eee640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36264/0 (socket says 172.21.15.45:36264) 2024-05-08T09:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b89eee640 1 -- 172.21.15.45:0/31893249 learned_addr learned my addr 172.21.15.45:0/31893249 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b89eee640 1 -- 172.21.15.45:0/31893249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b84071d30 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b89eee640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c480 tx=0x7f7b8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80017070 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b80005c10 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b84129090 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.679+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b80007070 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.680+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b84071050 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.681+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f7b8001a070 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.681+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b841284b0 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.681+0000 7f7b7a7fc640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 0x7f7b6803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.681+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f7b8004add0 con 0x7f7b8412c5b0 2024-05-08T09:25:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.681+0000 7f7b896ed640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 0x7f7b6803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.682+0000 7f7b896ed640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 0x7f7b6803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b74036000 tx=0x7f7b74008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.686+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f7b8001a790 con 0x7f7b8412c5b0 2024-05-08T09:25:09.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.869+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b8406ea60 con 0x7f7b68038060 2024-05-08T09:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.885+0000 7f7b7a7fc640 1 -- 172.21.15.45:0/31893249 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+658423 (secure 0 0 0) 0x7f7b8406ea60 con 0x7f7b68038060 2024-05-08T09:25:09.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:25:09.897 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 msgr2=0x7f7b6803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 0x7f7b6803a520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b74036000 tx=0x7f7b74008030 comp rx=0 tx=0).stop 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 msgr2=0x7f7b841227a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f7b8000c480 tx=0x7f7b8000c940 comp rx=0 tx=0).stop 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 shutdown_connections 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f7b68038060 0x7f7b6803a520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 --2- 172.21.15.45:0/31893249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b8412c5b0 0x7f7b841227a0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 >> 172.21.15.45:0/31893249 conn(0x7f7b84099380 msgr2=0x7f7b8406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 shutdown_connections 2024-05-08T09:25:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:09.890+0000 7f7b8c152640 1 -- 172.21.15.45:0/31893249 wait complete. 2024-05-08T09:25:09.900 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-05-08T09:25:08.901714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5100,"num_read_kb":4681,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4715,"ondisk_log_size":4715,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":144088,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":141305,"kb_avail":377343272,"statfs":{"total":386547056640,"available":386399510528,"internally_reserved":0,"allocated":2809856,"data_stored":1719982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":144697111},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003774"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912000+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:23:33.912000+0000","last_peered":"2024-05-08T09:23:33.912000+0000","last_clean":"2024-05-08T09:23:33.912000+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:23:33.912000+0000","last_undegraded":"2024-05-08T09:23:33.912000+0000","last_fullsized":"2024-05-08T09:23:33.912000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293551+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:38.293551+0000","last_peered":"2024-05-08T09:24:38.293551+0000","last_clean":"2024-05-08T09:24:38.293551+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:38.293551+0000","last_undegraded":"2024-05-08T09:24:38.293551+0000","last_fullsized":"2024-05-08T09:24:38.293551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.378338+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.378338+0000","last_peered":"2024-05-08T09:23:37.378338+0000","last_clean":"2024-05-08T09:23:37.378338+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.378338+0000","last_undegraded":"2024-05-08T09:23:37.378338+0000","last_fullsized":"2024-05-08T09:23:37.378338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173731+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.173731+0000","last_peered":"2024-05-08T09:24:38.173731+0000","last_clean":"2024-05-08T09:24:38.173731+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.173731+0000","last_undegraded":"2024-05-08T09:24:38.173731+0000","last_fullsized":"2024-05-08T09:24:38.173731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912281+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:23:33.912281+0000","last_peered":"2024-05-08T09:23:33.912281+0000","last_clean":"2024-05-08T09:23:33.912281+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:23:33.912281+0000","last_undegraded":"2024-05-08T09:23:33.912281+0000","last_fullsized":"2024-05-08T09:23:33.912281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917617+0000","last_change":"2024-05-08T09:21:30.959732+0000","last_active":"2024-05-08T09:24:03.917617+0000","last_peered":"2024-05-08T09:24:03.917617+0000","last_clean":"2024-05-08T09:24:03.917617+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:24:03.917617+0000","last_undegraded":"2024-05-08T09:24:03.917617+0000","last_fullsized":"2024-05-08T09:24:03.917617+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911067+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:23:28.911067+0000","last_peered":"2024-05-08T09:23:28.911067+0000","last_clean":"2024-05-08T09:23:28.911067+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:23:28.911067+0000","last_undegraded":"2024-05-08T09:23:28.911067+0000","last_fullsized":"2024-05-08T09:23:28.911067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.952879+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.952879+0000","last_peered":"2024-05-08T09:24:37.952879+0000","last_clean":"2024-05-08T09:24:37.952879+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.952879+0000","last_undegraded":"2024-05-08T09:24:37.952879+0000","last_fullsized":"2024-05-08T09:24:37.952879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916767+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:23:58.916767+0000","last_peered":"2024-05-08T09:23:58.916767+0000","last_clean":"2024-05-08T09:23:58.916767+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:23:58.916767+0000","last_undegraded":"2024-05-08T09:23:58.916767+0000","last_fullsized":"2024-05-08T09:23:58.916767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037321+0000","last_change":"2024-05-08T09:21:30.942925+0000","last_active":"2024-05-08T09:24:38.037321+0000","last_peered":"2024-05-08T09:24:38.037321+0000","last_clean":"2024-05-08T09:24:38.037321+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:24:38.037321+0000","last_undegraded":"2024-05-08T09:24:38.037321+0000","last_fullsized":"2024-05-08T09:24:38.037321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916014+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:23:58.916014+0000","last_peered":"2024-05-08T09:23:58.916014+0000","last_clean":"2024-05-08T09:23:58.916014+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:23:58.916014+0000","last_undegraded":"2024-05-08T09:23:58.916014+0000","last_fullsized":"2024-05-08T09:23:58.916014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.952803+0000","last_change":"2024-05-08T09:21:30.960649+0000","last_active":"2024-05-08T09:24:37.952803+0000","last_peered":"2024-05-08T09:24:37.952803+0000","last_clean":"2024-05-08T09:24:37.952803+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:24:37.952803+0000","last_undegraded":"2024-05-08T09:24:37.952803+0000","last_fullsized":"2024-05-08T09:24:37.952803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916673+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:23:58.916673+0000","last_peered":"2024-05-08T09:23:58.916673+0000","last_clean":"2024-05-08T09:23:58.916673+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:23:58.916673+0000","last_undegraded":"2024-05-08T09:23:58.916673+0000","last_fullsized":"2024-05-08T09:23:58.916673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912764+0000","last_change":"2024-05-08T09:21:30.950639+0000","last_active":"2024-05-08T09:23:38.912764+0000","last_peered":"2024-05-08T09:23:38.912764+0000","last_clean":"2024-05-08T09:23:38.912764+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:23:38.912764+0000","last_undegraded":"2024-05-08T09:23:38.912764+0000","last_fullsized":"2024-05-08T09:23:38.912764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.911254+0000","last_change":"2024-05-08T09:21:28.962227+0000","last_active":"2024-05-08T09:23:58.911254+0000","last_peered":"2024-05-08T09:23:58.911254+0000","last_clean":"2024-05-08T09:23:58.911254+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:23:58.911254+0000","last_undegraded":"2024-05-08T09:23:58.911254+0000","last_fullsized":"2024-05-08T09:23:58.911254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037313+0000","last_change":"2024-05-08T09:21:30.953880+0000","last_active":"2024-05-08T09:24:38.037313+0000","last_peered":"2024-05-08T09:24:38.037313+0000","last_clean":"2024-05-08T09:24:38.037313+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:24:38.037313+0000","last_undegraded":"2024-05-08T09:24:38.037313+0000","last_fullsized":"2024-05-08T09:24:38.037313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173195+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.173195+0000","last_peered":"2024-05-08T09:24:38.173195+0000","last_clean":"2024-05-08T09:24:38.173195+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.173195+0000","last_undegraded":"2024-05-08T09:24:38.173195+0000","last_fullsized":"2024-05-08T09:24:38.173195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905454+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:24:44.905454+0000","last_peered":"2024-05-08T09:24:44.905454+0000","last_clean":"2024-05-08T09:24:44.905454+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:24:44.905454+0000","last_undegraded":"2024-05-08T09:24:44.905454+0000","last_fullsized":"2024-05-08T09:24:44.905454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915252+0000","last_change":"2024-05-08T09:21:30.945729+0000","last_active":"2024-05-08T09:23:53.915252+0000","last_peered":"2024-05-08T09:23:53.915252+0000","last_clean":"2024-05-08T09:23:53.915252+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:23:53.915252+0000","last_undegraded":"2024-05-08T09:23:53.915252+0000","last_fullsized":"2024-05-08T09:23:53.915252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915368+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:23:53.915368+0000","last_peered":"2024-05-08T09:23:53.915368+0000","last_clean":"2024-05-08T09:23:53.915368+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:23:53.915368+0000","last_undegraded":"2024-05-08T09:23:53.915368+0000","last_fullsized":"2024-05-08T09:23:53.915368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915313+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:23:53.915313+0000","last_peered":"2024-05-08T09:23:53.915313+0000","last_clean":"2024-05-08T09:23:53.915313+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:23:53.915313+0000","last_undegraded":"2024-05-08T09:23:53.915313+0000","last_fullsized":"2024-05-08T09:23:53.915313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915412+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:53.915412+0000","last_peered":"2024-05-08T09:23:53.915412+0000","last_clean":"2024-05-08T09:23:53.915412+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:53.915412+0000","last_undegraded":"2024-05-08T09:23:53.915412+0000","last_fullsized":"2024-05-08T09:23:53.915412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.911326+0000","last_change":"2024-05-08T09:21:30.955095+0000","last_active":"2024-05-08T09:23:58.911326+0000","last_peered":"2024-05-08T09:23:58.911326+0000","last_clean":"2024-05-08T09:23:58.911326+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:23:58.911326+0000","last_undegraded":"2024-05-08T09:23:58.911326+0000","last_fullsized":"2024-05-08T09:23:58.911326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915360+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:23:53.915360+0000","last_peered":"2024-05-08T09:23:53.915360+0000","last_clean":"2024-05-08T09:23:53.915360+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:23:53.915360+0000","last_undegraded":"2024-05-08T09:23:53.915360+0000","last_fullsized":"2024-05-08T09:23:53.915360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.249545+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.249545+0000","last_peered":"2024-05-08T09:24:38.249545+0000","last_clean":"2024-05-08T09:24:38.249545+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.249545+0000","last_undegraded":"2024-05-08T09:24:38.249545+0000","last_fullsized":"2024-05-08T09:24:38.249545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.910617+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:23:53.910617+0000","last_peered":"2024-05-08T09:23:53.910617+0000","last_clean":"2024-05-08T09:23:53.910617+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:23:53.910617+0000","last_undegraded":"2024-05-08T09:23:53.910617+0000","last_fullsized":"2024-05-08T09:23:53.910617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037913+0000","last_change":"2024-05-08T09:21:30.941566+0000","last_active":"2024-05-08T09:24:38.037913+0000","last_peered":"2024-05-08T09:24:38.037913+0000","last_clean":"2024-05-08T09:24:38.037913+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:24:38.037913+0000","last_undegraded":"2024-05-08T09:24:38.037913+0000","last_fullsized":"2024-05-08T09:24:38.037913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914978+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:23:48.914978+0000","last_peered":"2024-05-08T09:23:48.914978+0000","last_clean":"2024-05-08T09:23:48.914978+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:23:48.914978+0000","last_undegraded":"2024-05-08T09:23:48.914978+0000","last_fullsized":"2024-05-08T09:23:48.914978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'35","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.257297+0000","last_change":"2024-05-08T09:21:38.981335+0000","last_active":"2024-05-08T09:24:38.257297+0000","last_peered":"2024-05-08T09:24:38.257297+0000","last_clean":"2024-05-08T09:24:38.257297+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:24:38.257297+0000","last_undegraded":"2024-05-08T09:24:38.257297+0000","last_fullsized":"2024-05-08T09:24:38.257297+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218348+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218348+0000","last_peered":"2024-05-08T09:24:38.218348+0000","last_clean":"2024-05-08T09:24:38.218348+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218348+0000","last_undegraded":"2024-05-08T09:24:38.218348+0000","last_fullsized":"2024-05-08T09:24:38.218348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155052+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.155052+0000","last_peered":"2024-05-08T09:24:38.155052+0000","last_clean":"2024-05-08T09:24:38.155052+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.155052+0000","last_undegraded":"2024-05-08T09:24:38.155052+0000","last_fullsized":"2024-05-08T09:24:38.155052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.080175+0000","last_change":"2024-05-08T09:24:52.080213+0000","last_active":"2024-05-08T09:24:52.080175+0000","last_peered":"2024-05-08T09:24:52.080175+0000","last_clean":"2024-05-08T09:24:52.080175+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:24:52.080175+0000","last_undegraded":"2024-05-08T09:24:52.080175+0000","last_fullsized":"2024-05-08T09:24:52.080175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.080065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:28:14.528132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.875417+0000","last_change":"2024-05-08T09:21:34.968612+0000","last_active":"2024-05-08T09:24:44.875417+0000","last_peered":"2024-05-08T09:24:44.875417+0000","last_clean":"2024-05-08T09:24:44.875417+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:24:44.875417+0000","last_undegraded":"2024-05-08T09:24:44.875417+0000","last_fullsized":"2024-05-08T09:24:44.875417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.718141+0000","last_change":"2024-05-08T09:24:56.718169+0000","last_active":"2024-05-08T09:24:56.718141+0000","last_peered":"2024-05-08T09:24:56.718141+0000","last_clean":"2024-05-08T09:24:56.718141+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:24:56.718141+0000","last_undegraded":"2024-05-08T09:24:56.718141+0000","last_fullsized":"2024-05-08T09:24:56.718141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.718047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:41.337920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917039+0000","last_change":"2024-05-08T09:21:38.984125+0000","last_active":"2024-05-08T09:24:03.917039+0000","last_peered":"2024-05-08T09:24:03.917039+0000","last_clean":"2024-05-08T09:24:03.917039+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:24:03.917039+0000","last_undegraded":"2024-05-08T09:24:03.917039+0000","last_fullsized":"2024-05-08T09:24:03.917039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.246698+0000","last_change":"2024-05-08T09:21:30.961147+0000","last_active":"2024-05-08T09:24:38.246698+0000","last_peered":"2024-05-08T09:24:38.246698+0000","last_clean":"2024-05-08T09:24:38.246698+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:24:38.246698+0000","last_undegraded":"2024-05-08T09:24:38.246698+0000","last_fullsized":"2024-05-08T09:24:38.246698+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914413+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:23:48.914413+0000","last_peered":"2024-05-08T09:23:48.914413+0000","last_clean":"2024-05-08T09:23:48.914413+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:23:48.914413+0000","last_undegraded":"2024-05-08T09:23:48.914413+0000","last_fullsized":"2024-05-08T09:23:48.914413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.910631+0000","last_change":"2024-05-08T09:21:32.957525+0000","last_active":"2024-05-08T09:23:53.910631+0000","last_peered":"2024-05-08T09:23:53.910631+0000","last_clean":"2024-05-08T09:23:53.910631+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:23:53.910631+0000","last_undegraded":"2024-05-08T09:23:53.910631+0000","last_fullsized":"2024-05-08T09:23:53.910631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.687493+0000","last_change":"2024-05-08T09:24:55.687547+0000","last_active":"2024-05-08T09:24:55.687493+0000","last_peered":"2024-05-08T09:24:55.687493+0000","last_clean":"2024-05-08T09:24:55.687493+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:24:55.687493+0000","last_undegraded":"2024-05-08T09:24:55.687493+0000","last_fullsized":"2024-05-08T09:24:55.687493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.687356+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:29.151994+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.701766+0000","last_change":"2024-05-08T09:24:49.701793+0000","last_active":"2024-05-08T09:24:49.701766+0000","last_peered":"2024-05-08T09:24:49.701766+0000","last_clean":"2024-05-08T09:24:49.701766+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:24:49.701766+0000","last_undegraded":"2024-05-08T09:24:49.701766+0000","last_fullsized":"2024-05-08T09:24:49.701766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.701660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:37.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.912690+0000","last_change":"2024-05-08T09:21:38.971525+0000","last_active":"2024-05-08T09:24:08.912690+0000","last_peered":"2024-05-08T09:24:08.912690+0000","last_clean":"2024-05-08T09:24:08.912690+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:24:08.912690+0000","last_undegraded":"2024-05-08T09:24:08.912690+0000","last_fullsized":"2024-05-08T09:24:08.912690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218296+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.218296+0000","last_peered":"2024-05-08T09:24:38.218296+0000","last_clean":"2024-05-08T09:24:38.218296+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.218296+0000","last_undegraded":"2024-05-08T09:24:38.218296+0000","last_fullsized":"2024-05-08T09:24:38.218296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914895+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:23:48.914895+0000","last_peered":"2024-05-08T09:23:48.914895+0000","last_clean":"2024-05-08T09:23:48.914895+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:23:48.914895+0000","last_undegraded":"2024-05-08T09:23:48.914895+0000","last_fullsized":"2024-05-08T09:23:48.914895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:43.922998+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:24:43.922998+0000","last_peered":"2024-05-08T09:24:43.922998+0000","last_clean":"2024-05-08T09:24:43.922998+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:24:43.922998+0000","last_undegraded":"2024-05-08T09:24:43.922998+0000","last_fullsized":"2024-05-08T09:24:43.922998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.328472+0000","last_change":"2024-05-08T09:24:54.328519+0000","last_active":"2024-05-08T09:24:54.328472+0000","last_peered":"2024-05-08T09:24:54.328472+0000","last_clean":"2024-05-08T09:24:54.328472+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:24:54.328472+0000","last_undegraded":"2024-05-08T09:24:54.328472+0000","last_fullsized":"2024-05-08T09:24:54.328472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.328362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:05.483598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.942317+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:44.942317+0000","last_peered":"2024-05-08T09:24:44.942317+0000","last_clean":"2024-05-08T09:24:44.942317+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:44.942317+0000","last_undegraded":"2024-05-08T09:24:44.942317+0000","last_fullsized":"2024-05-08T09:24:44.942317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.917650+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:24:08.917650+0000","last_peered":"2024-05-08T09:24:08.917650+0000","last_clean":"2024-05-08T09:24:08.917650+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:24:08.917650+0000","last_undegraded":"2024-05-08T09:24:08.917650+0000","last_fullsized":"2024-05-08T09:24:08.917650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247403+0000","last_change":"2024-05-08T09:21:30.943637+0000","last_active":"2024-05-08T09:24:38.247403+0000","last_peered":"2024-05-08T09:24:38.247403+0000","last_clean":"2024-05-08T09:24:38.247403+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:24:38.247403+0000","last_undegraded":"2024-05-08T09:24:38.247403+0000","last_fullsized":"2024-05-08T09:24:38.247403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905437+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:24:44.905437+0000","last_peered":"2024-05-08T09:24:44.905437+0000","last_clean":"2024-05-08T09:24:44.905437+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:24:44.905437+0000","last_undegraded":"2024-05-08T09:24:44.905437+0000","last_fullsized":"2024-05-08T09:24:44.905437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.084809+0000","last_change":"2024-05-08T09:24:53.084847+0000","last_active":"2024-05-08T09:24:53.084809+0000","last_peered":"2024-05-08T09:24:53.084809+0000","last_clean":"2024-05-08T09:24:53.084809+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:24:53.084809+0000","last_undegraded":"2024-05-08T09:24:53.084809+0000","last_fullsized":"2024-05-08T09:24:53.084809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.084720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:14.978196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.309726+0000","last_change":"2024-05-08T09:24:55.309760+0000","last_active":"2024-05-08T09:24:55.309726+0000","last_peered":"2024-05-08T09:24:55.309726+0000","last_clean":"2024-05-08T09:24:55.309726+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:24:55.309726+0000","last_undegraded":"2024-05-08T09:24:55.309726+0000","last_fullsized":"2024-05-08T09:24:55.309726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.309641+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.625772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.838065+0000","last_change":"2024-05-08T09:24:50.838092+0000","last_active":"2024-05-08T09:24:50.838065+0000","last_peered":"2024-05-08T09:24:50.838065+0000","last_clean":"2024-05-08T09:24:50.838065+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:50.838065+0000","last_undegraded":"2024-05-08T09:24:50.838065+0000","last_fullsized":"2024-05-08T09:24:50.838065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.837975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:13.392037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218420+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.218420+0000","last_peered":"2024-05-08T09:24:38.218420+0000","last_clean":"2024-05-08T09:24:38.218420+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.218420+0000","last_undegraded":"2024-05-08T09:24:38.218420+0000","last_fullsized":"2024-05-08T09:24:38.218420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151397+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.151397+0000","last_peered":"2024-05-08T09:24:38.151397+0000","last_clean":"2024-05-08T09:24:38.151397+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.151397+0000","last_undegraded":"2024-05-08T09:24:38.151397+0000","last_fullsized":"2024-05-08T09:24:38.151397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.708632+0000","last_change":"2024-05-08T09:25:01.708663+0000","last_active":"2024-05-08T09:25:01.708632+0000","last_peered":"2024-05-08T09:25:01.708632+0000","last_clean":"2024-05-08T09:25:01.708632+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:25:01.708632+0000","last_undegraded":"2024-05-08T09:25:01.708632+0000","last_fullsized":"2024-05-08T09:25:01.708632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.708527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:21:55.937487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.295053+0000","last_change":"2024-05-08T09:24:58.295107+0000","last_active":"2024-05-08T09:24:58.295053+0000","last_peered":"2024-05-08T09:24:58.295053+0000","last_clean":"2024-05-08T09:24:58.295053+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:24:58.295053+0000","last_undegraded":"2024-05-08T09:24:58.295053+0000","last_fullsized":"2024-05-08T09:24:58.295053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.294960+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:44.289112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.790076+0000","last_change":"2024-05-08T09:24:51.790127+0000","last_active":"2024-05-08T09:24:51.790076+0000","last_peered":"2024-05-08T09:24:51.790076+0000","last_clean":"2024-05-08T09:24:51.790076+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:24:51.790076+0000","last_undegraded":"2024-05-08T09:24:51.790076+0000","last_fullsized":"2024-05-08T09:24:51.790076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.789971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:01.201509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913650+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:23:43.913650+0000","last_peered":"2024-05-08T09:23:43.913650+0000","last_clean":"2024-05-08T09:23:43.913650+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:23:43.913650+0000","last_undegraded":"2024-05-08T09:23:43.913650+0000","last_fullsized":"2024-05-08T09:23:43.913650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247338+0000","last_change":"2024-05-08T09:21:30.942033+0000","last_active":"2024-05-08T09:24:38.247338+0000","last_peered":"2024-05-08T09:24:38.247338+0000","last_clean":"2024-05-08T09:24:38.247338+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:24:38.247338+0000","last_undegraded":"2024-05-08T09:24:38.247338+0000","last_fullsized":"2024-05-08T09:24:38.247338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913734+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:23:43.913734+0000","last_peered":"2024-05-08T09:23:43.913734+0000","last_clean":"2024-05-08T09:23:43.913734+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:23:43.913734+0000","last_undegraded":"2024-05-08T09:23:43.913734+0000","last_fullsized":"2024-05-08T09:23:43.913734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.908977+0000","last_change":"2024-05-08T09:21:32.956199+0000","last_active":"2024-05-08T09:23:43.908977+0000","last_peered":"2024-05-08T09:23:43.908977+0000","last_clean":"2024-05-08T09:23:43.908977+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:23:43.908977+0000","last_undegraded":"2024-05-08T09:23:43.908977+0000","last_fullsized":"2024-05-08T09:23:43.908977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'34","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.828373+0000","last_change":"2024-05-08T09:21:34.969113+0000","last_active":"2024-05-08T09:24:44.828373+0000","last_peered":"2024-05-08T09:24:44.828373+0000","last_clean":"2024-05-08T09:24:44.828373+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:24:44.828373+0000","last_undegraded":"2024-05-08T09:24:44.828373+0000","last_fullsized":"2024-05-08T09:24:44.828373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.808071+0000","last_change":"2024-05-08T09:24:49.808113+0000","last_active":"2024-05-08T09:24:49.808071+0000","last_peered":"2024-05-08T09:24:49.808071+0000","last_clean":"2024-05-08T09:24:49.808071+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:24:49.808071+0000","last_undegraded":"2024-05-08T09:24:49.808071+0000","last_fullsized":"2024-05-08T09:24:49.808071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.807955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:48.540567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913715+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:43.913715+0000","last_peered":"2024-05-08T09:23:43.913715+0000","last_clean":"2024-05-08T09:23:43.913715+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:43.913715+0000","last_undegraded":"2024-05-08T09:23:43.913715+0000","last_fullsized":"2024-05-08T09:23:43.913715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913596+0000","last_change":"2024-05-08T09:21:30.953247+0000","last_active":"2024-05-08T09:23:43.913596+0000","last_peered":"2024-05-08T09:23:43.913596+0000","last_clean":"2024-05-08T09:23:43.913596+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:23:43.913596+0000","last_undegraded":"2024-05-08T09:23:43.913596+0000","last_fullsized":"2024-05-08T09:23:43.913596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914140+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:23:43.914140+0000","last_peered":"2024-05-08T09:23:43.914140+0000","last_clean":"2024-05-08T09:23:43.914140+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:23:43.914140+0000","last_undegraded":"2024-05-08T09:23:43.914140+0000","last_fullsized":"2024-05-08T09:23:43.914140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909894+0000","last_change":"2024-05-08T09:21:32.957626+0000","last_active":"2024-05-08T09:23:48.909894+0000","last_peered":"2024-05-08T09:23:48.909894+0000","last_clean":"2024-05-08T09:23:48.909894+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:23:48.909894+0000","last_undegraded":"2024-05-08T09:23:48.909894+0000","last_fullsized":"2024-05-08T09:23:48.909894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.027233+0000","last_change":"2024-05-08T09:25:02.027279+0000","last_active":"2024-05-08T09:25:02.027233+0000","last_peered":"2024-05-08T09:25:02.027233+0000","last_clean":"2024-05-08T09:25:02.027233+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:25:02.027233+0000","last_undegraded":"2024-05-08T09:25:02.027233+0000","last_fullsized":"2024-05-08T09:25:02.027233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.027147+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:01.654874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":380,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.948176+0000","last_change":"2024-05-08T09:21:36.978801+0000","last_active":"2024-05-08T09:24:44.948176+0000","last_peered":"2024-05-08T09:24:44.948176+0000","last_clean":"2024-05-08T09:24:44.948176+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:24:44.948176+0000","last_undegraded":"2024-05-08T09:24:44.948176+0000","last_fullsized":"2024-05-08T09:24:44.948176+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909980+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:23:48.909980+0000","last_peered":"2024-05-08T09:23:48.909980+0000","last_clean":"2024-05-08T09:23:48.909980+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:23:48.909980+0000","last_undegraded":"2024-05-08T09:23:48.909980+0000","last_fullsized":"2024-05-08T09:23:48.909980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914451+0000","last_change":"2024-05-08T09:21:30.951955+0000","last_active":"2024-05-08T09:23:48.914451+0000","last_peered":"2024-05-08T09:23:48.914451+0000","last_clean":"2024-05-08T09:23:48.914451+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:23:48.914451+0000","last_undegraded":"2024-05-08T09:23:48.914451+0000","last_fullsized":"2024-05-08T09:23:48.914451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914072+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:23:43.914072+0000","last_peered":"2024-05-08T09:23:43.914072+0000","last_clean":"2024-05-08T09:23:43.914072+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:23:43.914072+0000","last_undegraded":"2024-05-08T09:23:43.914072+0000","last_fullsized":"2024-05-08T09:23:43.914072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909045+0000","last_change":"2024-05-08T09:21:32.957023+0000","last_active":"2024-05-08T09:23:43.909045+0000","last_peered":"2024-05-08T09:23:43.909045+0000","last_clean":"2024-05-08T09:23:43.909045+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:23:43.909045+0000","last_undegraded":"2024-05-08T09:23:43.909045+0000","last_fullsized":"2024-05-08T09:23:43.909045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'61","reported_seq":126,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.899108+0000","last_change":"2024-05-08T09:21:34.966546+0000","last_active":"2024-05-08T09:24:44.899108+0000","last_peered":"2024-05-08T09:24:44.899108+0000","last_clean":"2024-05-08T09:24:44.899108+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:24:44.899108+0000","last_undegraded":"2024-05-08T09:24:44.899108+0000","last_fullsized":"2024-05-08T09:24:44.899108+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.818524+0000","last_change":"2024-05-08T09:24:48.818545+0000","last_active":"2024-05-08T09:24:48.818524+0000","last_peered":"2024-05-08T09:24:48.818524+0000","last_clean":"2024-05-08T09:24:48.818524+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:24:48.818524+0000","last_undegraded":"2024-05-08T09:24:48.818524+0000","last_fullsized":"2024-05-08T09:24:48.818524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.818433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:36.182911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.340880+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.340880+0000","last_peered":"2024-05-08T09:24:38.340880+0000","last_clean":"2024-05-08T09:24:38.340880+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.340880+0000","last_undegraded":"2024-05-08T09:24:38.340880+0000","last_fullsized":"2024-05-08T09:24:38.340880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173566+0000","last_change":"2024-05-08T09:21:30.955072+0000","last_active":"2024-05-08T09:24:38.173566+0000","last_peered":"2024-05-08T09:24:38.173566+0000","last_clean":"2024-05-08T09:24:38.173566+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:24:38.173566+0000","last_undegraded":"2024-05-08T09:24:38.173566+0000","last_fullsized":"2024-05-08T09:24:38.173566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909078+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:23:43.909078+0000","last_peered":"2024-05-08T09:23:43.909078+0000","last_clean":"2024-05-08T09:23:43.909078+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:23:43.909078+0000","last_undegraded":"2024-05-08T09:23:43.909078+0000","last_fullsized":"2024-05-08T09:23:43.909078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.322499+0000","last_change":"2024-05-08T09:25:03.322535+0000","last_active":"2024-05-08T09:25:03.322499+0000","last_peered":"2024-05-08T09:25:03.322499+0000","last_clean":"2024-05-08T09:25:03.322499+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:25:03.322499+0000","last_undegraded":"2024-05-08T09:25:03.322499+0000","last_fullsized":"2024-05-08T09:25:03.322499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.322403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:06.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.739742+0000","last_change":"2024-05-08T09:24:57.739783+0000","last_active":"2024-05-08T09:24:57.739742+0000","last_peered":"2024-05-08T09:24:57.739742+0000","last_clean":"2024-05-08T09:24:57.739742+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:24:57.739742+0000","last_undegraded":"2024-05-08T09:24:57.739742+0000","last_fullsized":"2024-05-08T09:24:57.739742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.739657+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:25.965876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.916023+0000","last_change":"2024-05-08T09:21:36.980935+0000","last_active":"2024-05-08T09:23:53.916023+0000","last_peered":"2024-05-08T09:23:53.916023+0000","last_clean":"2024-05-08T09:23:53.916023+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:23:53.916023+0000","last_undegraded":"2024-05-08T09:23:53.916023+0000","last_fullsized":"2024-05-08T09:23:53.916023+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.298717+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:24:38.298717+0000","last_peered":"2024-05-08T09:24:38.298717+0000","last_clean":"2024-05-08T09:24:38.298717+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:24:38.298717+0000","last_undegraded":"2024-05-08T09:24:38.298717+0000","last_fullsized":"2024-05-08T09:24:38.298717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.020163+0000","last_change":"2024-05-08T09:25:01.020191+0000","last_active":"2024-05-08T09:25:01.020163+0000","last_peered":"2024-05-08T09:25:01.020163+0000","last_clean":"2024-05-08T09:25:01.020163+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:25:01.020163+0000","last_undegraded":"2024-05-08T09:25:01.020163+0000","last_fullsized":"2024-05-08T09:25:01.020163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.020070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:37.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913154+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:23:38.913154+0000","last_peered":"2024-05-08T09:23:38.913154+0000","last_clean":"2024-05-08T09:23:38.913154+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:23:38.913154+0000","last_undegraded":"2024-05-08T09:23:38.913154+0000","last_fullsized":"2024-05-08T09:23:38.913154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'4","reported_seq":229,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.757847+0000","last_change":"2024-05-08T09:21:32.957213+0000","last_active":"2024-05-08T09:24:44.757847+0000","last_peered":"2024-05-08T09:24:44.757847+0000","last_clean":"2024-05-08T09:24:44.757847+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:24:44.757847+0000","last_undegraded":"2024-05-08T09:24:44.757847+0000","last_fullsized":"2024-05-08T09:24:44.757847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.303146+0000","last_change":"2024-05-08T09:25:02.303194+0000","last_active":"2024-05-08T09:25:02.303146+0000","last_peered":"2024-05-08T09:25:02.303146+0000","last_clean":"2024-05-08T09:25:02.303146+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:25:02.303146+0000","last_undegraded":"2024-05-08T09:25:02.303146+0000","last_fullsized":"2024-05-08T09:25:02.303146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.303063+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:10.132225+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.302336+0000","last_change":"2024-05-08T09:24:53.302402+0000","last_active":"2024-05-08T09:24:53.302336+0000","last_peered":"2024-05-08T09:24:53.302336+0000","last_clean":"2024-05-08T09:24:53.302336+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:53.302336+0000","last_undegraded":"2024-05-08T09:24:53.302336+0000","last_fullsized":"2024-05-08T09:24:53.302336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.302236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:25.305583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.300442+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:38.300442+0000","last_peered":"2024-05-08T09:24:38.300442+0000","last_clean":"2024-05-08T09:24:38.300442+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:38.300442+0000","last_undegraded":"2024-05-08T09:24:38.300442+0000","last_fullsized":"2024-05-08T09:24:38.300442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914538+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:23:48.914538+0000","last_peered":"2024-05-08T09:23:48.914538+0000","last_clean":"2024-05-08T09:23:48.914538+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:23:48.914538+0000","last_undegraded":"2024-05-08T09:23:48.914538+0000","last_fullsized":"2024-05-08T09:23:48.914538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913097+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:23:38.913097+0000","last_peered":"2024-05-08T09:23:38.913097+0000","last_clean":"2024-05-08T09:23:38.913097+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:23:38.913097+0000","last_undegraded":"2024-05-08T09:23:38.913097+0000","last_fullsized":"2024-05-08T09:23:38.913097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'3","reported_seq":418,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.768465+0000","last_change":"2024-05-08T09:21:32.955025+0000","last_active":"2024-05-08T09:24:44.768465+0000","last_peered":"2024-05-08T09:24:44.768465+0000","last_clean":"2024-05-08T09:24:44.768465+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:24:44.768465+0000","last_undegraded":"2024-05-08T09:24:44.768465+0000","last_fullsized":"2024-05-08T09:24:44.768465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915932+0000","last_change":"2024-05-08T09:21:34.969633+0000","last_active":"2024-05-08T09:23:53.915932+0000","last_peered":"2024-05-08T09:23:53.915932+0000","last_clean":"2024-05-08T09:23:53.915932+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:23:53.915932+0000","last_undegraded":"2024-05-08T09:23:53.915932+0000","last_fullsized":"2024-05-08T09:23:53.915932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.722811+0000","last_change":"2024-05-08T09:24:48.722856+0000","last_active":"2024-05-08T09:24:48.722811+0000","last_peered":"2024-05-08T09:24:48.722811+0000","last_clean":"2024-05-08T09:24:48.722811+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:48.722811+0000","last_undegraded":"2024-05-08T09:24:48.722811+0000","last_fullsized":"2024-05-08T09:24:48.722811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.722702+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:43.871307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913575+0000","last_change":"2024-05-08T09:21:38.969278+0000","last_active":"2024-05-08T09:23:43.913575+0000","last_peered":"2024-05-08T09:23:43.913575+0000","last_clean":"2024-05-08T09:23:43.913575+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:23:43.913575+0000","last_undegraded":"2024-05-08T09:23:43.913575+0000","last_fullsized":"2024-05-08T09:23:43.913575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218539+0000","last_change":"2024-05-08T09:21:30.955832+0000","last_active":"2024-05-08T09:24:38.218539+0000","last_peered":"2024-05-08T09:24:38.218539+0000","last_clean":"2024-05-08T09:24:38.218539+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:24:38.218539+0000","last_undegraded":"2024-05-08T09:24:38.218539+0000","last_fullsized":"2024-05-08T09:24:38.218539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913031+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:23:38.913031+0000","last_peered":"2024-05-08T09:23:38.913031+0000","last_clean":"2024-05-08T09:23:38.913031+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:23:38.913031+0000","last_undegraded":"2024-05-08T09:23:38.913031+0000","last_fullsized":"2024-05-08T09:23:38.913031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.047804+0000","last_change":"2024-05-08T09:24:54.047846+0000","last_active":"2024-05-08T09:24:54.047804+0000","last_peered":"2024-05-08T09:24:54.047804+0000","last_clean":"2024-05-08T09:24:54.047804+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:24:54.047804+0000","last_undegraded":"2024-05-08T09:24:54.047804+0000","last_fullsized":"2024-05-08T09:24:54.047804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.047713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:28.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.765587+0000","last_change":"2024-05-08T09:24:59.765651+0000","last_active":"2024-05-08T09:24:59.765587+0000","last_peered":"2024-05-08T09:24:59.765587+0000","last_clean":"2024-05-08T09:24:59.765587+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:24:59.765587+0000","last_undegraded":"2024-05-08T09:24:59.765587+0000","last_fullsized":"2024-05-08T09:24:59.765587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.765502+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:46.174195+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.320572+0000","last_change":"2024-05-08T09:24:57.320607+0000","last_active":"2024-05-08T09:24:57.320572+0000","last_peered":"2024-05-08T09:24:57.320572+0000","last_clean":"2024-05-08T09:24:57.320572+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:24:57.320572+0000","last_undegraded":"2024-05-08T09:24:57.320572+0000","last_fullsized":"2024-05-08T09:24:57.320572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.320468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:09.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.339249+0000","last_change":"2024-05-08T09:21:38.977441+0000","last_active":"2024-05-08T09:24:38.339249+0000","last_peered":"2024-05-08T09:24:38.339249+0000","last_clean":"2024-05-08T09:24:38.339249+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:24:38.339249+0000","last_undegraded":"2024-05-08T09:24:38.339249+0000","last_fullsized":"2024-05-08T09:24:38.339249+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.000474+0000","last_change":"2024-05-08T09:25:03.000502+0000","last_active":"2024-05-08T09:25:03.000474+0000","last_peered":"2024-05-08T09:25:03.000474+0000","last_clean":"2024-05-08T09:25:03.000474+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:25:03.000474+0000","last_undegraded":"2024-05-08T09:25:03.000474+0000","last_fullsized":"2024-05-08T09:25:03.000474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.000386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:27.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":197,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:23.910232+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:23:23.910232+0000","last_peered":"2024-05-08T09:23:23.910232+0000","last_clean":"2024-05-08T09:23:23.910232+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:23:23.910232+0000","last_undegraded":"2024-05-08T09:23:23.910232+0000","last_fullsized":"2024-05-08T09:23:23.910232+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911303+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:23:28.911303+0000","last_peered":"2024-05-08T09:23:28.911303+0000","last_clean":"2024-05-08T09:23:28.911303+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:23:28.911303+0000","last_undegraded":"2024-05-08T09:23:28.911303+0000","last_fullsized":"2024-05-08T09:23:28.911303+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912168+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:23:33.912168+0000","last_peered":"2024-05-08T09:23:33.912168+0000","last_clean":"2024-05-08T09:23:33.912168+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:23:33.912168+0000","last_undegraded":"2024-05-08T09:23:33.912168+0000","last_fullsized":"2024-05-08T09:23:33.912168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912730+0000","last_change":"2024-05-08T09:21:32.954960+0000","last_active":"2024-05-08T09:23:38.912730+0000","last_peered":"2024-05-08T09:23:38.912730+0000","last_clean":"2024-05-08T09:23:38.912730+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:23:38.912730+0000","last_undegraded":"2024-05-08T09:23:38.912730+0000","last_fullsized":"2024-05-08T09:23:38.912730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.062888+0000","last_change":"2024-05-08T09:24:56.062932+0000","last_active":"2024-05-08T09:24:56.062888+0000","last_peered":"2024-05-08T09:24:56.062888+0000","last_clean":"2024-05-08T09:24:56.062888+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:24:56.062888+0000","last_undegraded":"2024-05-08T09:24:56.062888+0000","last_fullsized":"2024-05-08T09:24:56.062888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.062751+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:23.610342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.720491+0000","last_change":"2024-05-08T09:24:56.720522+0000","last_active":"2024-05-08T09:24:56.720491+0000","last_peered":"2024-05-08T09:24:56.720491+0000","last_clean":"2024-05-08T09:24:56.720491+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:24:56.720491+0000","last_undegraded":"2024-05-08T09:24:56.720491+0000","last_fullsized":"2024-05-08T09:24:56.720491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.720398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:12.622377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":163,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.255760+0000","last_change":"2024-05-08T09:21:38.970424+0000","last_active":"2024-05-08T09:24:38.255760+0000","last_peered":"2024-05-08T09:24:38.255760+0000","last_clean":"2024-05-08T09:24:38.255760+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:24:38.255760+0000","last_undegraded":"2024-05-08T09:24:38.255760+0000","last_fullsized":"2024-05-08T09:24:38.255760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293381+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:24:38.293381+0000","last_peered":"2024-05-08T09:24:38.293381+0000","last_clean":"2024-05-08T09:24:38.293381+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:24:38.293381+0000","last_undegraded":"2024-05-08T09:24:38.293381+0000","last_fullsized":"2024-05-08T09:24:38.293381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:23.910443+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:23:23.910443+0000","last_peered":"2024-05-08T09:23:23.910443+0000","last_clean":"2024-05-08T09:23:23.910443+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:23:23.910443+0000","last_undegraded":"2024-05-08T09:23:23.910443+0000","last_fullsized":"2024-05-08T09:23:23.910443+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.238872+0000","last_change":"2024-05-08T09:21:28.963914+0000","last_active":"2024-05-08T09:24:38.238872+0000","last_peered":"2024-05-08T09:24:38.238872+0000","last_clean":"2024-05-08T09:24:38.238872+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:24:38.238872+0000","last_undegraded":"2024-05-08T09:24:38.238872+0000","last_fullsized":"2024-05-08T09:24:38.238872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.124853+0000","last_change":"2024-05-08T09:24:50.124896+0000","last_active":"2024-05-08T09:24:50.124853+0000","last_peered":"2024-05-08T09:24:50.124853+0000","last_clean":"2024-05-08T09:24:50.124853+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:24:50.124853+0000","last_undegraded":"2024-05-08T09:24:50.124853+0000","last_fullsized":"2024-05-08T09:24:50.124853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.124732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:35.398499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.697048+0000","last_change":"2024-05-08T09:24:53.697104+0000","last_active":"2024-05-08T09:24:53.697048+0000","last_peered":"2024-05-08T09:24:53.697048+0000","last_clean":"2024-05-08T09:24:53.697048+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:53.697048+0000","last_undegraded":"2024-05-08T09:24:53.697048+0000","last_fullsized":"2024-05-08T09:24:53.697048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.696956+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:53.816751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914101+0000","last_change":"2024-05-08T09:21:36.982457+0000","last_active":"2024-05-08T09:23:43.914101+0000","last_peered":"2024-05-08T09:23:43.914101+0000","last_clean":"2024-05-08T09:23:43.914101+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:23:43.914101+0000","last_undegraded":"2024-05-08T09:23:43.914101+0000","last_fullsized":"2024-05-08T09:23:43.914101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914418+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:23:48.914418+0000","last_peered":"2024-05-08T09:23:48.914418+0000","last_clean":"2024-05-08T09:23:48.914418+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:23:48.914418+0000","last_undegraded":"2024-05-08T09:23:48.914418+0000","last_fullsized":"2024-05-08T09:23:48.914418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909172+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:43.909172+0000","last_peered":"2024-05-08T09:23:43.909172+0000","last_clean":"2024-05-08T09:23:43.909172+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:43.909172+0000","last_undegraded":"2024-05-08T09:23:43.909172+0000","last_fullsized":"2024-05-08T09:23:43.909172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:23.910208+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:23:23.910208+0000","last_peered":"2024-05-08T09:23:23.910208+0000","last_clean":"2024-05-08T09:23:23.910208+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:23:23.910208+0000","last_undegraded":"2024-05-08T09:23:23.910208+0000","last_fullsized":"2024-05-08T09:23:23.910208+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906342+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:23:28.906342+0000","last_peered":"2024-05-08T09:23:28.906342+0000","last_clean":"2024-05-08T09:23:28.906342+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:23:28.906342+0000","last_undegraded":"2024-05-08T09:23:28.906342+0000","last_fullsized":"2024-05-08T09:23:28.906342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"20'1","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913717+0000","last_change":"2024-05-08T09:21:32.954033+0000","last_active":"2024-05-08T09:23:43.913717+0000","last_peered":"2024-05-08T09:23:43.913717+0000","last_clean":"2024-05-08T09:23:43.913717+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:23:43.913717+0000","last_undegraded":"2024-05-08T09:23:43.913717+0000","last_fullsized":"2024-05-08T09:23:43.913717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.284507+0000","last_change":"2024-05-08T09:25:00.284595+0000","last_active":"2024-05-08T09:25:00.284507+0000","last_peered":"2024-05-08T09:25:00.284507+0000","last_clean":"2024-05-08T09:25:00.284507+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:25:00.284507+0000","last_undegraded":"2024-05-08T09:25:00.284507+0000","last_fullsized":"2024-05-08T09:25:00.284507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.284405+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:11:16.757164+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909101+0000","last_change":"2024-05-08T09:21:36.973699+0000","last_active":"2024-05-08T09:23:43.909101+0000","last_peered":"2024-05-08T09:23:43.909101+0000","last_clean":"2024-05-08T09:23:43.909101+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:23:43.909101+0000","last_undegraded":"2024-05-08T09:23:43.909101+0000","last_fullsized":"2024-05-08T09:23:43.909101+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915813+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:23:53.915813+0000","last_peered":"2024-05-08T09:23:53.915813+0000","last_clean":"2024-05-08T09:23:53.915813+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:23:53.915813+0000","last_undegraded":"2024-05-08T09:23:53.915813+0000","last_fullsized":"2024-05-08T09:23:53.915813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908155+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:38.908155+0000","last_peered":"2024-05-08T09:23:38.908155+0000","last_clean":"2024-05-08T09:23:38.908155+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:38.908155+0000","last_undegraded":"2024-05-08T09:23:38.908155+0000","last_fullsized":"2024-05-08T09:23:38.908155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911258+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:23:28.911258+0000","last_peered":"2024-05-08T09:23:28.911258+0000","last_clean":"2024-05-08T09:23:28.911258+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:23:28.911258+0000","last_undegraded":"2024-05-08T09:23:28.911258+0000","last_fullsized":"2024-05-08T09:23:28.911258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.911928+0000","last_change":"2024-05-08T09:21:28.975541+0000","last_active":"2024-05-08T09:23:33.911928+0000","last_peered":"2024-05-08T09:23:33.911928+0000","last_clean":"2024-05-08T09:23:33.911928+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:23:33.911928+0000","last_undegraded":"2024-05-08T09:23:33.911928+0000","last_fullsized":"2024-05-08T09:23:33.911928+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.703290+0000","last_change":"2024-05-08T09:25:02.703314+0000","last_active":"2024-05-08T09:25:02.703290+0000","last_peered":"2024-05-08T09:25:02.703290+0000","last_clean":"2024-05-08T09:25:02.703290+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:25:02.703290+0000","last_undegraded":"2024-05-08T09:25:02.703290+0000","last_fullsized":"2024-05-08T09:25:02.703290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.703179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:19.071013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.065110+0000","last_change":"2024-05-08T09:24:58.065155+0000","last_active":"2024-05-08T09:24:58.065110+0000","last_peered":"2024-05-08T09:24:58.065110+0000","last_clean":"2024-05-08T09:24:58.065110+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:58.065110+0000","last_undegraded":"2024-05-08T09:24:58.065110+0000","last_fullsized":"2024-05-08T09:24:58.065110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.065021+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:41.445580+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915128+0000","last_change":"2024-05-08T09:21:36.980954+0000","last_active":"2024-05-08T09:23:48.915128+0000","last_peered":"2024-05-08T09:23:48.915128+0000","last_clean":"2024-05-08T09:23:48.915128+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:23:48.915128+0000","last_undegraded":"2024-05-08T09:23:48.915128+0000","last_fullsized":"2024-05-08T09:23:48.915128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914328+0000","last_change":"2024-05-08T09:21:38.979327+0000","last_active":"2024-05-08T09:23:48.914328+0000","last_peered":"2024-05-08T09:23:48.914328+0000","last_clean":"2024-05-08T09:23:48.914328+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:23:48.914328+0000","last_undegraded":"2024-05-08T09:23:48.914328+0000","last_fullsized":"2024-05-08T09:23:48.914328+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173546+0000","last_change":"2024-05-08T09:21:30.954313+0000","last_active":"2024-05-08T09:24:38.173546+0000","last_peered":"2024-05-08T09:24:38.173546+0000","last_clean":"2024-05-08T09:24:38.173546+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:24:38.173546+0000","last_undegraded":"2024-05-08T09:24:38.173546+0000","last_fullsized":"2024-05-08T09:24:38.173546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.907134+0000","last_change":"2024-05-08T09:21:28.977568+0000","last_active":"2024-05-08T09:24:37.907134+0000","last_peered":"2024-05-08T09:24:37.907134+0000","last_clean":"2024-05-08T09:24:37.907134+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:24:37.907134+0000","last_undegraded":"2024-05-08T09:24:37.907134+0000","last_fullsized":"2024-05-08T09:24:37.907134+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906426+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:23:28.906426+0000","last_peered":"2024-05-08T09:23:28.906426+0000","last_clean":"2024-05-08T09:23:28.906426+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:23:28.906426+0000","last_undegraded":"2024-05-08T09:23:28.906426+0000","last_fullsized":"2024-05-08T09:23:28.906426+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.733755+0000","last_change":"2024-05-08T09:25:03.733784+0000","last_active":"2024-05-08T09:25:03.733755+0000","last_peered":"2024-05-08T09:25:03.733755+0000","last_clean":"2024-05-08T09:25:03.733755+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:25:03.733755+0000","last_undegraded":"2024-05-08T09:25:03.733755+0000","last_fullsized":"2024-05-08T09:25:03.733755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.733661+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:36.989441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'73","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.773058+0000","last_change":"2024-05-08T09:24:57.773109+0000","last_active":"2024-05-08T09:24:57.773058+0000","last_peered":"2024-05-08T09:24:57.773058+0000","last_clean":"2024-05-08T09:24:57.773058+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:24:57.773058+0000","last_undegraded":"2024-05-08T09:24:57.773058+0000","last_fullsized":"2024-05-08T09:24:57.773058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.772960+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:39.160649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.236732+0000","last_change":"2024-05-08T09:24:49.236766+0000","last_active":"2024-05-08T09:24:49.236732+0000","last_peered":"2024-05-08T09:24:49.236732+0000","last_clean":"2024-05-08T09:24:49.236732+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:24:49.236732+0000","last_undegraded":"2024-05-08T09:24:49.236732+0000","last_fullsized":"2024-05-08T09:24:49.236732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.236605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:51.830567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.221643+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.221643+0000","last_peered":"2024-05-08T09:24:38.221643+0000","last_clean":"2024-05-08T09:24:38.221643+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.221643+0000","last_undegraded":"2024-05-08T09:24:38.221643+0000","last_fullsized":"2024-05-08T09:24:38.221643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293604+0000","last_change":"2024-05-08T09:21:30.954500+0000","last_active":"2024-05-08T09:24:38.293604+0000","last_peered":"2024-05-08T09:24:38.293604+0000","last_clean":"2024-05-08T09:24:38.293604+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:24:38.293604+0000","last_undegraded":"2024-05-08T09:24:38.293604+0000","last_fullsized":"2024-05-08T09:24:38.293604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907199+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:23:33.907199+0000","last_peered":"2024-05-08T09:23:33.907199+0000","last_clean":"2024-05-08T09:23:33.907199+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:23:33.907199+0000","last_undegraded":"2024-05-08T09:23:33.907199+0000","last_fullsized":"2024-05-08T09:23:33.907199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911343+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:23:28.911343+0000","last_peered":"2024-05-08T09:23:28.911343+0000","last_clean":"2024-05-08T09:23:28.911343+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:23:28.911343+0000","last_undegraded":"2024-05-08T09:23:28.911343+0000","last_fullsized":"2024-05-08T09:23:28.911343+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.124204+0000","last_change":"2024-05-08T09:24:51.124254+0000","last_active":"2024-05-08T09:24:51.124204+0000","last_peered":"2024-05-08T09:24:51.124204+0000","last_clean":"2024-05-08T09:24:51.124204+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:24:51.124204+0000","last_undegraded":"2024-05-08T09:24:51.124204+0000","last_fullsized":"2024-05-08T09:24:51.124204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.124097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:45.345946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.719193+0000","last_change":"2024-05-08T09:24:54.719272+0000","last_active":"2024-05-08T09:24:54.719193+0000","last_peered":"2024-05-08T09:24:54.719193+0000","last_clean":"2024-05-08T09:24:54.719193+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:24:54.719193+0000","last_undegraded":"2024-05-08T09:24:54.719193+0000","last_fullsized":"2024-05-08T09:24:54.719193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.719066+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.377306+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":368,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.668777+0000","last_change":"2024-05-08T09:24:50.668807+0000","last_active":"2024-05-08T09:24:50.668777+0000","last_peered":"2024-05-08T09:24:50.668777+0000","last_clean":"2024-05-08T09:24:50.668777+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:50.668777+0000","last_undegraded":"2024-05-08T09:24:50.668777+0000","last_fullsized":"2024-05-08T09:24:50.668777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.668685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:49.401297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.916011+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:23:53.916011+0000","last_peered":"2024-05-08T09:23:53.916011+0000","last_clean":"2024-05-08T09:23:53.916011+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:23:53.916011+0000","last_undegraded":"2024-05-08T09:23:53.916011+0000","last_fullsized":"2024-05-08T09:23:53.916011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544414+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.544414+0000","last_peered":"2024-05-08T09:23:37.544414+0000","last_clean":"2024-05-08T09:23:37.544414+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.544414+0000","last_undegraded":"2024-05-08T09:23:37.544414+0000","last_fullsized":"2024-05-08T09:23:37.544414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905567+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:24:44.905567+0000","last_peered":"2024-05-08T09:24:44.905567+0000","last_clean":"2024-05-08T09:24:44.905567+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:24:44.905567+0000","last_undegraded":"2024-05-08T09:24:44.905567+0000","last_fullsized":"2024-05-08T09:24:44.905567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906465+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:23:28.906465+0000","last_peered":"2024-05-08T09:23:28.906465+0000","last_clean":"2024-05-08T09:23:28.906465+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:23:28.906465+0000","last_undegraded":"2024-05-08T09:23:28.906465+0000","last_fullsized":"2024-05-08T09:23:28.906465+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.073152+0000","last_change":"2024-05-08T09:24:57.073177+0000","last_active":"2024-05-08T09:24:57.073152+0000","last_peered":"2024-05-08T09:24:57.073152+0000","last_clean":"2024-05-08T09:24:57.073152+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:24:57.073152+0000","last_undegraded":"2024-05-08T09:24:57.073152+0000","last_fullsized":"2024-05-08T09:24:57.073152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.073058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:35.322368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914034+0000","last_change":"2024-05-08T09:21:34.965238+0000","last_active":"2024-05-08T09:23:43.914034+0000","last_peered":"2024-05-08T09:23:43.914034+0000","last_clean":"2024-05-08T09:23:43.914034+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:23:43.914034+0000","last_undegraded":"2024-05-08T09:23:43.914034+0000","last_fullsized":"2024-05-08T09:23:43.914034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.762542+0000","last_change":"2024-05-08T09:24:53.762592+0000","last_active":"2024-05-08T09:24:53.762542+0000","last_peered":"2024-05-08T09:24:53.762542+0000","last_clean":"2024-05-08T09:24:53.762542+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:53.762542+0000","last_undegraded":"2024-05-08T09:24:53.762542+0000","last_fullsized":"2024-05-08T09:24:53.762542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.762413+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:17.292293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.728980+0000","last_change":"2024-05-08T09:25:00.729008+0000","last_active":"2024-05-08T09:25:00.728980+0000","last_peered":"2024-05-08T09:25:00.728980+0000","last_clean":"2024-05-08T09:25:00.728980+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:25:00.728980+0000","last_undegraded":"2024-05-08T09:25:00.728980+0000","last_fullsized":"2024-05-08T09:25:00.728980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.728878+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:46.558237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'14","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.295990+0000","last_change":"2024-05-08T09:21:30.954521+0000","last_active":"2024-05-08T09:24:38.295990+0000","last_peered":"2024-05-08T09:24:38.295990+0000","last_clean":"2024-05-08T09:24:38.295990+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:24:38.295990+0000","last_undegraded":"2024-05-08T09:24:38.295990+0000","last_fullsized":"2024-05-08T09:24:38.295990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912787+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:23:38.912787+0000","last_peered":"2024-05-08T09:23:38.912787+0000","last_clean":"2024-05-08T09:23:38.912787+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:23:38.912787+0000","last_undegraded":"2024-05-08T09:23:38.912787+0000","last_fullsized":"2024-05-08T09:23:38.912787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912336+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:23:33.912336+0000","last_peered":"2024-05-08T09:23:33.912336+0000","last_clean":"2024-05-08T09:23:33.912336+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:23:33.912336+0000","last_undegraded":"2024-05-08T09:23:33.912336+0000","last_fullsized":"2024-05-08T09:23:33.912336+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.067112+0000","last_change":"2024-05-08T09:25:00.067152+0000","last_active":"2024-05-08T09:25:00.067112+0000","last_peered":"2024-05-08T09:25:00.067112+0000","last_clean":"2024-05-08T09:25:00.067112+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:25:00.067112+0000","last_undegraded":"2024-05-08T09:25:00.067112+0000","last_fullsized":"2024-05-08T09:25:00.067112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.067020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:54.239410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.290063+0000","last_change":"2024-05-08T09:24:56.290105+0000","last_active":"2024-05-08T09:24:56.290063+0000","last_peered":"2024-05-08T09:24:56.290063+0000","last_clean":"2024-05-08T09:24:56.290063+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:24:56.290063+0000","last_undegraded":"2024-05-08T09:24:56.290063+0000","last_fullsized":"2024-05-08T09:24:56.290063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.289983+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:24.762692+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.755647+0000","last_change":"2024-05-08T09:24:52.755671+0000","last_active":"2024-05-08T09:24:52.755647+0000","last_peered":"2024-05-08T09:24:52.755647+0000","last_clean":"2024-05-08T09:24:52.755647+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:24:52.755647+0000","last_undegraded":"2024-05-08T09:24:52.755647+0000","last_fullsized":"2024-05-08T09:24:52.755647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.755558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:37:21.018669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915330+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:23:53.915330+0000","last_peered":"2024-05-08T09:23:53.915330+0000","last_clean":"2024-05-08T09:23:53.915330+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:23:53.915330+0000","last_undegraded":"2024-05-08T09:23:53.915330+0000","last_fullsized":"2024-05-08T09:23:53.915330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913760+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:23:43.913760+0000","last_peered":"2024-05-08T09:23:43.913760+0000","last_clean":"2024-05-08T09:23:43.913760+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:23:43.913760+0000","last_undegraded":"2024-05-08T09:23:43.913760+0000","last_fullsized":"2024-05-08T09:23:43.913760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247489+0000","last_change":"2024-05-08T09:21:30.956220+0000","last_active":"2024-05-08T09:24:38.247489+0000","last_peered":"2024-05-08T09:24:38.247489+0000","last_clean":"2024-05-08T09:24:38.247489+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:24:38.247489+0000","last_undegraded":"2024-05-08T09:24:38.247489+0000","last_fullsized":"2024-05-08T09:24:38.247489+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915038+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:23:48.915038+0000","last_peered":"2024-05-08T09:23:48.915038+0000","last_clean":"2024-05-08T09:23:48.915038+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:23:48.915038+0000","last_undegraded":"2024-05-08T09:23:48.915038+0000","last_fullsized":"2024-05-08T09:23:48.915038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.738977+0000","last_change":"2024-05-08T09:25:03.739001+0000","last_active":"2024-05-08T09:25:03.738977+0000","last_peered":"2024-05-08T09:25:03.738977+0000","last_clean":"2024-05-08T09:25:03.738977+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:25:03.738977+0000","last_undegraded":"2024-05-08T09:25:03.738977+0000","last_fullsized":"2024-05-08T09:25:03.738977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.738886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:20.106720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'37","reported_seq":85,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.890430+0000","last_change":"2024-05-08T09:21:34.964839+0000","last_active":"2024-05-08T09:24:44.890430+0000","last_peered":"2024-05-08T09:24:44.890430+0000","last_clean":"2024-05-08T09:24:44.890430+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:24:44.890430+0000","last_undegraded":"2024-05-08T09:24:44.890430+0000","last_fullsized":"2024-05-08T09:24:44.890430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916587+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:23:58.916587+0000","last_peered":"2024-05-08T09:23:58.916587+0000","last_clean":"2024-05-08T09:23:58.916587+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:23:58.916587+0000","last_undegraded":"2024-05-08T09:23:58.916587+0000","last_fullsized":"2024-05-08T09:23:58.916587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.038949+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.038949+0000","last_peered":"2024-05-08T09:24:38.038949+0000","last_clean":"2024-05-08T09:24:38.038949+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.038949+0000","last_undegraded":"2024-05-08T09:24:38.038949+0000","last_fullsized":"2024-05-08T09:24:38.038949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247038+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.247038+0000","last_peered":"2024-05-08T09:24:38.247038+0000","last_clean":"2024-05-08T09:24:38.247038+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.247038+0000","last_undegraded":"2024-05-08T09:24:38.247038+0000","last_fullsized":"2024-05-08T09:24:38.247038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915312+0000","last_change":"2024-05-08T09:21:28.977160+0000","last_active":"2024-05-08T09:23:53.915312+0000","last_peered":"2024-05-08T09:23:53.915312+0000","last_clean":"2024-05-08T09:23:53.915312+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:23:53.915312+0000","last_undegraded":"2024-05-08T09:23:53.915312+0000","last_fullsized":"2024-05-08T09:23:53.915312+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.092621+0000","last_change":"2024-05-08T09:24:59.092649+0000","last_active":"2024-05-08T09:24:59.092621+0000","last_peered":"2024-05-08T09:24:59.092621+0000","last_clean":"2024-05-08T09:24:59.092621+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:24:59.092621+0000","last_undegraded":"2024-05-08T09:24:59.092621+0000","last_fullsized":"2024-05-08T09:24:59.092621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.092531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:16.893025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.726480+0000","last_change":"2024-05-08T09:25:01.726515+0000","last_active":"2024-05-08T09:25:01.726480+0000","last_peered":"2024-05-08T09:25:01.726480+0000","last_clean":"2024-05-08T09:25:01.726480+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:25:01.726480+0000","last_undegraded":"2024-05-08T09:25:01.726480+0000","last_fullsized":"2024-05-08T09:25:01.726480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.726389+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:39.682934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.262975+0000","last_change":"2024-05-08T09:24:50.262998+0000","last_active":"2024-05-08T09:24:50.262975+0000","last_peered":"2024-05-08T09:24:50.262975+0000","last_clean":"2024-05-08T09:24:50.262975+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:24:50.262975+0000","last_undegraded":"2024-05-08T09:24:50.262975+0000","last_fullsized":"2024-05-08T09:24:50.262975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.262889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:10.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.912760+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:24:08.912760+0000","last_peered":"2024-05-08T09:24:08.912760+0000","last_clean":"2024-05-08T09:24:08.912760+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:24:08.912760+0000","last_undegraded":"2024-05-08T09:24:08.912760+0000","last_fullsized":"2024-05-08T09:24:08.912760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.952782+0000","last_change":"2024-05-08T09:21:30.953686+0000","last_active":"2024-05-08T09:24:37.952782+0000","last_peered":"2024-05-08T09:24:37.952782+0000","last_clean":"2024-05-08T09:24:37.952782+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:24:37.952782+0000","last_undegraded":"2024-05-08T09:24:37.952782+0000","last_fullsized":"2024-05-08T09:24:37.952782+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915353+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:23:53.915353+0000","last_peered":"2024-05-08T09:23:53.915353+0000","last_clean":"2024-05-08T09:23:53.915353+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:23:53.915353+0000","last_undegraded":"2024-05-08T09:23:53.915353+0000","last_fullsized":"2024-05-08T09:23:53.915353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915194+0000","last_change":"2024-05-08T09:21:32.956150+0000","last_active":"2024-05-08T09:23:53.915194+0000","last_peered":"2024-05-08T09:23:53.915194+0000","last_clean":"2024-05-08T09:23:53.915194+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:23:53.915194+0000","last_undegraded":"2024-05-08T09:23:53.915194+0000","last_fullsized":"2024-05-08T09:23:53.915194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.742554+0000","last_change":"2024-05-08T09:24:54.742594+0000","last_active":"2024-05-08T09:24:54.742554+0000","last_peered":"2024-05-08T09:24:54.742554+0000","last_clean":"2024-05-08T09:24:54.742554+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:54.742554+0000","last_undegraded":"2024-05-08T09:24:54.742554+0000","last_fullsized":"2024-05-08T09:24:54.742554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.742456+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:50.767894+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.658943+0000","last_change":"2024-05-08T09:24:51.658969+0000","last_active":"2024-05-08T09:24:51.658943+0000","last_peered":"2024-05-08T09:24:51.658943+0000","last_clean":"2024-05-08T09:24:51.658943+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:24:51.658943+0000","last_undegraded":"2024-05-08T09:24:51.658943+0000","last_fullsized":"2024-05-08T09:24:51.658943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.658847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:21:59.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.918541+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:24:08.918541+0000","last_peered":"2024-05-08T09:24:08.918541+0000","last_clean":"2024-05-08T09:24:08.918541+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:24:08.918541+0000","last_undegraded":"2024-05-08T09:24:08.918541+0000","last_fullsized":"2024-05-08T09:24:08.918541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.922201+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.922201+0000","last_peered":"2024-05-08T09:24:38.922201+0000","last_clean":"2024-05-08T09:24:38.922201+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.922201+0000","last_undegraded":"2024-05-08T09:24:38.922201+0000","last_fullsized":"2024-05-08T09:24:38.922201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915480+0000","last_change":"2024-05-08T09:21:28.976895+0000","last_active":"2024-05-08T09:23:53.915480+0000","last_peered":"2024-05-08T09:23:53.915480+0000","last_clean":"2024-05-08T09:23:53.915480+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:23:53.915480+0000","last_undegraded":"2024-05-08T09:23:53.915480+0000","last_fullsized":"2024-05-08T09:23:53.915480+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.045028+0000","last_change":"2024-05-08T09:24:55.045049+0000","last_active":"2024-05-08T09:24:55.045028+0000","last_peered":"2024-05-08T09:24:55.045028+0000","last_clean":"2024-05-08T09:24:55.045028+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:24:55.045028+0000","last_undegraded":"2024-05-08T09:24:55.045028+0000","last_fullsized":"2024-05-08T09:24:55.045028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.044956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:28.363607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.255638+0000","last_change":"2024-05-08T09:24:59.255686+0000","last_active":"2024-05-08T09:24:59.255638+0000","last_peered":"2024-05-08T09:24:59.255638+0000","last_clean":"2024-05-08T09:24:59.255638+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:24:59.255638+0000","last_undegraded":"2024-05-08T09:24:59.255638+0000","last_fullsized":"2024-05-08T09:24:59.255638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.255555+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:18:31.061439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.260222+0000","last_change":"2024-05-08T09:24:51.260245+0000","last_active":"2024-05-08T09:24:51.260222+0000","last_peered":"2024-05-08T09:24:51.260222+0000","last_clean":"2024-05-08T09:24:51.260222+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:24:51.260222+0000","last_undegraded":"2024-05-08T09:24:51.260222+0000","last_fullsized":"2024-05-08T09:24:51.260222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.260133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:11.715270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913349+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:23:38.913349+0000","last_peered":"2024-05-08T09:23:38.913349+0000","last_clean":"2024-05-08T09:23:38.913349+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:23:38.913349+0000","last_undegraded":"2024-05-08T09:23:38.913349+0000","last_fullsized":"2024-05-08T09:23:38.913349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915688+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:23:53.915688+0000","last_peered":"2024-05-08T09:23:53.915688+0000","last_clean":"2024-05-08T09:23:53.915688+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:23:53.915688+0000","last_undegraded":"2024-05-08T09:23:53.915688+0000","last_fullsized":"2024-05-08T09:23:53.915688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907230+0000","last_change":"2024-05-08T09:21:32.957500+0000","last_active":"2024-05-08T09:23:33.907230+0000","last_peered":"2024-05-08T09:23:33.907230+0000","last_clean":"2024-05-08T09:23:33.907230+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:23:33.907230+0000","last_undegraded":"2024-05-08T09:23:33.907230+0000","last_fullsized":"2024-05-08T09:23:33.907230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.736974+0000","last_change":"2024-05-08T09:24:58.737020+0000","last_active":"2024-05-08T09:24:58.736974+0000","last_peered":"2024-05-08T09:24:58.736974+0000","last_clean":"2024-05-08T09:24:58.736974+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:24:58.736974+0000","last_undegraded":"2024-05-08T09:24:58.736974+0000","last_fullsized":"2024-05-08T09:24:58.736974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.736875+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:49.606990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.304313+0000","last_change":"2024-05-08T09:24:52.304336+0000","last_active":"2024-05-08T09:24:52.304313+0000","last_peered":"2024-05-08T09:24:52.304313+0000","last_clean":"2024-05-08T09:24:52.304313+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:24:52.304313+0000","last_undegraded":"2024-05-08T09:24:52.304313+0000","last_fullsized":"2024-05-08T09:24:52.304313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.304223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:48.209866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.170794+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:38.170794+0000","last_peered":"2024-05-08T09:24:38.170794+0000","last_clean":"2024-05-08T09:24:38.170794+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:38.170794+0000","last_undegraded":"2024-05-08T09:24:38.170794+0000","last_fullsized":"2024-05-08T09:24:38.170794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907257+0000","last_change":"2024-05-08T09:21:30.946651+0000","last_active":"2024-05-08T09:23:33.907257+0000","last_peered":"2024-05-08T09:23:33.907257+0000","last_clean":"2024-05-08T09:23:33.907257+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:23:33.907257+0000","last_undegraded":"2024-05-08T09:23:33.907257+0000","last_fullsized":"2024-05-08T09:23:33.907257+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905453+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:24:44.905453+0000","last_peered":"2024-05-08T09:24:44.905453+0000","last_clean":"2024-05-08T09:24:44.905453+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:24:44.905453+0000","last_undegraded":"2024-05-08T09:24:44.905453+0000","last_fullsized":"2024-05-08T09:24:44.905453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912781+0000","last_change":"2024-05-08T09:21:32.952239+0000","last_active":"2024-05-08T09:23:38.912781+0000","last_peered":"2024-05-08T09:23:38.912781+0000","last_clean":"2024-05-08T09:23:38.912781+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:23:38.912781+0000","last_undegraded":"2024-05-08T09:23:38.912781+0000","last_fullsized":"2024-05-08T09:23:38.912781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'39","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.850436+0000","last_change":"2024-05-08T09:21:34.964379+0000","last_active":"2024-05-08T09:24:44.850436+0000","last_peered":"2024-05-08T09:24:44.850436+0000","last_clean":"2024-05-08T09:24:44.850436+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:24:44.850436+0000","last_undegraded":"2024-05-08T09:24:44.850436+0000","last_fullsized":"2024-05-08T09:24:44.850436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.696777+0000","last_change":"2024-05-08T09:24:52.696803+0000","last_active":"2024-05-08T09:24:52.696777+0000","last_peered":"2024-05-08T09:24:52.696777+0000","last_clean":"2024-05-08T09:24:52.696777+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:24:52.696777+0000","last_undegraded":"2024-05-08T09:24:52.696777+0000","last_fullsized":"2024-05-08T09:24:52.696777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.696677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:55.771440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916695+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:23:58.916695+0000","last_peered":"2024-05-08T09:23:58.916695+0000","last_clean":"2024-05-08T09:23:58.916695+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:23:58.916695+0000","last_undegraded":"2024-05-08T09:23:58.916695+0000","last_fullsized":"2024-05-08T09:23:58.916695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294320+0000","last_change":"2024-05-08T09:21:30.961494+0000","last_active":"2024-05-08T09:24:38.294320+0000","last_peered":"2024-05-08T09:24:38.294320+0000","last_clean":"2024-05-08T09:24:38.294320+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:24:38.294320+0000","last_undegraded":"2024-05-08T09:24:38.294320+0000","last_fullsized":"2024-05-08T09:24:38.294320+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916185+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:23:58.916185+0000","last_peered":"2024-05-08T09:23:58.916185+0000","last_clean":"2024-05-08T09:23:58.916185+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:23:58.916185+0000","last_undegraded":"2024-05-08T09:23:58.916185+0000","last_fullsized":"2024-05-08T09:23:58.916185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917029+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:24:03.917029+0000","last_peered":"2024-05-08T09:24:03.917029+0000","last_clean":"2024-05-08T09:24:03.917029+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:24:03.917029+0000","last_undegraded":"2024-05-08T09:24:03.917029+0000","last_fullsized":"2024-05-08T09:24:03.917029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'42","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.696183+0000","last_change":"2024-05-08T09:24:59.696268+0000","last_active":"2024-05-08T09:24:59.696183+0000","last_peered":"2024-05-08T09:24:59.696183+0000","last_clean":"2024-05-08T09:24:59.696183+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:24:59.696183+0000","last_undegraded":"2024-05-08T09:24:59.696183+0000","last_fullsized":"2024-05-08T09:24:59.696183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.696053+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:13:58.776407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.838386+0000","last_change":"2024-05-08T09:24:47.838408+0000","last_active":"2024-05-08T09:24:47.838386+0000","last_peered":"2024-05-08T09:24:47.838386+0000","last_clean":"2024-05-08T09:24:47.838386+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:24:47.838386+0000","last_undegraded":"2024-05-08T09:24:47.838386+0000","last_fullsized":"2024-05-08T09:24:47.838386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_clean_scrub_stamp":"2024-05-08T09:24:47.838309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:42.986914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350051+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.350051+0000","last_peered":"2024-05-08T09:24:38.350051+0000","last_clean":"2024-05-08T09:24:38.350051+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.350051+0000","last_undegraded":"2024-05-08T09:24:38.350051+0000","last_fullsized":"2024-05-08T09:24:38.350051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293958+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:38.293958+0000","last_peered":"2024-05-08T09:24:38.293958+0000","last_clean":"2024-05-08T09:24:38.293958+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:38.293958+0000","last_undegraded":"2024-05-08T09:24:38.293958+0000","last_fullsized":"2024-05-08T09:24:38.293958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916750+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:23:58.916750+0000","last_peered":"2024-05-08T09:23:58.916750+0000","last_clean":"2024-05-08T09:23:58.916750+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:23:58.916750+0000","last_undegraded":"2024-05-08T09:23:58.916750+0000","last_fullsized":"2024-05-08T09:23:58.916750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917137+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:24:03.917137+0000","last_peered":"2024-05-08T09:24:03.917137+0000","last_clean":"2024-05-08T09:24:03.917137+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:24:03.917137+0000","last_undegraded":"2024-05-08T09:24:03.917137+0000","last_fullsized":"2024-05-08T09:24:03.917137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"27'10","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913305+0000","last_change":"2024-05-08T09:21:34.967409+0000","last_active":"2024-05-08T09:23:38.913305+0000","last_peered":"2024-05-08T09:23:38.913305+0000","last_clean":"2024-05-08T09:23:38.913305+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:23:38.913305+0000","last_undegraded":"2024-05-08T09:23:38.913305+0000","last_fullsized":"2024-05-08T09:23:38.913305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.309850+0000","last_change":"2024-05-08T09:25:01.309897+0000","last_active":"2024-05-08T09:25:01.309850+0000","last_peered":"2024-05-08T09:25:01.309850+0000","last_clean":"2024-05-08T09:25:01.309850+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:25:01.309850+0000","last_undegraded":"2024-05-08T09:25:01.309850+0000","last_fullsized":"2024-05-08T09:25:01.309850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.309733+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:23.863794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916533+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:23:58.916533+0000","last_peered":"2024-05-08T09:23:58.916533+0000","last_clean":"2024-05-08T09:23:58.916533+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:23:58.916533+0000","last_undegraded":"2024-05-08T09:23:58.916533+0000","last_fullsized":"2024-05-08T09:23:58.916533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.215238+0000","last_change":"2024-05-08T09:21:30.952074+0000","last_active":"2024-05-08T09:24:38.215238+0000","last_peered":"2024-05-08T09:24:38.215238+0000","last_clean":"2024-05-08T09:24:38.215238+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:24:38.215238+0000","last_undegraded":"2024-05-08T09:24:38.215238+0000","last_fullsized":"2024-05-08T09:24:38.215238+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.907325+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:24:44.907325+0000","last_peered":"2024-05-08T09:24:44.907325+0000","last_clean":"2024-05-08T09:24:44.907325+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:24:44.907325+0000","last_undegraded":"2024-05-08T09:24:44.907325+0000","last_fullsized":"2024-05-08T09:24:44.907325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.708229+0000","last_change":"2024-05-08T09:25:02.708273+0000","last_active":"2024-05-08T09:25:02.708229+0000","last_peered":"2024-05-08T09:25:02.708229+0000","last_clean":"2024-05-08T09:25:02.708229+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:25:02.708229+0000","last_undegraded":"2024-05-08T09:25:02.708229+0000","last_fullsized":"2024-05-08T09:25:02.708229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.708109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:40.664654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.785230+0000","last_change":"2024-05-08T09:24:58.785302+0000","last_active":"2024-05-08T09:24:58.785230+0000","last_peered":"2024-05-08T09:24:58.785230+0000","last_clean":"2024-05-08T09:24:58.785230+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:58.785230+0000","last_undegraded":"2024-05-08T09:24:58.785230+0000","last_fullsized":"2024-05-08T09:24:58.785230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.785128+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:40.172817+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.715808+0000","last_change":"2024-05-08T09:25:00.715835+0000","last_active":"2024-05-08T09:25:00.715808+0000","last_peered":"2024-05-08T09:25:00.715808+0000","last_clean":"2024-05-08T09:25:00.715808+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:25:00.715808+0000","last_undegraded":"2024-05-08T09:25:00.715808+0000","last_fullsized":"2024-05-08T09:25:00.715808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.715715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.307803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917206+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:24:03.917206+0000","last_peered":"2024-05-08T09:24:03.917206+0000","last_clean":"2024-05-08T09:24:03.917206+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:24:03.917206+0000","last_undegraded":"2024-05-08T09:24:03.917206+0000","last_fullsized":"2024-05-08T09:24:03.917206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'5","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293095+0000","last_change":"2024-05-08T09:21:30.945039+0000","last_active":"2024-05-08T09:24:38.293095+0000","last_peered":"2024-05-08T09:24:38.293095+0000","last_clean":"2024-05-08T09:24:38.293095+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:24:38.293095+0000","last_undegraded":"2024-05-08T09:24:38.293095+0000","last_fullsized":"2024-05-08T09:24:38.293095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916866+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:23:58.916866+0000","last_peered":"2024-05-08T09:23:58.916866+0000","last_clean":"2024-05-08T09:23:58.916866+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:23:58.916866+0000","last_undegraded":"2024-05-08T09:23:58.916866+0000","last_fullsized":"2024-05-08T09:23:58.916866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917002+0000","last_change":"2024-05-08T09:21:32.956273+0000","last_active":"2024-05-08T09:24:03.917002+0000","last_peered":"2024-05-08T09:24:03.917002+0000","last_clean":"2024-05-08T09:24:03.917002+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:24:03.917002+0000","last_undegraded":"2024-05-08T09:24:03.917002+0000","last_fullsized":"2024-05-08T09:24:03.917002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.725148+0000","last_change":"2024-05-08T09:24:55.725187+0000","last_active":"2024-05-08T09:24:55.725148+0000","last_peered":"2024-05-08T09:24:55.725148+0000","last_clean":"2024-05-08T09:24:55.725148+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:24:55.725148+0000","last_undegraded":"2024-05-08T09:24:55.725148+0000","last_fullsized":"2024-05-08T09:24:55.725148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.725057+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:11.134393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917514+0000","last_change":"2024-05-08T09:21:36.975698+0000","last_active":"2024-05-08T09:24:03.917514+0000","last_peered":"2024-05-08T09:24:03.917514+0000","last_clean":"2024-05-08T09:24:03.917514+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:24:03.917514+0000","last_undegraded":"2024-05-08T09:24:03.917514+0000","last_fullsized":"2024-05-08T09:24:03.917514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917812+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:24:03.917812+0000","last_peered":"2024-05-08T09:24:03.917812+0000","last_clean":"2024-05-08T09:24:03.917812+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:24:03.917812+0000","last_undegraded":"2024-05-08T09:24:03.917812+0000","last_fullsized":"2024-05-08T09:24:03.917812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916636+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:23:58.916636+0000","last_peered":"2024-05-08T09:23:58.916636+0000","last_clean":"2024-05-08T09:23:58.916636+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:23:58.916636+0000","last_undegraded":"2024-05-08T09:23:58.916636+0000","last_fullsized":"2024-05-08T09:23:58.916636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906475+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:23:28.906475+0000","last_peered":"2024-05-08T09:23:28.906475+0000","last_clean":"2024-05-08T09:23:28.906475+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:23:28.906475+0000","last_undegraded":"2024-05-08T09:23:28.906475+0000","last_fullsized":"2024-05-08T09:23:28.906475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916097+0000","last_change":"2024-05-08T09:21:32.952670+0000","last_active":"2024-05-08T09:23:58.916097+0000","last_peered":"2024-05-08T09:23:58.916097+0000","last_clean":"2024-05-08T09:23:58.916097+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:23:58.916097+0000","last_undegraded":"2024-05-08T09:23:58.916097+0000","last_fullsized":"2024-05-08T09:23:58.916097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'29","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.896122+0000","last_change":"2024-05-08T09:21:34.964514+0000","last_active":"2024-05-08T09:24:44.896122+0000","last_peered":"2024-05-08T09:24:44.896122+0000","last_clean":"2024-05-08T09:24:44.896122+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:24:44.896122+0000","last_undegraded":"2024-05-08T09:24:44.896122+0000","last_fullsized":"2024-05-08T09:24:44.896122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.918440+0000","last_change":"2024-05-08T09:21:36.978806+0000","last_active":"2024-05-08T09:24:08.918440+0000","last_peered":"2024-05-08T09:24:08.918440+0000","last_clean":"2024-05-08T09:24:08.918440+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:24:08.918440+0000","last_undegraded":"2024-05-08T09:24:08.918440+0000","last_fullsized":"2024-05-08T09:24:08.918440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917702+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:24:03.917702+0000","last_peered":"2024-05-08T09:24:03.917702+0000","last_clean":"2024-05-08T09:24:03.917702+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:24:03.917702+0000","last_undegraded":"2024-05-08T09:24:03.917702+0000","last_fullsized":"2024-05-08T09:24:03.917702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247178+0000","last_change":"2024-05-08T09:21:30.945358+0000","last_active":"2024-05-08T09:24:38.247178+0000","last_peered":"2024-05-08T09:24:38.247178+0000","last_clean":"2024-05-08T09:24:38.247178+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:24:38.247178+0000","last_undegraded":"2024-05-08T09:24:38.247178+0000","last_fullsized":"2024-05-08T09:24:38.247178+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.911966+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:23:33.911966+0000","last_peered":"2024-05-08T09:23:33.911966+0000","last_clean":"2024-05-08T09:23:33.911966+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:23:33.911966+0000","last_undegraded":"2024-05-08T09:23:33.911966+0000","last_fullsized":"2024-05-08T09:23:33.911966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'2","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916148+0000","last_change":"2024-05-08T09:21:32.956974+0000","last_active":"2024-05-08T09:23:58.916148+0000","last_peered":"2024-05-08T09:23:58.916148+0000","last_clean":"2024-05-08T09:23:58.916148+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:23:58.916148+0000","last_undegraded":"2024-05-08T09:23:58.916148+0000","last_fullsized":"2024-05-08T09:23:58.916148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'35","reported_seq":84,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.918018+0000","last_change":"2024-05-08T09:21:34.965967+0000","last_active":"2024-05-08T09:24:44.918018+0000","last_peered":"2024-05-08T09:24:44.918018+0000","last_clean":"2024-05-08T09:24:44.918018+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:24:44.918018+0000","last_undegraded":"2024-05-08T09:24:44.918018+0000","last_fullsized":"2024-05-08T09:24:44.918018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:33.940846+0000","last_clean_scrub_stamp":"2024-05-08T09:21:33.940846+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.912716+0000","last_change":"2024-05-08T09:21:36.973796+0000","last_active":"2024-05-08T09:24:08.912716+0000","last_peered":"2024-05-08T09:24:08.912716+0000","last_clean":"2024-05-08T09:24:08.912716+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:24:08.912716+0000","last_undegraded":"2024-05-08T09:24:08.912716+0000","last_fullsized":"2024-05-08T09:24:08.912716+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916792+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:58.916792+0000","last_peered":"2024-05-08T09:23:58.916792+0000","last_clean":"2024-05-08T09:23:58.916792+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:58.916792+0000","last_undegraded":"2024-05-08T09:23:58.916792+0000","last_fullsized":"2024-05-08T09:23:58.916792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218550+0000","last_change":"2024-05-08T09:21:30.954737+0000","last_active":"2024-05-08T09:24:38.218550+0000","last_peered":"2024-05-08T09:24:38.218550+0000","last_clean":"2024-05-08T09:24:38.218550+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:24:38.218550+0000","last_undegraded":"2024-05-08T09:24:38.218550+0000","last_fullsized":"2024-05-08T09:24:38.218550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.911860+0000","last_change":"2024-05-08T09:21:28.974311+0000","last_active":"2024-05-08T09:23:33.911860+0000","last_peered":"2024-05-08T09:23:33.911860+0000","last_clean":"2024-05-08T09:23:33.911860+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:23:33.911860+0000","last_undegraded":"2024-05-08T09:23:33.911860+0000","last_fullsized":"2024-05-08T09:23:33.911860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037229+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.037229+0000","last_peered":"2024-05-08T09:24:38.037229+0000","last_clean":"2024-05-08T09:24:38.037229+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.037229+0000","last_undegraded":"2024-05-08T09:24:38.037229+0000","last_fullsized":"2024-05-08T09:24:38.037229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907117+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:23:33.907117+0000","last_peered":"2024-05-08T09:23:33.907117+0000","last_clean":"2024-05-08T09:23:33.907117+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:23:33.907117+0000","last_undegraded":"2024-05-08T09:23:33.907117+0000","last_fullsized":"2024-05-08T09:23:33.907117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914115+0000","last_change":"2024-05-08T09:21:30.961138+0000","last_active":"2024-05-08T09:23:43.914115+0000","last_peered":"2024-05-08T09:23:43.914115+0000","last_clean":"2024-05-08T09:23:43.914115+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:23:43.914115+0000","last_undegraded":"2024-05-08T09:23:43.914115+0000","last_fullsized":"2024-05-08T09:23:43.914115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912151+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:23:33.912151+0000","last_peered":"2024-05-08T09:23:33.912151+0000","last_clean":"2024-05-08T09:23:33.912151+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:23:33.912151+0000","last_undegraded":"2024-05-08T09:23:33.912151+0000","last_fullsized":"2024-05-08T09:23:33.912151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247246+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.247246+0000","last_peered":"2024-05-08T09:24:38.247246+0000","last_clean":"2024-05-08T09:24:38.247246+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.247246+0000","last_undegraded":"2024-05-08T09:24:38.247246+0000","last_fullsized":"2024-05-08T09:24:38.247246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907175+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:23:33.907175+0000","last_peered":"2024-05-08T09:23:33.907175+0000","last_clean":"2024-05-08T09:23:33.907175+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:23:33.907175+0000","last_undegraded":"2024-05-08T09:23:33.907175+0000","last_fullsized":"2024-05-08T09:23:33.907175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.952552+0000","last_change":"2024-05-08T09:21:30.953450+0000","last_active":"2024-05-08T09:24:37.952552+0000","last_peered":"2024-05-08T09:24:37.952552+0000","last_clean":"2024-05-08T09:24:37.952552+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:24:37.952552+0000","last_undegraded":"2024-05-08T09:24:37.952552+0000","last_fullsized":"2024-05-08T09:24:37.952552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908141+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:23:38.908141+0000","last_peered":"2024-05-08T09:23:38.908141+0000","last_clean":"2024-05-08T09:23:38.908141+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:23:38.908141+0000","last_undegraded":"2024-05-08T09:23:38.908141+0000","last_fullsized":"2024-05-08T09:23:38.908141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247141+0000","last_change":"2024-05-08T09:21:30.954588+0000","last_active":"2024-05-08T09:24:38.247141+0000","last_peered":"2024-05-08T09:24:38.247141+0000","last_clean":"2024-05-08T09:24:38.247141+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:24:38.247141+0000","last_undegraded":"2024-05-08T09:24:38.247141+0000","last_fullsized":"2024-05-08T09:24:38.247141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912753+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:23:38.912753+0000","last_peered":"2024-05-08T09:23:38.912753+0000","last_clean":"2024-05-08T09:23:38.912753+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:23:38.912753+0000","last_undegraded":"2024-05-08T09:23:38.912753+0000","last_fullsized":"2024-05-08T09:23:38.912753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173264+0000","last_change":"2024-05-08T09:21:30.943875+0000","last_active":"2024-05-08T09:24:38.173264+0000","last_peered":"2024-05-08T09:24:38.173264+0000","last_clean":"2024-05-08T09:24:38.173264+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:24:38.173264+0000","last_undegraded":"2024-05-08T09:24:38.173264+0000","last_fullsized":"2024-05-08T09:24:38.173264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912740+0000","last_change":"2024-05-08T09:21:28.974367+0000","last_active":"2024-05-08T09:23:38.912740+0000","last_peered":"2024-05-08T09:23:38.912740+0000","last_clean":"2024-05-08T09:23:38.912740+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:23:38.912740+0000","last_undegraded":"2024-05-08T09:23:38.912740+0000","last_fullsized":"2024-05-08T09:23:38.912740+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293920+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.293920+0000","last_peered":"2024-05-08T09:24:38.293920+0000","last_clean":"2024-05-08T09:24:38.293920+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.293920+0000","last_undegraded":"2024-05-08T09:24:38.293920+0000","last_fullsized":"2024-05-08T09:24:38.293920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908227+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:23:38.908227+0000","last_peered":"2024-05-08T09:23:38.908227+0000","last_clean":"2024-05-08T09:23:38.908227+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:23:38.908227+0000","last_undegraded":"2024-05-08T09:23:38.908227+0000","last_fullsized":"2024-05-08T09:23:38.908227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037247+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.037247+0000","last_peered":"2024-05-08T09:24:38.037247+0000","last_clean":"2024-05-08T09:24:38.037247+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.037247+0000","last_undegraded":"2024-05-08T09:24:38.037247+0000","last_fullsized":"2024-05-08T09:24:38.037247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913019+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:38.913019+0000","last_peered":"2024-05-08T09:23:38.913019+0000","last_clean":"2024-05-08T09:23:38.913019+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:38.913019+0000","last_undegraded":"2024-05-08T09:23:38.913019+0000","last_fullsized":"2024-05-08T09:23:38.913019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915990+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:23:53.915990+0000","last_peered":"2024-05-08T09:23:53.915990+0000","last_clean":"2024-05-08T09:23:53.915990+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:23:53.915990+0000","last_undegraded":"2024-05-08T09:23:53.915990+0000","last_fullsized":"2024-05-08T09:23:53.915990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909013+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:23:43.909013+0000","last_peered":"2024-05-08T09:23:43.909013+0000","last_clean":"2024-05-08T09:23:43.909013+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:23:43.909013+0000","last_undegraded":"2024-05-08T09:23:43.909013+0000","last_fullsized":"2024-05-08T09:23:43.909013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909964+0000","last_change":"2024-05-08T09:21:30.953222+0000","last_active":"2024-05-08T09:23:48.909964+0000","last_peered":"2024-05-08T09:23:48.909964+0000","last_clean":"2024-05-08T09:23:48.909964+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:23:48.909964+0000","last_undegraded":"2024-05-08T09:23:48.909964+0000","last_fullsized":"2024-05-08T09:23:48.909964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.907459+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:24:44.907459+0000","last_peered":"2024-05-08T09:24:44.907459+0000","last_clean":"2024-05-08T09:24:44.907459+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:24:44.907459+0000","last_undegraded":"2024-05-08T09:24:44.907459+0000","last_fullsized":"2024-05-08T09:24:44.907459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293420+0000","last_change":"2024-05-08T09:21:30.943497+0000","last_active":"2024-05-08T09:24:38.293420+0000","last_peered":"2024-05-08T09:24:38.293420+0000","last_clean":"2024-05-08T09:24:38.293420+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:24:38.293420+0000","last_undegraded":"2024-05-08T09:24:38.293420+0000","last_fullsized":"2024-05-08T09:24:38.293420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.928679+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.928679+0000","last_peered":"2024-05-08T09:24:37.928679+0000","last_clean":"2024-05-08T09:24:37.928679+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.928679+0000","last_undegraded":"2024-05-08T09:24:37.928679+0000","last_fullsized":"2024-05-08T09:24:37.928679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.215666+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.215666+0000","last_peered":"2024-05-08T09:24:38.215666+0000","last_clean":"2024-05-08T09:24:38.215666+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.215666+0000","last_undegraded":"2024-05-08T09:24:38.215666+0000","last_fullsized":"2024-05-08T09:24:38.215666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914086+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:23:43.914086+0000","last_peered":"2024-05-08T09:23:43.914086+0000","last_clean":"2024-05-08T09:23:43.914086+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:23:43.914086+0000","last_undegraded":"2024-05-08T09:23:43.914086+0000","last_fullsized":"2024-05-08T09:23:43.914086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037258+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.037258+0000","last_peered":"2024-05-08T09:24:38.037258+0000","last_clean":"2024-05-08T09:24:38.037258+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.037258+0000","last_undegraded":"2024-05-08T09:24:38.037258+0000","last_fullsized":"2024-05-08T09:24:38.037258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905558+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:24:44.905558+0000","last_peered":"2024-05-08T09:24:44.905558+0000","last_clean":"2024-05-08T09:24:44.905558+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:24:44.905558+0000","last_undegraded":"2024-05-08T09:24:44.905558+0000","last_fullsized":"2024-05-08T09:24:44.905558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914916+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:48.914916+0000","last_peered":"2024-05-08T09:23:48.914916+0000","last_clean":"2024-05-08T09:23:48.914916+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:48.914916+0000","last_undegraded":"2024-05-08T09:23:48.914916+0000","last_fullsized":"2024-05-08T09:23:48.914916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.162636+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.162636+0000","last_peered":"2024-05-08T09:24:38.162636+0000","last_clean":"2024-05-08T09:24:38.162636+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.162636+0000","last_undegraded":"2024-05-08T09:24:38.162636+0000","last_fullsized":"2024-05-08T09:24:38.162636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173155+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.173155+0000","last_peered":"2024-05-08T09:24:38.173155+0000","last_clean":"2024-05-08T09:24:38.173155+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.173155+0000","last_undegraded":"2024-05-08T09:24:38.173155+0000","last_fullsized":"2024-05-08T09:24:38.173155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915137+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:23:48.915137+0000","last_peered":"2024-05-08T09:23:48.915137+0000","last_clean":"2024-05-08T09:23:48.915137+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:23:48.915137+0000","last_undegraded":"2024-05-08T09:23:48.915137+0000","last_fullsized":"2024-05-08T09:23:48.915137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158005+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.158005+0000","last_peered":"2024-05-08T09:24:38.158005+0000","last_clean":"2024-05-08T09:24:38.158005+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.158005+0000","last_undegraded":"2024-05-08T09:24:38.158005+0000","last_fullsized":"2024-05-08T09:24:38.158005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.911417+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:23:58.911417+0000","last_peered":"2024-05-08T09:23:58.911417+0000","last_clean":"2024-05-08T09:23:58.911417+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:23:58.911417+0000","last_undegraded":"2024-05-08T09:23:58.911417+0000","last_fullsized":"2024-05-08T09:23:58.911417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909843+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:23:48.909843+0000","last_peered":"2024-05-08T09:23:48.909843+0000","last_clean":"2024-05-08T09:23:48.909843+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:23:48.909843+0000","last_undegraded":"2024-05-08T09:23:48.909843+0000","last_fullsized":"2024-05-08T09:23:48.909843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294011+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.294011+0000","last_peered":"2024-05-08T09:24:38.294011+0000","last_clean":"2024-05-08T09:24:38.294011+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.294011+0000","last_undegraded":"2024-05-08T09:24:38.294011+0000","last_fullsized":"2024-05-08T09:24:38.294011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1554,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1482,"ondisk_log_size":1482,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705713,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705712,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36276,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335564,"statfs":{"total":96636764160,"available":96599617536,"internally_reserved":0,"allocated":962560,"data_stored":723288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705712,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":999424,"data_stored":725474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705713,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:25:09.941 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.942 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.943 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.944 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.945 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.946 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.947 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.948 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.949 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.950 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.951 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.953 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.954 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.955 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.956 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.957 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.958 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.959 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.960 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.961 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-05-08T09:21:33.940846+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=33, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.962 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.963 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.964 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.965 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:09.966 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T09:25:29.967 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:25:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe39e06d640 1 Processor -- start 2024-05-08T09:25:30.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe39e06d640 1 -- start start 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe39e06d640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe39812e460 0x7fe398130850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe39e06d640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe398071020 con 0x7fe398127ea0 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe39e06d640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fe398071780 con 0x7fe39812e460 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe396ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe39812e460 0x7fe398130850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe3977fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe398127ea0 0x7fe398128280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:35126/0 (socket says 172.21.15.45:35126) 2024-05-08T09:25:30.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.084+0000 7fe3977fe640 1 -- 172.21.15.45:0/1389868447 learned_addr learned my addr 172.21.15.45:0/1389868447 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.085+0000 7fe396ffd640 1 -- 172.21.15.45:0/1389868447 >> v1:172.21.15.45:6789/0 conn(0x7fe398127ea0 legacy=0x7fe398128280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.085+0000 7fe396ffd640 1 -- 172.21.15.45:0/1389868447 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39806e6e0 con 0x7fe39812e460 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.085+0000 7fe396ffd640 1 --2- 172.21.15.45:0/1389868447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe39812e460 0x7fe398130850 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009720 tx=0x7fe38c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3395b13602f493d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe3967fc640 1 -- 172.21.15.45:0/1389868447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38c035020 con 0x7fe39812e460 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe3967fc640 1 -- 172.21.15.45:0/1389868447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38c031760 con 0x7fe39812e460 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe3967fc640 1 -- 172.21.15.45:0/1389868447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe38c031a60 con 0x7fe39812e460 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 -- 172.21.15.45:0/1389868447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe39812e460 msgr2=0x7fe398130850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 --2- 172.21.15.45:0/1389868447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe39812e460 0x7fe398130850 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009720 tx=0x7fe38c02b8d0 comp rx=0 tx=0).stop 2024-05-08T09:25:30.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 -- 172.21.15.45:0/1389868447 shutdown_connections 2024-05-08T09:25:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 --2- 172.21.15.45:0/1389868447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe39812e460 0x7fe398130850 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 -- 172.21.15.45:0/1389868447 >> 172.21.15.45:0/1389868447 conn(0x7fe398099380 msgr2=0x7fe398099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 -- 172.21.15.45:0/1389868447 shutdown_connections 2024-05-08T09:25:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.086+0000 7fe39e06d640 1 -- 172.21.15.45:0/1389868447 wait complete. 2024-05-08T09:25:30.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.087+0000 7fe39e06d640 1 Processor -- start 2024-05-08T09:25:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.087+0000 7fe39e06d640 1 -- start start 2024-05-08T09:25:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe39e06d640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe39e06d640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fe3980725d0 con 0x7fe398127ea0 2024-05-08T09:25:30.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe3977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe3977fe640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46430/0 (socket says 172.21.15.45:46430) 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe3977fe640 1 -- 172.21.15.45:0/842859252 learned_addr learned my addr 172.21.15.45:0/842859252 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe3977fe640 1 -- 172.21.15.45:0/842859252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe398114640 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe3977fe640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c4a0 tx=0x7fe38800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388017070 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe388005c10 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe388007070 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.088+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe398125110 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.089+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe398124960 con 0x7fe398127ea0 2024-05-08T09:25:30.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.090+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fe38801a070 con 0x7fe398127ea0 2024-05-08T09:25:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.090+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398062e90 con 0x7fe398127ea0 2024-05-08T09:25:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.090+0000 7fe37ffff640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 0x7fe38403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.090+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fe38804aca0 con 0x7fe398127ea0 2024-05-08T09:25:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.090+0000 7fe396ffd640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 0x7fe38403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:30.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.091+0000 7fe396ffd640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 0x7fe38403a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe38c036000 tx=0x7fe38c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:30.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.095+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fe38801b410 con 0x7fe398127ea0 2024-05-08T09:25:30.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.275+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe39806eae0 con 0x7fe384038060 2024-05-08T09:25:30.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.291+0000 7fe37ffff640 1 -- 172.21.15.45:0/842859252 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+661523 (secure 0 0 0) 0x7fe39806eae0 con 0x7fe384038060 2024-05-08T09:25:30.298 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:25:30.303 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:25:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 msgr2=0x7fe38403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:30.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 0x7fe38403a520 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe38c036000 tx=0x7fe38c008030 comp rx=0 tx=0).stop 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 msgr2=0x7fe398113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c4a0 tx=0x7fe38800c960 comp rx=0 tx=0).stop 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 shutdown_connections 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fe384038060 0x7fe38403a520 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 --2- 172.21.15.45:0/842859252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe398127ea0 0x7fe398113060 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 >> 172.21.15.45:0/842859252 conn(0x7fe398099380 msgr2=0x7fe39809a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 shutdown_connections 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:30.296+0000 7fe39e06d640 1 -- 172.21.15.45:0/842859252 wait complete. 2024-05-08T09:25:30.307 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-05-08T09:25:28.908320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5100,"num_read_kb":4681,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4770,"ondisk_log_size":4770,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148248,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377339112,"statfs":{"total":386547056640,"available":386395250688,"internally_reserved":0,"allocated":2809856,"data_stored":1719982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":148956951},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003737"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912000+0000","last_change":"2024-05-08T09:21:28.968552+0000","last_active":"2024-05-08T09:23:33.912000+0000","last_peered":"2024-05-08T09:23:33.912000+0000","last_clean":"2024-05-08T09:23:33.912000+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:23:33.912000+0000","last_undegraded":"2024-05-08T09:23:33.912000+0000","last_fullsized":"2024-05-08T09:23:33.912000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'3","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293551+0000","last_change":"2024-05-08T09:21:30.950762+0000","last_active":"2024-05-08T09:24:38.293551+0000","last_peered":"2024-05-08T09:24:38.293551+0000","last_clean":"2024-05-08T09:24:38.293551+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:24:38.293551+0000","last_undegraded":"2024-05-08T09:24:38.293551+0000","last_fullsized":"2024-05-08T09:24:38.293551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.378338+0000","last_change":"2024-05-08T09:21:28.957581+0000","last_active":"2024-05-08T09:23:37.378338+0000","last_peered":"2024-05-08T09:23:37.378338+0000","last_clean":"2024-05-08T09:23:37.378338+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:23:37.378338+0000","last_undegraded":"2024-05-08T09:23:37.378338+0000","last_fullsized":"2024-05-08T09:23:37.378338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173731+0000","last_change":"2024-05-08T09:21:30.958965+0000","last_active":"2024-05-08T09:24:38.173731+0000","last_peered":"2024-05-08T09:24:38.173731+0000","last_clean":"2024-05-08T09:24:38.173731+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:24:38.173731+0000","last_undegraded":"2024-05-08T09:24:38.173731+0000","last_fullsized":"2024-05-08T09:24:38.173731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912281+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:23:33.912281+0000","last_peered":"2024-05-08T09:23:33.912281+0000","last_clean":"2024-05-08T09:23:33.912281+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:23:33.912281+0000","last_undegraded":"2024-05-08T09:23:33.912281+0000","last_fullsized":"2024-05-08T09:23:33.912281+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.172663+0000","last_change":"2024-05-08T09:25:11.172689+0000","last_active":"2024-05-08T09:25:11.172663+0000","last_peered":"2024-05-08T09:25:11.172663+0000","last_clean":"2024-05-08T09:25:11.172663+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:25:11.172663+0000","last_undegraded":"2024-05-08T09:25:11.172663+0000","last_fullsized":"2024-05-08T09:25:11.172663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.172569+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:37.984066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911067+0000","last_change":"2024-05-08T09:21:28.972975+0000","last_active":"2024-05-08T09:23:28.911067+0000","last_peered":"2024-05-08T09:23:28.911067+0000","last_clean":"2024-05-08T09:23:28.911067+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:23:28.911067+0000","last_undegraded":"2024-05-08T09:23:28.911067+0000","last_fullsized":"2024-05-08T09:23:28.911067+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.952879+0000","last_change":"2024-05-08T09:21:30.955645+0000","last_active":"2024-05-08T09:24:37.952879+0000","last_peered":"2024-05-08T09:24:37.952879+0000","last_clean":"2024-05-08T09:24:37.952879+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:24:37.952879+0000","last_undegraded":"2024-05-08T09:24:37.952879+0000","last_fullsized":"2024-05-08T09:24:37.952879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916767+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:23:58.916767+0000","last_peered":"2024-05-08T09:23:58.916767+0000","last_clean":"2024-05-08T09:23:58.916767+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:23:58.916767+0000","last_undegraded":"2024-05-08T09:23:58.916767+0000","last_fullsized":"2024-05-08T09:23:58.916767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.826638+0000","last_change":"2024-05-08T09:25:18.826663+0000","last_active":"2024-05-08T09:25:18.826638+0000","last_peered":"2024-05-08T09:25:18.826638+0000","last_clean":"2024-05-08T09:25:18.826638+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:25:18.826638+0000","last_undegraded":"2024-05-08T09:25:18.826638+0000","last_fullsized":"2024-05-08T09:25:18.826638+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.826549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.998939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916014+0000","last_change":"2024-05-08T09:21:28.957852+0000","last_active":"2024-05-08T09:23:58.916014+0000","last_peered":"2024-05-08T09:23:58.916014+0000","last_clean":"2024-05-08T09:23:58.916014+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:23:58.916014+0000","last_undegraded":"2024-05-08T09:23:58.916014+0000","last_fullsized":"2024-05-08T09:23:58.916014+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.114230+0000","last_change":"2024-05-08T09:25:09.114273+0000","last_active":"2024-05-08T09:25:09.114230+0000","last_peered":"2024-05-08T09:25:09.114230+0000","last_clean":"2024-05-08T09:25:09.114230+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:25:09.114230+0000","last_undegraded":"2024-05-08T09:25:09.114230+0000","last_fullsized":"2024-05-08T09:25:09.114230+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.114110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:02.470835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916673+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:23:58.916673+0000","last_peered":"2024-05-08T09:23:58.916673+0000","last_clean":"2024-05-08T09:23:58.916673+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:23:58.916673+0000","last_undegraded":"2024-05-08T09:23:58.916673+0000","last_fullsized":"2024-05-08T09:23:58.916673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.316534+0000","last_change":"2024-05-08T09:25:13.316558+0000","last_active":"2024-05-08T09:25:13.316534+0000","last_peered":"2024-05-08T09:25:13.316534+0000","last_clean":"2024-05-08T09:25:13.316534+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:25:13.316534+0000","last_undegraded":"2024-05-08T09:25:13.316534+0000","last_fullsized":"2024-05-08T09:25:13.316534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.316411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:51.272956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.931019+0000","last_change":"2024-05-08T09:25:21.931062+0000","last_active":"2024-05-08T09:25:21.931019+0000","last_peered":"2024-05-08T09:25:21.931019+0000","last_clean":"2024-05-08T09:25:21.931019+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:25:21.931019+0000","last_undegraded":"2024-05-08T09:25:21.931019+0000","last_fullsized":"2024-05-08T09:25:21.931019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.930918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:54.987159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.305808+0000","last_change":"2024-05-08T09:25:21.305844+0000","last_active":"2024-05-08T09:25:21.305808+0000","last_peered":"2024-05-08T09:25:21.305808+0000","last_clean":"2024-05-08T09:25:21.305808+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:25:21.305808+0000","last_undegraded":"2024-05-08T09:25:21.305808+0000","last_fullsized":"2024-05-08T09:25:21.305808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.305723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:01.811529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173195+0000","last_change":"2024-05-08T09:21:30.959482+0000","last_active":"2024-05-08T09:24:38.173195+0000","last_peered":"2024-05-08T09:24:38.173195+0000","last_clean":"2024-05-08T09:24:38.173195+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:24:38.173195+0000","last_undegraded":"2024-05-08T09:24:38.173195+0000","last_fullsized":"2024-05-08T09:24:38.173195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905454+0000","last_change":"2024-05-08T09:21:28.976159+0000","last_active":"2024-05-08T09:24:44.905454+0000","last_peered":"2024-05-08T09:24:44.905454+0000","last_clean":"2024-05-08T09:24:44.905454+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:24:44.905454+0000","last_undegraded":"2024-05-08T09:24:44.905454+0000","last_fullsized":"2024-05-08T09:24:44.905454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.781776+0000","last_change":"2024-05-08T09:25:22.781804+0000","last_active":"2024-05-08T09:25:22.781776+0000","last_peered":"2024-05-08T09:25:22.781776+0000","last_clean":"2024-05-08T09:25:22.781776+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:25:22.781776+0000","last_undegraded":"2024-05-08T09:25:22.781776+0000","last_fullsized":"2024-05-08T09:25:22.781776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.781682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:55.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915368+0000","last_change":"2024-05-08T09:21:28.967538+0000","last_active":"2024-05-08T09:23:53.915368+0000","last_peered":"2024-05-08T09:23:53.915368+0000","last_clean":"2024-05-08T09:23:53.915368+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:23:53.915368+0000","last_undegraded":"2024-05-08T09:23:53.915368+0000","last_fullsized":"2024-05-08T09:23:53.915368+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915313+0000","last_change":"2024-05-08T09:21:30.947414+0000","last_active":"2024-05-08T09:23:53.915313+0000","last_peered":"2024-05-08T09:23:53.915313+0000","last_clean":"2024-05-08T09:23:53.915313+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:23:53.915313+0000","last_undegraded":"2024-05-08T09:23:53.915313+0000","last_fullsized":"2024-05-08T09:23:53.915313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915412+0000","last_change":"2024-05-08T09:21:28.974560+0000","last_active":"2024-05-08T09:23:53.915412+0000","last_peered":"2024-05-08T09:23:53.915412+0000","last_clean":"2024-05-08T09:23:53.915412+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:23:53.915412+0000","last_undegraded":"2024-05-08T09:23:53.915412+0000","last_fullsized":"2024-05-08T09:23:53.915412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.846119+0000","last_change":"2024-05-08T09:25:13.846147+0000","last_active":"2024-05-08T09:25:13.846119+0000","last_peered":"2024-05-08T09:25:13.846119+0000","last_clean":"2024-05-08T09:25:13.846119+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:25:13.846119+0000","last_undegraded":"2024-05-08T09:25:13.846119+0000","last_fullsized":"2024-05-08T09:25:13.846119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.846024+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:41.393615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915360+0000","last_change":"2024-05-08T09:21:28.972075+0000","last_active":"2024-05-08T09:23:53.915360+0000","last_peered":"2024-05-08T09:23:53.915360+0000","last_clean":"2024-05-08T09:23:53.915360+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:23:53.915360+0000","last_undegraded":"2024-05-08T09:23:53.915360+0000","last_fullsized":"2024-05-08T09:23:53.915360+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.249545+0000","last_change":"2024-05-08T09:21:30.955117+0000","last_active":"2024-05-08T09:24:38.249545+0000","last_peered":"2024-05-08T09:24:38.249545+0000","last_clean":"2024-05-08T09:24:38.249545+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:24:38.249545+0000","last_undegraded":"2024-05-08T09:24:38.249545+0000","last_fullsized":"2024-05-08T09:24:38.249545+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.910617+0000","last_change":"2024-05-08T09:21:28.954105+0000","last_active":"2024-05-08T09:23:53.910617+0000","last_peered":"2024-05-08T09:23:53.910617+0000","last_clean":"2024-05-08T09:23:53.910617+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:23:53.910617+0000","last_undegraded":"2024-05-08T09:23:53.910617+0000","last_fullsized":"2024-05-08T09:23:53.910617+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.830304+0000","last_change":"2024-05-08T09:25:21.830341+0000","last_active":"2024-05-08T09:25:21.830304+0000","last_peered":"2024-05-08T09:25:21.830304+0000","last_clean":"2024-05-08T09:25:21.830304+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:25:21.830304+0000","last_undegraded":"2024-05-08T09:25:21.830304+0000","last_fullsized":"2024-05-08T09:25:21.830304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.830191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:46.061745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914978+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:23:48.914978+0000","last_peered":"2024-05-08T09:23:48.914978+0000","last_clean":"2024-05-08T09:23:48.914978+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:23:48.914978+0000","last_undegraded":"2024-05-08T09:23:48.914978+0000","last_fullsized":"2024-05-08T09:23:48.914978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.761410+0000","last_change":"2024-05-08T09:25:12.761456+0000","last_active":"2024-05-08T09:25:12.761410+0000","last_peered":"2024-05-08T09:25:12.761410+0000","last_clean":"2024-05-08T09:25:12.761410+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:25:12.761410+0000","last_undegraded":"2024-05-08T09:25:12.761410+0000","last_fullsized":"2024-05-08T09:25:12.761410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.761304+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:25.524875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218348+0000","last_change":"2024-05-08T09:21:30.956335+0000","last_active":"2024-05-08T09:24:38.218348+0000","last_peered":"2024-05-08T09:24:38.218348+0000","last_clean":"2024-05-08T09:24:38.218348+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:24:38.218348+0000","last_undegraded":"2024-05-08T09:24:38.218348+0000","last_fullsized":"2024-05-08T09:24:38.218348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155052+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.155052+0000","last_peered":"2024-05-08T09:24:38.155052+0000","last_clean":"2024-05-08T09:24:38.155052+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.155052+0000","last_undegraded":"2024-05-08T09:24:38.155052+0000","last_fullsized":"2024-05-08T09:24:38.155052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.080175+0000","last_change":"2024-05-08T09:24:52.080213+0000","last_active":"2024-05-08T09:24:52.080175+0000","last_peered":"2024-05-08T09:24:52.080175+0000","last_clean":"2024-05-08T09:24:52.080175+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:24:52.080175+0000","last_undegraded":"2024-05-08T09:24:52.080175+0000","last_fullsized":"2024-05-08T09:24:52.080175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.080065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:28:14.528132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.264691+0000","last_change":"2024-05-08T09:25:17.264747+0000","last_active":"2024-05-08T09:25:17.264691+0000","last_peered":"2024-05-08T09:25:17.264691+0000","last_clean":"2024-05-08T09:25:17.264691+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:25:17.264691+0000","last_undegraded":"2024-05-08T09:25:17.264691+0000","last_fullsized":"2024-05-08T09:25:17.264691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.264579+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:59.907138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.718141+0000","last_change":"2024-05-08T09:24:56.718169+0000","last_active":"2024-05-08T09:24:56.718141+0000","last_peered":"2024-05-08T09:24:56.718141+0000","last_clean":"2024-05-08T09:24:56.718141+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:24:56.718141+0000","last_undegraded":"2024-05-08T09:24:56.718141+0000","last_fullsized":"2024-05-08T09:24:56.718141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.718047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:41.337920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.813429+0000","last_change":"2024-05-08T09:25:16.813454+0000","last_active":"2024-05-08T09:25:16.813429+0000","last_peered":"2024-05-08T09:25:16.813429+0000","last_clean":"2024-05-08T09:25:16.813429+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:25:16.813429+0000","last_undegraded":"2024-05-08T09:25:16.813429+0000","last_fullsized":"2024-05-08T09:25:16.813429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.813330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:00.193889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.069683+0000","last_change":"2024-05-08T09:25:07.069725+0000","last_active":"2024-05-08T09:25:07.069683+0000","last_peered":"2024-05-08T09:25:07.069683+0000","last_clean":"2024-05-08T09:25:07.069683+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:25:07.069683+0000","last_undegraded":"2024-05-08T09:25:07.069683+0000","last_fullsized":"2024-05-08T09:25:07.069683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.069574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:46.463982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914413+0000","last_change":"2024-05-08T09:21:28.958897+0000","last_active":"2024-05-08T09:23:48.914413+0000","last_peered":"2024-05-08T09:23:48.914413+0000","last_clean":"2024-05-08T09:23:48.914413+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:23:48.914413+0000","last_undegraded":"2024-05-08T09:23:48.914413+0000","last_fullsized":"2024-05-08T09:23:48.914413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.811079+0000","last_change":"2024-05-08T09:25:06.811118+0000","last_active":"2024-05-08T09:25:06.811079+0000","last_peered":"2024-05-08T09:25:06.811079+0000","last_clean":"2024-05-08T09:25:06.811079+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:25:06.811079+0000","last_undegraded":"2024-05-08T09:25:06.811079+0000","last_fullsized":"2024-05-08T09:25:06.811079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.810982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:45.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.687493+0000","last_change":"2024-05-08T09:24:55.687547+0000","last_active":"2024-05-08T09:24:55.687493+0000","last_peered":"2024-05-08T09:24:55.687493+0000","last_clean":"2024-05-08T09:24:55.687493+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:24:55.687493+0000","last_undegraded":"2024-05-08T09:24:55.687493+0000","last_fullsized":"2024-05-08T09:24:55.687493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.687356+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:29.151994+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.701766+0000","last_change":"2024-05-08T09:24:49.701793+0000","last_active":"2024-05-08T09:24:49.701766+0000","last_peered":"2024-05-08T09:24:49.701766+0000","last_clean":"2024-05-08T09:24:49.701766+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:24:49.701766+0000","last_undegraded":"2024-05-08T09:24:49.701766+0000","last_fullsized":"2024-05-08T09:24:49.701766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.701660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:37.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.910474+0000","last_change":"2024-05-08T09:25:16.910503+0000","last_active":"2024-05-08T09:25:16.910474+0000","last_peered":"2024-05-08T09:25:16.910474+0000","last_clean":"2024-05-08T09:25:16.910474+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:25:16.910474+0000","last_undegraded":"2024-05-08T09:25:16.910474+0000","last_fullsized":"2024-05-08T09:25:16.910474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.910378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:34.710873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218296+0000","last_change":"2024-05-08T09:21:30.955432+0000","last_active":"2024-05-08T09:24:38.218296+0000","last_peered":"2024-05-08T09:24:38.218296+0000","last_clean":"2024-05-08T09:24:38.218296+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:24:38.218296+0000","last_undegraded":"2024-05-08T09:24:38.218296+0000","last_fullsized":"2024-05-08T09:24:38.218296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914895+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:23:48.914895+0000","last_peered":"2024-05-08T09:23:48.914895+0000","last_clean":"2024-05-08T09:23:48.914895+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:23:48.914895+0000","last_undegraded":"2024-05-08T09:23:48.914895+0000","last_fullsized":"2024-05-08T09:23:48.914895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:43.922998+0000","last_change":"2024-05-08T09:22:16.003875+0000","last_active":"2024-05-08T09:24:43.922998+0000","last_peered":"2024-05-08T09:24:43.922998+0000","last_clean":"2024-05-08T09:24:43.922998+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:24:43.922998+0000","last_undegraded":"2024-05-08T09:24:43.922998+0000","last_fullsized":"2024-05-08T09:24:43.922998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.328472+0000","last_change":"2024-05-08T09:24:54.328519+0000","last_active":"2024-05-08T09:24:54.328472+0000","last_peered":"2024-05-08T09:24:54.328472+0000","last_clean":"2024-05-08T09:24:54.328472+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:24:54.328472+0000","last_undegraded":"2024-05-08T09:24:54.328472+0000","last_fullsized":"2024-05-08T09:24:54.328472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.328362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:05.483598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'285","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.942317+0000","last_change":"2024-05-08T09:21:36.985512+0000","last_active":"2024-05-08T09:24:44.942317+0000","last_peered":"2024-05-08T09:24:44.942317+0000","last_clean":"2024-05-08T09:24:44.942317+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:24:44.942317+0000","last_undegraded":"2024-05-08T09:24:44.942317+0000","last_fullsized":"2024-05-08T09:24:44.942317+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.917650+0000","last_change":"2024-05-08T09:21:38.980292+0000","last_active":"2024-05-08T09:24:08.917650+0000","last_peered":"2024-05-08T09:24:08.917650+0000","last_clean":"2024-05-08T09:24:08.917650+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:24:08.917650+0000","last_undegraded":"2024-05-08T09:24:08.917650+0000","last_fullsized":"2024-05-08T09:24:08.917650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.913368+0000","last_change":"2024-05-08T09:25:18.913395+0000","last_active":"2024-05-08T09:25:18.913368+0000","last_peered":"2024-05-08T09:25:18.913368+0000","last_clean":"2024-05-08T09:25:18.913368+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:25:18.913368+0000","last_undegraded":"2024-05-08T09:25:18.913368+0000","last_fullsized":"2024-05-08T09:25:18.913368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.913278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.872761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905437+0000","last_change":"2024-05-08T09:21:28.975894+0000","last_active":"2024-05-08T09:24:44.905437+0000","last_peered":"2024-05-08T09:24:44.905437+0000","last_clean":"2024-05-08T09:24:44.905437+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:24:44.905437+0000","last_undegraded":"2024-05-08T09:24:44.905437+0000","last_fullsized":"2024-05-08T09:24:44.905437+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.084809+0000","last_change":"2024-05-08T09:24:53.084847+0000","last_active":"2024-05-08T09:24:53.084809+0000","last_peered":"2024-05-08T09:24:53.084809+0000","last_clean":"2024-05-08T09:24:53.084809+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:24:53.084809+0000","last_undegraded":"2024-05-08T09:24:53.084809+0000","last_fullsized":"2024-05-08T09:24:53.084809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.084720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:14.978196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.309726+0000","last_change":"2024-05-08T09:24:55.309760+0000","last_active":"2024-05-08T09:24:55.309726+0000","last_peered":"2024-05-08T09:24:55.309726+0000","last_clean":"2024-05-08T09:24:55.309726+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:24:55.309726+0000","last_undegraded":"2024-05-08T09:24:55.309726+0000","last_fullsized":"2024-05-08T09:24:55.309726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.309641+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.625772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.838065+0000","last_change":"2024-05-08T09:24:50.838092+0000","last_active":"2024-05-08T09:24:50.838065+0000","last_peered":"2024-05-08T09:24:50.838065+0000","last_clean":"2024-05-08T09:24:50.838065+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:50.838065+0000","last_undegraded":"2024-05-08T09:24:50.838065+0000","last_fullsized":"2024-05-08T09:24:50.838065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.837975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:13.392037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.218420+0000","last_change":"2024-05-08T09:21:30.958951+0000","last_active":"2024-05-08T09:24:38.218420+0000","last_peered":"2024-05-08T09:24:38.218420+0000","last_clean":"2024-05-08T09:24:38.218420+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:24:38.218420+0000","last_undegraded":"2024-05-08T09:24:38.218420+0000","last_fullsized":"2024-05-08T09:24:38.218420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.151397+0000","last_change":"2024-05-08T09:21:28.970803+0000","last_active":"2024-05-08T09:24:38.151397+0000","last_peered":"2024-05-08T09:24:38.151397+0000","last_clean":"2024-05-08T09:24:38.151397+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:24:38.151397+0000","last_undegraded":"2024-05-08T09:24:38.151397+0000","last_fullsized":"2024-05-08T09:24:38.151397+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.708632+0000","last_change":"2024-05-08T09:25:01.708663+0000","last_active":"2024-05-08T09:25:01.708632+0000","last_peered":"2024-05-08T09:25:01.708632+0000","last_clean":"2024-05-08T09:25:01.708632+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:25:01.708632+0000","last_undegraded":"2024-05-08T09:25:01.708632+0000","last_fullsized":"2024-05-08T09:25:01.708632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.708527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:21:55.937487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.295053+0000","last_change":"2024-05-08T09:24:58.295107+0000","last_active":"2024-05-08T09:24:58.295053+0000","last_peered":"2024-05-08T09:24:58.295053+0000","last_clean":"2024-05-08T09:24:58.295053+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:24:58.295053+0000","last_undegraded":"2024-05-08T09:24:58.295053+0000","last_fullsized":"2024-05-08T09:24:58.295053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.294960+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:44.289112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.790076+0000","last_change":"2024-05-08T09:24:51.790127+0000","last_active":"2024-05-08T09:24:51.790076+0000","last_peered":"2024-05-08T09:24:51.790076+0000","last_clean":"2024-05-08T09:24:51.790076+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:24:51.790076+0000","last_undegraded":"2024-05-08T09:24:51.790076+0000","last_fullsized":"2024-05-08T09:24:51.790076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.789971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:01.201509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913650+0000","last_change":"2024-05-08T09:21:38.971593+0000","last_active":"2024-05-08T09:23:43.913650+0000","last_peered":"2024-05-08T09:23:43.913650+0000","last_clean":"2024-05-08T09:23:43.913650+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:23:43.913650+0000","last_undegraded":"2024-05-08T09:23:43.913650+0000","last_fullsized":"2024-05-08T09:23:43.913650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.785213+0000","last_change":"2024-05-08T09:25:19.785250+0000","last_active":"2024-05-08T09:25:19.785213+0000","last_peered":"2024-05-08T09:25:19.785213+0000","last_clean":"2024-05-08T09:25:19.785213+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:25:19.785213+0000","last_undegraded":"2024-05-08T09:25:19.785213+0000","last_fullsized":"2024-05-08T09:25:19.785213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.785121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:56.744605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913734+0000","last_change":"2024-05-08T09:21:28.971557+0000","last_active":"2024-05-08T09:23:43.913734+0000","last_peered":"2024-05-08T09:23:43.913734+0000","last_clean":"2024-05-08T09:23:43.913734+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:23:43.913734+0000","last_undegraded":"2024-05-08T09:23:43.913734+0000","last_fullsized":"2024-05-08T09:23:43.913734+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.840912+0000","last_change":"2024-05-08T09:25:11.840940+0000","last_active":"2024-05-08T09:25:11.840912+0000","last_peered":"2024-05-08T09:25:11.840912+0000","last_clean":"2024-05-08T09:25:11.840912+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:25:11.840912+0000","last_undegraded":"2024-05-08T09:25:11.840912+0000","last_fullsized":"2024-05-08T09:25:11.840912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.840802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:24.604373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.225184+0000","last_change":"2024-05-08T09:25:16.225238+0000","last_active":"2024-05-08T09:25:16.225184+0000","last_peered":"2024-05-08T09:25:16.225184+0000","last_clean":"2024-05-08T09:25:16.225184+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:25:16.225184+0000","last_undegraded":"2024-05-08T09:25:16.225184+0000","last_fullsized":"2024-05-08T09:25:16.225184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.225076+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.968267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.808071+0000","last_change":"2024-05-08T09:24:49.808113+0000","last_active":"2024-05-08T09:24:49.808071+0000","last_peered":"2024-05-08T09:24:49.808071+0000","last_clean":"2024-05-08T09:24:49.808071+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:24:49.808071+0000","last_undegraded":"2024-05-08T09:24:49.808071+0000","last_fullsized":"2024-05-08T09:24:49.808071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.807955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:48.540567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913715+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:43.913715+0000","last_peered":"2024-05-08T09:23:43.913715+0000","last_clean":"2024-05-08T09:23:43.913715+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:43.913715+0000","last_undegraded":"2024-05-08T09:23:43.913715+0000","last_fullsized":"2024-05-08T09:23:43.913715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.303755+0000","last_change":"2024-05-08T09:25:19.303783+0000","last_active":"2024-05-08T09:25:19.303755+0000","last_peered":"2024-05-08T09:25:19.303755+0000","last_clean":"2024-05-08T09:25:19.303755+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:25:19.303755+0000","last_undegraded":"2024-05-08T09:25:19.303755+0000","last_fullsized":"2024-05-08T09:25:19.303755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.303658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:04.577425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914140+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:23:43.914140+0000","last_peered":"2024-05-08T09:23:43.914140+0000","last_clean":"2024-05-08T09:23:43.914140+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:23:43.914140+0000","last_undegraded":"2024-05-08T09:23:43.914140+0000","last_fullsized":"2024-05-08T09:23:43.914140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.784639+0000","last_change":"2024-05-08T09:25:05.784665+0000","last_active":"2024-05-08T09:25:05.784639+0000","last_peered":"2024-05-08T09:25:05.784639+0000","last_clean":"2024-05-08T09:25:05.784639+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:25:05.784639+0000","last_undegraded":"2024-05-08T09:25:05.784639+0000","last_fullsized":"2024-05-08T09:25:05.784639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:48.571658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.027233+0000","last_change":"2024-05-08T09:25:02.027279+0000","last_active":"2024-05-08T09:25:02.027233+0000","last_peered":"2024-05-08T09:25:02.027233+0000","last_clean":"2024-05-08T09:25:02.027233+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:25:02.027233+0000","last_undegraded":"2024-05-08T09:25:02.027233+0000","last_fullsized":"2024-05-08T09:25:02.027233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.027147+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:01.654874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.823561+0000","last_change":"2024-05-08T09:25:12.823593+0000","last_active":"2024-05-08T09:25:12.823561+0000","last_peered":"2024-05-08T09:25:12.823561+0000","last_clean":"2024-05-08T09:25:12.823561+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:25:12.823561+0000","last_undegraded":"2024-05-08T09:25:12.823561+0000","last_fullsized":"2024-05-08T09:25:12.823561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.823468+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.142119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909980+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:23:48.909980+0000","last_peered":"2024-05-08T09:23:48.909980+0000","last_clean":"2024-05-08T09:23:48.909980+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:23:48.909980+0000","last_undegraded":"2024-05-08T09:23:48.909980+0000","last_fullsized":"2024-05-08T09:23:48.909980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.337524+0000","last_change":"2024-05-08T09:25:15.337550+0000","last_active":"2024-05-08T09:25:15.337524+0000","last_peered":"2024-05-08T09:25:15.337524+0000","last_clean":"2024-05-08T09:25:15.337524+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:25:15.337524+0000","last_undegraded":"2024-05-08T09:25:15.337524+0000","last_fullsized":"2024-05-08T09:25:15.337524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.337431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:48.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914072+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:23:43.914072+0000","last_peered":"2024-05-08T09:23:43.914072+0000","last_clean":"2024-05-08T09:23:43.914072+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:23:43.914072+0000","last_undegraded":"2024-05-08T09:23:43.914072+0000","last_fullsized":"2024-05-08T09:23:43.914072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.809318+0000","last_change":"2024-05-08T09:25:10.809344+0000","last_active":"2024-05-08T09:25:10.809318+0000","last_peered":"2024-05-08T09:25:10.809318+0000","last_clean":"2024-05-08T09:25:10.809318+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:25:10.809318+0000","last_undegraded":"2024-05-08T09:25:10.809318+0000","last_fullsized":"2024-05-08T09:25:10.809318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.809216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:37.851520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'66","reported_seq":139,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.217624+0000","last_change":"2024-05-08T09:25:20.217666+0000","last_active":"2024-05-08T09:25:20.217624+0000","last_peered":"2024-05-08T09:25:20.217624+0000","last_clean":"2024-05-08T09:25:20.217624+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:25:20.217624+0000","last_undegraded":"2024-05-08T09:25:20.217624+0000","last_fullsized":"2024-05-08T09:25:20.217624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.217529+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:21.026949+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.818524+0000","last_change":"2024-05-08T09:24:48.818545+0000","last_active":"2024-05-08T09:24:48.818524+0000","last_peered":"2024-05-08T09:24:48.818524+0000","last_clean":"2024-05-08T09:24:48.818524+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:24:48.818524+0000","last_undegraded":"2024-05-08T09:24:48.818524+0000","last_fullsized":"2024-05-08T09:24:48.818524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.818433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:36.182911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.340880+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.340880+0000","last_peered":"2024-05-08T09:24:38.340880+0000","last_clean":"2024-05-08T09:24:38.340880+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.340880+0000","last_undegraded":"2024-05-08T09:24:38.340880+0000","last_fullsized":"2024-05-08T09:24:38.340880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.730702+0000","last_change":"2024-05-08T09:25:11.730752+0000","last_active":"2024-05-08T09:25:11.730702+0000","last_peered":"2024-05-08T09:25:11.730702+0000","last_clean":"2024-05-08T09:25:11.730702+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:25:11.730702+0000","last_undegraded":"2024-05-08T09:25:11.730702+0000","last_fullsized":"2024-05-08T09:25:11.730702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.730568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:38.772872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909078+0000","last_change":"2024-05-08T09:21:28.962156+0000","last_active":"2024-05-08T09:23:43.909078+0000","last_peered":"2024-05-08T09:23:43.909078+0000","last_clean":"2024-05-08T09:23:43.909078+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:23:43.909078+0000","last_undegraded":"2024-05-08T09:23:43.909078+0000","last_fullsized":"2024-05-08T09:23:43.909078+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.322499+0000","last_change":"2024-05-08T09:25:03.322535+0000","last_active":"2024-05-08T09:25:03.322499+0000","last_peered":"2024-05-08T09:25:03.322499+0000","last_clean":"2024-05-08T09:25:03.322499+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:25:03.322499+0000","last_undegraded":"2024-05-08T09:25:03.322499+0000","last_fullsized":"2024-05-08T09:25:03.322499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.322403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:06.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.739742+0000","last_change":"2024-05-08T09:24:57.739783+0000","last_active":"2024-05-08T09:24:57.739742+0000","last_peered":"2024-05-08T09:24:57.739742+0000","last_clean":"2024-05-08T09:24:57.739742+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:24:57.739742+0000","last_undegraded":"2024-05-08T09:24:57.739742+0000","last_fullsized":"2024-05-08T09:24:57.739742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.739657+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:25.965876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.255635+0000","last_change":"2024-05-08T09:25:14.255684+0000","last_active":"2024-05-08T09:25:14.255635+0000","last_peered":"2024-05-08T09:25:14.255635+0000","last_clean":"2024-05-08T09:25:14.255635+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:25:14.255635+0000","last_undegraded":"2024-05-08T09:25:14.255635+0000","last_fullsized":"2024-05-08T09:25:14.255635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.255525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:04.947242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.298717+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:24:38.298717+0000","last_peered":"2024-05-08T09:24:38.298717+0000","last_clean":"2024-05-08T09:24:38.298717+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:24:38.298717+0000","last_undegraded":"2024-05-08T09:24:38.298717+0000","last_fullsized":"2024-05-08T09:24:38.298717+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.020163+0000","last_change":"2024-05-08T09:25:01.020191+0000","last_active":"2024-05-08T09:25:01.020163+0000","last_peered":"2024-05-08T09:25:01.020163+0000","last_clean":"2024-05-08T09:25:01.020163+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:25:01.020163+0000","last_undegraded":"2024-05-08T09:25:01.020163+0000","last_fullsized":"2024-05-08T09:25:01.020163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.020070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:37.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913154+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:23:38.913154+0000","last_peered":"2024-05-08T09:23:38.913154+0000","last_clean":"2024-05-08T09:23:38.913154+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:23:38.913154+0000","last_undegraded":"2024-05-08T09:23:38.913154+0000","last_fullsized":"2024-05-08T09:23:38.913154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'5","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.794975+0000","last_change":"2024-05-08T09:25:09.795024+0000","last_active":"2024-05-08T09:25:09.794975+0000","last_peered":"2024-05-08T09:25:09.794975+0000","last_clean":"2024-05-08T09:25:09.794975+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:25:09.794975+0000","last_undegraded":"2024-05-08T09:25:09.794975+0000","last_fullsized":"2024-05-08T09:25:09.794975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.794854+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.624478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.303146+0000","last_change":"2024-05-08T09:25:02.303194+0000","last_active":"2024-05-08T09:25:02.303146+0000","last_peered":"2024-05-08T09:25:02.303146+0000","last_clean":"2024-05-08T09:25:02.303146+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:25:02.303146+0000","last_undegraded":"2024-05-08T09:25:02.303146+0000","last_fullsized":"2024-05-08T09:25:02.303146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.303063+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:10.132225+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.302336+0000","last_change":"2024-05-08T09:24:53.302402+0000","last_active":"2024-05-08T09:24:53.302336+0000","last_peered":"2024-05-08T09:24:53.302336+0000","last_clean":"2024-05-08T09:24:53.302336+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:53.302336+0000","last_undegraded":"2024-05-08T09:24:53.302336+0000","last_fullsized":"2024-05-08T09:24:53.302336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.302236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:25.305583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.300442+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:38.300442+0000","last_peered":"2024-05-08T09:24:38.300442+0000","last_clean":"2024-05-08T09:24:38.300442+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:38.300442+0000","last_undegraded":"2024-05-08T09:24:38.300442+0000","last_fullsized":"2024-05-08T09:24:38.300442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914538+0000","last_change":"2024-05-08T09:21:30.955913+0000","last_active":"2024-05-08T09:23:48.914538+0000","last_peered":"2024-05-08T09:23:48.914538+0000","last_clean":"2024-05-08T09:23:48.914538+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:23:48.914538+0000","last_undegraded":"2024-05-08T09:23:48.914538+0000","last_fullsized":"2024-05-08T09:23:48.914538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913097+0000","last_change":"2024-05-08T09:21:28.979970+0000","last_active":"2024-05-08T09:23:38.913097+0000","last_peered":"2024-05-08T09:23:38.913097+0000","last_clean":"2024-05-08T09:23:38.913097+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:23:38.913097+0000","last_undegraded":"2024-05-08T09:23:38.913097+0000","last_fullsized":"2024-05-08T09:23:38.913097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.758567+0000","last_change":"2024-05-08T09:25:06.758612+0000","last_active":"2024-05-08T09:25:06.758567+0000","last_peered":"2024-05-08T09:25:06.758567+0000","last_clean":"2024-05-08T09:25:06.758567+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:25:06.758567+0000","last_undegraded":"2024-05-08T09:25:06.758567+0000","last_fullsized":"2024-05-08T09:25:06.758567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.758460+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:49.545574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.255289+0000","last_change":"2024-05-08T09:25:15.255329+0000","last_active":"2024-05-08T09:25:15.255289+0000","last_peered":"2024-05-08T09:25:15.255289+0000","last_clean":"2024-05-08T09:25:15.255289+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:25:15.255289+0000","last_undegraded":"2024-05-08T09:25:15.255289+0000","last_fullsized":"2024-05-08T09:25:15.255289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.255201+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:23.835791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.722811+0000","last_change":"2024-05-08T09:24:48.722856+0000","last_active":"2024-05-08T09:24:48.722811+0000","last_peered":"2024-05-08T09:24:48.722811+0000","last_clean":"2024-05-08T09:24:48.722811+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:48.722811+0000","last_undegraded":"2024-05-08T09:24:48.722811+0000","last_fullsized":"2024-05-08T09:24:48.722811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.722702+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:43.871307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.320578+0000","last_change":"2024-05-08T09:25:05.320604+0000","last_active":"2024-05-08T09:25:05.320578+0000","last_peered":"2024-05-08T09:25:05.320578+0000","last_clean":"2024-05-08T09:25:05.320578+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:25:05.320578+0000","last_undegraded":"2024-05-08T09:25:05.320578+0000","last_fullsized":"2024-05-08T09:25:05.320578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.320491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:51.978731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.748295+0000","last_change":"2024-05-08T09:25:10.748318+0000","last_active":"2024-05-08T09:25:10.748295+0000","last_peered":"2024-05-08T09:25:10.748295+0000","last_clean":"2024-05-08T09:25:10.748295+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:25:10.748295+0000","last_undegraded":"2024-05-08T09:25:10.748295+0000","last_fullsized":"2024-05-08T09:25:10.748295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.748214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:58.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913031+0000","last_change":"2024-05-08T09:21:28.978863+0000","last_active":"2024-05-08T09:23:38.913031+0000","last_peered":"2024-05-08T09:23:38.913031+0000","last_clean":"2024-05-08T09:23:38.913031+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:23:38.913031+0000","last_undegraded":"2024-05-08T09:23:38.913031+0000","last_fullsized":"2024-05-08T09:23:38.913031+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.047804+0000","last_change":"2024-05-08T09:24:54.047846+0000","last_active":"2024-05-08T09:24:54.047804+0000","last_peered":"2024-05-08T09:24:54.047804+0000","last_clean":"2024-05-08T09:24:54.047804+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:24:54.047804+0000","last_undegraded":"2024-05-08T09:24:54.047804+0000","last_fullsized":"2024-05-08T09:24:54.047804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.047713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:28.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.765587+0000","last_change":"2024-05-08T09:24:59.765651+0000","last_active":"2024-05-08T09:24:59.765587+0000","last_peered":"2024-05-08T09:24:59.765587+0000","last_clean":"2024-05-08T09:24:59.765587+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:24:59.765587+0000","last_undegraded":"2024-05-08T09:24:59.765587+0000","last_fullsized":"2024-05-08T09:24:59.765587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.765502+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:46.174195+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.320572+0000","last_change":"2024-05-08T09:24:57.320607+0000","last_active":"2024-05-08T09:24:57.320572+0000","last_peered":"2024-05-08T09:24:57.320572+0000","last_clean":"2024-05-08T09:24:57.320572+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:24:57.320572+0000","last_undegraded":"2024-05-08T09:24:57.320572+0000","last_fullsized":"2024-05-08T09:24:57.320572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.320468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:09.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.786845+0000","last_change":"2024-05-08T09:25:04.786877+0000","last_active":"2024-05-08T09:25:04.786845+0000","last_peered":"2024-05-08T09:25:04.786845+0000","last_clean":"2024-05-08T09:25:04.786845+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:25:04.786845+0000","last_undegraded":"2024-05-08T09:25:04.786845+0000","last_fullsized":"2024-05-08T09:25:04.786845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.786748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:38.042528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.000474+0000","last_change":"2024-05-08T09:25:03.000502+0000","last_active":"2024-05-08T09:25:03.000474+0000","last_peered":"2024-05-08T09:25:03.000474+0000","last_clean":"2024-05-08T09:25:03.000474+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:25:03.000474+0000","last_undegraded":"2024-05-08T09:25:03.000474+0000","last_fullsized":"2024-05-08T09:25:03.000474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.000386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:27.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":198,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.276541+0000","last_change":"2024-05-08T09:21:20.673413+0000","last_active":"2024-05-08T09:24:48.276541+0000","last_peered":"2024-05-08T09:24:48.276541+0000","last_clean":"2024-05-08T09:24:48.276541+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:24:48.276541+0000","last_undegraded":"2024-05-08T09:24:48.276541+0000","last_fullsized":"2024-05-08T09:24:48.276541+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911303+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:23:28.911303+0000","last_peered":"2024-05-08T09:23:28.911303+0000","last_clean":"2024-05-08T09:23:28.911303+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:23:28.911303+0000","last_undegraded":"2024-05-08T09:23:28.911303+0000","last_fullsized":"2024-05-08T09:23:28.911303+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912168+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:23:33.912168+0000","last_peered":"2024-05-08T09:23:33.912168+0000","last_clean":"2024-05-08T09:23:33.912168+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:23:33.912168+0000","last_undegraded":"2024-05-08T09:23:33.912168+0000","last_fullsized":"2024-05-08T09:23:33.912168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.755013+0000","last_change":"2024-05-08T09:25:07.755062+0000","last_active":"2024-05-08T09:25:07.755013+0000","last_peered":"2024-05-08T09:25:07.755013+0000","last_clean":"2024-05-08T09:25:07.755013+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:25:07.755013+0000","last_undegraded":"2024-05-08T09:25:07.755013+0000","last_fullsized":"2024-05-08T09:25:07.755013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.754913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:46.567445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.062888+0000","last_change":"2024-05-08T09:24:56.062932+0000","last_active":"2024-05-08T09:24:56.062888+0000","last_peered":"2024-05-08T09:24:56.062888+0000","last_clean":"2024-05-08T09:24:56.062888+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:24:56.062888+0000","last_undegraded":"2024-05-08T09:24:56.062888+0000","last_fullsized":"2024-05-08T09:24:56.062888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.062751+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:23.610342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.720491+0000","last_change":"2024-05-08T09:24:56.720522+0000","last_active":"2024-05-08T09:24:56.720491+0000","last_peered":"2024-05-08T09:24:56.720491+0000","last_clean":"2024-05-08T09:24:56.720491+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:24:56.720491+0000","last_undegraded":"2024-05-08T09:24:56.720491+0000","last_fullsized":"2024-05-08T09:24:56.720491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.720398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:12.622377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.309603+0000","last_change":"2024-05-08T09:25:09.309632+0000","last_active":"2024-05-08T09:25:09.309603+0000","last_peered":"2024-05-08T09:25:09.309603+0000","last_clean":"2024-05-08T09:25:09.309603+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:25:09.309603+0000","last_undegraded":"2024-05-08T09:25:09.309603+0000","last_fullsized":"2024-05-08T09:25:09.309603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.309508+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:50.697197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'5","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293381+0000","last_change":"2024-05-08T09:21:30.955359+0000","last_active":"2024-05-08T09:24:38.293381+0000","last_peered":"2024-05-08T09:24:38.293381+0000","last_clean":"2024-05-08T09:24:38.293381+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:24:38.293381+0000","last_undegraded":"2024-05-08T09:24:38.293381+0000","last_fullsized":"2024-05-08T09:24:38.293381+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178385+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:24:49.178385+0000","last_peered":"2024-05-08T09:24:49.178385+0000","last_clean":"2024-05-08T09:24:49.178385+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:24:49.178385+0000","last_undegraded":"2024-05-08T09:24:49.178385+0000","last_fullsized":"2024-05-08T09:24:49.178385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.887933+0000","last_change":"2024-05-08T09:25:19.887978+0000","last_active":"2024-05-08T09:25:19.887933+0000","last_peered":"2024-05-08T09:25:19.887933+0000","last_clean":"2024-05-08T09:25:19.887933+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:25:19.887933+0000","last_undegraded":"2024-05-08T09:25:19.887933+0000","last_fullsized":"2024-05-08T09:25:19.887933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.887845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:19.515572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.124853+0000","last_change":"2024-05-08T09:24:50.124896+0000","last_active":"2024-05-08T09:24:50.124853+0000","last_peered":"2024-05-08T09:24:50.124853+0000","last_clean":"2024-05-08T09:24:50.124853+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:24:50.124853+0000","last_undegraded":"2024-05-08T09:24:50.124853+0000","last_fullsized":"2024-05-08T09:24:50.124853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.124732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:35.398499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.697048+0000","last_change":"2024-05-08T09:24:53.697104+0000","last_active":"2024-05-08T09:24:53.697048+0000","last_peered":"2024-05-08T09:24:53.697048+0000","last_clean":"2024-05-08T09:24:53.697048+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:53.697048+0000","last_undegraded":"2024-05-08T09:24:53.697048+0000","last_fullsized":"2024-05-08T09:24:53.697048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.696956+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:53.816751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.235900+0000","last_change":"2024-05-08T09:25:22.235958+0000","last_active":"2024-05-08T09:25:22.235900+0000","last_peered":"2024-05-08T09:25:22.235900+0000","last_clean":"2024-05-08T09:25:22.235900+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:25:22.235900+0000","last_undegraded":"2024-05-08T09:25:22.235900+0000","last_fullsized":"2024-05-08T09:25:22.235900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.235783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:01.285711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914418+0000","last_change":"2024-05-08T09:21:38.986837+0000","last_active":"2024-05-08T09:23:48.914418+0000","last_peered":"2024-05-08T09:23:48.914418+0000","last_clean":"2024-05-08T09:23:48.914418+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:23:48.914418+0000","last_undegraded":"2024-05-08T09:23:48.914418+0000","last_fullsized":"2024-05-08T09:23:48.914418+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909172+0000","last_change":"2024-05-08T09:21:30.946721+0000","last_active":"2024-05-08T09:23:43.909172+0000","last_peered":"2024-05-08T09:23:43.909172+0000","last_clean":"2024-05-08T09:23:43.909172+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:23:43.909172+0000","last_undegraded":"2024-05-08T09:23:43.909172+0000","last_fullsized":"2024-05-08T09:23:43.909172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:23.910208+0000","last_change":"2024-05-08T09:21:20.670998+0000","last_active":"2024-05-08T09:23:23.910208+0000","last_peered":"2024-05-08T09:23:23.910208+0000","last_clean":"2024-05-08T09:23:23.910208+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:23:23.910208+0000","last_undegraded":"2024-05-08T09:23:23.910208+0000","last_fullsized":"2024-05-08T09:23:23.910208+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906342+0000","last_change":"2024-05-08T09:21:28.962141+0000","last_active":"2024-05-08T09:23:28.906342+0000","last_peered":"2024-05-08T09:23:28.906342+0000","last_clean":"2024-05-08T09:23:28.906342+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:23:28.906342+0000","last_undegraded":"2024-05-08T09:23:28.906342+0000","last_fullsized":"2024-05-08T09:23:28.906342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.314972+0000","last_change":"2024-05-08T09:25:07.315030+0000","last_active":"2024-05-08T09:25:07.314972+0000","last_peered":"2024-05-08T09:25:07.314972+0000","last_clean":"2024-05-08T09:25:07.314972+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:25:07.314972+0000","last_undegraded":"2024-05-08T09:25:07.314972+0000","last_fullsized":"2024-05-08T09:25:07.314972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.314876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:51.934749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.284507+0000","last_change":"2024-05-08T09:25:00.284595+0000","last_active":"2024-05-08T09:25:00.284507+0000","last_peered":"2024-05-08T09:25:00.284507+0000","last_clean":"2024-05-08T09:25:00.284507+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:25:00.284507+0000","last_undegraded":"2024-05-08T09:25:00.284507+0000","last_fullsized":"2024-05-08T09:25:00.284507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.284405+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:11:16.757164+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.743909+0000","last_change":"2024-05-08T09:25:04.743937+0000","last_active":"2024-05-08T09:25:04.743909+0000","last_peered":"2024-05-08T09:25:04.743909+0000","last_clean":"2024-05-08T09:25:04.743909+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:25:04.743909+0000","last_undegraded":"2024-05-08T09:25:04.743909+0000","last_fullsized":"2024-05-08T09:25:04.743909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.743814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:55.764703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915813+0000","last_change":"2024-05-08T09:21:38.977729+0000","last_active":"2024-05-08T09:23:53.915813+0000","last_peered":"2024-05-08T09:23:53.915813+0000","last_clean":"2024-05-08T09:23:53.915813+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:23:53.915813+0000","last_undegraded":"2024-05-08T09:23:53.915813+0000","last_fullsized":"2024-05-08T09:23:53.915813+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908155+0000","last_change":"2024-05-08T09:21:30.949724+0000","last_active":"2024-05-08T09:23:38.908155+0000","last_peered":"2024-05-08T09:23:38.908155+0000","last_clean":"2024-05-08T09:23:38.908155+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:23:38.908155+0000","last_undegraded":"2024-05-08T09:23:38.908155+0000","last_fullsized":"2024-05-08T09:23:38.908155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911258+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:23:28.911258+0000","last_peered":"2024-05-08T09:23:28.911258+0000","last_clean":"2024-05-08T09:23:28.911258+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:23:28.911258+0000","last_undegraded":"2024-05-08T09:23:28.911258+0000","last_fullsized":"2024-05-08T09:23:28.911258+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.348308+0000","last_change":"2024-05-08T09:25:18.348367+0000","last_active":"2024-05-08T09:25:18.348308+0000","last_peered":"2024-05-08T09:25:18.348308+0000","last_clean":"2024-05-08T09:25:18.348308+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:25:18.348308+0000","last_undegraded":"2024-05-08T09:25:18.348308+0000","last_fullsized":"2024-05-08T09:25:18.348308+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.348203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:24.290463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.703290+0000","last_change":"2024-05-08T09:25:02.703314+0000","last_active":"2024-05-08T09:25:02.703290+0000","last_peered":"2024-05-08T09:25:02.703290+0000","last_clean":"2024-05-08T09:25:02.703290+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:25:02.703290+0000","last_undegraded":"2024-05-08T09:25:02.703290+0000","last_fullsized":"2024-05-08T09:25:02.703290+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.703179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:19.071013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.065110+0000","last_change":"2024-05-08T09:24:58.065155+0000","last_active":"2024-05-08T09:24:58.065110+0000","last_peered":"2024-05-08T09:24:58.065110+0000","last_clean":"2024-05-08T09:24:58.065110+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:58.065110+0000","last_undegraded":"2024-05-08T09:24:58.065110+0000","last_fullsized":"2024-05-08T09:24:58.065110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.065021+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:41.445580+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.225891+0000","last_change":"2024-05-08T09:25:18.225915+0000","last_active":"2024-05-08T09:25:18.225891+0000","last_peered":"2024-05-08T09:25:18.225891+0000","last_clean":"2024-05-08T09:25:18.225891+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:25:18.225891+0000","last_undegraded":"2024-05-08T09:25:18.225891+0000","last_fullsized":"2024-05-08T09:25:18.225891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.225797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:51.835449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.735683+0000","last_change":"2024-05-08T09:25:08.735709+0000","last_active":"2024-05-08T09:25:08.735683+0000","last_peered":"2024-05-08T09:25:08.735683+0000","last_clean":"2024-05-08T09:25:08.735683+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:25:08.735683+0000","last_undegraded":"2024-05-08T09:25:08.735683+0000","last_fullsized":"2024-05-08T09:25:08.735683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.735600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:33.339447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.776756+0000","last_change":"2024-05-08T09:25:17.776797+0000","last_active":"2024-05-08T09:25:17.776756+0000","last_peered":"2024-05-08T09:25:17.776756+0000","last_clean":"2024-05-08T09:25:17.776756+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:25:17.776756+0000","last_undegraded":"2024-05-08T09:25:17.776756+0000","last_fullsized":"2024-05-08T09:25:17.776756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.776647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:35.577142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.356391+0000","last_change":"2024-05-08T09:25:14.356418+0000","last_active":"2024-05-08T09:25:14.356391+0000","last_peered":"2024-05-08T09:25:14.356391+0000","last_clean":"2024-05-08T09:25:14.356391+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:25:14.356391+0000","last_undegraded":"2024-05-08T09:25:14.356391+0000","last_fullsized":"2024-05-08T09:25:14.356391+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.356288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:30.724123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906426+0000","last_change":"2024-05-08T09:21:20.671933+0000","last_active":"2024-05-08T09:23:28.906426+0000","last_peered":"2024-05-08T09:23:28.906426+0000","last_clean":"2024-05-08T09:23:28.906426+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:23:28.906426+0000","last_undegraded":"2024-05-08T09:23:28.906426+0000","last_fullsized":"2024-05-08T09:23:28.906426+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.733755+0000","last_change":"2024-05-08T09:25:03.733784+0000","last_active":"2024-05-08T09:25:03.733755+0000","last_peered":"2024-05-08T09:25:03.733755+0000","last_clean":"2024-05-08T09:25:03.733755+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:25:03.733755+0000","last_undegraded":"2024-05-08T09:25:03.733755+0000","last_fullsized":"2024-05-08T09:25:03.733755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.733661+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:36.989441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'73","reported_seq":149,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.773058+0000","last_change":"2024-05-08T09:24:57.773109+0000","last_active":"2024-05-08T09:24:57.773058+0000","last_peered":"2024-05-08T09:24:57.773058+0000","last_clean":"2024-05-08T09:24:57.773058+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:24:57.773058+0000","last_undegraded":"2024-05-08T09:24:57.773058+0000","last_fullsized":"2024-05-08T09:24:57.773058+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.772960+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:39.160649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.236732+0000","last_change":"2024-05-08T09:24:49.236766+0000","last_active":"2024-05-08T09:24:49.236732+0000","last_peered":"2024-05-08T09:24:49.236732+0000","last_clean":"2024-05-08T09:24:49.236732+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:24:49.236732+0000","last_undegraded":"2024-05-08T09:24:49.236732+0000","last_fullsized":"2024-05-08T09:24:49.236732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.236605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:51.830567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.221643+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.221643+0000","last_peered":"2024-05-08T09:24:38.221643+0000","last_clean":"2024-05-08T09:24:38.221643+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.221643+0000","last_undegraded":"2024-05-08T09:24:38.221643+0000","last_fullsized":"2024-05-08T09:24:38.221643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.839586+0000","last_change":"2024-05-08T09:25:15.839615+0000","last_active":"2024-05-08T09:25:15.839586+0000","last_peered":"2024-05-08T09:25:15.839586+0000","last_clean":"2024-05-08T09:25:15.839586+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:25:15.839586+0000","last_undegraded":"2024-05-08T09:25:15.839586+0000","last_fullsized":"2024-05-08T09:25:15.839586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.839497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.088807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907199+0000","last_change":"2024-05-08T09:21:28.950004+0000","last_active":"2024-05-08T09:23:33.907199+0000","last_peered":"2024-05-08T09:23:33.907199+0000","last_clean":"2024-05-08T09:23:33.907199+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:23:33.907199+0000","last_undegraded":"2024-05-08T09:23:33.907199+0000","last_fullsized":"2024-05-08T09:23:33.907199+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.911343+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:23:28.911343+0000","last_peered":"2024-05-08T09:23:28.911343+0000","last_clean":"2024-05-08T09:23:28.911343+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:23:28.911343+0000","last_undegraded":"2024-05-08T09:23:28.911343+0000","last_fullsized":"2024-05-08T09:23:28.911343+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.124204+0000","last_change":"2024-05-08T09:24:51.124254+0000","last_active":"2024-05-08T09:24:51.124204+0000","last_peered":"2024-05-08T09:24:51.124204+0000","last_clean":"2024-05-08T09:24:51.124204+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:24:51.124204+0000","last_undegraded":"2024-05-08T09:24:51.124204+0000","last_fullsized":"2024-05-08T09:24:51.124204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.124097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:45.345946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.719193+0000","last_change":"2024-05-08T09:24:54.719272+0000","last_active":"2024-05-08T09:24:54.719193+0000","last_peered":"2024-05-08T09:24:54.719193+0000","last_clean":"2024-05-08T09:24:54.719193+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:24:54.719193+0000","last_undegraded":"2024-05-08T09:24:54.719193+0000","last_fullsized":"2024-05-08T09:24:54.719193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.719066+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.377306+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":368,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.668777+0000","last_change":"2024-05-08T09:24:50.668807+0000","last_active":"2024-05-08T09:24:50.668777+0000","last_peered":"2024-05-08T09:24:50.668777+0000","last_clean":"2024-05-08T09:24:50.668777+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:50.668777+0000","last_undegraded":"2024-05-08T09:24:50.668777+0000","last_fullsized":"2024-05-08T09:24:50.668777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.668685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:49.401297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.916011+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:23:53.916011+0000","last_peered":"2024-05-08T09:23:53.916011+0000","last_clean":"2024-05-08T09:23:53.916011+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:23:53.916011+0000","last_undegraded":"2024-05-08T09:23:53.916011+0000","last_fullsized":"2024-05-08T09:23:53.916011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:37.544414+0000","last_change":"2024-05-08T09:21:30.958244+0000","last_active":"2024-05-08T09:23:37.544414+0000","last_peered":"2024-05-08T09:23:37.544414+0000","last_clean":"2024-05-08T09:23:37.544414+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:23:37.544414+0000","last_undegraded":"2024-05-08T09:23:37.544414+0000","last_fullsized":"2024-05-08T09:23:37.544414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905567+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:24:44.905567+0000","last_peered":"2024-05-08T09:24:44.905567+0000","last_clean":"2024-05-08T09:24:44.905567+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:24:44.905567+0000","last_undegraded":"2024-05-08T09:24:44.905567+0000","last_fullsized":"2024-05-08T09:24:44.905567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906465+0000","last_change":"2024-05-08T09:21:20.673116+0000","last_active":"2024-05-08T09:23:28.906465+0000","last_peered":"2024-05-08T09:23:28.906465+0000","last_clean":"2024-05-08T09:23:28.906465+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:23:28.906465+0000","last_undegraded":"2024-05-08T09:23:28.906465+0000","last_fullsized":"2024-05-08T09:23:28.906465+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.073152+0000","last_change":"2024-05-08T09:24:57.073177+0000","last_active":"2024-05-08T09:24:57.073152+0000","last_peered":"2024-05-08T09:24:57.073152+0000","last_clean":"2024-05-08T09:24:57.073152+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:24:57.073152+0000","last_undegraded":"2024-05-08T09:24:57.073152+0000","last_fullsized":"2024-05-08T09:24:57.073152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.073058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:35.322368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.226003+0000","last_change":"2024-05-08T09:25:23.226059+0000","last_active":"2024-05-08T09:25:23.226003+0000","last_peered":"2024-05-08T09:25:23.226003+0000","last_clean":"2024-05-08T09:25:23.226003+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:25:23.226003+0000","last_undegraded":"2024-05-08T09:25:23.226003+0000","last_fullsized":"2024-05-08T09:25:23.226003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.225893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:55.821357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.762542+0000","last_change":"2024-05-08T09:24:53.762592+0000","last_active":"2024-05-08T09:24:53.762542+0000","last_peered":"2024-05-08T09:24:53.762542+0000","last_clean":"2024-05-08T09:24:53.762542+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:53.762542+0000","last_undegraded":"2024-05-08T09:24:53.762542+0000","last_fullsized":"2024-05-08T09:24:53.762542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.762413+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:17.292293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.728980+0000","last_change":"2024-05-08T09:25:00.729008+0000","last_active":"2024-05-08T09:25:00.728980+0000","last_peered":"2024-05-08T09:25:00.728980+0000","last_clean":"2024-05-08T09:25:00.728980+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:25:00.728980+0000","last_undegraded":"2024-05-08T09:25:00.728980+0000","last_fullsized":"2024-05-08T09:25:00.728980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.728878+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:46.558237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'16","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.273858+0000","last_change":"2024-05-08T09:25:23.273892+0000","last_active":"2024-05-08T09:25:23.273858+0000","last_peered":"2024-05-08T09:25:23.273858+0000","last_clean":"2024-05-08T09:25:23.273858+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:25:23.273858+0000","last_undegraded":"2024-05-08T09:25:23.273858+0000","last_fullsized":"2024-05-08T09:25:23.273858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.273754+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:57.512051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912787+0000","last_change":"2024-05-08T09:21:28.974644+0000","last_active":"2024-05-08T09:23:38.912787+0000","last_peered":"2024-05-08T09:23:38.912787+0000","last_clean":"2024-05-08T09:23:38.912787+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:23:38.912787+0000","last_undegraded":"2024-05-08T09:23:38.912787+0000","last_fullsized":"2024-05-08T09:23:38.912787+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912336+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:23:33.912336+0000","last_peered":"2024-05-08T09:23:33.912336+0000","last_clean":"2024-05-08T09:23:33.912336+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:23:33.912336+0000","last_undegraded":"2024-05-08T09:23:33.912336+0000","last_fullsized":"2024-05-08T09:23:33.912336+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.067112+0000","last_change":"2024-05-08T09:25:00.067152+0000","last_active":"2024-05-08T09:25:00.067112+0000","last_peered":"2024-05-08T09:25:00.067112+0000","last_clean":"2024-05-08T09:25:00.067112+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:25:00.067112+0000","last_undegraded":"2024-05-08T09:25:00.067112+0000","last_fullsized":"2024-05-08T09:25:00.067112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.067020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:54.239410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.290063+0000","last_change":"2024-05-08T09:24:56.290105+0000","last_active":"2024-05-08T09:24:56.290063+0000","last_peered":"2024-05-08T09:24:56.290063+0000","last_clean":"2024-05-08T09:24:56.290063+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:24:56.290063+0000","last_undegraded":"2024-05-08T09:24:56.290063+0000","last_fullsized":"2024-05-08T09:24:56.290063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.289983+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:24.762692+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.755647+0000","last_change":"2024-05-08T09:24:52.755671+0000","last_active":"2024-05-08T09:24:52.755647+0000","last_peered":"2024-05-08T09:24:52.755647+0000","last_clean":"2024-05-08T09:24:52.755647+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:24:52.755647+0000","last_undegraded":"2024-05-08T09:24:52.755647+0000","last_fullsized":"2024-05-08T09:24:52.755647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.755558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:37:21.018669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915330+0000","last_change":"2024-05-08T09:21:38.972925+0000","last_active":"2024-05-08T09:23:53.915330+0000","last_peered":"2024-05-08T09:23:53.915330+0000","last_clean":"2024-05-08T09:23:53.915330+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:23:53.915330+0000","last_undegraded":"2024-05-08T09:23:53.915330+0000","last_fullsized":"2024-05-08T09:23:53.915330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913760+0000","last_change":"2024-05-08T09:21:38.980418+0000","last_active":"2024-05-08T09:23:43.913760+0000","last_peered":"2024-05-08T09:23:43.913760+0000","last_clean":"2024-05-08T09:23:43.913760+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:23:43.913760+0000","last_undegraded":"2024-05-08T09:23:43.913760+0000","last_fullsized":"2024-05-08T09:23:43.913760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.264300+0000","last_change":"2024-05-08T09:25:10.264323+0000","last_active":"2024-05-08T09:25:10.264300+0000","last_peered":"2024-05-08T09:25:10.264300+0000","last_clean":"2024-05-08T09:25:10.264300+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:25:10.264300+0000","last_undegraded":"2024-05-08T09:25:10.264300+0000","last_fullsized":"2024-05-08T09:25:10.264300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.264214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:56.672907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915038+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:23:48.915038+0000","last_peered":"2024-05-08T09:23:48.915038+0000","last_clean":"2024-05-08T09:23:48.915038+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:23:48.915038+0000","last_undegraded":"2024-05-08T09:23:48.915038+0000","last_fullsized":"2024-05-08T09:23:48.915038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.738977+0000","last_change":"2024-05-08T09:25:03.739001+0000","last_active":"2024-05-08T09:25:03.738977+0000","last_peered":"2024-05-08T09:25:03.738977+0000","last_clean":"2024-05-08T09:25:03.738977+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:25:03.738977+0000","last_undegraded":"2024-05-08T09:25:03.738977+0000","last_fullsized":"2024-05-08T09:25:03.738977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.738886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:20.106720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.129955+0000","last_change":"2024-05-08T09:25:10.129988+0000","last_active":"2024-05-08T09:25:10.129955+0000","last_peered":"2024-05-08T09:25:10.129955+0000","last_clean":"2024-05-08T09:25:10.129955+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:25:10.129955+0000","last_undegraded":"2024-05-08T09:25:10.129955+0000","last_fullsized":"2024-05-08T09:25:10.129955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.129867+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:03.675404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916587+0000","last_change":"2024-05-08T09:21:36.985659+0000","last_active":"2024-05-08T09:23:58.916587+0000","last_peered":"2024-05-08T09:23:58.916587+0000","last_clean":"2024-05-08T09:23:58.916587+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:23:58.916587+0000","last_undegraded":"2024-05-08T09:23:58.916587+0000","last_fullsized":"2024-05-08T09:23:58.916587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:35.947500+0000","last_clean_scrub_stamp":"2024-05-08T09:21:35.947500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":24,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.038949+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:38.038949+0000","last_peered":"2024-05-08T09:24:38.038949+0000","last_clean":"2024-05-08T09:24:38.038949+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:38.038949+0000","last_undegraded":"2024-05-08T09:24:38.038949+0000","last_fullsized":"2024-05-08T09:24:38.038949+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247038+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.247038+0000","last_peered":"2024-05-08T09:24:38.247038+0000","last_clean":"2024-05-08T09:24:38.247038+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.247038+0000","last_undegraded":"2024-05-08T09:24:38.247038+0000","last_fullsized":"2024-05-08T09:24:38.247038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.324870+0000","last_change":"2024-05-08T09:25:16.324894+0000","last_active":"2024-05-08T09:25:16.324870+0000","last_peered":"2024-05-08T09:25:16.324870+0000","last_clean":"2024-05-08T09:25:16.324870+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:25:16.324870+0000","last_undegraded":"2024-05-08T09:25:16.324870+0000","last_fullsized":"2024-05-08T09:25:16.324870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.324762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:07.345651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.092621+0000","last_change":"2024-05-08T09:24:59.092649+0000","last_active":"2024-05-08T09:24:59.092621+0000","last_peered":"2024-05-08T09:24:59.092621+0000","last_clean":"2024-05-08T09:24:59.092621+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:24:59.092621+0000","last_undegraded":"2024-05-08T09:24:59.092621+0000","last_fullsized":"2024-05-08T09:24:59.092621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.092531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:16.893025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.726480+0000","last_change":"2024-05-08T09:25:01.726515+0000","last_active":"2024-05-08T09:25:01.726480+0000","last_peered":"2024-05-08T09:25:01.726480+0000","last_clean":"2024-05-08T09:25:01.726480+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:25:01.726480+0000","last_undegraded":"2024-05-08T09:25:01.726480+0000","last_fullsized":"2024-05-08T09:25:01.726480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.726389+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:39.682934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.262975+0000","last_change":"2024-05-08T09:24:50.262998+0000","last_active":"2024-05-08T09:24:50.262975+0000","last_peered":"2024-05-08T09:24:50.262975+0000","last_clean":"2024-05-08T09:24:50.262975+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:24:50.262975+0000","last_undegraded":"2024-05-08T09:24:50.262975+0000","last_fullsized":"2024-05-08T09:24:50.262975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.262889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:10.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.912760+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:24:08.912760+0000","last_peered":"2024-05-08T09:24:08.912760+0000","last_clean":"2024-05-08T09:24:08.912760+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:24:08.912760+0000","last_undegraded":"2024-05-08T09:24:08.912760+0000","last_fullsized":"2024-05-08T09:24:08.912760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.877397+0000","last_change":"2024-05-08T09:25:14.877426+0000","last_active":"2024-05-08T09:25:14.877397+0000","last_peered":"2024-05-08T09:25:14.877397+0000","last_clean":"2024-05-08T09:25:14.877397+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:25:14.877397+0000","last_undegraded":"2024-05-08T09:25:14.877397+0000","last_fullsized":"2024-05-08T09:25:14.877397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.877308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:53.126619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915353+0000","last_change":"2024-05-08T09:21:28.969540+0000","last_active":"2024-05-08T09:23:53.915353+0000","last_peered":"2024-05-08T09:23:53.915353+0000","last_clean":"2024-05-08T09:23:53.915353+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:23:53.915353+0000","last_undegraded":"2024-05-08T09:23:53.915353+0000","last_fullsized":"2024-05-08T09:23:53.915353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.328695+0000","last_change":"2024-05-08T09:25:06.328721+0000","last_active":"2024-05-08T09:25:06.328695+0000","last_peered":"2024-05-08T09:25:06.328695+0000","last_clean":"2024-05-08T09:25:06.328695+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:25:06.328695+0000","last_undegraded":"2024-05-08T09:25:06.328695+0000","last_fullsized":"2024-05-08T09:25:06.328695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.328595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:24.990182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.742554+0000","last_change":"2024-05-08T09:24:54.742594+0000","last_active":"2024-05-08T09:24:54.742554+0000","last_peered":"2024-05-08T09:24:54.742554+0000","last_clean":"2024-05-08T09:24:54.742554+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:54.742554+0000","last_undegraded":"2024-05-08T09:24:54.742554+0000","last_fullsized":"2024-05-08T09:24:54.742554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.742456+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:50.767894+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.658943+0000","last_change":"2024-05-08T09:24:51.658969+0000","last_active":"2024-05-08T09:24:51.658943+0000","last_peered":"2024-05-08T09:24:51.658943+0000","last_clean":"2024-05-08T09:24:51.658943+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:24:51.658943+0000","last_undegraded":"2024-05-08T09:24:51.658943+0000","last_fullsized":"2024-05-08T09:24:51.658943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.658847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:21:59.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.918541+0000","last_change":"2024-05-08T09:21:38.976480+0000","last_active":"2024-05-08T09:24:08.918541+0000","last_peered":"2024-05-08T09:24:08.918541+0000","last_clean":"2024-05-08T09:24:08.918541+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:24:08.918541+0000","last_undegraded":"2024-05-08T09:24:08.918541+0000","last_fullsized":"2024-05-08T09:24:08.918541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.922201+0000","last_change":"2024-05-08T09:22:16.007584+0000","last_active":"2024-05-08T09:24:38.922201+0000","last_peered":"2024-05-08T09:24:38.922201+0000","last_clean":"2024-05-08T09:24:38.922201+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:24:38.922201+0000","last_undegraded":"2024-05-08T09:24:38.922201+0000","last_fullsized":"2024-05-08T09:24:38.922201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.759058+0000","last_change":"2024-05-08T09:25:23.759086+0000","last_active":"2024-05-08T09:25:23.759058+0000","last_peered":"2024-05-08T09:25:23.759058+0000","last_clean":"2024-05-08T09:25:23.759058+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:25:23.759058+0000","last_undegraded":"2024-05-08T09:25:23.759058+0000","last_fullsized":"2024-05-08T09:25:23.759058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.758963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:56.200915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.045028+0000","last_change":"2024-05-08T09:24:55.045049+0000","last_active":"2024-05-08T09:24:55.045028+0000","last_peered":"2024-05-08T09:24:55.045028+0000","last_clean":"2024-05-08T09:24:55.045028+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:24:55.045028+0000","last_undegraded":"2024-05-08T09:24:55.045028+0000","last_fullsized":"2024-05-08T09:24:55.045028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.044956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:28.363607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.255638+0000","last_change":"2024-05-08T09:24:59.255686+0000","last_active":"2024-05-08T09:24:59.255638+0000","last_peered":"2024-05-08T09:24:59.255638+0000","last_clean":"2024-05-08T09:24:59.255638+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:24:59.255638+0000","last_undegraded":"2024-05-08T09:24:59.255638+0000","last_fullsized":"2024-05-08T09:24:59.255638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.255555+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:18:31.061439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.260222+0000","last_change":"2024-05-08T09:24:51.260245+0000","last_active":"2024-05-08T09:24:51.260222+0000","last_peered":"2024-05-08T09:24:51.260222+0000","last_clean":"2024-05-08T09:24:51.260222+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:24:51.260222+0000","last_undegraded":"2024-05-08T09:24:51.260222+0000","last_fullsized":"2024-05-08T09:24:51.260222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.260133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:11.715270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913349+0000","last_change":"2024-05-08T09:21:30.955082+0000","last_active":"2024-05-08T09:23:38.913349+0000","last_peered":"2024-05-08T09:23:38.913349+0000","last_clean":"2024-05-08T09:23:38.913349+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:23:38.913349+0000","last_undegraded":"2024-05-08T09:23:38.913349+0000","last_fullsized":"2024-05-08T09:23:38.913349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915688+0000","last_change":"2024-05-08T09:21:28.979212+0000","last_active":"2024-05-08T09:23:53.915688+0000","last_peered":"2024-05-08T09:23:53.915688+0000","last_clean":"2024-05-08T09:23:53.915688+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:23:53.915688+0000","last_undegraded":"2024-05-08T09:23:53.915688+0000","last_fullsized":"2024-05-08T09:23:53.915688+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.798674+0000","last_change":"2024-05-08T09:25:07.798715+0000","last_active":"2024-05-08T09:25:07.798674+0000","last_peered":"2024-05-08T09:25:07.798674+0000","last_clean":"2024-05-08T09:25:07.798674+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:25:07.798674+0000","last_undegraded":"2024-05-08T09:25:07.798674+0000","last_fullsized":"2024-05-08T09:25:07.798674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.798584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.402432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.736974+0000","last_change":"2024-05-08T09:24:58.737020+0000","last_active":"2024-05-08T09:24:58.736974+0000","last_peered":"2024-05-08T09:24:58.736974+0000","last_clean":"2024-05-08T09:24:58.736974+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:24:58.736974+0000","last_undegraded":"2024-05-08T09:24:58.736974+0000","last_fullsized":"2024-05-08T09:24:58.736974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.736875+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:49.606990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.304313+0000","last_change":"2024-05-08T09:24:52.304336+0000","last_active":"2024-05-08T09:24:52.304313+0000","last_peered":"2024-05-08T09:24:52.304313+0000","last_clean":"2024-05-08T09:24:52.304313+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:24:52.304313+0000","last_undegraded":"2024-05-08T09:24:52.304313+0000","last_fullsized":"2024-05-08T09:24:52.304313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.304223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:48.209866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.170794+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:38.170794+0000","last_peered":"2024-05-08T09:24:38.170794+0000","last_clean":"2024-05-08T09:24:38.170794+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:38.170794+0000","last_undegraded":"2024-05-08T09:24:38.170794+0000","last_fullsized":"2024-05-08T09:24:38.170794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.968800+0000","last_change":"2024-05-08T09:25:22.968858+0000","last_active":"2024-05-08T09:25:22.968800+0000","last_peered":"2024-05-08T09:25:22.968800+0000","last_clean":"2024-05-08T09:25:22.968800+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:25:22.968800+0000","last_undegraded":"2024-05-08T09:25:22.968800+0000","last_fullsized":"2024-05-08T09:25:22.968800+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.968709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:43.854555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905453+0000","last_change":"2024-05-08T09:21:28.966390+0000","last_active":"2024-05-08T09:24:44.905453+0000","last_peered":"2024-05-08T09:24:44.905453+0000","last_clean":"2024-05-08T09:24:44.905453+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:24:44.905453+0000","last_undegraded":"2024-05-08T09:24:44.905453+0000","last_fullsized":"2024-05-08T09:24:44.905453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.316280+0000","last_change":"2024-05-08T09:25:08.316305+0000","last_active":"2024-05-08T09:25:08.316280+0000","last_peered":"2024-05-08T09:25:08.316280+0000","last_clean":"2024-05-08T09:25:08.316280+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:25:08.316280+0000","last_undegraded":"2024-05-08T09:25:08.316280+0000","last_fullsized":"2024-05-08T09:25:08.316280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.316182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:36.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.028482+0000","last_change":"2024-05-08T09:25:04.028522+0000","last_active":"2024-05-08T09:25:04.028482+0000","last_peered":"2024-05-08T09:25:04.028482+0000","last_clean":"2024-05-08T09:25:04.028482+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:25:04.028482+0000","last_undegraded":"2024-05-08T09:25:04.028482+0000","last_fullsized":"2024-05-08T09:25:04.028482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.028381+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:37.084622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.696777+0000","last_change":"2024-05-08T09:24:52.696803+0000","last_active":"2024-05-08T09:24:52.696777+0000","last_peered":"2024-05-08T09:24:52.696777+0000","last_clean":"2024-05-08T09:24:52.696777+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:24:52.696777+0000","last_undegraded":"2024-05-08T09:24:52.696777+0000","last_fullsized":"2024-05-08T09:24:52.696777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.696677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:55.771440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916695+0000","last_change":"2024-05-08T09:21:38.978182+0000","last_active":"2024-05-08T09:23:58.916695+0000","last_peered":"2024-05-08T09:23:58.916695+0000","last_clean":"2024-05-08T09:23:58.916695+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:23:58.916695+0000","last_undegraded":"2024-05-08T09:23:58.916695+0000","last_fullsized":"2024-05-08T09:23:58.916695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.978022+0000","last_change":"2024-05-08T09:25:04.978073+0000","last_active":"2024-05-08T09:25:04.978022+0000","last_peered":"2024-05-08T09:25:04.978022+0000","last_clean":"2024-05-08T09:25:04.978022+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:25:04.978022+0000","last_undegraded":"2024-05-08T09:25:04.978022+0000","last_fullsized":"2024-05-08T09:25:04.978022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.977922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:25.863768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916185+0000","last_change":"2024-05-08T09:21:28.976244+0000","last_active":"2024-05-08T09:23:58.916185+0000","last_peered":"2024-05-08T09:23:58.916185+0000","last_clean":"2024-05-08T09:23:58.916185+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:23:58.916185+0000","last_undegraded":"2024-05-08T09:23:58.916185+0000","last_fullsized":"2024-05-08T09:23:58.916185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917029+0000","last_change":"2024-05-08T09:22:16.005426+0000","last_active":"2024-05-08T09:24:03.917029+0000","last_peered":"2024-05-08T09:24:03.917029+0000","last_clean":"2024-05-08T09:24:03.917029+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:24:03.917029+0000","last_undegraded":"2024-05-08T09:24:03.917029+0000","last_fullsized":"2024-05-08T09:24:03.917029+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'42","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.696183+0000","last_change":"2024-05-08T09:24:59.696268+0000","last_active":"2024-05-08T09:24:59.696183+0000","last_peered":"2024-05-08T09:24:59.696183+0000","last_clean":"2024-05-08T09:24:59.696183+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:24:59.696183+0000","last_undegraded":"2024-05-08T09:24:59.696183+0000","last_fullsized":"2024-05-08T09:24:59.696183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.696053+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:13:58.776407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.838386+0000","last_change":"2024-05-08T09:24:47.838408+0000","last_active":"2024-05-08T09:24:47.838386+0000","last_peered":"2024-05-08T09:24:47.838386+0000","last_clean":"2024-05-08T09:24:47.838386+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:24:47.838386+0000","last_undegraded":"2024-05-08T09:24:47.838386+0000","last_fullsized":"2024-05-08T09:24:47.838386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_clean_scrub_stamp":"2024-05-08T09:24:47.838309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:42.986914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350051+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.350051+0000","last_peered":"2024-05-08T09:24:38.350051+0000","last_clean":"2024-05-08T09:24:38.350051+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.350051+0000","last_undegraded":"2024-05-08T09:24:38.350051+0000","last_fullsized":"2024-05-08T09:24:38.350051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'1","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293958+0000","last_change":"2024-05-08T09:21:30.949433+0000","last_active":"2024-05-08T09:24:38.293958+0000","last_peered":"2024-05-08T09:24:38.293958+0000","last_clean":"2024-05-08T09:24:38.293958+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:24:38.293958+0000","last_undegraded":"2024-05-08T09:24:38.293958+0000","last_fullsized":"2024-05-08T09:24:38.293958+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916750+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:23:58.916750+0000","last_peered":"2024-05-08T09:23:58.916750+0000","last_clean":"2024-05-08T09:23:58.916750+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:23:58.916750+0000","last_undegraded":"2024-05-08T09:23:58.916750+0000","last_fullsized":"2024-05-08T09:23:58.916750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917137+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:24:03.917137+0000","last_peered":"2024-05-08T09:24:03.917137+0000","last_clean":"2024-05-08T09:24:03.917137+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:24:03.917137+0000","last_undegraded":"2024-05-08T09:24:03.917137+0000","last_fullsized":"2024-05-08T09:24:03.917137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.221033+0000","last_change":"2024-05-08T09:25:19.221077+0000","last_active":"2024-05-08T09:25:19.221033+0000","last_peered":"2024-05-08T09:25:19.221033+0000","last_clean":"2024-05-08T09:25:19.221033+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:25:19.221033+0000","last_undegraded":"2024-05-08T09:25:19.221033+0000","last_fullsized":"2024-05-08T09:25:19.221033+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.220927+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:19.461415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.309850+0000","last_change":"2024-05-08T09:25:01.309897+0000","last_active":"2024-05-08T09:25:01.309850+0000","last_peered":"2024-05-08T09:25:01.309850+0000","last_clean":"2024-05-08T09:25:01.309850+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:25:01.309850+0000","last_undegraded":"2024-05-08T09:25:01.309850+0000","last_fullsized":"2024-05-08T09:25:01.309850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.309733+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:23.863794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916533+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:23:58.916533+0000","last_peered":"2024-05-08T09:23:58.916533+0000","last_clean":"2024-05-08T09:23:58.916533+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:23:58.916533+0000","last_undegraded":"2024-05-08T09:23:58.916533+0000","last_fullsized":"2024-05-08T09:23:58.916533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.354967+0000","last_change":"2024-05-08T09:25:17.354994+0000","last_active":"2024-05-08T09:25:17.354967+0000","last_peered":"2024-05-08T09:25:17.354967+0000","last_clean":"2024-05-08T09:25:17.354967+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:25:17.354967+0000","last_undegraded":"2024-05-08T09:25:17.354967+0000","last_fullsized":"2024-05-08T09:25:17.354967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.354872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:43:36.638892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'6","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.907325+0000","last_change":"2024-05-08T09:21:28.966302+0000","last_active":"2024-05-08T09:24:44.907325+0000","last_peered":"2024-05-08T09:24:44.907325+0000","last_clean":"2024-05-08T09:24:44.907325+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:24:44.907325+0000","last_undegraded":"2024-05-08T09:24:44.907325+0000","last_fullsized":"2024-05-08T09:24:44.907325+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.708229+0000","last_change":"2024-05-08T09:25:02.708273+0000","last_active":"2024-05-08T09:25:02.708229+0000","last_peered":"2024-05-08T09:25:02.708229+0000","last_clean":"2024-05-08T09:25:02.708229+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:25:02.708229+0000","last_undegraded":"2024-05-08T09:25:02.708229+0000","last_fullsized":"2024-05-08T09:25:02.708229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.708109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:40.664654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.785230+0000","last_change":"2024-05-08T09:24:58.785302+0000","last_active":"2024-05-08T09:24:58.785230+0000","last_peered":"2024-05-08T09:24:58.785230+0000","last_clean":"2024-05-08T09:24:58.785230+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:58.785230+0000","last_undegraded":"2024-05-08T09:24:58.785230+0000","last_fullsized":"2024-05-08T09:24:58.785230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.785128+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:40.172817+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.715808+0000","last_change":"2024-05-08T09:25:00.715835+0000","last_active":"2024-05-08T09:25:00.715808+0000","last_peered":"2024-05-08T09:25:00.715808+0000","last_clean":"2024-05-08T09:25:00.715808+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:25:00.715808+0000","last_undegraded":"2024-05-08T09:25:00.715808+0000","last_fullsized":"2024-05-08T09:25:00.715808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.715715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.307803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917206+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:24:03.917206+0000","last_peered":"2024-05-08T09:24:03.917206+0000","last_clean":"2024-05-08T09:24:03.917206+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:24:03.917206+0000","last_undegraded":"2024-05-08T09:24:03.917206+0000","last_fullsized":"2024-05-08T09:24:03.917206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.293530+0000","last_change":"2024-05-08T09:25:12.293561+0000","last_active":"2024-05-08T09:25:12.293530+0000","last_peered":"2024-05-08T09:25:12.293530+0000","last_clean":"2024-05-08T09:25:12.293530+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:25:12.293530+0000","last_undegraded":"2024-05-08T09:25:12.293530+0000","last_fullsized":"2024-05-08T09:25:12.293530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.293425+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:22:06.522385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916866+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:23:58.916866+0000","last_peered":"2024-05-08T09:23:58.916866+0000","last_clean":"2024-05-08T09:23:58.916866+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:23:58.916866+0000","last_undegraded":"2024-05-08T09:23:58.916866+0000","last_fullsized":"2024-05-08T09:23:58.916866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.325599+0000","last_change":"2024-05-08T09:25:04.325623+0000","last_active":"2024-05-08T09:25:04.325599+0000","last_peered":"2024-05-08T09:25:04.325599+0000","last_clean":"2024-05-08T09:25:04.325599+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:25:04.325599+0000","last_undegraded":"2024-05-08T09:25:04.325599+0000","last_fullsized":"2024-05-08T09:25:04.325599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.325510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:21:04.445305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.725148+0000","last_change":"2024-05-08T09:24:55.725187+0000","last_active":"2024-05-08T09:24:55.725148+0000","last_peered":"2024-05-08T09:24:55.725148+0000","last_clean":"2024-05-08T09:24:55.725148+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:24:55.725148+0000","last_undegraded":"2024-05-08T09:24:55.725148+0000","last_fullsized":"2024-05-08T09:24:55.725148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.725057+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:11.134393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.242609+0000","last_change":"2024-05-08T09:25:13.242631+0000","last_active":"2024-05-08T09:25:13.242609+0000","last_peered":"2024-05-08T09:25:13.242609+0000","last_clean":"2024-05-08T09:25:13.242609+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:25:13.242609+0000","last_undegraded":"2024-05-08T09:25:13.242609+0000","last_fullsized":"2024-05-08T09:25:13.242609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.242515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:24.570077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917812+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:24:03.917812+0000","last_peered":"2024-05-08T09:24:03.917812+0000","last_clean":"2024-05-08T09:24:03.917812+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:24:03.917812+0000","last_undegraded":"2024-05-08T09:24:03.917812+0000","last_fullsized":"2024-05-08T09:24:03.917812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916636+0000","last_change":"2024-05-08T09:21:30.953662+0000","last_active":"2024-05-08T09:23:58.916636+0000","last_peered":"2024-05-08T09:23:58.916636+0000","last_clean":"2024-05-08T09:23:58.916636+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:23:58.916636+0000","last_undegraded":"2024-05-08T09:23:58.916636+0000","last_fullsized":"2024-05-08T09:23:58.916636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:28.906475+0000","last_change":"2024-05-08T09:21:28.957648+0000","last_active":"2024-05-08T09:23:28.906475+0000","last_peered":"2024-05-08T09:23:28.906475+0000","last_clean":"2024-05-08T09:23:28.906475+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:23:28.906475+0000","last_undegraded":"2024-05-08T09:23:28.906475+0000","last_fullsized":"2024-05-08T09:23:28.906475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.710549+0000","last_change":"2024-05-08T09:25:09.710589+0000","last_active":"2024-05-08T09:25:09.710549+0000","last_peered":"2024-05-08T09:25:09.710549+0000","last_clean":"2024-05-08T09:25:09.710549+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:25:09.710549+0000","last_undegraded":"2024-05-08T09:25:09.710549+0000","last_fullsized":"2024-05-08T09:25:09.710549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.710445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:39.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.024510+0000","last_change":"2024-05-08T09:25:06.024545+0000","last_active":"2024-05-08T09:25:06.024510+0000","last_peered":"2024-05-08T09:25:06.024510+0000","last_clean":"2024-05-08T09:25:06.024510+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:25:06.024510+0000","last_undegraded":"2024-05-08T09:25:06.024510+0000","last_fullsized":"2024-05-08T09:25:06.024510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.024416+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:05.508652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.219331+0000","last_change":"2024-05-08T09:25:12.219351+0000","last_active":"2024-05-08T09:25:12.219331+0000","last_peered":"2024-05-08T09:25:12.219331+0000","last_clean":"2024-05-08T09:25:12.219331+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:25:12.219331+0000","last_undegraded":"2024-05-08T09:25:12.219331+0000","last_fullsized":"2024-05-08T09:25:12.219331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.219227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:57.964012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917702+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:24:03.917702+0000","last_peered":"2024-05-08T09:24:03.917702+0000","last_clean":"2024-05-08T09:24:03.917702+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:24:03.917702+0000","last_undegraded":"2024-05-08T09:24:03.917702+0000","last_fullsized":"2024-05-08T09:24:03.917702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.291187+0000","last_change":"2024-05-08T09:25:11.291213+0000","last_active":"2024-05-08T09:25:11.291187+0000","last_peered":"2024-05-08T09:25:11.291187+0000","last_clean":"2024-05-08T09:25:11.291187+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:25:11.291187+0000","last_undegraded":"2024-05-08T09:25:11.291187+0000","last_fullsized":"2024-05-08T09:25:11.291187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.291068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:14:10.371422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.911966+0000","last_change":"2024-05-08T09:21:28.975926+0000","last_active":"2024-05-08T09:23:33.911966+0000","last_peered":"2024-05-08T09:23:33.911966+0000","last_clean":"2024-05-08T09:23:33.911966+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:23:33.911966+0000","last_undegraded":"2024-05-08T09:23:33.911966+0000","last_fullsized":"2024-05-08T09:23:33.911966+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.744081+0000","last_change":"2024-05-08T09:25:05.744126+0000","last_active":"2024-05-08T09:25:05.744081+0000","last_peered":"2024-05-08T09:25:05.744081+0000","last_clean":"2024-05-08T09:25:05.744081+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:25:05.744081+0000","last_undegraded":"2024-05-08T09:25:05.744081+0000","last_fullsized":"2024-05-08T09:25:05.744081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.743972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:56.764860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.247188+0000","last_change":"2024-05-08T09:25:21.247244+0000","last_active":"2024-05-08T09:25:21.247188+0000","last_peered":"2024-05-08T09:25:21.247188+0000","last_clean":"2024-05-08T09:25:21.247188+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:25:21.247188+0000","last_undegraded":"2024-05-08T09:25:21.247188+0000","last_fullsized":"2024-05-08T09:25:21.247188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.247063+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:06.940266+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.806517+0000","last_change":"2024-05-08T09:25:08.806540+0000","last_active":"2024-05-08T09:25:08.806517+0000","last_peered":"2024-05-08T09:25:08.806517+0000","last_clean":"2024-05-08T09:25:08.806517+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:25:08.806517+0000","last_undegraded":"2024-05-08T09:25:08.806517+0000","last_fullsized":"2024-05-08T09:25:08.806517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.806424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:38.700044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916792+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:58.916792+0000","last_peered":"2024-05-08T09:23:58.916792+0000","last_clean":"2024-05-08T09:23:58.916792+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:58.916792+0000","last_undegraded":"2024-05-08T09:23:58.916792+0000","last_fullsized":"2024-05-08T09:23:58.916792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.775219+0000","last_change":"2024-05-08T09:25:13.775263+0000","last_active":"2024-05-08T09:25:13.775219+0000","last_peered":"2024-05-08T09:25:13.775219+0000","last_clean":"2024-05-08T09:25:13.775219+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:25:13.775219+0000","last_undegraded":"2024-05-08T09:25:13.775219+0000","last_fullsized":"2024-05-08T09:25:13.775219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.775111+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:47.093763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.312992+0000","last_change":"2024-05-08T09:25:22.313018+0000","last_active":"2024-05-08T09:25:22.312992+0000","last_peered":"2024-05-08T09:25:22.312992+0000","last_clean":"2024-05-08T09:25:22.312992+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:25:22.312992+0000","last_undegraded":"2024-05-08T09:25:22.312992+0000","last_fullsized":"2024-05-08T09:25:22.312992+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.312893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:44.206369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037229+0000","last_change":"2024-05-08T09:21:30.949470+0000","last_active":"2024-05-08T09:24:38.037229+0000","last_peered":"2024-05-08T09:24:38.037229+0000","last_clean":"2024-05-08T09:24:38.037229+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:24:38.037229+0000","last_undegraded":"2024-05-08T09:24:38.037229+0000","last_fullsized":"2024-05-08T09:24:38.037229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907117+0000","last_change":"2024-05-08T09:21:28.961902+0000","last_active":"2024-05-08T09:23:33.907117+0000","last_peered":"2024-05-08T09:23:33.907117+0000","last_clean":"2024-05-08T09:23:33.907117+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:23:33.907117+0000","last_undegraded":"2024-05-08T09:23:33.907117+0000","last_fullsized":"2024-05-08T09:23:33.907117+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.095431+0000","last_change":"2024-05-08T09:25:08.095458+0000","last_active":"2024-05-08T09:25:08.095431+0000","last_peered":"2024-05-08T09:25:08.095431+0000","last_clean":"2024-05-08T09:25:08.095431+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:25:08.095431+0000","last_undegraded":"2024-05-08T09:25:08.095431+0000","last_fullsized":"2024-05-08T09:25:08.095431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.095295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:36.538089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.912151+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:23:33.912151+0000","last_peered":"2024-05-08T09:23:33.912151+0000","last_clean":"2024-05-08T09:23:33.912151+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:23:33.912151+0000","last_undegraded":"2024-05-08T09:23:33.912151+0000","last_fullsized":"2024-05-08T09:23:33.912151+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247246+0000","last_change":"2024-05-08T09:21:30.950068+0000","last_active":"2024-05-08T09:24:38.247246+0000","last_peered":"2024-05-08T09:24:38.247246+0000","last_clean":"2024-05-08T09:24:38.247246+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:24:38.247246+0000","last_undegraded":"2024-05-08T09:24:38.247246+0000","last_fullsized":"2024-05-08T09:24:38.247246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:33.907175+0000","last_change":"2024-05-08T09:21:28.961994+0000","last_active":"2024-05-08T09:23:33.907175+0000","last_peered":"2024-05-08T09:23:33.907175+0000","last_clean":"2024-05-08T09:23:33.907175+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:23:33.907175+0000","last_undegraded":"2024-05-08T09:23:33.907175+0000","last_fullsized":"2024-05-08T09:23:33.907175+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.864362+0000","last_change":"2024-05-08T09:25:15.864386+0000","last_active":"2024-05-08T09:25:15.864362+0000","last_peered":"2024-05-08T09:25:15.864362+0000","last_clean":"2024-05-08T09:25:15.864362+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:25:15.864362+0000","last_undegraded":"2024-05-08T09:25:15.864362+0000","last_fullsized":"2024-05-08T09:25:15.864362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.864275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:59.244834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908141+0000","last_change":"2024-05-08T09:21:28.949808+0000","last_active":"2024-05-08T09:23:38.908141+0000","last_peered":"2024-05-08T09:23:38.908141+0000","last_clean":"2024-05-08T09:23:38.908141+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:23:38.908141+0000","last_undegraded":"2024-05-08T09:23:38.908141+0000","last_fullsized":"2024-05-08T09:23:38.908141+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.793902+0000","last_change":"2024-05-08T09:25:14.793928+0000","last_active":"2024-05-08T09:25:14.793902+0000","last_peered":"2024-05-08T09:25:14.793902+0000","last_clean":"2024-05-08T09:25:14.793902+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:25:14.793902+0000","last_undegraded":"2024-05-08T09:25:14.793902+0000","last_fullsized":"2024-05-08T09:25:14.793902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.793800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:42.341391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.912753+0000","last_change":"2024-05-08T09:21:28.974287+0000","last_active":"2024-05-08T09:23:38.912753+0000","last_peered":"2024-05-08T09:23:38.912753+0000","last_clean":"2024-05-08T09:23:38.912753+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:23:38.912753+0000","last_undegraded":"2024-05-08T09:23:38.912753+0000","last_fullsized":"2024-05-08T09:23:38.912753+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.897337+0000","last_change":"2024-05-08T09:25:20.897362+0000","last_active":"2024-05-08T09:25:20.897337+0000","last_peered":"2024-05-08T09:25:20.897337+0000","last_clean":"2024-05-08T09:25:20.897337+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:25:20.897337+0000","last_undegraded":"2024-05-08T09:25:20.897337+0000","last_fullsized":"2024-05-08T09:25:20.897337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.897248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:45.128802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.310353+0000","last_change":"2024-05-08T09:25:20.310379+0000","last_active":"2024-05-08T09:25:20.310353+0000","last_peered":"2024-05-08T09:25:20.310353+0000","last_clean":"2024-05-08T09:25:20.310353+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:25:20.310353+0000","last_undegraded":"2024-05-08T09:25:20.310353+0000","last_fullsized":"2024-05-08T09:25:20.310353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.310253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:13:14.532102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'9","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.293920+0000","last_change":"2024-05-08T09:21:30.950090+0000","last_active":"2024-05-08T09:24:38.293920+0000","last_peered":"2024-05-08T09:24:38.293920+0000","last_clean":"2024-05-08T09:24:38.293920+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:24:38.293920+0000","last_undegraded":"2024-05-08T09:24:38.293920+0000","last_fullsized":"2024-05-08T09:24:38.293920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.908227+0000","last_change":"2024-05-08T09:21:28.954198+0000","last_active":"2024-05-08T09:23:38.908227+0000","last_peered":"2024-05-08T09:23:38.908227+0000","last_clean":"2024-05-08T09:23:38.908227+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:23:38.908227+0000","last_undegraded":"2024-05-08T09:23:38.908227+0000","last_fullsized":"2024-05-08T09:23:38.908227+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037247+0000","last_change":"2024-05-08T09:21:30.946395+0000","last_active":"2024-05-08T09:24:38.037247+0000","last_peered":"2024-05-08T09:24:38.037247+0000","last_clean":"2024-05-08T09:24:38.037247+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:24:38.037247+0000","last_undegraded":"2024-05-08T09:24:38.037247+0000","last_fullsized":"2024-05-08T09:24:38.037247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913019+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:38.913019+0000","last_peered":"2024-05-08T09:23:38.913019+0000","last_clean":"2024-05-08T09:23:38.913019+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:38.913019+0000","last_undegraded":"2024-05-08T09:23:38.913019+0000","last_fullsized":"2024-05-08T09:23:38.913019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.915990+0000","last_change":"2024-05-08T09:21:30.957737+0000","last_active":"2024-05-08T09:23:53.915990+0000","last_peered":"2024-05-08T09:23:53.915990+0000","last_clean":"2024-05-08T09:23:53.915990+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:23:53.915990+0000","last_undegraded":"2024-05-08T09:23:53.915990+0000","last_fullsized":"2024-05-08T09:23:53.915990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.909013+0000","last_change":"2024-05-08T09:21:28.961345+0000","last_active":"2024-05-08T09:23:43.909013+0000","last_peered":"2024-05-08T09:23:43.909013+0000","last_clean":"2024-05-08T09:23:43.909013+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:23:43.909013+0000","last_undegraded":"2024-05-08T09:23:43.909013+0000","last_fullsized":"2024-05-08T09:23:43.909013+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.880687+0000","last_change":"2024-05-08T09:25:17.880714+0000","last_active":"2024-05-08T09:25:17.880687+0000","last_peered":"2024-05-08T09:25:17.880687+0000","last_clean":"2024-05-08T09:25:17.880687+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:25:17.880687+0000","last_undegraded":"2024-05-08T09:25:17.880687+0000","last_fullsized":"2024-05-08T09:25:17.880687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.880592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.052981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.907459+0000","last_change":"2024-05-08T09:21:28.973921+0000","last_active":"2024-05-08T09:24:44.907459+0000","last_peered":"2024-05-08T09:24:44.907459+0000","last_clean":"2024-05-08T09:24:44.907459+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:24:44.907459+0000","last_undegraded":"2024-05-08T09:24:44.907459+0000","last_fullsized":"2024-05-08T09:24:44.907459+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.831492+0000","last_change":"2024-05-08T09:25:20.831519+0000","last_active":"2024-05-08T09:25:20.831492+0000","last_peered":"2024-05-08T09:25:20.831492+0000","last_clean":"2024-05-08T09:25:20.831492+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:25:20.831492+0000","last_undegraded":"2024-05-08T09:25:20.831492+0000","last_fullsized":"2024-05-08T09:25:20.831492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.831407+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:00:36.603443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:37.928679+0000","last_change":"2024-05-08T09:21:28.974531+0000","last_active":"2024-05-08T09:24:37.928679+0000","last_peered":"2024-05-08T09:24:37.928679+0000","last_clean":"2024-05-08T09:24:37.928679+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:24:37.928679+0000","last_undegraded":"2024-05-08T09:24:37.928679+0000","last_fullsized":"2024-05-08T09:24:37.928679+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.215666+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.215666+0000","last_peered":"2024-05-08T09:24:38.215666+0000","last_clean":"2024-05-08T09:24:38.215666+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.215666+0000","last_undegraded":"2024-05-08T09:24:38.215666+0000","last_fullsized":"2024-05-08T09:24:38.215666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914086+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:23:43.914086+0000","last_peered":"2024-05-08T09:23:43.914086+0000","last_clean":"2024-05-08T09:23:43.914086+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:23:43.914086+0000","last_undegraded":"2024-05-08T09:23:43.914086+0000","last_fullsized":"2024-05-08T09:23:43.914086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.037258+0000","last_change":"2024-05-08T09:21:30.947207+0000","last_active":"2024-05-08T09:24:38.037258+0000","last_peered":"2024-05-08T09:24:38.037258+0000","last_clean":"2024-05-08T09:24:38.037258+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:24:38.037258+0000","last_undegraded":"2024-05-08T09:24:38.037258+0000","last_fullsized":"2024-05-08T09:24:38.037258+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905558+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:24:44.905558+0000","last_peered":"2024-05-08T09:24:44.905558+0000","last_clean":"2024-05-08T09:24:44.905558+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:24:44.905558+0000","last_undegraded":"2024-05-08T09:24:44.905558+0000","last_fullsized":"2024-05-08T09:24:44.905558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914916+0000","last_change":"2024-05-08T09:21:30.953899+0000","last_active":"2024-05-08T09:23:48.914916+0000","last_peered":"2024-05-08T09:23:48.914916+0000","last_clean":"2024-05-08T09:23:48.914916+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:23:48.914916+0000","last_undegraded":"2024-05-08T09:23:48.914916+0000","last_fullsized":"2024-05-08T09:23:48.914916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.162636+0000","last_change":"2024-05-08T09:21:28.967998+0000","last_active":"2024-05-08T09:24:38.162636+0000","last_peered":"2024-05-08T09:24:38.162636+0000","last_clean":"2024-05-08T09:24:38.162636+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:24:38.162636+0000","last_undegraded":"2024-05-08T09:24:38.162636+0000","last_fullsized":"2024-05-08T09:24:38.162636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.173155+0000","last_change":"2024-05-08T09:21:30.950968+0000","last_active":"2024-05-08T09:24:38.173155+0000","last_peered":"2024-05-08T09:24:38.173155+0000","last_clean":"2024-05-08T09:24:38.173155+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:24:38.173155+0000","last_undegraded":"2024-05-08T09:24:38.173155+0000","last_fullsized":"2024-05-08T09:24:38.173155+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915137+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:23:48.915137+0000","last_peered":"2024-05-08T09:23:48.915137+0000","last_clean":"2024-05-08T09:23:48.915137+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:23:48.915137+0000","last_undegraded":"2024-05-08T09:23:48.915137+0000","last_fullsized":"2024-05-08T09:23:48.915137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158005+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.158005+0000","last_peered":"2024-05-08T09:24:38.158005+0000","last_clean":"2024-05-08T09:24:38.158005+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.158005+0000","last_undegraded":"2024-05-08T09:24:38.158005+0000","last_fullsized":"2024-05-08T09:24:38.158005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.911417+0000","last_change":"2024-05-08T09:21:30.948843+0000","last_active":"2024-05-08T09:23:58.911417+0000","last_peered":"2024-05-08T09:23:58.911417+0000","last_clean":"2024-05-08T09:23:58.911417+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:23:58.911417+0000","last_undegraded":"2024-05-08T09:23:58.911417+0000","last_fullsized":"2024-05-08T09:23:58.911417+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909843+0000","last_change":"2024-05-08T09:21:28.961838+0000","last_active":"2024-05-08T09:23:48.909843+0000","last_peered":"2024-05-08T09:23:48.909843+0000","last_clean":"2024-05-08T09:23:48.909843+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:23:48.909843+0000","last_undegraded":"2024-05-08T09:23:48.909843+0000","last_fullsized":"2024-05-08T09:23:48.909843+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294011+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.294011+0000","last_peered":"2024-05-08T09:24:38.294011+0000","last_clean":"2024-05-08T09:24:38.294011+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.294011+0000","last_undegraded":"2024-05-08T09:24:38.294011+0000","last_fullsized":"2024-05-08T09:24:38.294011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":478,"ondisk_log_size":478,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705717,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705716,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":962560,"data_stored":723288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705716,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36312,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335528,"statfs":{"total":96636764160,"available":96599580672,"internally_reserved":0,"allocated":999424,"data_stored":725474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705717,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:25:30.319 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.319 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.319 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.319 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.319 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.320 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.321 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.322 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.323 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.324 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.325 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.326 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.327 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.327 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.327 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.327 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.327 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.328 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-05-08T09:21:35.947500+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=35, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.329 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.330 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.331 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.332 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.333 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.334 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.335 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.336 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:30.336 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T09:25:50.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.454+0000 7f08fa938640 1 Processor -- start 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.454+0000 7f08fa938640 1 -- start start 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08fa938640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08f412c5b0 0x7f08f412c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08fa938640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08f4113dd0 con 0x7f08f412ced0 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08fa938640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f08f4072290 con 0x7f08f412c5b0 2024-05-08T09:25:50.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08f3fff640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08f412c5b0 0x7f08f412c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08f37fe640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08f412ced0 0x7f08f406e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39150/0 (socket says 172.21.15.45:39150) 2024-05-08T09:25:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08f37fe640 1 -- 172.21.15.45:0/1434609190 learned_addr learned my addr 172.21.15.45:0/1434609190 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:25:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08f3fff640 1 -- 172.21.15.45:0/1434609190 >> v1:172.21.15.45:6789/0 conn(0x7f08f412ced0 legacy=0x7f08f406e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.455+0000 7f08f3fff640 1 -- 172.21.15.45:0/1434609190 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f412c390 con 0x7f08f412c5b0 2024-05-08T09:25:50.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.456+0000 7f08f3fff640 1 --2- 172.21.15.45:0/1434609190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f412c990 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668fcc713b309d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.456+0000 7f08f2ffd640 1 -- 172.21.15.45:0/1434609190 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e40316d0 con 0x7f08f412c5b0 2024-05-08T09:25:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.456+0000 7f08f2ffd640 1 -- 172.21.15.45:0/1434609190 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4037070 con 0x7f08f412c5b0 2024-05-08T09:25:50.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.456+0000 7f08f2ffd640 1 -- 172.21.15.45:0/1434609190 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e40319c0 con 0x7f08f412c5b0 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 -- 172.21.15.45:0/1434609190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 msgr2=0x7f08f412c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 --2- 172.21.15.45:0/1434609190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f412c990 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e402b840 comp rx=0 tx=0).stop 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 -- 172.21.15.45:0/1434609190 shutdown_connections 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 --2- 172.21.15.45:0/1434609190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f412c990 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 -- 172.21.15.45:0/1434609190 >> 172.21.15.45:0/1434609190 conn(0x7f08f4099380 msgr2=0x7f08f4099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 -- 172.21.15.45:0/1434609190 shutdown_connections 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 -- 172.21.15.45:0/1434609190 wait complete. 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.457+0000 7f08fa938640 1 Processor -- start 2024-05-08T09:25:50.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08fa938640 1 -- start start 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08fa938640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08fa938640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f08f4113b10 con 0x7f08f412c5b0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08f3fff640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44666/0 (socket says 172.21.15.45:44666) 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.458+0000 7f08f3fff640 1 -- 172.21.15.45:0/3126476422 learned_addr learned my addr 172.21.15.45:0/3126476422 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08f3fff640 1 -- 172.21.15.45:0/3126476422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f4118a00 con 0x7f08f412c5b0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08f3fff640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e4032770 con 0x7f08f412c5b0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e4032910 con 0x7f08f412c5b0 2024-05-08T09:25:50.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f412b650 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f08e4032bf0 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.459+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f4119870 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.460+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f08e403b3f0 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.460+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f4062e90 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.460+0000 7f08f0ff9640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 0x7f08e003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.460+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f08e402f050 con 0x7f08f412c5b0 2024-05-08T09:25:50.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.460+0000 7f08f37fe640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 0x7f08e003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:25:50.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.461+0000 7f08f37fe640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 0x7f08e003a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007fd0 tx=0x7f08e8007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:25:50.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.465+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f08f4119870 con 0x7f08f412c5b0 2024-05-08T09:25:50.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.644+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08f411a1a0 con 0x7f08e0038060 2024-05-08T09:25:50.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.659+0000 7f08f0ff9640 1 -- 172.21.15.45:0/3126476422 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+664566 (secure 0 0 0) 0x7f08f411a1a0 con 0x7f08e0038060 2024-05-08T09:25:50.666 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:25:50.671 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 msgr2=0x7f08e003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 0x7f08e003a520 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08e8007fd0 tx=0x7f08e8007ac0 comp rx=0 tx=0).stop 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 msgr2=0x7f08f41c13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009720 tx=0x7f08e40046c0 comp rx=0 tx=0).stop 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 shutdown_connections 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f08e0038060 0x7f08e003a520 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:50.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 --2- 172.21.15.45:0/3126476422 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08f412c5b0 0x7f08f41c13b0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:25:50.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 >> 172.21.15.45:0/3126476422 conn(0x7f08f4099380 msgr2=0x7f08f409b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:25:50.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 shutdown_connections 2024-05-08T09:25:50.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:25:50.664+0000 7f08fa938640 1 -- 172.21.15.45:0/3126476422 wait complete. 2024-05-08T09:25:50.675 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-05-08T09:25:48.915378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5100,"num_read_kb":4681,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4777,"ondisk_log_size":4777,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1719982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.351112+0000","last_change":"2024-05-08T09:25:32.351112+0000","last_active":"2024-05-08T09:25:32.351112+0000","last_peered":"2024-05-08T09:25:32.351112+0000","last_clean":"2024-05-08T09:25:32.351112+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:25:32.351112+0000","last_undegraded":"2024-05-08T09:25:32.351112+0000","last_fullsized":"2024-05-08T09:25:32.351112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.350996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:31.978723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.758284+0000","last_change":"2024-05-08T09:25:32.758312+0000","last_active":"2024-05-08T09:25:32.758284+0000","last_peered":"2024-05-08T09:25:32.758284+0000","last_clean":"2024-05-08T09:25:32.758284+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:25:32.758284+0000","last_undegraded":"2024-05-08T09:25:32.758284+0000","last_fullsized":"2024-05-08T09:25:32.758284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.758203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:23.449919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.057033+0000","last_change":"2024-05-08T09:25:41.057108+0000","last_active":"2024-05-08T09:25:41.057033+0000","last_peered":"2024-05-08T09:25:41.057033+0000","last_clean":"2024-05-08T09:25:41.057033+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:25:41.057033+0000","last_undegraded":"2024-05-08T09:25:41.057033+0000","last_fullsized":"2024-05-08T09:25:41.057033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.056917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:01:13.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.164166+0000","last_change":"2024-05-08T09:25:25.164192+0000","last_active":"2024-05-08T09:25:25.164166+0000","last_peered":"2024-05-08T09:25:25.164166+0000","last_clean":"2024-05-08T09:25:25.164166+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:25:25.164166+0000","last_undegraded":"2024-05-08T09:25:25.164166+0000","last_fullsized":"2024-05-08T09:25:25.164166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.164078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:10.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178918+0000","last_change":"2024-05-08T09:21:28.969512+0000","last_active":"2024-05-08T09:24:49.178918+0000","last_peered":"2024-05-08T09:24:49.178918+0000","last_clean":"2024-05-08T09:24:49.178918+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:24:49.178918+0000","last_undegraded":"2024-05-08T09:24:49.178918+0000","last_fullsized":"2024-05-08T09:24:49.178918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.172663+0000","last_change":"2024-05-08T09:25:11.172689+0000","last_active":"2024-05-08T09:25:11.172663+0000","last_peered":"2024-05-08T09:25:11.172663+0000","last_clean":"2024-05-08T09:25:11.172663+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:25:11.172663+0000","last_undegraded":"2024-05-08T09:25:11.172663+0000","last_fullsized":"2024-05-08T09:25:11.172663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.172569+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:37.984066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.262678+0000","last_change":"2024-05-08T09:25:24.262678+0000","last_active":"2024-05-08T09:25:24.262678+0000","last_peered":"2024-05-08T09:25:24.262678+0000","last_clean":"2024-05-08T09:25:24.262678+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:25:24.262678+0000","last_undegraded":"2024-05-08T09:25:24.262678+0000","last_fullsized":"2024-05-08T09:25:24.262678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.262520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.902721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.201206+0000","last_change":"2024-05-08T09:25:32.201233+0000","last_active":"2024-05-08T09:25:32.201206+0000","last_peered":"2024-05-08T09:25:32.201206+0000","last_clean":"2024-05-08T09:25:32.201206+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:25:32.201206+0000","last_undegraded":"2024-05-08T09:25:32.201206+0000","last_fullsized":"2024-05-08T09:25:32.201206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.201119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:56.962461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916767+0000","last_change":"2024-05-08T09:21:28.966172+0000","last_active":"2024-05-08T09:23:58.916767+0000","last_peered":"2024-05-08T09:23:58.916767+0000","last_clean":"2024-05-08T09:23:58.916767+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:23:58.916767+0000","last_undegraded":"2024-05-08T09:23:58.916767+0000","last_fullsized":"2024-05-08T09:23:58.916767+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.826663+0000","last_change":"2024-05-08T09:25:18.826663+0000","last_active":"2024-05-08T09:25:18.826663+0000","last_peered":"2024-05-08T09:25:18.826663+0000","last_clean":"2024-05-08T09:25:18.826663+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:25:18.826663+0000","last_undegraded":"2024-05-08T09:25:18.826663+0000","last_fullsized":"2024-05-08T09:25:18.826663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.826549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.998939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.333479+0000","last_change":"2024-05-08T09:25:28.333560+0000","last_active":"2024-05-08T09:25:28.333479+0000","last_peered":"2024-05-08T09:25:28.333479+0000","last_clean":"2024-05-08T09:25:28.333479+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:25:28.333479+0000","last_undegraded":"2024-05-08T09:25:28.333479+0000","last_fullsized":"2024-05-08T09:25:28.333479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.333344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:11.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.114273+0000","last_change":"2024-05-08T09:25:09.114273+0000","last_active":"2024-05-08T09:25:09.114273+0000","last_peered":"2024-05-08T09:25:09.114273+0000","last_clean":"2024-05-08T09:25:09.114273+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:25:09.114273+0000","last_undegraded":"2024-05-08T09:25:09.114273+0000","last_fullsized":"2024-05-08T09:25:09.114273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.114110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:02.470835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916673+0000","last_change":"2024-05-08T09:21:28.967358+0000","last_active":"2024-05-08T09:23:58.916673+0000","last_peered":"2024-05-08T09:23:58.916673+0000","last_clean":"2024-05-08T09:23:58.916673+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:23:58.916673+0000","last_undegraded":"2024-05-08T09:23:58.916673+0000","last_fullsized":"2024-05-08T09:23:58.916673+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.316558+0000","last_change":"2024-05-08T09:25:13.316558+0000","last_active":"2024-05-08T09:25:13.316558+0000","last_peered":"2024-05-08T09:25:13.316558+0000","last_clean":"2024-05-08T09:25:13.316558+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:25:13.316558+0000","last_undegraded":"2024-05-08T09:25:13.316558+0000","last_fullsized":"2024-05-08T09:25:13.316558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.316411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:51.272956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.931019+0000","last_change":"2024-05-08T09:25:21.931062+0000","last_active":"2024-05-08T09:25:21.931019+0000","last_peered":"2024-05-08T09:25:21.931019+0000","last_clean":"2024-05-08T09:25:21.931019+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:25:21.931019+0000","last_undegraded":"2024-05-08T09:25:21.931019+0000","last_fullsized":"2024-05-08T09:25:21.931019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.930918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:54.987159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.305844+0000","last_change":"2024-05-08T09:25:21.305844+0000","last_active":"2024-05-08T09:25:21.305844+0000","last_peered":"2024-05-08T09:25:21.305844+0000","last_clean":"2024-05-08T09:25:21.305844+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:25:21.305844+0000","last_undegraded":"2024-05-08T09:25:21.305844+0000","last_fullsized":"2024-05-08T09:25:21.305844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.305723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:01.811529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.197120+0000","last_change":"2024-05-08T09:25:24.197143+0000","last_active":"2024-05-08T09:25:24.197120+0000","last_peered":"2024-05-08T09:25:24.197120+0000","last_clean":"2024-05-08T09:25:24.197120+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:25:24.197120+0000","last_undegraded":"2024-05-08T09:25:24.197120+0000","last_fullsized":"2024-05-08T09:25:24.197120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.197029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:02.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.797878+0000","last_change":"2024-05-08T09:25:27.797909+0000","last_active":"2024-05-08T09:25:27.797878+0000","last_peered":"2024-05-08T09:25:27.797878+0000","last_clean":"2024-05-08T09:25:27.797878+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:25:27.797878+0000","last_undegraded":"2024-05-08T09:25:27.797878+0000","last_fullsized":"2024-05-08T09:25:27.797878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.797770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:21.154495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.781776+0000","last_change":"2024-05-08T09:25:22.781804+0000","last_active":"2024-05-08T09:25:22.781776+0000","last_peered":"2024-05-08T09:25:22.781776+0000","last_clean":"2024-05-08T09:25:22.781776+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:25:22.781776+0000","last_undegraded":"2024-05-08T09:25:22.781776+0000","last_fullsized":"2024-05-08T09:25:22.781776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.781682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:55.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.344011+0000","last_change":"2024-05-08T09:25:30.344041+0000","last_active":"2024-05-08T09:25:30.344011+0000","last_peered":"2024-05-08T09:25:30.344011+0000","last_clean":"2024-05-08T09:25:30.344011+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:25:30.344011+0000","last_undegraded":"2024-05-08T09:25:30.344011+0000","last_fullsized":"2024-05-08T09:25:30.344011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.343910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:24.516299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.748106+0000","last_change":"2024-05-08T09:25:28.748130+0000","last_active":"2024-05-08T09:25:28.748106+0000","last_peered":"2024-05-08T09:25:28.748106+0000","last_clean":"2024-05-08T09:25:28.748106+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:25:28.748106+0000","last_undegraded":"2024-05-08T09:25:28.748106+0000","last_fullsized":"2024-05-08T09:25:28.748106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.748024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:22.963514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.654809+0000","last_change":"2024-05-08T09:25:41.654848+0000","last_active":"2024-05-08T09:25:41.654809+0000","last_peered":"2024-05-08T09:25:41.654809+0000","last_clean":"2024-05-08T09:25:41.654809+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:25:41.654809+0000","last_undegraded":"2024-05-08T09:25:41.654809+0000","last_fullsized":"2024-05-08T09:25:41.654809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.654716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:19:53.492400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.846119+0000","last_change":"2024-05-08T09:25:13.846147+0000","last_active":"2024-05-08T09:25:13.846119+0000","last_peered":"2024-05-08T09:25:13.846119+0000","last_clean":"2024-05-08T09:25:13.846119+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:25:13.846119+0000","last_undegraded":"2024-05-08T09:25:13.846119+0000","last_fullsized":"2024-05-08T09:25:13.846119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.846024+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:41.393615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.745924+0000","last_change":"2024-05-08T09:25:37.745949+0000","last_active":"2024-05-08T09:25:37.745924+0000","last_peered":"2024-05-08T09:25:37.745924+0000","last_clean":"2024-05-08T09:25:37.745924+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:25:37.745924+0000","last_undegraded":"2024-05-08T09:25:37.745924+0000","last_fullsized":"2024-05-08T09:25:37.745924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.745832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.237079+0000","last_change":"2024-05-08T09:25:25.237119+0000","last_active":"2024-05-08T09:25:25.237079+0000","last_peered":"2024-05-08T09:25:25.237079+0000","last_clean":"2024-05-08T09:25:25.237079+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:25:25.237079+0000","last_undegraded":"2024-05-08T09:25:25.237079+0000","last_fullsized":"2024-05-08T09:25:25.237079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.236991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:23.829920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.020091+0000","last_change":"2024-05-08T09:25:39.020148+0000","last_active":"2024-05-08T09:25:39.020091+0000","last_peered":"2024-05-08T09:25:39.020091+0000","last_clean":"2024-05-08T09:25:39.020091+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:25:39.020091+0000","last_undegraded":"2024-05-08T09:25:39.020091+0000","last_fullsized":"2024-05-08T09:25:39.020091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:24.713184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.830304+0000","last_change":"2024-05-08T09:25:21.830341+0000","last_active":"2024-05-08T09:25:21.830304+0000","last_peered":"2024-05-08T09:25:21.830304+0000","last_clean":"2024-05-08T09:25:21.830304+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:25:21.830304+0000","last_undegraded":"2024-05-08T09:25:21.830304+0000","last_fullsized":"2024-05-08T09:25:21.830304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.830191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:46.061745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914978+0000","last_change":"2024-05-08T09:21:28.966223+0000","last_active":"2024-05-08T09:23:48.914978+0000","last_peered":"2024-05-08T09:23:48.914978+0000","last_clean":"2024-05-08T09:23:48.914978+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:23:48.914978+0000","last_undegraded":"2024-05-08T09:23:48.914978+0000","last_fullsized":"2024-05-08T09:23:48.914978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.761410+0000","last_change":"2024-05-08T09:25:12.761456+0000","last_active":"2024-05-08T09:25:12.761410+0000","last_peered":"2024-05-08T09:25:12.761410+0000","last_clean":"2024-05-08T09:25:12.761410+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:25:12.761410+0000","last_undegraded":"2024-05-08T09:25:12.761410+0000","last_fullsized":"2024-05-08T09:25:12.761410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.761304+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:25.524875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.236879+0000","last_change":"2024-05-08T09:25:31.236908+0000","last_active":"2024-05-08T09:25:31.236879+0000","last_peered":"2024-05-08T09:25:31.236879+0000","last_clean":"2024-05-08T09:25:31.236879+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:25:31.236879+0000","last_undegraded":"2024-05-08T09:25:31.236879+0000","last_fullsized":"2024-05-08T09:25:31.236879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.236783+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:04.221673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.155052+0000","last_change":"2024-05-08T09:21:28.965849+0000","last_active":"2024-05-08T09:24:38.155052+0000","last_peered":"2024-05-08T09:24:38.155052+0000","last_clean":"2024-05-08T09:24:38.155052+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:24:38.155052+0000","last_undegraded":"2024-05-08T09:24:38.155052+0000","last_fullsized":"2024-05-08T09:24:38.155052+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.080175+0000","last_change":"2024-05-08T09:24:52.080213+0000","last_active":"2024-05-08T09:24:52.080175+0000","last_peered":"2024-05-08T09:24:52.080175+0000","last_clean":"2024-05-08T09:24:52.080175+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:24:52.080175+0000","last_undegraded":"2024-05-08T09:24:52.080175+0000","last_fullsized":"2024-05-08T09:24:52.080175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.080065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:28:14.528132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.264691+0000","last_change":"2024-05-08T09:25:17.264747+0000","last_active":"2024-05-08T09:25:17.264691+0000","last_peered":"2024-05-08T09:25:17.264691+0000","last_clean":"2024-05-08T09:25:17.264691+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:25:17.264691+0000","last_undegraded":"2024-05-08T09:25:17.264691+0000","last_fullsized":"2024-05-08T09:25:17.264691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.264579+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:59.907138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.718141+0000","last_change":"2024-05-08T09:24:56.718169+0000","last_active":"2024-05-08T09:24:56.718141+0000","last_peered":"2024-05-08T09:24:56.718141+0000","last_clean":"2024-05-08T09:24:56.718141+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:24:56.718141+0000","last_undegraded":"2024-05-08T09:24:56.718141+0000","last_fullsized":"2024-05-08T09:24:56.718141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.718047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:41.337920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.813429+0000","last_change":"2024-05-08T09:25:16.813454+0000","last_active":"2024-05-08T09:25:16.813429+0000","last_peered":"2024-05-08T09:25:16.813429+0000","last_clean":"2024-05-08T09:25:16.813429+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:25:16.813429+0000","last_undegraded":"2024-05-08T09:25:16.813429+0000","last_fullsized":"2024-05-08T09:25:16.813429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.813330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:00.193889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.069683+0000","last_change":"2024-05-08T09:25:07.069725+0000","last_active":"2024-05-08T09:25:07.069683+0000","last_peered":"2024-05-08T09:25:07.069683+0000","last_clean":"2024-05-08T09:25:07.069683+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:25:07.069683+0000","last_undegraded":"2024-05-08T09:25:07.069683+0000","last_fullsized":"2024-05-08T09:25:07.069683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.069574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:46.463982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.341588+0000","last_change":"2024-05-08T09:25:29.341616+0000","last_active":"2024-05-08T09:25:29.341588+0000","last_peered":"2024-05-08T09:25:29.341588+0000","last_clean":"2024-05-08T09:25:29.341588+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:25:29.341588+0000","last_undegraded":"2024-05-08T09:25:29.341588+0000","last_fullsized":"2024-05-08T09:25:29.341588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.341497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:47.141991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.811079+0000","last_change":"2024-05-08T09:25:06.811118+0000","last_active":"2024-05-08T09:25:06.811079+0000","last_peered":"2024-05-08T09:25:06.811079+0000","last_clean":"2024-05-08T09:25:06.811079+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:25:06.811079+0000","last_undegraded":"2024-05-08T09:25:06.811079+0000","last_fullsized":"2024-05-08T09:25:06.811079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.810982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:45.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.687493+0000","last_change":"2024-05-08T09:24:55.687547+0000","last_active":"2024-05-08T09:24:55.687493+0000","last_peered":"2024-05-08T09:24:55.687493+0000","last_clean":"2024-05-08T09:24:55.687493+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:24:55.687493+0000","last_undegraded":"2024-05-08T09:24:55.687493+0000","last_fullsized":"2024-05-08T09:24:55.687493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.687356+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:29.151994+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.701766+0000","last_change":"2024-05-08T09:24:49.701793+0000","last_active":"2024-05-08T09:24:49.701766+0000","last_peered":"2024-05-08T09:24:49.701766+0000","last_clean":"2024-05-08T09:24:49.701766+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:24:49.701766+0000","last_undegraded":"2024-05-08T09:24:49.701766+0000","last_fullsized":"2024-05-08T09:24:49.701766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.701660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:37.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.910474+0000","last_change":"2024-05-08T09:25:16.910503+0000","last_active":"2024-05-08T09:25:16.910474+0000","last_peered":"2024-05-08T09:25:16.910474+0000","last_clean":"2024-05-08T09:25:16.910474+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:25:16.910474+0000","last_undegraded":"2024-05-08T09:25:16.910474+0000","last_fullsized":"2024-05-08T09:25:16.910474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.910378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:34.710873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.226019+0000","last_change":"2024-05-08T09:25:33.226050+0000","last_active":"2024-05-08T09:25:33.226019+0000","last_peered":"2024-05-08T09:25:33.226019+0000","last_clean":"2024-05-08T09:25:33.226019+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:25:33.226019+0000","last_undegraded":"2024-05-08T09:25:33.226019+0000","last_fullsized":"2024-05-08T09:25:33.226019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.225927+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:00.191310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.914895+0000","last_change":"2024-05-08T09:21:28.966909+0000","last_active":"2024-05-08T09:23:48.914895+0000","last_peered":"2024-05-08T09:23:48.914895+0000","last_clean":"2024-05-08T09:23:48.914895+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:23:48.914895+0000","last_undegraded":"2024-05-08T09:23:48.914895+0000","last_fullsized":"2024-05-08T09:23:48.914895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.311903+0000","last_change":"2024-05-08T09:25:40.311928+0000","last_active":"2024-05-08T09:25:40.311903+0000","last_peered":"2024-05-08T09:25:40.311903+0000","last_clean":"2024-05-08T09:25:40.311903+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:25:40.311903+0000","last_undegraded":"2024-05-08T09:25:40.311903+0000","last_fullsized":"2024-05-08T09:25:40.311903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.311808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:34.527299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.328472+0000","last_change":"2024-05-08T09:24:54.328519+0000","last_active":"2024-05-08T09:24:54.328472+0000","last_peered":"2024-05-08T09:24:54.328472+0000","last_clean":"2024-05-08T09:24:54.328472+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:24:54.328472+0000","last_undegraded":"2024-05-08T09:24:54.328472+0000","last_fullsized":"2024-05-08T09:24:54.328472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.328362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:05.483598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":434,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.130751+0000","last_change":"2024-05-08T09:25:26.130779+0000","last_active":"2024-05-08T09:25:26.130751+0000","last_peered":"2024-05-08T09:25:26.130751+0000","last_clean":"2024-05-08T09:25:26.130751+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:25:26.130751+0000","last_undegraded":"2024-05-08T09:25:26.130751+0000","last_fullsized":"2024-05-08T09:25:26.130751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.130675+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:51:46.979797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.306963+0000","last_change":"2024-05-08T09:25:38.306988+0000","last_active":"2024-05-08T09:25:38.306963+0000","last_peered":"2024-05-08T09:25:38.306963+0000","last_clean":"2024-05-08T09:25:38.306963+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:25:38.306963+0000","last_undegraded":"2024-05-08T09:25:38.306963+0000","last_fullsized":"2024-05-08T09:25:38.306963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.306873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:06.749667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.913368+0000","last_change":"2024-05-08T09:25:18.913395+0000","last_active":"2024-05-08T09:25:18.913368+0000","last_peered":"2024-05-08T09:25:18.913368+0000","last_clean":"2024-05-08T09:25:18.913368+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:25:18.913368+0000","last_undegraded":"2024-05-08T09:25:18.913368+0000","last_fullsized":"2024-05-08T09:25:18.913368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.913278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.872761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.782433+0000","last_change":"2024-05-08T09:25:31.782462+0000","last_active":"2024-05-08T09:25:31.782433+0000","last_peered":"2024-05-08T09:25:31.782433+0000","last_clean":"2024-05-08T09:25:31.782433+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:25:31.782433+0000","last_undegraded":"2024-05-08T09:25:31.782433+0000","last_fullsized":"2024-05-08T09:25:31.782433+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.782326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:43.109888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.084809+0000","last_change":"2024-05-08T09:24:53.084847+0000","last_active":"2024-05-08T09:24:53.084809+0000","last_peered":"2024-05-08T09:24:53.084809+0000","last_clean":"2024-05-08T09:24:53.084809+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:24:53.084809+0000","last_undegraded":"2024-05-08T09:24:53.084809+0000","last_fullsized":"2024-05-08T09:24:53.084809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.084720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:14.978196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.309726+0000","last_change":"2024-05-08T09:24:55.309760+0000","last_active":"2024-05-08T09:24:55.309726+0000","last_peered":"2024-05-08T09:24:55.309726+0000","last_clean":"2024-05-08T09:24:55.309726+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:24:55.309726+0000","last_undegraded":"2024-05-08T09:24:55.309726+0000","last_fullsized":"2024-05-08T09:24:55.309726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.309641+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.625772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.838065+0000","last_change":"2024-05-08T09:24:50.838092+0000","last_active":"2024-05-08T09:24:50.838065+0000","last_peered":"2024-05-08T09:24:50.838065+0000","last_clean":"2024-05-08T09:24:50.838065+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:50.838065+0000","last_undegraded":"2024-05-08T09:24:50.838065+0000","last_fullsized":"2024-05-08T09:24:50.838065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.837975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:13.392037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.165589+0000","last_change":"2024-05-08T09:25:27.165615+0000","last_active":"2024-05-08T09:25:27.165589+0000","last_peered":"2024-05-08T09:25:27.165589+0000","last_clean":"2024-05-08T09:25:27.165589+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:25:27.165589+0000","last_undegraded":"2024-05-08T09:25:27.165589+0000","last_fullsized":"2024-05-08T09:25:27.165589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.165476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:41.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.343585+0000","last_change":"2024-05-08T09:25:34.343622+0000","last_active":"2024-05-08T09:25:34.343585+0000","last_peered":"2024-05-08T09:25:34.343585+0000","last_clean":"2024-05-08T09:25:34.343585+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:25:34.343585+0000","last_undegraded":"2024-05-08T09:25:34.343585+0000","last_fullsized":"2024-05-08T09:25:34.343585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.343478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:44.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.708632+0000","last_change":"2024-05-08T09:25:01.708663+0000","last_active":"2024-05-08T09:25:01.708632+0000","last_peered":"2024-05-08T09:25:01.708632+0000","last_clean":"2024-05-08T09:25:01.708632+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:25:01.708632+0000","last_undegraded":"2024-05-08T09:25:01.708632+0000","last_fullsized":"2024-05-08T09:25:01.708632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.708527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:21:55.937487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":111,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.295053+0000","last_change":"2024-05-08T09:24:58.295107+0000","last_active":"2024-05-08T09:24:58.295053+0000","last_peered":"2024-05-08T09:24:58.295053+0000","last_clean":"2024-05-08T09:24:58.295053+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:24:58.295053+0000","last_undegraded":"2024-05-08T09:24:58.295053+0000","last_fullsized":"2024-05-08T09:24:58.295053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.294960+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:44.289112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.790076+0000","last_change":"2024-05-08T09:24:51.790127+0000","last_active":"2024-05-08T09:24:51.790076+0000","last_peered":"2024-05-08T09:24:51.790076+0000","last_clean":"2024-05-08T09:24:51.790076+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:24:51.790076+0000","last_undegraded":"2024-05-08T09:24:51.790076+0000","last_fullsized":"2024-05-08T09:24:51.790076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.789971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:01.201509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.361275+0000","last_change":"2024-05-08T09:25:36.361302+0000","last_active":"2024-05-08T09:25:36.361275+0000","last_peered":"2024-05-08T09:25:36.361275+0000","last_clean":"2024-05-08T09:25:36.361275+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:25:36.361275+0000","last_undegraded":"2024-05-08T09:25:36.361275+0000","last_fullsized":"2024-05-08T09:25:36.361275+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.361192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:02.992029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.785213+0000","last_change":"2024-05-08T09:25:19.785250+0000","last_active":"2024-05-08T09:25:19.785213+0000","last_peered":"2024-05-08T09:25:19.785213+0000","last_clean":"2024-05-08T09:25:19.785213+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:25:19.785213+0000","last_undegraded":"2024-05-08T09:25:19.785213+0000","last_fullsized":"2024-05-08T09:25:19.785213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.785121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:56.744605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.245838+0000","last_change":"2024-05-08T09:25:26.245875+0000","last_active":"2024-05-08T09:25:26.245838+0000","last_peered":"2024-05-08T09:25:26.245838+0000","last_clean":"2024-05-08T09:25:26.245838+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:25:26.245838+0000","last_undegraded":"2024-05-08T09:25:26.245838+0000","last_fullsized":"2024-05-08T09:25:26.245838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.245734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:53.793325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.840912+0000","last_change":"2024-05-08T09:25:11.840940+0000","last_active":"2024-05-08T09:25:11.840912+0000","last_peered":"2024-05-08T09:25:11.840912+0000","last_clean":"2024-05-08T09:25:11.840912+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:25:11.840912+0000","last_undegraded":"2024-05-08T09:25:11.840912+0000","last_fullsized":"2024-05-08T09:25:11.840912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.840802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:24.604373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.225184+0000","last_change":"2024-05-08T09:25:16.225238+0000","last_active":"2024-05-08T09:25:16.225184+0000","last_peered":"2024-05-08T09:25:16.225184+0000","last_clean":"2024-05-08T09:25:16.225184+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:25:16.225184+0000","last_undegraded":"2024-05-08T09:25:16.225184+0000","last_fullsized":"2024-05-08T09:25:16.225184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.225076+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.968267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.808071+0000","last_change":"2024-05-08T09:24:49.808113+0000","last_active":"2024-05-08T09:24:49.808071+0000","last_peered":"2024-05-08T09:24:49.808071+0000","last_clean":"2024-05-08T09:24:49.808071+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:24:49.808071+0000","last_undegraded":"2024-05-08T09:24:49.808071+0000","last_fullsized":"2024-05-08T09:24:49.808071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.807955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:48.540567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'5","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.913715+0000","last_change":"2024-05-08T09:21:38.987220+0000","last_active":"2024-05-08T09:23:43.913715+0000","last_peered":"2024-05-08T09:23:43.913715+0000","last_clean":"2024-05-08T09:23:43.913715+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:23:43.913715+0000","last_undegraded":"2024-05-08T09:23:43.913715+0000","last_fullsized":"2024-05-08T09:23:43.913715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.303755+0000","last_change":"2024-05-08T09:25:19.303783+0000","last_active":"2024-05-08T09:25:19.303755+0000","last_peered":"2024-05-08T09:25:19.303755+0000","last_clean":"2024-05-08T09:25:19.303755+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:25:19.303755+0000","last_undegraded":"2024-05-08T09:25:19.303755+0000","last_fullsized":"2024-05-08T09:25:19.303755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.303658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:04.577425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914140+0000","last_change":"2024-05-08T09:21:28.970308+0000","last_active":"2024-05-08T09:23:43.914140+0000","last_peered":"2024-05-08T09:23:43.914140+0000","last_clean":"2024-05-08T09:23:43.914140+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:23:43.914140+0000","last_undegraded":"2024-05-08T09:23:43.914140+0000","last_fullsized":"2024-05-08T09:23:43.914140+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.784639+0000","last_change":"2024-05-08T09:25:05.784665+0000","last_active":"2024-05-08T09:25:05.784639+0000","last_peered":"2024-05-08T09:25:05.784639+0000","last_clean":"2024-05-08T09:25:05.784639+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:25:05.784639+0000","last_undegraded":"2024-05-08T09:25:05.784639+0000","last_fullsized":"2024-05-08T09:25:05.784639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:48.571658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.027233+0000","last_change":"2024-05-08T09:25:02.027279+0000","last_active":"2024-05-08T09:25:02.027233+0000","last_peered":"2024-05-08T09:25:02.027233+0000","last_clean":"2024-05-08T09:25:02.027233+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:25:02.027233+0000","last_undegraded":"2024-05-08T09:25:02.027233+0000","last_fullsized":"2024-05-08T09:25:02.027233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.027147+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:01.654874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.823561+0000","last_change":"2024-05-08T09:25:12.823593+0000","last_active":"2024-05-08T09:25:12.823561+0000","last_peered":"2024-05-08T09:25:12.823561+0000","last_clean":"2024-05-08T09:25:12.823561+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:25:12.823561+0000","last_undegraded":"2024-05-08T09:25:12.823561+0000","last_fullsized":"2024-05-08T09:25:12.823561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.823468+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.142119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.909980+0000","last_change":"2024-05-08T09:21:38.973937+0000","last_active":"2024-05-08T09:23:48.909980+0000","last_peered":"2024-05-08T09:23:48.909980+0000","last_clean":"2024-05-08T09:23:48.909980+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:23:48.909980+0000","last_undegraded":"2024-05-08T09:23:48.909980+0000","last_fullsized":"2024-05-08T09:23:48.909980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.337524+0000","last_change":"2024-05-08T09:25:15.337550+0000","last_active":"2024-05-08T09:25:15.337524+0000","last_peered":"2024-05-08T09:25:15.337524+0000","last_clean":"2024-05-08T09:25:15.337524+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:25:15.337524+0000","last_undegraded":"2024-05-08T09:25:15.337524+0000","last_fullsized":"2024-05-08T09:25:15.337524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.337431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:48.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914072+0000","last_change":"2024-05-08T09:21:28.967544+0000","last_active":"2024-05-08T09:23:43.914072+0000","last_peered":"2024-05-08T09:23:43.914072+0000","last_clean":"2024-05-08T09:23:43.914072+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:23:43.914072+0000","last_undegraded":"2024-05-08T09:23:43.914072+0000","last_fullsized":"2024-05-08T09:23:43.914072+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.809318+0000","last_change":"2024-05-08T09:25:10.809344+0000","last_active":"2024-05-08T09:25:10.809318+0000","last_peered":"2024-05-08T09:25:10.809318+0000","last_clean":"2024-05-08T09:25:10.809318+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:25:10.809318+0000","last_undegraded":"2024-05-08T09:25:10.809318+0000","last_fullsized":"2024-05-08T09:25:10.809318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.809216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:37.851520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'66","reported_seq":139,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.217624+0000","last_change":"2024-05-08T09:25:20.217666+0000","last_active":"2024-05-08T09:25:20.217624+0000","last_peered":"2024-05-08T09:25:20.217624+0000","last_clean":"2024-05-08T09:25:20.217624+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:25:20.217624+0000","last_undegraded":"2024-05-08T09:25:20.217624+0000","last_fullsized":"2024-05-08T09:25:20.217624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.217529+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:21.026949+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.818524+0000","last_change":"2024-05-08T09:24:48.818545+0000","last_active":"2024-05-08T09:24:48.818524+0000","last_peered":"2024-05-08T09:24:48.818524+0000","last_clean":"2024-05-08T09:24:48.818524+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:24:48.818524+0000","last_undegraded":"2024-05-08T09:24:48.818524+0000","last_fullsized":"2024-05-08T09:24:48.818524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.818433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:36.182911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'20","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.340880+0000","last_change":"2024-05-08T09:21:38.976795+0000","last_active":"2024-05-08T09:24:38.340880+0000","last_peered":"2024-05-08T09:24:38.340880+0000","last_clean":"2024-05-08T09:24:38.340880+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:24:38.340880+0000","last_undegraded":"2024-05-08T09:24:38.340880+0000","last_fullsized":"2024-05-08T09:24:38.340880+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.730702+0000","last_change":"2024-05-08T09:25:11.730752+0000","last_active":"2024-05-08T09:25:11.730702+0000","last_peered":"2024-05-08T09:25:11.730702+0000","last_clean":"2024-05-08T09:25:11.730702+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:25:11.730702+0000","last_undegraded":"2024-05-08T09:25:11.730702+0000","last_fullsized":"2024-05-08T09:25:11.730702+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.730568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:38.772872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.928025+0000","last_change":"2024-05-08T09:25:23.928071+0000","last_active":"2024-05-08T09:25:23.928025+0000","last_peered":"2024-05-08T09:25:23.928025+0000","last_clean":"2024-05-08T09:25:23.928025+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:25:23.928025+0000","last_undegraded":"2024-05-08T09:25:23.928025+0000","last_fullsized":"2024-05-08T09:25:23.928025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.927879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:23.412115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.322499+0000","last_change":"2024-05-08T09:25:03.322535+0000","last_active":"2024-05-08T09:25:03.322499+0000","last_peered":"2024-05-08T09:25:03.322499+0000","last_clean":"2024-05-08T09:25:03.322499+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:25:03.322499+0000","last_undegraded":"2024-05-08T09:25:03.322499+0000","last_fullsized":"2024-05-08T09:25:03.322499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.322403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:06.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":96,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.739742+0000","last_change":"2024-05-08T09:24:57.739783+0000","last_active":"2024-05-08T09:24:57.739742+0000","last_peered":"2024-05-08T09:24:57.739742+0000","last_clean":"2024-05-08T09:24:57.739742+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:24:57.739742+0000","last_undegraded":"2024-05-08T09:24:57.739742+0000","last_fullsized":"2024-05-08T09:24:57.739742+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.739657+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:25.965876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.255635+0000","last_change":"2024-05-08T09:25:14.255684+0000","last_active":"2024-05-08T09:25:14.255635+0000","last_peered":"2024-05-08T09:25:14.255635+0000","last_clean":"2024-05-08T09:25:14.255635+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:25:14.255635+0000","last_undegraded":"2024-05-08T09:25:14.255635+0000","last_fullsized":"2024-05-08T09:25:14.255635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.255525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:04.947242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.179879+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:24:49.179879+0000","last_peered":"2024-05-08T09:24:49.179879+0000","last_clean":"2024-05-08T09:24:49.179879+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:24:49.179879+0000","last_undegraded":"2024-05-08T09:24:49.179879+0000","last_fullsized":"2024-05-08T09:24:49.179879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.020163+0000","last_change":"2024-05-08T09:25:01.020191+0000","last_active":"2024-05-08T09:25:01.020163+0000","last_peered":"2024-05-08T09:25:01.020163+0000","last_clean":"2024-05-08T09:25:01.020163+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:25:01.020163+0000","last_undegraded":"2024-05-08T09:25:01.020163+0000","last_fullsized":"2024-05-08T09:25:01.020163+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.020070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:37.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913154+0000","last_change":"2024-05-08T09:21:28.967251+0000","last_active":"2024-05-08T09:23:38.913154+0000","last_peered":"2024-05-08T09:23:38.913154+0000","last_clean":"2024-05-08T09:23:38.913154+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:23:38.913154+0000","last_undegraded":"2024-05-08T09:23:38.913154+0000","last_fullsized":"2024-05-08T09:23:38.913154+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'5","reported_seq":238,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.794975+0000","last_change":"2024-05-08T09:25:09.795024+0000","last_active":"2024-05-08T09:25:09.794975+0000","last_peered":"2024-05-08T09:25:09.794975+0000","last_clean":"2024-05-08T09:25:09.794975+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:25:09.794975+0000","last_undegraded":"2024-05-08T09:25:09.794975+0000","last_fullsized":"2024-05-08T09:25:09.794975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.794854+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.624478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.303146+0000","last_change":"2024-05-08T09:25:02.303194+0000","last_active":"2024-05-08T09:25:02.303146+0000","last_peered":"2024-05-08T09:25:02.303146+0000","last_clean":"2024-05-08T09:25:02.303146+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:25:02.303146+0000","last_undegraded":"2024-05-08T09:25:02.303146+0000","last_fullsized":"2024-05-08T09:25:02.303146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.303063+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:10.132225+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":415,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.302336+0000","last_change":"2024-05-08T09:24:53.302402+0000","last_active":"2024-05-08T09:24:53.302336+0000","last_peered":"2024-05-08T09:24:53.302336+0000","last_clean":"2024-05-08T09:24:53.302336+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:53.302336+0000","last_undegraded":"2024-05-08T09:24:53.302336+0000","last_fullsized":"2024-05-08T09:24:53.302336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.302236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:25.305583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'18","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.300442+0000","last_change":"2024-05-08T09:21:38.976309+0000","last_active":"2024-05-08T09:24:38.300442+0000","last_peered":"2024-05-08T09:24:38.300442+0000","last_clean":"2024-05-08T09:24:38.300442+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:24:38.300442+0000","last_undegraded":"2024-05-08T09:24:38.300442+0000","last_fullsized":"2024-05-08T09:24:38.300442+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.381375+0000","last_change":"2024-05-08T09:25:35.381403+0000","last_active":"2024-05-08T09:25:35.381375+0000","last_peered":"2024-05-08T09:25:35.381375+0000","last_clean":"2024-05-08T09:25:35.381375+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:25:35.381375+0000","last_undegraded":"2024-05-08T09:25:35.381375+0000","last_fullsized":"2024-05-08T09:25:35.381375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.381285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:07.823236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.216294+0000","last_change":"2024-05-08T09:25:40.216318+0000","last_active":"2024-05-08T09:25:40.216294+0000","last_peered":"2024-05-08T09:25:40.216294+0000","last_clean":"2024-05-08T09:25:40.216294+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:25:40.216294+0000","last_undegraded":"2024-05-08T09:25:40.216294+0000","last_fullsized":"2024-05-08T09:25:40.216294+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.216203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:38.399582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":428,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.758567+0000","last_change":"2024-05-08T09:25:06.758612+0000","last_active":"2024-05-08T09:25:06.758567+0000","last_peered":"2024-05-08T09:25:06.758567+0000","last_clean":"2024-05-08T09:25:06.758567+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:25:06.758567+0000","last_undegraded":"2024-05-08T09:25:06.758567+0000","last_fullsized":"2024-05-08T09:25:06.758567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.758460+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:49.545574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.255289+0000","last_change":"2024-05-08T09:25:15.255329+0000","last_active":"2024-05-08T09:25:15.255289+0000","last_peered":"2024-05-08T09:25:15.255289+0000","last_clean":"2024-05-08T09:25:15.255289+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:25:15.255289+0000","last_undegraded":"2024-05-08T09:25:15.255289+0000","last_fullsized":"2024-05-08T09:25:15.255289+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.255201+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:23.835791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.722811+0000","last_change":"2024-05-08T09:24:48.722856+0000","last_active":"2024-05-08T09:24:48.722811+0000","last_peered":"2024-05-08T09:24:48.722811+0000","last_clean":"2024-05-08T09:24:48.722811+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:48.722811+0000","last_undegraded":"2024-05-08T09:24:48.722811+0000","last_fullsized":"2024-05-08T09:24:48.722811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.722702+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:43.871307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.320578+0000","last_change":"2024-05-08T09:25:05.320604+0000","last_active":"2024-05-08T09:25:05.320578+0000","last_peered":"2024-05-08T09:25:05.320578+0000","last_clean":"2024-05-08T09:25:05.320578+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:25:05.320578+0000","last_undegraded":"2024-05-08T09:25:05.320578+0000","last_fullsized":"2024-05-08T09:25:05.320578+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.320491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:51.978731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.748295+0000","last_change":"2024-05-08T09:25:10.748318+0000","last_active":"2024-05-08T09:25:10.748295+0000","last_peered":"2024-05-08T09:25:10.748295+0000","last_clean":"2024-05-08T09:25:10.748295+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:25:10.748295+0000","last_undegraded":"2024-05-08T09:25:10.748295+0000","last_fullsized":"2024-05-08T09:25:10.748295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.748214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:58.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.197694+0000","last_change":"2024-05-08T09:25:43.197723+0000","last_active":"2024-05-08T09:25:43.197694+0000","last_peered":"2024-05-08T09:25:43.197694+0000","last_clean":"2024-05-08T09:25:43.197694+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:25:43.197694+0000","last_undegraded":"2024-05-08T09:25:43.197694+0000","last_fullsized":"2024-05-08T09:25:43.197694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.197608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:33.612547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.047804+0000","last_change":"2024-05-08T09:24:54.047846+0000","last_active":"2024-05-08T09:24:54.047804+0000","last_peered":"2024-05-08T09:24:54.047804+0000","last_clean":"2024-05-08T09:24:54.047804+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:24:54.047804+0000","last_undegraded":"2024-05-08T09:24:54.047804+0000","last_fullsized":"2024-05-08T09:24:54.047804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.047713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:28.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":107,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.765587+0000","last_change":"2024-05-08T09:24:59.765651+0000","last_active":"2024-05-08T09:24:59.765587+0000","last_peered":"2024-05-08T09:24:59.765587+0000","last_clean":"2024-05-08T09:24:59.765587+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:24:59.765587+0000","last_undegraded":"2024-05-08T09:24:59.765587+0000","last_fullsized":"2024-05-08T09:24:59.765587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.765502+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:46.174195+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.320572+0000","last_change":"2024-05-08T09:24:57.320607+0000","last_active":"2024-05-08T09:24:57.320572+0000","last_peered":"2024-05-08T09:24:57.320572+0000","last_clean":"2024-05-08T09:24:57.320572+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:24:57.320572+0000","last_undegraded":"2024-05-08T09:24:57.320572+0000","last_fullsized":"2024-05-08T09:24:57.320572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.320468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:09.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.786845+0000","last_change":"2024-05-08T09:25:04.786877+0000","last_active":"2024-05-08T09:25:04.786845+0000","last_peered":"2024-05-08T09:25:04.786845+0000","last_clean":"2024-05-08T09:25:04.786845+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:25:04.786845+0000","last_undegraded":"2024-05-08T09:25:04.786845+0000","last_fullsized":"2024-05-08T09:25:04.786845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.786748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:38.042528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.000502+0000","last_change":"2024-05-08T09:25:03.000502+0000","last_active":"2024-05-08T09:25:03.000502+0000","last_peered":"2024-05-08T09:25:03.000502+0000","last_clean":"2024-05-08T09:25:03.000502+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:25:03.000502+0000","last_undegraded":"2024-05-08T09:25:03.000502+0000","last_fullsized":"2024-05-08T09:25:03.000502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.000386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:27.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.770914+0000","last_change":"2024-05-08T09:25:34.770949+0000","last_active":"2024-05-08T09:25:34.770914+0000","last_peered":"2024-05-08T09:25:34.770914+0000","last_clean":"2024-05-08T09:25:34.770914+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:25:34.770914+0000","last_undegraded":"2024-05-08T09:25:34.770914+0000","last_fullsized":"2024-05-08T09:25:34.770914+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.770818+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:46.514009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178386+0000","last_change":"2024-05-08T09:21:20.673347+0000","last_active":"2024-05-08T09:24:49.178386+0000","last_peered":"2024-05-08T09:24:49.178386+0000","last_clean":"2024-05-08T09:24:49.178386+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:24:49.178386+0000","last_undegraded":"2024-05-08T09:24:49.178386+0000","last_fullsized":"2024-05-08T09:24:49.178386+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178445+0000","last_change":"2024-05-08T09:21:28.978612+0000","last_active":"2024-05-08T09:24:49.178445+0000","last_peered":"2024-05-08T09:24:49.178445+0000","last_clean":"2024-05-08T09:24:49.178445+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:24:49.178445+0000","last_undegraded":"2024-05-08T09:24:49.178445+0000","last_fullsized":"2024-05-08T09:24:49.178445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.755062+0000","last_change":"2024-05-08T09:25:07.755062+0000","last_active":"2024-05-08T09:25:07.755062+0000","last_peered":"2024-05-08T09:25:07.755062+0000","last_clean":"2024-05-08T09:25:07.755062+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:25:07.755062+0000","last_undegraded":"2024-05-08T09:25:07.755062+0000","last_fullsized":"2024-05-08T09:25:07.755062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.754913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:46.567445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":177,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.062888+0000","last_change":"2024-05-08T09:24:56.062932+0000","last_active":"2024-05-08T09:24:56.062888+0000","last_peered":"2024-05-08T09:24:56.062888+0000","last_clean":"2024-05-08T09:24:56.062888+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:24:56.062888+0000","last_undegraded":"2024-05-08T09:24:56.062888+0000","last_fullsized":"2024-05-08T09:24:56.062888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.062751+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:23.610342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.720491+0000","last_change":"2024-05-08T09:24:56.720522+0000","last_active":"2024-05-08T09:24:56.720491+0000","last_peered":"2024-05-08T09:24:56.720491+0000","last_clean":"2024-05-08T09:24:56.720491+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:24:56.720491+0000","last_undegraded":"2024-05-08T09:24:56.720491+0000","last_fullsized":"2024-05-08T09:24:56.720491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.720398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:12.622377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":171,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.309603+0000","last_change":"2024-05-08T09:25:09.309632+0000","last_active":"2024-05-08T09:25:09.309603+0000","last_peered":"2024-05-08T09:25:09.309603+0000","last_clean":"2024-05-08T09:25:09.309603+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:25:09.309603+0000","last_undegraded":"2024-05-08T09:25:09.309603+0000","last_fullsized":"2024-05-08T09:25:09.309603+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.309508+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:50.697197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.253989+0000","last_change":"2024-05-08T09:25:35.254017+0000","last_active":"2024-05-08T09:25:35.253989+0000","last_peered":"2024-05-08T09:25:35.253989+0000","last_clean":"2024-05-08T09:25:35.253989+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:25:35.253989+0000","last_undegraded":"2024-05-08T09:25:35.253989+0000","last_fullsized":"2024-05-08T09:25:35.253989+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.253888+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:26.962382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178385+0000","last_change":"2024-05-08T09:21:20.671040+0000","last_active":"2024-05-08T09:24:49.178385+0000","last_peered":"2024-05-08T09:24:49.178385+0000","last_clean":"2024-05-08T09:24:49.178385+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:24:49.178385+0000","last_undegraded":"2024-05-08T09:24:49.178385+0000","last_fullsized":"2024-05-08T09:24:49.178385+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.887978+0000","last_change":"2024-05-08T09:25:19.887978+0000","last_active":"2024-05-08T09:25:19.887978+0000","last_peered":"2024-05-08T09:25:19.887978+0000","last_clean":"2024-05-08T09:25:19.887978+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:25:19.887978+0000","last_undegraded":"2024-05-08T09:25:19.887978+0000","last_fullsized":"2024-05-08T09:25:19.887978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.887845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:19.515572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.124853+0000","last_change":"2024-05-08T09:24:50.124896+0000","last_active":"2024-05-08T09:24:50.124853+0000","last_peered":"2024-05-08T09:24:50.124853+0000","last_clean":"2024-05-08T09:24:50.124853+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:24:50.124853+0000","last_undegraded":"2024-05-08T09:24:50.124853+0000","last_fullsized":"2024-05-08T09:24:50.124853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.124732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:35.398499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.697048+0000","last_change":"2024-05-08T09:24:53.697104+0000","last_active":"2024-05-08T09:24:53.697048+0000","last_peered":"2024-05-08T09:24:53.697048+0000","last_clean":"2024-05-08T09:24:53.697048+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:53.697048+0000","last_undegraded":"2024-05-08T09:24:53.697048+0000","last_fullsized":"2024-05-08T09:24:53.697048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.696956+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:53.816751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.235900+0000","last_change":"2024-05-08T09:25:22.235958+0000","last_active":"2024-05-08T09:25:22.235900+0000","last_peered":"2024-05-08T09:25:22.235900+0000","last_clean":"2024-05-08T09:25:22.235900+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:25:22.235900+0000","last_undegraded":"2024-05-08T09:25:22.235900+0000","last_fullsized":"2024-05-08T09:25:22.235900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.235783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:01.285711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.610821+0000","last_change":"2024-05-08T09:25:43.610862+0000","last_active":"2024-05-08T09:25:43.610821+0000","last_peered":"2024-05-08T09:25:43.610821+0000","last_clean":"2024-05-08T09:25:43.610821+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:25:43.610821+0000","last_undegraded":"2024-05-08T09:25:43.610821+0000","last_fullsized":"2024-05-08T09:25:43.610821+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.610735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:19:53.132295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.882901+0000","last_change":"2024-05-08T09:25:24.882929+0000","last_active":"2024-05-08T09:25:24.882901+0000","last_peered":"2024-05-08T09:25:24.882901+0000","last_clean":"2024-05-08T09:25:24.882901+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:25:24.882901+0000","last_undegraded":"2024-05-08T09:25:24.882901+0000","last_fullsized":"2024-05-08T09:25:24.882901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.882795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:04.277203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.290947+0000","last_change":"2024-05-08T09:25:27.290947+0000","last_active":"2024-05-08T09:25:27.290947+0000","last_peered":"2024-05-08T09:25:27.290947+0000","last_clean":"2024-05-08T09:25:27.290947+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:25:27.290947+0000","last_undegraded":"2024-05-08T09:25:27.290947+0000","last_fullsized":"2024-05-08T09:25:27.290947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.290724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.933110+0000","last_change":"2024-05-08T09:25:25.933110+0000","last_active":"2024-05-08T09:25:25.933110+0000","last_peered":"2024-05-08T09:25:25.933110+0000","last_clean":"2024-05-08T09:25:25.933110+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:25:25.933110+0000","last_undegraded":"2024-05-08T09:25:25.933110+0000","last_fullsized":"2024-05-08T09:25:25.933110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.932974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:54.375768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.314972+0000","last_change":"2024-05-08T09:25:07.315030+0000","last_active":"2024-05-08T09:25:07.314972+0000","last_peered":"2024-05-08T09:25:07.314972+0000","last_clean":"2024-05-08T09:25:07.314972+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:25:07.314972+0000","last_undegraded":"2024-05-08T09:25:07.314972+0000","last_fullsized":"2024-05-08T09:25:07.314972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.314876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:51.934749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":100,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.284507+0000","last_change":"2024-05-08T09:25:00.284595+0000","last_active":"2024-05-08T09:25:00.284507+0000","last_peered":"2024-05-08T09:25:00.284507+0000","last_clean":"2024-05-08T09:25:00.284507+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:25:00.284507+0000","last_undegraded":"2024-05-08T09:25:00.284507+0000","last_fullsized":"2024-05-08T09:25:00.284507+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.284405+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:11:16.757164+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.743909+0000","last_change":"2024-05-08T09:25:04.743937+0000","last_active":"2024-05-08T09:25:04.743909+0000","last_peered":"2024-05-08T09:25:04.743909+0000","last_clean":"2024-05-08T09:25:04.743909+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:25:04.743909+0000","last_undegraded":"2024-05-08T09:25:04.743909+0000","last_fullsized":"2024-05-08T09:25:04.743909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.743814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:55.764703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.255381+0000","last_change":"2024-05-08T09:25:38.255444+0000","last_active":"2024-05-08T09:25:38.255381+0000","last_peered":"2024-05-08T09:25:38.255381+0000","last_clean":"2024-05-08T09:25:38.255381+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:25:38.255381+0000","last_undegraded":"2024-05-08T09:25:38.255381+0000","last_fullsized":"2024-05-08T09:25:38.255381+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.255280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:02:43.030188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.997209+0000","last_change":"2024-05-08T09:25:32.997209+0000","last_active":"2024-05-08T09:25:32.997209+0000","last_peered":"2024-05-08T09:25:32.997209+0000","last_clean":"2024-05-08T09:25:32.997209+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:25:32.997209+0000","last_undegraded":"2024-05-08T09:25:32.997209+0000","last_fullsized":"2024-05-08T09:25:32.997209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.997014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:41.577605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178408+0000","last_change":"2024-05-08T09:21:20.671260+0000","last_active":"2024-05-08T09:24:49.178408+0000","last_peered":"2024-05-08T09:24:49.178408+0000","last_clean":"2024-05-08T09:24:49.178408+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:24:49.178408+0000","last_undegraded":"2024-05-08T09:24:49.178408+0000","last_fullsized":"2024-05-08T09:24:49.178408+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.348367+0000","last_change":"2024-05-08T09:25:18.348367+0000","last_active":"2024-05-08T09:25:18.348367+0000","last_peered":"2024-05-08T09:25:18.348367+0000","last_clean":"2024-05-08T09:25:18.348367+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:25:18.348367+0000","last_undegraded":"2024-05-08T09:25:18.348367+0000","last_fullsized":"2024-05-08T09:25:18.348367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.348203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:24.290463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.703314+0000","last_change":"2024-05-08T09:25:02.703314+0000","last_active":"2024-05-08T09:25:02.703314+0000","last_peered":"2024-05-08T09:25:02.703314+0000","last_clean":"2024-05-08T09:25:02.703314+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:25:02.703314+0000","last_undegraded":"2024-05-08T09:25:02.703314+0000","last_fullsized":"2024-05-08T09:25:02.703314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.703179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:19.071013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.065110+0000","last_change":"2024-05-08T09:24:58.065155+0000","last_active":"2024-05-08T09:24:58.065110+0000","last_peered":"2024-05-08T09:24:58.065110+0000","last_clean":"2024-05-08T09:24:58.065110+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:58.065110+0000","last_undegraded":"2024-05-08T09:24:58.065110+0000","last_fullsized":"2024-05-08T09:24:58.065110+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.065021+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:41.445580+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.225891+0000","last_change":"2024-05-08T09:25:18.225915+0000","last_active":"2024-05-08T09:25:18.225891+0000","last_peered":"2024-05-08T09:25:18.225891+0000","last_clean":"2024-05-08T09:25:18.225891+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:25:18.225891+0000","last_undegraded":"2024-05-08T09:25:18.225891+0000","last_fullsized":"2024-05-08T09:25:18.225891+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.225797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:51.835449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.735683+0000","last_change":"2024-05-08T09:25:08.735709+0000","last_active":"2024-05-08T09:25:08.735683+0000","last_peered":"2024-05-08T09:25:08.735683+0000","last_clean":"2024-05-08T09:25:08.735683+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:25:08.735683+0000","last_undegraded":"2024-05-08T09:25:08.735683+0000","last_fullsized":"2024-05-08T09:25:08.735683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.735600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:33.339447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.776797+0000","last_change":"2024-05-08T09:25:17.776797+0000","last_active":"2024-05-08T09:25:17.776797+0000","last_peered":"2024-05-08T09:25:17.776797+0000","last_clean":"2024-05-08T09:25:17.776797+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:25:17.776797+0000","last_undegraded":"2024-05-08T09:25:17.776797+0000","last_fullsized":"2024-05-08T09:25:17.776797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.776647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:35.577142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.356418+0000","last_change":"2024-05-08T09:25:14.356418+0000","last_active":"2024-05-08T09:25:14.356418+0000","last_peered":"2024-05-08T09:25:14.356418+0000","last_clean":"2024-05-08T09:25:14.356418+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:25:14.356418+0000","last_undegraded":"2024-05-08T09:25:14.356418+0000","last_fullsized":"2024-05-08T09:25:14.356418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.356288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:30.724123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.052956+0000","last_change":"2024-05-08T09:25:35.052987+0000","last_active":"2024-05-08T09:25:35.052956+0000","last_peered":"2024-05-08T09:25:35.052956+0000","last_clean":"2024-05-08T09:25:35.052956+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:25:35.052956+0000","last_undegraded":"2024-05-08T09:25:35.052956+0000","last_fullsized":"2024-05-08T09:25:35.052956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.052855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.695413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.733784+0000","last_change":"2024-05-08T09:25:03.733784+0000","last_active":"2024-05-08T09:25:03.733784+0000","last_peered":"2024-05-08T09:25:03.733784+0000","last_clean":"2024-05-08T09:25:03.733784+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:25:03.733784+0000","last_undegraded":"2024-05-08T09:25:03.733784+0000","last_fullsized":"2024-05-08T09:25:03.733784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.733661+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:36.989441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'73","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.773109+0000","last_change":"2024-05-08T09:24:57.773109+0000","last_active":"2024-05-08T09:24:57.773109+0000","last_peered":"2024-05-08T09:24:57.773109+0000","last_clean":"2024-05-08T09:24:57.773109+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:24:57.773109+0000","last_undegraded":"2024-05-08T09:24:57.773109+0000","last_fullsized":"2024-05-08T09:24:57.773109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.772960+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:39.160649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.236732+0000","last_change":"2024-05-08T09:24:49.236766+0000","last_active":"2024-05-08T09:24:49.236732+0000","last_peered":"2024-05-08T09:24:49.236732+0000","last_clean":"2024-05-08T09:24:49.236732+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:24:49.236732+0000","last_undegraded":"2024-05-08T09:24:49.236732+0000","last_fullsized":"2024-05-08T09:24:49.236732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.236605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:51.830567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.221643+0000","last_change":"2024-05-08T09:21:38.978488+0000","last_active":"2024-05-08T09:24:38.221643+0000","last_peered":"2024-05-08T09:24:38.221643+0000","last_clean":"2024-05-08T09:24:38.221643+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:24:38.221643+0000","last_undegraded":"2024-05-08T09:24:38.221643+0000","last_fullsized":"2024-05-08T09:24:38.221643+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.839615+0000","last_change":"2024-05-08T09:25:15.839615+0000","last_active":"2024-05-08T09:25:15.839615+0000","last_peered":"2024-05-08T09:25:15.839615+0000","last_clean":"2024-05-08T09:25:15.839615+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:25:15.839615+0000","last_undegraded":"2024-05-08T09:25:15.839615+0000","last_fullsized":"2024-05-08T09:25:15.839615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.839497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.088807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.030733+0000","last_change":"2024-05-08T09:25:38.030733+0000","last_active":"2024-05-08T09:25:38.030733+0000","last_peered":"2024-05-08T09:25:38.030733+0000","last_clean":"2024-05-08T09:25:38.030733+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:25:38.030733+0000","last_undegraded":"2024-05-08T09:25:38.030733+0000","last_fullsized":"2024-05-08T09:25:38.030733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.030617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:38.840037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178429+0000","last_change":"2024-05-08T09:21:20.671418+0000","last_active":"2024-05-08T09:24:49.178429+0000","last_peered":"2024-05-08T09:24:49.178429+0000","last_clean":"2024-05-08T09:24:49.178429+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:24:49.178429+0000","last_undegraded":"2024-05-08T09:24:49.178429+0000","last_fullsized":"2024-05-08T09:24:49.178429+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.124254+0000","last_change":"2024-05-08T09:24:51.124254+0000","last_active":"2024-05-08T09:24:51.124254+0000","last_peered":"2024-05-08T09:24:51.124254+0000","last_clean":"2024-05-08T09:24:51.124254+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:24:51.124254+0000","last_undegraded":"2024-05-08T09:24:51.124254+0000","last_fullsized":"2024-05-08T09:24:51.124254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.124097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:45.345946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.719193+0000","last_change":"2024-05-08T09:24:54.719272+0000","last_active":"2024-05-08T09:24:54.719193+0000","last_peered":"2024-05-08T09:24:54.719193+0000","last_clean":"2024-05-08T09:24:54.719193+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:24:54.719193+0000","last_undegraded":"2024-05-08T09:24:54.719193+0000","last_fullsized":"2024-05-08T09:24:54.719193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.719066+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.377306+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":369,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.668807+0000","last_change":"2024-05-08T09:24:50.668807+0000","last_active":"2024-05-08T09:24:50.668807+0000","last_peered":"2024-05-08T09:24:50.668807+0000","last_clean":"2024-05-08T09:24:50.668807+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:50.668807+0000","last_undegraded":"2024-05-08T09:24:50.668807+0000","last_fullsized":"2024-05-08T09:24:50.668807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.668685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:49.401297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:53.916011+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:23:53.916011+0000","last_peered":"2024-05-08T09:23:53.916011+0000","last_clean":"2024-05-08T09:23:53.916011+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:23:53.916011+0000","last_undegraded":"2024-05-08T09:23:53.916011+0000","last_fullsized":"2024-05-08T09:23:53.916011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.152804+0000","last_change":"2024-05-08T09:25:28.152804+0000","last_active":"2024-05-08T09:25:28.152804+0000","last_peered":"2024-05-08T09:25:28.152804+0000","last_clean":"2024-05-08T09:25:28.152804+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:25:28.152804+0000","last_undegraded":"2024-05-08T09:25:28.152804+0000","last_fullsized":"2024-05-08T09:25:28.152804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.152679+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:10.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905567+0000","last_change":"2024-05-08T09:21:28.966832+0000","last_active":"2024-05-08T09:24:44.905567+0000","last_peered":"2024-05-08T09:24:44.905567+0000","last_clean":"2024-05-08T09:24:44.905567+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:24:44.905567+0000","last_undegraded":"2024-05-08T09:24:44.905567+0000","last_fullsized":"2024-05-08T09:24:44.905567+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.064673+0000","last_change":"2024-05-08T09:25:36.064673+0000","last_active":"2024-05-08T09:25:36.064673+0000","last_peered":"2024-05-08T09:25:36.064673+0000","last_clean":"2024-05-08T09:25:36.064673+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:25:36.064673+0000","last_undegraded":"2024-05-08T09:25:36.064673+0000","last_fullsized":"2024-05-08T09:25:36.064673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.064555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:09.674206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.073177+0000","last_change":"2024-05-08T09:24:57.073177+0000","last_active":"2024-05-08T09:24:57.073177+0000","last_peered":"2024-05-08T09:24:57.073177+0000","last_clean":"2024-05-08T09:24:57.073177+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:24:57.073177+0000","last_undegraded":"2024-05-08T09:24:57.073177+0000","last_fullsized":"2024-05-08T09:24:57.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.073058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:35.322368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.226003+0000","last_change":"2024-05-08T09:25:23.226059+0000","last_active":"2024-05-08T09:25:23.226003+0000","last_peered":"2024-05-08T09:25:23.226003+0000","last_clean":"2024-05-08T09:25:23.226003+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:25:23.226003+0000","last_undegraded":"2024-05-08T09:25:23.226003+0000","last_fullsized":"2024-05-08T09:25:23.226003+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.225893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:55.821357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":424,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.762542+0000","last_change":"2024-05-08T09:24:53.762592+0000","last_active":"2024-05-08T09:24:53.762542+0000","last_peered":"2024-05-08T09:24:53.762542+0000","last_clean":"2024-05-08T09:24:53.762542+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:53.762542+0000","last_undegraded":"2024-05-08T09:24:53.762542+0000","last_fullsized":"2024-05-08T09:24:53.762542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.762413+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:17.292293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.728980+0000","last_change":"2024-05-08T09:25:00.729008+0000","last_active":"2024-05-08T09:25:00.728980+0000","last_peered":"2024-05-08T09:25:00.728980+0000","last_clean":"2024-05-08T09:25:00.728980+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:25:00.728980+0000","last_undegraded":"2024-05-08T09:25:00.728980+0000","last_fullsized":"2024-05-08T09:25:00.728980+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.728878+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:46.558237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'16","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.273892+0000","last_change":"2024-05-08T09:25:23.273892+0000","last_active":"2024-05-08T09:25:23.273892+0000","last_peered":"2024-05-08T09:25:23.273892+0000","last_clean":"2024-05-08T09:25:23.273892+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:25:23.273892+0000","last_undegraded":"2024-05-08T09:25:23.273892+0000","last_fullsized":"2024-05-08T09:25:23.273892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.273754+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:57.512051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.750132+0000","last_change":"2024-05-08T09:25:33.750165+0000","last_active":"2024-05-08T09:25:33.750132+0000","last_peered":"2024-05-08T09:25:33.750132+0000","last_clean":"2024-05-08T09:25:33.750132+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:25:33.750132+0000","last_undegraded":"2024-05-08T09:25:33.750132+0000","last_fullsized":"2024-05-08T09:25:33.750132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.750034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:38.390790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178436+0000","last_change":"2024-05-08T09:21:20.672747+0000","last_active":"2024-05-08T09:24:49.178436+0000","last_peered":"2024-05-08T09:24:49.178436+0000","last_clean":"2024-05-08T09:24:49.178436+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:24:49.178436+0000","last_undegraded":"2024-05-08T09:24:49.178436+0000","last_fullsized":"2024-05-08T09:24:49.178436+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:19.663062+0000","last_clean_scrub_stamp":"2024-05-08T09:21:19.663062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.067152+0000","last_change":"2024-05-08T09:25:00.067152+0000","last_active":"2024-05-08T09:25:00.067152+0000","last_peered":"2024-05-08T09:25:00.067152+0000","last_clean":"2024-05-08T09:25:00.067152+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:25:00.067152+0000","last_undegraded":"2024-05-08T09:25:00.067152+0000","last_fullsized":"2024-05-08T09:25:00.067152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.067020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:54.239410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":189,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.290063+0000","last_change":"2024-05-08T09:24:56.290105+0000","last_active":"2024-05-08T09:24:56.290063+0000","last_peered":"2024-05-08T09:24:56.290063+0000","last_clean":"2024-05-08T09:24:56.290063+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:24:56.290063+0000","last_undegraded":"2024-05-08T09:24:56.290063+0000","last_fullsized":"2024-05-08T09:24:56.290063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.289983+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:24.762692+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.755647+0000","last_change":"2024-05-08T09:24:52.755671+0000","last_active":"2024-05-08T09:24:52.755647+0000","last_peered":"2024-05-08T09:24:52.755647+0000","last_clean":"2024-05-08T09:24:52.755647+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:24:52.755647+0000","last_undegraded":"2024-05-08T09:24:52.755647+0000","last_fullsized":"2024-05-08T09:24:52.755647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.755558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:37:21.018669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.335801+0000","last_change":"2024-05-08T09:25:37.335831+0000","last_active":"2024-05-08T09:25:37.335801+0000","last_peered":"2024-05-08T09:25:37.335801+0000","last_clean":"2024-05-08T09:25:37.335801+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:25:37.335801+0000","last_undegraded":"2024-05-08T09:25:37.335801+0000","last_fullsized":"2024-05-08T09:25:37.335801+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.335715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:16.730123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.339998+0000","last_change":"2024-05-08T09:25:39.340043+0000","last_active":"2024-05-08T09:25:39.339998+0000","last_peered":"2024-05-08T09:25:39.339998+0000","last_clean":"2024-05-08T09:25:39.339998+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:25:39.339998+0000","last_undegraded":"2024-05-08T09:25:39.339998+0000","last_fullsized":"2024-05-08T09:25:39.339998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.339896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:32.696620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.264300+0000","last_change":"2024-05-08T09:25:10.264323+0000","last_active":"2024-05-08T09:25:10.264300+0000","last_peered":"2024-05-08T09:25:10.264300+0000","last_clean":"2024-05-08T09:25:10.264300+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:25:10.264300+0000","last_undegraded":"2024-05-08T09:25:10.264300+0000","last_fullsized":"2024-05-08T09:25:10.264300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.264214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:56.672907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915038+0000","last_change":"2024-05-08T09:21:28.969783+0000","last_active":"2024-05-08T09:23:48.915038+0000","last_peered":"2024-05-08T09:23:48.915038+0000","last_clean":"2024-05-08T09:23:48.915038+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:23:48.915038+0000","last_undegraded":"2024-05-08T09:23:48.915038+0000","last_fullsized":"2024-05-08T09:23:48.915038+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.738977+0000","last_change":"2024-05-08T09:25:03.739001+0000","last_active":"2024-05-08T09:25:03.738977+0000","last_peered":"2024-05-08T09:25:03.738977+0000","last_clean":"2024-05-08T09:25:03.738977+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:25:03.738977+0000","last_undegraded":"2024-05-08T09:25:03.738977+0000","last_fullsized":"2024-05-08T09:25:03.738977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.738886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:20.106720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.129955+0000","last_change":"2024-05-08T09:25:10.129988+0000","last_active":"2024-05-08T09:25:10.129955+0000","last_peered":"2024-05-08T09:25:10.129955+0000","last_clean":"2024-05-08T09:25:10.129955+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:25:10.129955+0000","last_undegraded":"2024-05-08T09:25:10.129955+0000","last_fullsized":"2024-05-08T09:25:10.129955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.129867+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:03.675404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.234399+0000","last_change":"2024-05-08T09:25:30.234422+0000","last_active":"2024-05-08T09:25:30.234399+0000","last_peered":"2024-05-08T09:25:30.234399+0000","last_clean":"2024-05-08T09:25:30.234399+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:25:30.234399+0000","last_undegraded":"2024-05-08T09:25:30.234399+0000","last_fullsized":"2024-05-08T09:25:30.234399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.234277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:27.546403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":25,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.824746+0000","last_change":"2024-05-08T09:21:38.979968+0000","last_active":"2024-05-08T09:24:47.824746+0000","last_peered":"2024-05-08T09:24:47.824746+0000","last_clean":"2024-05-08T09:24:47.824746+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:24:47.824746+0000","last_undegraded":"2024-05-08T09:24:47.824746+0000","last_fullsized":"2024-05-08T09:24:47.824746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.247038+0000","last_change":"2024-05-08T09:22:16.068844+0000","last_active":"2024-05-08T09:24:38.247038+0000","last_peered":"2024-05-08T09:24:38.247038+0000","last_clean":"2024-05-08T09:24:38.247038+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:24:38.247038+0000","last_undegraded":"2024-05-08T09:24:38.247038+0000","last_fullsized":"2024-05-08T09:24:38.247038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.324870+0000","last_change":"2024-05-08T09:25:16.324894+0000","last_active":"2024-05-08T09:25:16.324870+0000","last_peered":"2024-05-08T09:25:16.324870+0000","last_clean":"2024-05-08T09:25:16.324870+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:25:16.324870+0000","last_undegraded":"2024-05-08T09:25:16.324870+0000","last_fullsized":"2024-05-08T09:25:16.324870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.324762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:07.345651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.092621+0000","last_change":"2024-05-08T09:24:59.092649+0000","last_active":"2024-05-08T09:24:59.092621+0000","last_peered":"2024-05-08T09:24:59.092621+0000","last_clean":"2024-05-08T09:24:59.092621+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:24:59.092621+0000","last_undegraded":"2024-05-08T09:24:59.092621+0000","last_fullsized":"2024-05-08T09:24:59.092621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.092531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:16.893025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.726480+0000","last_change":"2024-05-08T09:25:01.726515+0000","last_active":"2024-05-08T09:25:01.726480+0000","last_peered":"2024-05-08T09:25:01.726480+0000","last_clean":"2024-05-08T09:25:01.726480+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:25:01.726480+0000","last_undegraded":"2024-05-08T09:25:01.726480+0000","last_fullsized":"2024-05-08T09:25:01.726480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.726389+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:39.682934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.262975+0000","last_change":"2024-05-08T09:24:50.262998+0000","last_active":"2024-05-08T09:24:50.262975+0000","last_peered":"2024-05-08T09:24:50.262975+0000","last_clean":"2024-05-08T09:24:50.262975+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:24:50.262975+0000","last_undegraded":"2024-05-08T09:24:50.262975+0000","last_fullsized":"2024-05-08T09:24:50.262975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.262889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:10.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:08.912760+0000","last_change":"2024-05-08T09:21:38.974000+0000","last_active":"2024-05-08T09:24:08.912760+0000","last_peered":"2024-05-08T09:24:08.912760+0000","last_clean":"2024-05-08T09:24:08.912760+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:24:08.912760+0000","last_undegraded":"2024-05-08T09:24:08.912760+0000","last_fullsized":"2024-05-08T09:24:08.912760+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.877397+0000","last_change":"2024-05-08T09:25:14.877426+0000","last_active":"2024-05-08T09:25:14.877397+0000","last_peered":"2024-05-08T09:25:14.877397+0000","last_clean":"2024-05-08T09:25:14.877397+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:25:14.877397+0000","last_undegraded":"2024-05-08T09:25:14.877397+0000","last_fullsized":"2024-05-08T09:25:14.877397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.877308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:53.126619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.369985+0000","last_change":"2024-05-08T09:25:33.370010+0000","last_active":"2024-05-08T09:25:33.369985+0000","last_peered":"2024-05-08T09:25:33.369985+0000","last_clean":"2024-05-08T09:25:33.369985+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:25:33.369985+0000","last_undegraded":"2024-05-08T09:25:33.369985+0000","last_fullsized":"2024-05-08T09:25:33.369985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.369888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:36.532509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.328695+0000","last_change":"2024-05-08T09:25:06.328721+0000","last_active":"2024-05-08T09:25:06.328695+0000","last_peered":"2024-05-08T09:25:06.328695+0000","last_clean":"2024-05-08T09:25:06.328695+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:25:06.328695+0000","last_undegraded":"2024-05-08T09:25:06.328695+0000","last_fullsized":"2024-05-08T09:25:06.328695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.328595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:24.990182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.742554+0000","last_change":"2024-05-08T09:24:54.742594+0000","last_active":"2024-05-08T09:24:54.742554+0000","last_peered":"2024-05-08T09:24:54.742554+0000","last_clean":"2024-05-08T09:24:54.742554+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:54.742554+0000","last_undegraded":"2024-05-08T09:24:54.742554+0000","last_fullsized":"2024-05-08T09:24:54.742554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.742456+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:50.767894+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.658943+0000","last_change":"2024-05-08T09:24:51.658969+0000","last_active":"2024-05-08T09:24:51.658943+0000","last_peered":"2024-05-08T09:24:51.658943+0000","last_clean":"2024-05-08T09:24:51.658943+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:24:51.658943+0000","last_undegraded":"2024-05-08T09:24:51.658943+0000","last_fullsized":"2024-05-08T09:24:51.658943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.658847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:21:59.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.232278+0000","last_change":"2024-05-08T09:25:34.232307+0000","last_active":"2024-05-08T09:25:34.232278+0000","last_peered":"2024-05-08T09:25:34.232278+0000","last_clean":"2024-05-08T09:25:34.232278+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:25:34.232278+0000","last_undegraded":"2024-05-08T09:25:34.232278+0000","last_fullsized":"2024-05-08T09:25:34.232278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.232174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:46.890740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.305095+0000","last_change":"2024-05-08T09:25:42.305165+0000","last_active":"2024-05-08T09:25:42.305095+0000","last_peered":"2024-05-08T09:25:42.305095+0000","last_clean":"2024-05-08T09:25:42.305095+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:25:42.305095+0000","last_undegraded":"2024-05-08T09:25:42.305095+0000","last_fullsized":"2024-05-08T09:25:42.305095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.304979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:28.049765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.759058+0000","last_change":"2024-05-08T09:25:23.759086+0000","last_active":"2024-05-08T09:25:23.759058+0000","last_peered":"2024-05-08T09:25:23.759058+0000","last_clean":"2024-05-08T09:25:23.759058+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:25:23.759058+0000","last_undegraded":"2024-05-08T09:25:23.759058+0000","last_fullsized":"2024-05-08T09:25:23.759058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.758963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:56.200915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.045028+0000","last_change":"2024-05-08T09:24:55.045049+0000","last_active":"2024-05-08T09:24:55.045028+0000","last_peered":"2024-05-08T09:24:55.045028+0000","last_clean":"2024-05-08T09:24:55.045028+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:24:55.045028+0000","last_undegraded":"2024-05-08T09:24:55.045028+0000","last_fullsized":"2024-05-08T09:24:55.045028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.044956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:28.363607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.255638+0000","last_change":"2024-05-08T09:24:59.255686+0000","last_active":"2024-05-08T09:24:59.255638+0000","last_peered":"2024-05-08T09:24:59.255638+0000","last_clean":"2024-05-08T09:24:59.255638+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:24:59.255638+0000","last_undegraded":"2024-05-08T09:24:59.255638+0000","last_fullsized":"2024-05-08T09:24:59.255638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.255555+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:18:31.061439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.260222+0000","last_change":"2024-05-08T09:24:51.260245+0000","last_active":"2024-05-08T09:24:51.260222+0000","last_peered":"2024-05-08T09:24:51.260222+0000","last_clean":"2024-05-08T09:24:51.260222+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:24:51.260222+0000","last_undegraded":"2024-05-08T09:24:51.260222+0000","last_fullsized":"2024-05-08T09:24:51.260222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.260133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:11.715270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.220779+0000","last_change":"2024-05-08T09:25:36.220779+0000","last_active":"2024-05-08T09:25:36.220779+0000","last_peered":"2024-05-08T09:25:36.220779+0000","last_clean":"2024-05-08T09:25:36.220779+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:25:36.220779+0000","last_undegraded":"2024-05-08T09:25:36.220779+0000","last_fullsized":"2024-05-08T09:25:36.220779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.220667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:18.540821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.180602+0000","last_change":"2024-05-08T09:25:41.180625+0000","last_active":"2024-05-08T09:25:41.180602+0000","last_peered":"2024-05-08T09:25:41.180602+0000","last_clean":"2024-05-08T09:25:41.180602+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:25:41.180602+0000","last_undegraded":"2024-05-08T09:25:41.180602+0000","last_fullsized":"2024-05-08T09:25:41.180602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.120542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.798715+0000","last_change":"2024-05-08T09:25:07.798715+0000","last_active":"2024-05-08T09:25:07.798715+0000","last_peered":"2024-05-08T09:25:07.798715+0000","last_clean":"2024-05-08T09:25:07.798715+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:25:07.798715+0000","last_undegraded":"2024-05-08T09:25:07.798715+0000","last_fullsized":"2024-05-08T09:25:07.798715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.798584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.402432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.736974+0000","last_change":"2024-05-08T09:24:58.737020+0000","last_active":"2024-05-08T09:24:58.736974+0000","last_peered":"2024-05-08T09:24:58.736974+0000","last_clean":"2024-05-08T09:24:58.736974+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:24:58.736974+0000","last_undegraded":"2024-05-08T09:24:58.736974+0000","last_fullsized":"2024-05-08T09:24:58.736974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.736875+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:49.606990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.304313+0000","last_change":"2024-05-08T09:24:52.304336+0000","last_active":"2024-05-08T09:24:52.304313+0000","last_peered":"2024-05-08T09:24:52.304313+0000","last_clean":"2024-05-08T09:24:52.304313+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:24:52.304313+0000","last_undegraded":"2024-05-08T09:24:52.304313+0000","last_fullsized":"2024-05-08T09:24:52.304313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.304223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:48.209866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.170794+0000","last_change":"2024-05-08T09:21:38.972027+0000","last_active":"2024-05-08T09:24:38.170794+0000","last_peered":"2024-05-08T09:24:38.170794+0000","last_clean":"2024-05-08T09:24:38.170794+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:24:38.170794+0000","last_undegraded":"2024-05-08T09:24:38.170794+0000","last_fullsized":"2024-05-08T09:24:38.170794+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.968858+0000","last_change":"2024-05-08T09:25:22.968858+0000","last_active":"2024-05-08T09:25:22.968858+0000","last_peered":"2024-05-08T09:25:22.968858+0000","last_clean":"2024-05-08T09:25:22.968858+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:25:22.968858+0000","last_undegraded":"2024-05-08T09:25:22.968858+0000","last_fullsized":"2024-05-08T09:25:22.968858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.968709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:43.854555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.790495+0000","last_change":"2024-05-08T09:25:36.790527+0000","last_active":"2024-05-08T09:25:36.790495+0000","last_peered":"2024-05-08T09:25:36.790495+0000","last_clean":"2024-05-08T09:25:36.790495+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:25:36.790495+0000","last_undegraded":"2024-05-08T09:25:36.790495+0000","last_fullsized":"2024-05-08T09:25:36.790495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.790389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:10.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.316305+0000","last_change":"2024-05-08T09:25:08.316305+0000","last_active":"2024-05-08T09:25:08.316305+0000","last_peered":"2024-05-08T09:25:08.316305+0000","last_clean":"2024-05-08T09:25:08.316305+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:25:08.316305+0000","last_undegraded":"2024-05-08T09:25:08.316305+0000","last_fullsized":"2024-05-08T09:25:08.316305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.316182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:36.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.028482+0000","last_change":"2024-05-08T09:25:04.028522+0000","last_active":"2024-05-08T09:25:04.028482+0000","last_peered":"2024-05-08T09:25:04.028482+0000","last_clean":"2024-05-08T09:25:04.028482+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:25:04.028482+0000","last_undegraded":"2024-05-08T09:25:04.028482+0000","last_fullsized":"2024-05-08T09:25:04.028482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.028381+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:37.084622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.696777+0000","last_change":"2024-05-08T09:24:52.696803+0000","last_active":"2024-05-08T09:24:52.696777+0000","last_peered":"2024-05-08T09:24:52.696777+0000","last_clean":"2024-05-08T09:24:52.696777+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:24:52.696777+0000","last_undegraded":"2024-05-08T09:24:52.696777+0000","last_fullsized":"2024-05-08T09:24:52.696777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.696677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:55.771440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.211191+0000","last_change":"2024-05-08T09:25:42.211221+0000","last_active":"2024-05-08T09:25:42.211191+0000","last_peered":"2024-05-08T09:25:42.211191+0000","last_clean":"2024-05-08T09:25:42.211191+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:25:42.211191+0000","last_undegraded":"2024-05-08T09:25:42.211191+0000","last_fullsized":"2024-05-08T09:25:42.211191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.211101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:08.820703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.978022+0000","last_change":"2024-05-08T09:25:04.978073+0000","last_active":"2024-05-08T09:25:04.978022+0000","last_peered":"2024-05-08T09:25:04.978022+0000","last_clean":"2024-05-08T09:25:04.978022+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:25:04.978022+0000","last_undegraded":"2024-05-08T09:25:04.978022+0000","last_fullsized":"2024-05-08T09:25:04.978022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.977922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:25.863768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.827635+0000","last_change":"2024-05-08T09:25:25.827659+0000","last_active":"2024-05-08T09:25:25.827635+0000","last_peered":"2024-05-08T09:25:25.827635+0000","last_clean":"2024-05-08T09:25:25.827635+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:25:25.827635+0000","last_undegraded":"2024-05-08T09:25:25.827635+0000","last_fullsized":"2024-05-08T09:25:25.827635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.827542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:05.221950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.308936+0000","last_change":"2024-05-08T09:25:41.308979+0000","last_active":"2024-05-08T09:25:41.308936+0000","last_peered":"2024-05-08T09:25:41.308936+0000","last_clean":"2024-05-08T09:25:41.308936+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:25:41.308936+0000","last_undegraded":"2024-05-08T09:25:41.308936+0000","last_fullsized":"2024-05-08T09:25:41.308936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.308821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:15.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'42","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.696183+0000","last_change":"2024-05-08T09:24:59.696268+0000","last_active":"2024-05-08T09:24:59.696183+0000","last_peered":"2024-05-08T09:24:59.696183+0000","last_clean":"2024-05-08T09:24:59.696183+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:24:59.696183+0000","last_undegraded":"2024-05-08T09:24:59.696183+0000","last_fullsized":"2024-05-08T09:24:59.696183+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.696053+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:13:58.776407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.838408+0000","last_change":"2024-05-08T09:24:47.838408+0000","last_active":"2024-05-08T09:24:47.838408+0000","last_peered":"2024-05-08T09:24:47.838408+0000","last_clean":"2024-05-08T09:24:47.838408+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:24:47.838408+0000","last_undegraded":"2024-05-08T09:24:47.838408+0000","last_fullsized":"2024-05-08T09:24:47.838408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_clean_scrub_stamp":"2024-05-08T09:24:47.838309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:42.986914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350051+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.350051+0000","last_peered":"2024-05-08T09:24:38.350051+0000","last_clean":"2024-05-08T09:24:38.350051+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.350051+0000","last_undegraded":"2024-05-08T09:24:38.350051+0000","last_fullsized":"2024-05-08T09:24:38.350051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.888001+0000","last_change":"2024-05-08T09:25:28.888031+0000","last_active":"2024-05-08T09:25:28.888001+0000","last_peered":"2024-05-08T09:25:28.888001+0000","last_clean":"2024-05-08T09:25:28.888001+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:25:28.888001+0000","last_undegraded":"2024-05-08T09:25:28.888001+0000","last_fullsized":"2024-05-08T09:25:28.888001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.887905+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:55.699403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916750+0000","last_change":"2024-05-08T09:21:28.965593+0000","last_active":"2024-05-08T09:23:58.916750+0000","last_peered":"2024-05-08T09:23:58.916750+0000","last_clean":"2024-05-08T09:23:58.916750+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:23:58.916750+0000","last_undegraded":"2024-05-08T09:23:58.916750+0000","last_fullsized":"2024-05-08T09:23:58.916750+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917137+0000","last_change":"2024-05-08T09:22:16.002934+0000","last_active":"2024-05-08T09:24:03.917137+0000","last_peered":"2024-05-08T09:24:03.917137+0000","last_clean":"2024-05-08T09:24:03.917137+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:24:03.917137+0000","last_undegraded":"2024-05-08T09:24:03.917137+0000","last_fullsized":"2024-05-08T09:24:03.917137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:31.934438+0000","last_clean_scrub_stamp":"2024-05-08T09:21:31.934438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.221077+0000","last_change":"2024-05-08T09:25:19.221077+0000","last_active":"2024-05-08T09:25:19.221077+0000","last_peered":"2024-05-08T09:25:19.221077+0000","last_clean":"2024-05-08T09:25:19.221077+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:25:19.221077+0000","last_undegraded":"2024-05-08T09:25:19.221077+0000","last_fullsized":"2024-05-08T09:25:19.221077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.220927+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:19.461415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":387,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.309850+0000","last_change":"2024-05-08T09:25:01.309897+0000","last_active":"2024-05-08T09:25:01.309850+0000","last_peered":"2024-05-08T09:25:01.309850+0000","last_clean":"2024-05-08T09:25:01.309850+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:25:01.309850+0000","last_undegraded":"2024-05-08T09:25:01.309850+0000","last_fullsized":"2024-05-08T09:25:01.309850+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.309733+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:23.863794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916533+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:23:58.916533+0000","last_peered":"2024-05-08T09:23:58.916533+0000","last_clean":"2024-05-08T09:23:58.916533+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:23:58.916533+0000","last_undegraded":"2024-05-08T09:23:58.916533+0000","last_fullsized":"2024-05-08T09:23:58.916533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.354967+0000","last_change":"2024-05-08T09:25:17.354994+0000","last_active":"2024-05-08T09:25:17.354967+0000","last_peered":"2024-05-08T09:25:17.354967+0000","last_clean":"2024-05-08T09:25:17.354967+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:25:17.354967+0000","last_undegraded":"2024-05-08T09:25:17.354967+0000","last_fullsized":"2024-05-08T09:25:17.354967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.354872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:43:36.638892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.811884+0000","last_change":"2024-05-08T09:25:35.811937+0000","last_active":"2024-05-08T09:25:35.811884+0000","last_peered":"2024-05-08T09:25:35.811884+0000","last_clean":"2024-05-08T09:25:35.811884+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:25:35.811884+0000","last_undegraded":"2024-05-08T09:25:35.811884+0000","last_fullsized":"2024-05-08T09:25:35.811884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.811764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:18.454322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.708229+0000","last_change":"2024-05-08T09:25:02.708273+0000","last_active":"2024-05-08T09:25:02.708229+0000","last_peered":"2024-05-08T09:25:02.708229+0000","last_clean":"2024-05-08T09:25:02.708229+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:25:02.708229+0000","last_undegraded":"2024-05-08T09:25:02.708229+0000","last_fullsized":"2024-05-08T09:25:02.708229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.708109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:40.664654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.785230+0000","last_change":"2024-05-08T09:24:58.785302+0000","last_active":"2024-05-08T09:24:58.785230+0000","last_peered":"2024-05-08T09:24:58.785230+0000","last_clean":"2024-05-08T09:24:58.785230+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:58.785230+0000","last_undegraded":"2024-05-08T09:24:58.785230+0000","last_fullsized":"2024-05-08T09:24:58.785230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.785128+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:40.172817+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.715808+0000","last_change":"2024-05-08T09:25:00.715835+0000","last_active":"2024-05-08T09:25:00.715808+0000","last_peered":"2024-05-08T09:25:00.715808+0000","last_clean":"2024-05-08T09:25:00.715808+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:25:00.715808+0000","last_undegraded":"2024-05-08T09:25:00.715808+0000","last_fullsized":"2024-05-08T09:25:00.715808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.715715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.307803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917206+0000","last_change":"2024-05-08T09:21:38.986881+0000","last_active":"2024-05-08T09:24:03.917206+0000","last_peered":"2024-05-08T09:24:03.917206+0000","last_clean":"2024-05-08T09:24:03.917206+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:24:03.917206+0000","last_undegraded":"2024-05-08T09:24:03.917206+0000","last_fullsized":"2024-05-08T09:24:03.917206+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.293530+0000","last_change":"2024-05-08T09:25:12.293561+0000","last_active":"2024-05-08T09:25:12.293530+0000","last_peered":"2024-05-08T09:25:12.293530+0000","last_clean":"2024-05-08T09:25:12.293530+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:25:12.293530+0000","last_undegraded":"2024-05-08T09:25:12.293530+0000","last_fullsized":"2024-05-08T09:25:12.293530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.293425+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:22:06.522385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916866+0000","last_change":"2024-05-08T09:21:28.969544+0000","last_active":"2024-05-08T09:23:58.916866+0000","last_peered":"2024-05-08T09:23:58.916866+0000","last_clean":"2024-05-08T09:23:58.916866+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:23:58.916866+0000","last_undegraded":"2024-05-08T09:23:58.916866+0000","last_fullsized":"2024-05-08T09:23:58.916866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.325599+0000","last_change":"2024-05-08T09:25:04.325623+0000","last_active":"2024-05-08T09:25:04.325599+0000","last_peered":"2024-05-08T09:25:04.325599+0000","last_clean":"2024-05-08T09:25:04.325599+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:25:04.325599+0000","last_undegraded":"2024-05-08T09:25:04.325599+0000","last_fullsized":"2024-05-08T09:25:04.325599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.325510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:21:04.445305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.725148+0000","last_change":"2024-05-08T09:24:55.725187+0000","last_active":"2024-05-08T09:24:55.725148+0000","last_peered":"2024-05-08T09:24:55.725148+0000","last_clean":"2024-05-08T09:24:55.725148+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:24:55.725148+0000","last_undegraded":"2024-05-08T09:24:55.725148+0000","last_fullsized":"2024-05-08T09:24:55.725148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.725057+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:11.134393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.242609+0000","last_change":"2024-05-08T09:25:13.242631+0000","last_active":"2024-05-08T09:25:13.242609+0000","last_peered":"2024-05-08T09:25:13.242609+0000","last_clean":"2024-05-08T09:25:13.242609+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:25:13.242609+0000","last_undegraded":"2024-05-08T09:25:13.242609+0000","last_fullsized":"2024-05-08T09:25:13.242609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.242515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:24.570077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917812+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:24:03.917812+0000","last_peered":"2024-05-08T09:24:03.917812+0000","last_clean":"2024-05-08T09:24:03.917812+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:24:03.917812+0000","last_undegraded":"2024-05-08T09:24:03.917812+0000","last_fullsized":"2024-05-08T09:24:03.917812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.227623+0000","last_change":"2024-05-08T09:25:39.227646+0000","last_active":"2024-05-08T09:25:39.227623+0000","last_peered":"2024-05-08T09:25:39.227623+0000","last_clean":"2024-05-08T09:25:39.227623+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:25:39.227623+0000","last_undegraded":"2024-05-08T09:25:39.227623+0000","last_fullsized":"2024-05-08T09:25:39.227623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.227532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:48:33.902172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.018533+0000","last_change":"2024-05-08T09:25:42.018579+0000","last_active":"2024-05-08T09:25:42.018533+0000","last_peered":"2024-05-08T09:25:42.018533+0000","last_clean":"2024-05-08T09:25:42.018533+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:25:42.018533+0000","last_undegraded":"2024-05-08T09:25:42.018533+0000","last_fullsized":"2024-05-08T09:25:42.018533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.018441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:20.667622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.710549+0000","last_change":"2024-05-08T09:25:09.710589+0000","last_active":"2024-05-08T09:25:09.710549+0000","last_peered":"2024-05-08T09:25:09.710549+0000","last_clean":"2024-05-08T09:25:09.710549+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:25:09.710549+0000","last_undegraded":"2024-05-08T09:25:09.710549+0000","last_fullsized":"2024-05-08T09:25:09.710549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.710445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:39.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.024510+0000","last_change":"2024-05-08T09:25:06.024545+0000","last_active":"2024-05-08T09:25:06.024510+0000","last_peered":"2024-05-08T09:25:06.024510+0000","last_clean":"2024-05-08T09:25:06.024510+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:25:06.024510+0000","last_undegraded":"2024-05-08T09:25:06.024510+0000","last_fullsized":"2024-05-08T09:25:06.024510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.024416+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:05.508652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.219331+0000","last_change":"2024-05-08T09:25:12.219351+0000","last_active":"2024-05-08T09:25:12.219331+0000","last_peered":"2024-05-08T09:25:12.219331+0000","last_clean":"2024-05-08T09:25:12.219331+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:25:12.219331+0000","last_undegraded":"2024-05-08T09:25:12.219331+0000","last_fullsized":"2024-05-08T09:25:12.219331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.219227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:57.964012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917702+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:24:03.917702+0000","last_peered":"2024-05-08T09:24:03.917702+0000","last_clean":"2024-05-08T09:24:03.917702+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:24:03.917702+0000","last_undegraded":"2024-05-08T09:24:03.917702+0000","last_fullsized":"2024-05-08T09:24:03.917702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.291187+0000","last_change":"2024-05-08T09:25:11.291213+0000","last_active":"2024-05-08T09:25:11.291187+0000","last_peered":"2024-05-08T09:25:11.291187+0000","last_clean":"2024-05-08T09:25:11.291187+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:25:11.291187+0000","last_undegraded":"2024-05-08T09:25:11.291187+0000","last_fullsized":"2024-05-08T09:25:11.291187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.291068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:14:10.371422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.760346+0000","last_change":"2024-05-08T09:25:29.760346+0000","last_active":"2024-05-08T09:25:29.760346+0000","last_peered":"2024-05-08T09:25:29.760346+0000","last_clean":"2024-05-08T09:25:29.760346+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:25:29.760346+0000","last_undegraded":"2024-05-08T09:25:29.760346+0000","last_fullsized":"2024-05-08T09:25:29.760346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.760187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:56.571684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.744081+0000","last_change":"2024-05-08T09:25:05.744126+0000","last_active":"2024-05-08T09:25:05.744081+0000","last_peered":"2024-05-08T09:25:05.744081+0000","last_clean":"2024-05-08T09:25:05.744081+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:25:05.744081+0000","last_undegraded":"2024-05-08T09:25:05.744081+0000","last_fullsized":"2024-05-08T09:25:05.744081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.743972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:56.764860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.247188+0000","last_change":"2024-05-08T09:25:21.247244+0000","last_active":"2024-05-08T09:25:21.247188+0000","last_peered":"2024-05-08T09:25:21.247188+0000","last_clean":"2024-05-08T09:25:21.247188+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:25:21.247188+0000","last_undegraded":"2024-05-08T09:25:21.247188+0000","last_fullsized":"2024-05-08T09:25:21.247188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.247063+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:06.940266+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.806517+0000","last_change":"2024-05-08T09:25:08.806540+0000","last_active":"2024-05-08T09:25:08.806517+0000","last_peered":"2024-05-08T09:25:08.806517+0000","last_clean":"2024-05-08T09:25:08.806517+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:25:08.806517+0000","last_undegraded":"2024-05-08T09:25:08.806517+0000","last_fullsized":"2024-05-08T09:25:08.806517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.806424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:38.700044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916792+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:58.916792+0000","last_peered":"2024-05-08T09:23:58.916792+0000","last_clean":"2024-05-08T09:23:58.916792+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:58.916792+0000","last_undegraded":"2024-05-08T09:23:58.916792+0000","last_fullsized":"2024-05-08T09:23:58.916792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.775219+0000","last_change":"2024-05-08T09:25:13.775263+0000","last_active":"2024-05-08T09:25:13.775219+0000","last_peered":"2024-05-08T09:25:13.775219+0000","last_clean":"2024-05-08T09:25:13.775219+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:25:13.775219+0000","last_undegraded":"2024-05-08T09:25:13.775219+0000","last_fullsized":"2024-05-08T09:25:13.775219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.775111+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:47.093763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.313018+0000","last_change":"2024-05-08T09:25:22.313018+0000","last_active":"2024-05-08T09:25:22.313018+0000","last_peered":"2024-05-08T09:25:22.313018+0000","last_clean":"2024-05-08T09:25:22.313018+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:25:22.313018+0000","last_undegraded":"2024-05-08T09:25:22.313018+0000","last_fullsized":"2024-05-08T09:25:22.313018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.312893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:44.206369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.981908+0000","last_change":"2024-05-08T09:25:30.981937+0000","last_active":"2024-05-08T09:25:30.981908+0000","last_peered":"2024-05-08T09:25:30.981908+0000","last_clean":"2024-05-08T09:25:30.981908+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:25:30.981908+0000","last_undegraded":"2024-05-08T09:25:30.981908+0000","last_fullsized":"2024-05-08T09:25:30.981908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.981798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:42.309360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.933548+0000","last_change":"2024-05-08T09:25:29.933548+0000","last_active":"2024-05-08T09:25:29.933548+0000","last_peered":"2024-05-08T09:25:29.933548+0000","last_clean":"2024-05-08T09:25:29.933548+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:25:29.933548+0000","last_undegraded":"2024-05-08T09:25:29.933548+0000","last_fullsized":"2024-05-08T09:25:29.933548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.933418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:15.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.095431+0000","last_change":"2024-05-08T09:25:08.095458+0000","last_active":"2024-05-08T09:25:08.095431+0000","last_peered":"2024-05-08T09:25:08.095431+0000","last_clean":"2024-05-08T09:25:08.095431+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:25:08.095431+0000","last_undegraded":"2024-05-08T09:25:08.095431+0000","last_fullsized":"2024-05-08T09:25:08.095431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.095295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:36.538089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.178728+0000","last_change":"2024-05-08T09:21:28.976807+0000","last_active":"2024-05-08T09:24:49.178728+0000","last_peered":"2024-05-08T09:24:49.178728+0000","last_clean":"2024-05-08T09:24:49.178728+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:24:49.178728+0000","last_undegraded":"2024-05-08T09:24:49.178728+0000","last_fullsized":"2024-05-08T09:24:49.178728+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.024040+0000","last_change":"2024-05-08T09:25:43.024069+0000","last_active":"2024-05-08T09:25:43.024040+0000","last_peered":"2024-05-08T09:25:43.024040+0000","last_clean":"2024-05-08T09:25:43.024040+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:25:43.024040+0000","last_undegraded":"2024-05-08T09:25:43.024040+0000","last_fullsized":"2024-05-08T09:25:43.024040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.023920+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:28.250979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.935517+0000","last_change":"2024-05-08T09:25:27.935517+0000","last_active":"2024-05-08T09:25:27.935517+0000","last_peered":"2024-05-08T09:25:27.935517+0000","last_clean":"2024-05-08T09:25:27.935517+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:25:27.935517+0000","last_undegraded":"2024-05-08T09:25:27.935517+0000","last_fullsized":"2024-05-08T09:25:27.935517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.935400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:21.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.864386+0000","last_change":"2024-05-08T09:25:15.864386+0000","last_active":"2024-05-08T09:25:15.864386+0000","last_peered":"2024-05-08T09:25:15.864386+0000","last_clean":"2024-05-08T09:25:15.864386+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:25:15.864386+0000","last_undegraded":"2024-05-08T09:25:15.864386+0000","last_fullsized":"2024-05-08T09:25:15.864386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.864275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:59.244834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.043835+0000","last_change":"2024-05-08T09:25:37.043863+0000","last_active":"2024-05-08T09:25:37.043835+0000","last_peered":"2024-05-08T09:25:37.043835+0000","last_clean":"2024-05-08T09:25:37.043835+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:25:37.043835+0000","last_undegraded":"2024-05-08T09:25:37.043835+0000","last_fullsized":"2024-05-08T09:25:37.043835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.043737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.284226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.793928+0000","last_change":"2024-05-08T09:25:14.793928+0000","last_active":"2024-05-08T09:25:14.793928+0000","last_peered":"2024-05-08T09:25:14.793928+0000","last_clean":"2024-05-08T09:25:14.793928+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:25:14.793928+0000","last_undegraded":"2024-05-08T09:25:14.793928+0000","last_fullsized":"2024-05-08T09:25:14.793928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.793800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:42.341391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.685951+0000","last_change":"2024-05-08T09:25:39.686004+0000","last_active":"2024-05-08T09:25:39.685951+0000","last_peered":"2024-05-08T09:25:39.685951+0000","last_clean":"2024-05-08T09:25:39.685951+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:25:39.685951+0000","last_undegraded":"2024-05-08T09:25:39.685951+0000","last_fullsized":"2024-05-08T09:25:39.685951+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.685820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:49:08.938034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.897362+0000","last_change":"2024-05-08T09:25:20.897362+0000","last_active":"2024-05-08T09:25:20.897362+0000","last_peered":"2024-05-08T09:25:20.897362+0000","last_clean":"2024-05-08T09:25:20.897362+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:25:20.897362+0000","last_undegraded":"2024-05-08T09:25:20.897362+0000","last_fullsized":"2024-05-08T09:25:20.897362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.897248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:45.128802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.310353+0000","last_change":"2024-05-08T09:25:20.310379+0000","last_active":"2024-05-08T09:25:20.310353+0000","last_peered":"2024-05-08T09:25:20.310353+0000","last_clean":"2024-05-08T09:25:20.310353+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:25:20.310353+0000","last_undegraded":"2024-05-08T09:25:20.310353+0000","last_fullsized":"2024-05-08T09:25:20.310353+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.310253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:13:14.532102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'10","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.739969+0000","last_change":"2024-05-08T09:25:30.739969+0000","last_active":"2024-05-08T09:25:30.739969+0000","last_peered":"2024-05-08T09:25:30.739969+0000","last_clean":"2024-05-08T09:25:30.739969+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:25:30.739969+0000","last_undegraded":"2024-05-08T09:25:30.739969+0000","last_fullsized":"2024-05-08T09:25:30.739969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.739841+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:16.484626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.034902+0000","last_change":"2024-05-08T09:25:40.034958+0000","last_active":"2024-05-08T09:25:40.034902+0000","last_peered":"2024-05-08T09:25:40.034902+0000","last_clean":"2024-05-08T09:25:40.034902+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:25:40.034902+0000","last_undegraded":"2024-05-08T09:25:40.034902+0000","last_fullsized":"2024-05-08T09:25:40.034902+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.034807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.084734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.805431+0000","last_change":"2024-05-08T09:25:24.805478+0000","last_active":"2024-05-08T09:25:24.805431+0000","last_peered":"2024-05-08T09:25:24.805431+0000","last_clean":"2024-05-08T09:25:24.805431+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:25:24.805431+0000","last_undegraded":"2024-05-08T09:25:24.805431+0000","last_fullsized":"2024-05-08T09:25:24.805431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.805324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:24.289560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:38.913019+0000","last_change":"2024-05-08T09:21:28.978634+0000","last_active":"2024-05-08T09:23:38.913019+0000","last_peered":"2024-05-08T09:23:38.913019+0000","last_clean":"2024-05-08T09:23:38.913019+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:23:38.913019+0000","last_undegraded":"2024-05-08T09:23:38.913019+0000","last_fullsized":"2024-05-08T09:23:38.913019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.202764+0000","last_change":"2024-05-08T09:25:29.202792+0000","last_active":"2024-05-08T09:25:29.202764+0000","last_peered":"2024-05-08T09:25:29.202764+0000","last_clean":"2024-05-08T09:25:29.202764+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:25:29.202764+0000","last_undegraded":"2024-05-08T09:25:29.202764+0000","last_fullsized":"2024-05-08T09:25:29.202764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.202666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:43.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.004968+0000","last_change":"2024-05-08T09:25:34.005000+0000","last_active":"2024-05-08T09:25:34.004968+0000","last_peered":"2024-05-08T09:25:34.004968+0000","last_clean":"2024-05-08T09:25:34.004968+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:25:34.004968+0000","last_undegraded":"2024-05-08T09:25:34.004968+0000","last_fullsized":"2024-05-08T09:25:34.004968+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.004850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:45.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.880687+0000","last_change":"2024-05-08T09:25:17.880714+0000","last_active":"2024-05-08T09:25:17.880687+0000","last_peered":"2024-05-08T09:25:17.880687+0000","last_clean":"2024-05-08T09:25:17.880687+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:25:17.880687+0000","last_undegraded":"2024-05-08T09:25:17.880687+0000","last_fullsized":"2024-05-08T09:25:17.880687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.880592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.052981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.706963+0000","last_change":"2024-05-08T09:25:38.707011+0000","last_active":"2024-05-08T09:25:38.706963+0000","last_peered":"2024-05-08T09:25:38.706963+0000","last_clean":"2024-05-08T09:25:38.706963+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:25:38.706963+0000","last_undegraded":"2024-05-08T09:25:38.706963+0000","last_fullsized":"2024-05-08T09:25:38.706963+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.706857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:39.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'18","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.831492+0000","last_change":"2024-05-08T09:25:20.831519+0000","last_active":"2024-05-08T09:25:20.831492+0000","last_peered":"2024-05-08T09:25:20.831492+0000","last_clean":"2024-05-08T09:25:20.831492+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:25:20.831492+0000","last_undegraded":"2024-05-08T09:25:20.831492+0000","last_fullsized":"2024-05-08T09:25:20.831492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.831407+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:00:36.603443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.697895+0000","last_change":"2024-05-08T09:25:40.697924+0000","last_active":"2024-05-08T09:25:40.697895+0000","last_peered":"2024-05-08T09:25:40.697895+0000","last_clean":"2024-05-08T09:25:40.697895+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:25:40.697895+0000","last_undegraded":"2024-05-08T09:25:40.697895+0000","last_fullsized":"2024-05-08T09:25:40.697895+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.697798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.747725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.215666+0000","last_change":"2024-05-08T09:22:16.006433+0000","last_active":"2024-05-08T09:24:38.215666+0000","last_peered":"2024-05-08T09:24:38.215666+0000","last_clean":"2024-05-08T09:24:38.215666+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:24:38.215666+0000","last_undegraded":"2024-05-08T09:24:38.215666+0000","last_fullsized":"2024-05-08T09:24:38.215666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:43.914086+0000","last_change":"2024-05-08T09:21:28.967286+0000","last_active":"2024-05-08T09:23:43.914086+0000","last_peered":"2024-05-08T09:23:43.914086+0000","last_clean":"2024-05-08T09:23:43.914086+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:23:43.914086+0000","last_undegraded":"2024-05-08T09:23:43.914086+0000","last_fullsized":"2024-05-08T09:23:43.914086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.842723+0000","last_change":"2024-05-08T09:25:26.842788+0000","last_active":"2024-05-08T09:25:26.842723+0000","last_peered":"2024-05-08T09:25:26.842723+0000","last_clean":"2024-05-08T09:25:26.842723+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:25:26.842723+0000","last_undegraded":"2024-05-08T09:25:26.842723+0000","last_fullsized":"2024-05-08T09:25:26.842723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.842617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:55.285411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:44.905558+0000","last_change":"2024-05-08T09:21:28.969913+0000","last_active":"2024-05-08T09:24:44.905558+0000","last_peered":"2024-05-08T09:24:44.905558+0000","last_clean":"2024-05-08T09:24:44.905558+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:24:44.905558+0000","last_undegraded":"2024-05-08T09:24:44.905558+0000","last_fullsized":"2024-05-08T09:24:44.905558+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.262692+0000","last_change":"2024-05-08T09:25:37.262733+0000","last_active":"2024-05-08T09:25:37.262692+0000","last_peered":"2024-05-08T09:25:37.262692+0000","last_clean":"2024-05-08T09:25:37.262692+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:25:37.262692+0000","last_undegraded":"2024-05-08T09:25:37.262692+0000","last_fullsized":"2024-05-08T09:25:37.262692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.262592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:56.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.308554+0000","last_change":"2024-05-08T09:25:31.308585+0000","last_active":"2024-05-08T09:25:31.308554+0000","last_peered":"2024-05-08T09:25:31.308554+0000","last_clean":"2024-05-08T09:25:31.308554+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:25:31.308554+0000","last_undegraded":"2024-05-08T09:25:31.308554+0000","last_fullsized":"2024-05-08T09:25:31.308554+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.308462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:24.993949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.634448+0000","last_change":"2024-05-08T09:25:42.634475+0000","last_active":"2024-05-08T09:25:42.634448+0000","last_peered":"2024-05-08T09:25:42.634448+0000","last_clean":"2024-05-08T09:25:42.634448+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:25:42.634448+0000","last_undegraded":"2024-05-08T09:25:42.634448+0000","last_fullsized":"2024-05-08T09:25:42.634448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.634357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:42.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:48.915137+0000","last_change":"2024-05-08T09:21:28.965057+0000","last_active":"2024-05-08T09:23:48.915137+0000","last_peered":"2024-05-08T09:23:48.915137+0000","last_clean":"2024-05-08T09:23:48.915137+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:23:48.915137+0000","last_undegraded":"2024-05-08T09:23:48.915137+0000","last_fullsized":"2024-05-08T09:23:48.915137+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.158005+0000","last_change":"2024-05-08T09:21:28.962332+0000","last_active":"2024-05-08T09:24:38.158005+0000","last_peered":"2024-05-08T09:24:38.158005+0000","last_clean":"2024-05-08T09:24:38.158005+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:24:38.158005+0000","last_undegraded":"2024-05-08T09:24:38.158005+0000","last_fullsized":"2024-05-08T09:24:38.158005+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:27.920320+0000","last_clean_scrub_stamp":"2024-05-08T09:21:27.920320+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.956390+0000","last_change":"2024-05-08T09:25:26.956419+0000","last_active":"2024-05-08T09:25:26.956390+0000","last_peered":"2024-05-08T09:25:26.956390+0000","last_clean":"2024-05-08T09:25:26.956390+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:25:26.956390+0000","last_undegraded":"2024-05-08T09:25:26.956390+0000","last_fullsized":"2024-05-08T09:25:26.956390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.956297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:20.313021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.008494+0000","last_change":"2024-05-08T09:25:32.008527+0000","last_active":"2024-05-08T09:25:32.008494+0000","last_peered":"2024-05-08T09:25:32.008494+0000","last_clean":"2024-05-08T09:25:32.008494+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:25:32.008494+0000","last_undegraded":"2024-05-08T09:25:32.008494+0000","last_fullsized":"2024-05-08T09:25:32.008494+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.008402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:22.700119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'5","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.294011+0000","last_change":"2024-05-08T09:22:16.004396+0000","last_active":"2024-05-08T09:24:38.294011+0000","last_peered":"2024-05-08T09:24:38.294011+0000","last_clean":"2024-05-08T09:24:38.294011+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:24:38.294011+0000","last_undegraded":"2024-05-08T09:24:38.294011+0000","last_fullsized":"2024-05-08T09:24:38.294011+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:29.927045+0000","last_clean_scrub_stamp":"2024-05-08T09:21:29.927045+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":482,"ondisk_log_size":482,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705721,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705720,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":962560,"data_stored":723288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705720,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705721,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:25:50.686 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.687 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.687 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.687 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.687 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.688 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.689 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.689 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.689 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.689 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.689 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.690 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.690 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.690 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.690 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.690 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-08T09:21:19.663062+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=19, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.691 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-05-08T09:21:31.934438+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=31, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.692 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.693 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.693 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.693 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.693 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.693 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-08T09:21:27.920320+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=27, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-05-08T09:21:29.927045+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=29, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:25:50.694 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T09:26:10.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:26:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.812+0000 7f5b492eb640 1 Processor -- start 2024-05-08T09:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.812+0000 7f5b492eb640 1 -- start start 2024-05-08T09:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b492eb640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b44127ea0 0x7f5b44128280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b492eb640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b44071020 con 0x7f5b441287c0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b492eb640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f5b44071780 con 0x7f5b44127ea0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b42ffd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b44127ea0 0x7f5b44128280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b427fc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5b441287c0 0x7f5b4412b0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41376/0 (socket says 172.21.15.45:41376) 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b427fc640 1 -- 172.21.15.45:0/1571399330 learned_addr learned my addr 172.21.15.45:0/1571399330 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b41ffb640 1 -- 172.21.15.45:0/1571399330 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754420319 0 0) 0x7f5b44071020 con 0x7f5b441287c0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b41ffb640 1 -- 172.21.15.45:0/1571399330 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b2c003520 con 0x7f5b441287c0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b42ffd640 1 -- 172.21.15.45:0/1571399330 >> v1:172.21.15.45:6789/0 conn(0x7f5b441287c0 legacy=0x7f5b4412b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.813+0000 7f5b42ffd640 1 -- 172.21.15.45:0/1571399330 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b4406e6e0 con 0x7f5b44127ea0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.814+0000 7f5b42ffd640 1 --2- 172.21.15.45:0/1571399330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44128280 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009720 tx=0x7f5b3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119132bee0f0bbe2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.814+0000 7f5b41ffb640 1 -- 172.21.15.45:0/1571399330 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34035020 con 0x7f5b44127ea0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.814+0000 7f5b41ffb640 1 -- 172.21.15.45:0/1571399330 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b34031760 con 0x7f5b44127ea0 2024-05-08T09:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.814+0000 7f5b41ffb640 1 -- 172.21.15.45:0/1571399330 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34031a60 con 0x7f5b44127ea0 2024-05-08T09:26:10.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 -- 172.21.15.45:0/1571399330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 msgr2=0x7f5b44128280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:10.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 --2- 172.21.15.45:0/1571399330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44128280 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5b34009720 tx=0x7f5b3402b8d0 comp rx=0 tx=0).stop 2024-05-08T09:26:10.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 -- 172.21.15.45:0/1571399330 shutdown_connections 2024-05-08T09:26:10.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 --2- 172.21.15.45:0/1571399330 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44128280 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 -- 172.21.15.45:0/1571399330 >> 172.21.15.45:0/1571399330 conn(0x7f5b44099380 msgr2=0x7f5b44099760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 -- 172.21.15.45:0/1571399330 shutdown_connections 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.815+0000 7f5b492eb640 1 -- 172.21.15.45:0/1571399330 wait complete. 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.816+0000 7f5b492eb640 1 Processor -- start 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.816+0000 7f5b492eb640 1 -- start start 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.816+0000 7f5b492eb640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b492eb640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4412b800 con 0x7f5b44127ea0 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b42ffd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:58886/0 (socket says 172.21.15.45:58886) 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b42ffd640 1 -- 172.21.15.45:0/3763405164 learned_addr learned my addr 172.21.15.45:0/3763405164 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b42ffd640 1 -- 172.21.15.45:0/3763405164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b44114680 con 0x7f5b44127ea0 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b42ffd640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b34048070 con 0x7f5b44127ea0 2024-05-08T09:26:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3403a760 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b44115160 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b3403aa80 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.817+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b44124be0 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.818+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f5b3404b070 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.818+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b44062e90 con 0x7f5b44127ea0 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.818+0000 7f5b2b7fe640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 0x7f5b3003a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.819+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f5b34040070 con 0x7f5b44127ea0 2024-05-08T09:26:10.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.819+0000 7f5b427fc640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 0x7f5b3003a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:10.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.821+0000 7f5b427fc640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 0x7f5b3003a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001610 tx=0x7f5b38007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:10.823+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f5b34030bd0 con 0x7f5b44127ea0 2024-05-08T09:26:11.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.007+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5b44114850 con 0x7f5b30038060 2024-05-08T09:26:11.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.022+0000 7f5b2b7fe640 1 -- 172.21.15.45:0/3763405164 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666030 (secure 0 0 0) 0x7f5b380058b0 con 0x7f5b30038060 2024-05-08T09:26:11.028 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:26:11.034 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 msgr2=0x7f5b3003a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 0x7f5b3003a520 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b38001610 tx=0x7f5b38007970 comp rx=0 tx=0).stop 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 msgr2=0x7f5b44113060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000c00 tx=0x7f5b340046c0 comp rx=0 tx=0).stop 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 shutdown_connections 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5b30038060 0x7f5b3003a520 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 --2- 172.21.15.45:0/3763405164 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b44127ea0 0x7f5b44113060 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 >> 172.21.15.45:0/3763405164 conn(0x7f5b44099380 msgr2=0x7f5b4406ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 shutdown_connections 2024-05-08T09:26:11.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:11.027+0000 7f5b492eb640 1 -- 172.21.15.45:0/3763405164 wait complete. 2024-05-08T09:26:11.037 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":172,"stamp":"2024-05-08T09:26:10.922590+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5100,"num_read_kb":4681,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4783,"ondisk_log_size":4783,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1719982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003658"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.351112+0000","last_change":"2024-05-08T09:25:32.351112+0000","last_active":"2024-05-08T09:25:32.351112+0000","last_peered":"2024-05-08T09:25:32.351112+0000","last_clean":"2024-05-08T09:25:32.351112+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:25:32.351112+0000","last_undegraded":"2024-05-08T09:25:32.351112+0000","last_fullsized":"2024-05-08T09:25:32.351112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.350996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:31.978723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.758284+0000","last_change":"2024-05-08T09:25:32.758312+0000","last_active":"2024-05-08T09:25:32.758284+0000","last_peered":"2024-05-08T09:25:32.758284+0000","last_clean":"2024-05-08T09:25:32.758284+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:25:32.758284+0000","last_undegraded":"2024-05-08T09:25:32.758284+0000","last_fullsized":"2024-05-08T09:25:32.758284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.758203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:23.449919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.057033+0000","last_change":"2024-05-08T09:25:41.057108+0000","last_active":"2024-05-08T09:25:41.057033+0000","last_peered":"2024-05-08T09:25:41.057033+0000","last_clean":"2024-05-08T09:25:41.057033+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:25:41.057033+0000","last_undegraded":"2024-05-08T09:25:41.057033+0000","last_fullsized":"2024-05-08T09:25:41.057033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.056917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:01:13.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.164166+0000","last_change":"2024-05-08T09:25:25.164192+0000","last_active":"2024-05-08T09:25:25.164166+0000","last_peered":"2024-05-08T09:25:25.164166+0000","last_clean":"2024-05-08T09:25:25.164166+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:25:25.164166+0000","last_undegraded":"2024-05-08T09:25:25.164166+0000","last_fullsized":"2024-05-08T09:25:25.164166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.164078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:10.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.292774+0000","last_change":"2024-05-08T09:25:46.292798+0000","last_active":"2024-05-08T09:25:46.292774+0000","last_peered":"2024-05-08T09:25:46.292774+0000","last_clean":"2024-05-08T09:25:46.292774+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:25:46.292774+0000","last_undegraded":"2024-05-08T09:25:46.292774+0000","last_fullsized":"2024-05-08T09:25:46.292774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:46.292702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:46.292702+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.292702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:49.576427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.172663+0000","last_change":"2024-05-08T09:25:11.172689+0000","last_active":"2024-05-08T09:25:11.172663+0000","last_peered":"2024-05-08T09:25:11.172663+0000","last_clean":"2024-05-08T09:25:11.172663+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:25:11.172663+0000","last_undegraded":"2024-05-08T09:25:11.172663+0000","last_fullsized":"2024-05-08T09:25:11.172663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.172569+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:37.984066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.262678+0000","last_change":"2024-05-08T09:25:24.262678+0000","last_active":"2024-05-08T09:25:24.262678+0000","last_peered":"2024-05-08T09:25:24.262678+0000","last_clean":"2024-05-08T09:25:24.262678+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:25:24.262678+0000","last_undegraded":"2024-05-08T09:25:24.262678+0000","last_fullsized":"2024-05-08T09:25:24.262678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.262520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.902721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.201206+0000","last_change":"2024-05-08T09:25:32.201233+0000","last_active":"2024-05-08T09:25:32.201206+0000","last_peered":"2024-05-08T09:25:32.201206+0000","last_clean":"2024-05-08T09:25:32.201206+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:25:32.201206+0000","last_undegraded":"2024-05-08T09:25:32.201206+0000","last_fullsized":"2024-05-08T09:25:32.201206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.201119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:56.962461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:57.380629+0000","last_change":"2024-05-08T09:25:57.380678+0000","last_active":"2024-05-08T09:25:57.380629+0000","last_peered":"2024-05-08T09:25:57.380629+0000","last_clean":"2024-05-08T09:25:57.380629+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:25:57.380629+0000","last_undegraded":"2024-05-08T09:25:57.380629+0000","last_fullsized":"2024-05-08T09:25:57.380629+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:57.380522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:57.380522+0000","last_clean_scrub_stamp":"2024-05-08T09:25:57.380522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:52.831638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.826663+0000","last_change":"2024-05-08T09:25:18.826663+0000","last_active":"2024-05-08T09:25:18.826663+0000","last_peered":"2024-05-08T09:25:18.826663+0000","last_clean":"2024-05-08T09:25:18.826663+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:25:18.826663+0000","last_undegraded":"2024-05-08T09:25:18.826663+0000","last_fullsized":"2024-05-08T09:25:18.826663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.826549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.998939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.333479+0000","last_change":"2024-05-08T09:25:28.333560+0000","last_active":"2024-05-08T09:25:28.333479+0000","last_peered":"2024-05-08T09:25:28.333479+0000","last_clean":"2024-05-08T09:25:28.333479+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:25:28.333479+0000","last_undegraded":"2024-05-08T09:25:28.333479+0000","last_fullsized":"2024-05-08T09:25:28.333479+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.333344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:11.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.114273+0000","last_change":"2024-05-08T09:25:09.114273+0000","last_active":"2024-05-08T09:25:09.114273+0000","last_peered":"2024-05-08T09:25:09.114273+0000","last_clean":"2024-05-08T09:25:09.114273+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:25:09.114273+0000","last_undegraded":"2024-05-08T09:25:09.114273+0000","last_fullsized":"2024-05-08T09:25:09.114273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.114110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:02.470835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.246458+0000","last_change":"2024-05-08T09:25:45.246487+0000","last_active":"2024-05-08T09:25:45.246458+0000","last_peered":"2024-05-08T09:25:45.246458+0000","last_clean":"2024-05-08T09:25:45.246458+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:25:45.246458+0000","last_undegraded":"2024-05-08T09:25:45.246458+0000","last_fullsized":"2024-05-08T09:25:45.246458+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:45.246360+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:45.246360+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.246360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:21.564703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.316558+0000","last_change":"2024-05-08T09:25:13.316558+0000","last_active":"2024-05-08T09:25:13.316558+0000","last_peered":"2024-05-08T09:25:13.316558+0000","last_clean":"2024-05-08T09:25:13.316558+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:25:13.316558+0000","last_undegraded":"2024-05-08T09:25:13.316558+0000","last_fullsized":"2024-05-08T09:25:13.316558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.316411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:51.272956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.931019+0000","last_change":"2024-05-08T09:25:21.931062+0000","last_active":"2024-05-08T09:25:21.931019+0000","last_peered":"2024-05-08T09:25:21.931019+0000","last_clean":"2024-05-08T09:25:21.931019+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:25:21.931019+0000","last_undegraded":"2024-05-08T09:25:21.931019+0000","last_fullsized":"2024-05-08T09:25:21.931019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.930918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:54.987159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.305844+0000","last_change":"2024-05-08T09:25:21.305844+0000","last_active":"2024-05-08T09:25:21.305844+0000","last_peered":"2024-05-08T09:25:21.305844+0000","last_clean":"2024-05-08T09:25:21.305844+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:25:21.305844+0000","last_undegraded":"2024-05-08T09:25:21.305844+0000","last_fullsized":"2024-05-08T09:25:21.305844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.305723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:01.811529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.197120+0000","last_change":"2024-05-08T09:25:24.197143+0000","last_active":"2024-05-08T09:25:24.197120+0000","last_peered":"2024-05-08T09:25:24.197120+0000","last_clean":"2024-05-08T09:25:24.197120+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:25:24.197120+0000","last_undegraded":"2024-05-08T09:25:24.197120+0000","last_fullsized":"2024-05-08T09:25:24.197120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.197029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:02.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.797878+0000","last_change":"2024-05-08T09:25:27.797909+0000","last_active":"2024-05-08T09:25:27.797878+0000","last_peered":"2024-05-08T09:25:27.797878+0000","last_clean":"2024-05-08T09:25:27.797878+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:25:27.797878+0000","last_undegraded":"2024-05-08T09:25:27.797878+0000","last_fullsized":"2024-05-08T09:25:27.797878+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.797770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:21.154495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.781776+0000","last_change":"2024-05-08T09:25:22.781804+0000","last_active":"2024-05-08T09:25:22.781776+0000","last_peered":"2024-05-08T09:25:22.781776+0000","last_clean":"2024-05-08T09:25:22.781776+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:25:22.781776+0000","last_undegraded":"2024-05-08T09:25:22.781776+0000","last_fullsized":"2024-05-08T09:25:22.781776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.781682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:55.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.344011+0000","last_change":"2024-05-08T09:25:30.344041+0000","last_active":"2024-05-08T09:25:30.344011+0000","last_peered":"2024-05-08T09:25:30.344011+0000","last_clean":"2024-05-08T09:25:30.344011+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:25:30.344011+0000","last_undegraded":"2024-05-08T09:25:30.344011+0000","last_fullsized":"2024-05-08T09:25:30.344011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.343910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:24.516299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.748106+0000","last_change":"2024-05-08T09:25:28.748130+0000","last_active":"2024-05-08T09:25:28.748106+0000","last_peered":"2024-05-08T09:25:28.748106+0000","last_clean":"2024-05-08T09:25:28.748106+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:25:28.748106+0000","last_undegraded":"2024-05-08T09:25:28.748106+0000","last_fullsized":"2024-05-08T09:25:28.748106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.748024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:22.963514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.654809+0000","last_change":"2024-05-08T09:25:41.654848+0000","last_active":"2024-05-08T09:25:41.654809+0000","last_peered":"2024-05-08T09:25:41.654809+0000","last_clean":"2024-05-08T09:25:41.654809+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:25:41.654809+0000","last_undegraded":"2024-05-08T09:25:41.654809+0000","last_fullsized":"2024-05-08T09:25:41.654809+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.654716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:19:53.492400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":89,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.846119+0000","last_change":"2024-05-08T09:25:13.846147+0000","last_active":"2024-05-08T09:25:13.846119+0000","last_peered":"2024-05-08T09:25:13.846119+0000","last_clean":"2024-05-08T09:25:13.846119+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:25:13.846119+0000","last_undegraded":"2024-05-08T09:25:13.846119+0000","last_fullsized":"2024-05-08T09:25:13.846119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.846024+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:41.393615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.745924+0000","last_change":"2024-05-08T09:25:37.745949+0000","last_active":"2024-05-08T09:25:37.745924+0000","last_peered":"2024-05-08T09:25:37.745924+0000","last_clean":"2024-05-08T09:25:37.745924+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:25:37.745924+0000","last_undegraded":"2024-05-08T09:25:37.745924+0000","last_fullsized":"2024-05-08T09:25:37.745924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.745832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.237079+0000","last_change":"2024-05-08T09:25:25.237119+0000","last_active":"2024-05-08T09:25:25.237079+0000","last_peered":"2024-05-08T09:25:25.237079+0000","last_clean":"2024-05-08T09:25:25.237079+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:25:25.237079+0000","last_undegraded":"2024-05-08T09:25:25.237079+0000","last_fullsized":"2024-05-08T09:25:25.237079+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.236991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:23.829920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.020091+0000","last_change":"2024-05-08T09:25:39.020148+0000","last_active":"2024-05-08T09:25:39.020091+0000","last_peered":"2024-05-08T09:25:39.020091+0000","last_clean":"2024-05-08T09:25:39.020091+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:25:39.020091+0000","last_undegraded":"2024-05-08T09:25:39.020091+0000","last_fullsized":"2024-05-08T09:25:39.020091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:24.713184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.830304+0000","last_change":"2024-05-08T09:25:21.830341+0000","last_active":"2024-05-08T09:25:21.830304+0000","last_peered":"2024-05-08T09:25:21.830304+0000","last_clean":"2024-05-08T09:25:21.830304+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:25:21.830304+0000","last_undegraded":"2024-05-08T09:25:21.830304+0000","last_fullsized":"2024-05-08T09:25:21.830304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.830191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:46.061745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:55.317220+0000","last_change":"2024-05-08T09:25:55.317220+0000","last_active":"2024-05-08T09:25:55.317220+0000","last_peered":"2024-05-08T09:25:55.317220+0000","last_clean":"2024-05-08T09:25:55.317220+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:25:55.317220+0000","last_undegraded":"2024-05-08T09:25:55.317220+0000","last_fullsized":"2024-05-08T09:25:55.317220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:55.317064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:55.317064+0000","last_clean_scrub_stamp":"2024-05-08T09:25:55.317064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:36:47.398629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":109,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.761410+0000","last_change":"2024-05-08T09:25:12.761456+0000","last_active":"2024-05-08T09:25:12.761410+0000","last_peered":"2024-05-08T09:25:12.761410+0000","last_clean":"2024-05-08T09:25:12.761410+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:25:12.761410+0000","last_undegraded":"2024-05-08T09:25:12.761410+0000","last_fullsized":"2024-05-08T09:25:12.761410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.761304+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:25.524875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.236879+0000","last_change":"2024-05-08T09:25:31.236908+0000","last_active":"2024-05-08T09:25:31.236879+0000","last_peered":"2024-05-08T09:25:31.236879+0000","last_clean":"2024-05-08T09:25:31.236879+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:25:31.236879+0000","last_undegraded":"2024-05-08T09:25:31.236879+0000","last_fullsized":"2024-05-08T09:25:31.236879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.236783+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:04.221673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:59.417975+0000","last_change":"2024-05-08T09:25:59.417975+0000","last_active":"2024-05-08T09:25:59.417975+0000","last_peered":"2024-05-08T09:25:59.417975+0000","last_clean":"2024-05-08T09:25:59.417975+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:25:59.417975+0000","last_undegraded":"2024-05-08T09:25:59.417975+0000","last_fullsized":"2024-05-08T09:25:59.417975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:59.417806+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:59.417806+0000","last_clean_scrub_stamp":"2024-05-08T09:25:59.417806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:21.889200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.080175+0000","last_change":"2024-05-08T09:24:52.080213+0000","last_active":"2024-05-08T09:24:52.080175+0000","last_peered":"2024-05-08T09:24:52.080175+0000","last_clean":"2024-05-08T09:24:52.080175+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:24:52.080175+0000","last_undegraded":"2024-05-08T09:24:52.080175+0000","last_fullsized":"2024-05-08T09:24:52.080175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.080065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:28:14.528132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.264691+0000","last_change":"2024-05-08T09:25:17.264747+0000","last_active":"2024-05-08T09:25:17.264691+0000","last_peered":"2024-05-08T09:25:17.264691+0000","last_clean":"2024-05-08T09:25:17.264691+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:25:17.264691+0000","last_undegraded":"2024-05-08T09:25:17.264691+0000","last_fullsized":"2024-05-08T09:25:17.264691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.264579+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:59.907138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.718141+0000","last_change":"2024-05-08T09:24:56.718169+0000","last_active":"2024-05-08T09:24:56.718141+0000","last_peered":"2024-05-08T09:24:56.718141+0000","last_clean":"2024-05-08T09:24:56.718141+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:24:56.718141+0000","last_undegraded":"2024-05-08T09:24:56.718141+0000","last_fullsized":"2024-05-08T09:24:56.718141+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.718047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:41.337920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.813429+0000","last_change":"2024-05-08T09:25:16.813454+0000","last_active":"2024-05-08T09:25:16.813429+0000","last_peered":"2024-05-08T09:25:16.813429+0000","last_clean":"2024-05-08T09:25:16.813429+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:25:16.813429+0000","last_undegraded":"2024-05-08T09:25:16.813429+0000","last_fullsized":"2024-05-08T09:25:16.813429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.813330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:00.193889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.069683+0000","last_change":"2024-05-08T09:25:07.069725+0000","last_active":"2024-05-08T09:25:07.069683+0000","last_peered":"2024-05-08T09:25:07.069683+0000","last_clean":"2024-05-08T09:25:07.069683+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:25:07.069683+0000","last_undegraded":"2024-05-08T09:25:07.069683+0000","last_fullsized":"2024-05-08T09:25:07.069683+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.069574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:46.463982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.341616+0000","last_change":"2024-05-08T09:25:29.341616+0000","last_active":"2024-05-08T09:25:29.341616+0000","last_peered":"2024-05-08T09:25:29.341616+0000","last_clean":"2024-05-08T09:25:29.341616+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:25:29.341616+0000","last_undegraded":"2024-05-08T09:25:29.341616+0000","last_fullsized":"2024-05-08T09:25:29.341616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.341497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:47.141991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.811079+0000","last_change":"2024-05-08T09:25:06.811118+0000","last_active":"2024-05-08T09:25:06.811079+0000","last_peered":"2024-05-08T09:25:06.811079+0000","last_clean":"2024-05-08T09:25:06.811079+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:25:06.811079+0000","last_undegraded":"2024-05-08T09:25:06.811079+0000","last_fullsized":"2024-05-08T09:25:06.811079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.810982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:45.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.687493+0000","last_change":"2024-05-08T09:24:55.687547+0000","last_active":"2024-05-08T09:24:55.687493+0000","last_peered":"2024-05-08T09:24:55.687493+0000","last_clean":"2024-05-08T09:24:55.687493+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:24:55.687493+0000","last_undegraded":"2024-05-08T09:24:55.687493+0000","last_fullsized":"2024-05-08T09:24:55.687493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.687356+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:29.151994+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.701766+0000","last_change":"2024-05-08T09:24:49.701793+0000","last_active":"2024-05-08T09:24:49.701766+0000","last_peered":"2024-05-08T09:24:49.701766+0000","last_clean":"2024-05-08T09:24:49.701766+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:24:49.701766+0000","last_undegraded":"2024-05-08T09:24:49.701766+0000","last_fullsized":"2024-05-08T09:24:49.701766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.701660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:37.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.910474+0000","last_change":"2024-05-08T09:25:16.910503+0000","last_active":"2024-05-08T09:25:16.910474+0000","last_peered":"2024-05-08T09:25:16.910474+0000","last_clean":"2024-05-08T09:25:16.910474+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:25:16.910474+0000","last_undegraded":"2024-05-08T09:25:16.910474+0000","last_fullsized":"2024-05-08T09:25:16.910474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.910378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:34.710873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.226019+0000","last_change":"2024-05-08T09:25:33.226050+0000","last_active":"2024-05-08T09:25:33.226019+0000","last_peered":"2024-05-08T09:25:33.226019+0000","last_clean":"2024-05-08T09:25:33.226019+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:25:33.226019+0000","last_undegraded":"2024-05-08T09:25:33.226019+0000","last_fullsized":"2024-05-08T09:25:33.226019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.225927+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:00.191310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:51.333974+0000","last_change":"2024-05-08T09:25:51.333974+0000","last_active":"2024-05-08T09:25:51.333974+0000","last_peered":"2024-05-08T09:25:51.333974+0000","last_clean":"2024-05-08T09:25:51.333974+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:25:51.333974+0000","last_undegraded":"2024-05-08T09:25:51.333974+0000","last_fullsized":"2024-05-08T09:25:51.333974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:51.333778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:51.333778+0000","last_clean_scrub_stamp":"2024-05-08T09:25:51.333778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:57:57.114000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.311903+0000","last_change":"2024-05-08T09:25:40.311928+0000","last_active":"2024-05-08T09:25:40.311903+0000","last_peered":"2024-05-08T09:25:40.311903+0000","last_clean":"2024-05-08T09:25:40.311903+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:25:40.311903+0000","last_undegraded":"2024-05-08T09:25:40.311903+0000","last_fullsized":"2024-05-08T09:25:40.311903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.311808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:34.527299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.328472+0000","last_change":"2024-05-08T09:24:54.328519+0000","last_active":"2024-05-08T09:24:54.328472+0000","last_peered":"2024-05-08T09:24:54.328472+0000","last_clean":"2024-05-08T09:24:54.328472+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:24:54.328472+0000","last_undegraded":"2024-05-08T09:24:54.328472+0000","last_fullsized":"2024-05-08T09:24:54.328472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.328362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:05.483598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":434,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.130751+0000","last_change":"2024-05-08T09:25:26.130779+0000","last_active":"2024-05-08T09:25:26.130751+0000","last_peered":"2024-05-08T09:25:26.130751+0000","last_clean":"2024-05-08T09:25:26.130751+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:25:26.130751+0000","last_undegraded":"2024-05-08T09:25:26.130751+0000","last_fullsized":"2024-05-08T09:25:26.130751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.130675+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:51:46.979797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.306963+0000","last_change":"2024-05-08T09:25:38.306988+0000","last_active":"2024-05-08T09:25:38.306963+0000","last_peered":"2024-05-08T09:25:38.306963+0000","last_clean":"2024-05-08T09:25:38.306963+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:25:38.306963+0000","last_undegraded":"2024-05-08T09:25:38.306963+0000","last_fullsized":"2024-05-08T09:25:38.306963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.306873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:06.749667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.913368+0000","last_change":"2024-05-08T09:25:18.913395+0000","last_active":"2024-05-08T09:25:18.913368+0000","last_peered":"2024-05-08T09:25:18.913368+0000","last_clean":"2024-05-08T09:25:18.913368+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:25:18.913368+0000","last_undegraded":"2024-05-08T09:25:18.913368+0000","last_fullsized":"2024-05-08T09:25:18.913368+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.913278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.872761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.782462+0000","last_change":"2024-05-08T09:25:31.782462+0000","last_active":"2024-05-08T09:25:31.782462+0000","last_peered":"2024-05-08T09:25:31.782462+0000","last_clean":"2024-05-08T09:25:31.782462+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:25:31.782462+0000","last_undegraded":"2024-05-08T09:25:31.782462+0000","last_fullsized":"2024-05-08T09:25:31.782462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.782326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:43.109888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.084809+0000","last_change":"2024-05-08T09:24:53.084847+0000","last_active":"2024-05-08T09:24:53.084809+0000","last_peered":"2024-05-08T09:24:53.084809+0000","last_clean":"2024-05-08T09:24:53.084809+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:24:53.084809+0000","last_undegraded":"2024-05-08T09:24:53.084809+0000","last_fullsized":"2024-05-08T09:24:53.084809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.084720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:14.978196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.309726+0000","last_change":"2024-05-08T09:24:55.309760+0000","last_active":"2024-05-08T09:24:55.309726+0000","last_peered":"2024-05-08T09:24:55.309726+0000","last_clean":"2024-05-08T09:24:55.309726+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:24:55.309726+0000","last_undegraded":"2024-05-08T09:24:55.309726+0000","last_fullsized":"2024-05-08T09:24:55.309726+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.309641+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.625772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":413,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.838065+0000","last_change":"2024-05-08T09:24:50.838092+0000","last_active":"2024-05-08T09:24:50.838065+0000","last_peered":"2024-05-08T09:24:50.838065+0000","last_clean":"2024-05-08T09:24:50.838065+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:50.838065+0000","last_undegraded":"2024-05-08T09:24:50.838065+0000","last_fullsized":"2024-05-08T09:24:50.838065+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.837975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:13.392037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.165615+0000","last_change":"2024-05-08T09:25:27.165615+0000","last_active":"2024-05-08T09:25:27.165615+0000","last_peered":"2024-05-08T09:25:27.165615+0000","last_clean":"2024-05-08T09:25:27.165615+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:25:27.165615+0000","last_undegraded":"2024-05-08T09:25:27.165615+0000","last_fullsized":"2024-05-08T09:25:27.165615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.165476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:41.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.343622+0000","last_change":"2024-05-08T09:25:34.343622+0000","last_active":"2024-05-08T09:25:34.343622+0000","last_peered":"2024-05-08T09:25:34.343622+0000","last_clean":"2024-05-08T09:25:34.343622+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:25:34.343622+0000","last_undegraded":"2024-05-08T09:25:34.343622+0000","last_fullsized":"2024-05-08T09:25:34.343622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.343478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:44.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.708663+0000","last_change":"2024-05-08T09:25:01.708663+0000","last_active":"2024-05-08T09:25:01.708663+0000","last_peered":"2024-05-08T09:25:01.708663+0000","last_clean":"2024-05-08T09:25:01.708663+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:25:01.708663+0000","last_undegraded":"2024-05-08T09:25:01.708663+0000","last_fullsized":"2024-05-08T09:25:01.708663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.708527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:21:55.937487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.295107+0000","last_change":"2024-05-08T09:24:58.295107+0000","last_active":"2024-05-08T09:24:58.295107+0000","last_peered":"2024-05-08T09:24:58.295107+0000","last_clean":"2024-05-08T09:24:58.295107+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:24:58.295107+0000","last_undegraded":"2024-05-08T09:24:58.295107+0000","last_fullsized":"2024-05-08T09:24:58.295107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.294960+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:44.289112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.790127+0000","last_change":"2024-05-08T09:24:51.790127+0000","last_active":"2024-05-08T09:24:51.790127+0000","last_peered":"2024-05-08T09:24:51.790127+0000","last_clean":"2024-05-08T09:24:51.790127+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:24:51.790127+0000","last_undegraded":"2024-05-08T09:24:51.790127+0000","last_fullsized":"2024-05-08T09:24:51.790127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.789971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:01.201509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.361302+0000","last_change":"2024-05-08T09:25:36.361302+0000","last_active":"2024-05-08T09:25:36.361302+0000","last_peered":"2024-05-08T09:25:36.361302+0000","last_clean":"2024-05-08T09:25:36.361302+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:25:36.361302+0000","last_undegraded":"2024-05-08T09:25:36.361302+0000","last_fullsized":"2024-05-08T09:25:36.361302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.361192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:02.992029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.785250+0000","last_change":"2024-05-08T09:25:19.785250+0000","last_active":"2024-05-08T09:25:19.785250+0000","last_peered":"2024-05-08T09:25:19.785250+0000","last_clean":"2024-05-08T09:25:19.785250+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:25:19.785250+0000","last_undegraded":"2024-05-08T09:25:19.785250+0000","last_fullsized":"2024-05-08T09:25:19.785250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.785121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:56.744605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.245875+0000","last_change":"2024-05-08T09:25:26.245875+0000","last_active":"2024-05-08T09:25:26.245875+0000","last_peered":"2024-05-08T09:25:26.245875+0000","last_clean":"2024-05-08T09:25:26.245875+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:25:26.245875+0000","last_undegraded":"2024-05-08T09:25:26.245875+0000","last_fullsized":"2024-05-08T09:25:26.245875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.245734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:53.793325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.840940+0000","last_change":"2024-05-08T09:25:11.840940+0000","last_active":"2024-05-08T09:25:11.840940+0000","last_peered":"2024-05-08T09:25:11.840940+0000","last_clean":"2024-05-08T09:25:11.840940+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:25:11.840940+0000","last_undegraded":"2024-05-08T09:25:11.840940+0000","last_fullsized":"2024-05-08T09:25:11.840940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.840802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:24.604373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.225238+0000","last_change":"2024-05-08T09:25:16.225238+0000","last_active":"2024-05-08T09:25:16.225238+0000","last_peered":"2024-05-08T09:25:16.225238+0000","last_clean":"2024-05-08T09:25:16.225238+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:25:16.225238+0000","last_undegraded":"2024-05-08T09:25:16.225238+0000","last_fullsized":"2024-05-08T09:25:16.225238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.225076+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.968267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.808113+0000","last_change":"2024-05-08T09:24:49.808113+0000","last_active":"2024-05-08T09:24:49.808113+0000","last_peered":"2024-05-08T09:24:49.808113+0000","last_clean":"2024-05-08T09:24:49.808113+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:24:49.808113+0000","last_undegraded":"2024-05-08T09:24:49.808113+0000","last_fullsized":"2024-05-08T09:24:49.808113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.807955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:48.540567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.560775+0000","last_change":"2024-05-08T09:25:45.560775+0000","last_active":"2024-05-08T09:25:45.560775+0000","last_peered":"2024-05-08T09:25:45.560775+0000","last_clean":"2024-05-08T09:25:45.560775+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:25:45.560775+0000","last_undegraded":"2024-05-08T09:25:45.560775+0000","last_fullsized":"2024-05-08T09:25:45.560775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:45.560617+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:45.560617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.560617+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:59.513507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.303783+0000","last_change":"2024-05-08T09:25:19.303783+0000","last_active":"2024-05-08T09:25:19.303783+0000","last_peered":"2024-05-08T09:25:19.303783+0000","last_clean":"2024-05-08T09:25:19.303783+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:25:19.303783+0000","last_undegraded":"2024-05-08T09:25:19.303783+0000","last_fullsized":"2024-05-08T09:25:19.303783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.303658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:04.577425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:54.360848+0000","last_change":"2024-05-08T09:25:54.360848+0000","last_active":"2024-05-08T09:25:54.360848+0000","last_peered":"2024-05-08T09:25:54.360848+0000","last_clean":"2024-05-08T09:25:54.360848+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:25:54.360848+0000","last_undegraded":"2024-05-08T09:25:54.360848+0000","last_fullsized":"2024-05-08T09:25:54.360848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:54.360672+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:54.360672+0000","last_clean_scrub_stamp":"2024-05-08T09:25:54.360672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:07:19.832656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.784665+0000","last_change":"2024-05-08T09:25:05.784665+0000","last_active":"2024-05-08T09:25:05.784665+0000","last_peered":"2024-05-08T09:25:05.784665+0000","last_clean":"2024-05-08T09:25:05.784665+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:25:05.784665+0000","last_undegraded":"2024-05-08T09:25:05.784665+0000","last_fullsized":"2024-05-08T09:25:05.784665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:48.571658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.027279+0000","last_change":"2024-05-08T09:25:02.027279+0000","last_active":"2024-05-08T09:25:02.027279+0000","last_peered":"2024-05-08T09:25:02.027279+0000","last_clean":"2024-05-08T09:25:02.027279+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:25:02.027279+0000","last_undegraded":"2024-05-08T09:25:02.027279+0000","last_fullsized":"2024-05-08T09:25:02.027279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.027147+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:01.654874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.823593+0000","last_change":"2024-05-08T09:25:12.823593+0000","last_active":"2024-05-08T09:25:12.823593+0000","last_peered":"2024-05-08T09:25:12.823593+0000","last_clean":"2024-05-08T09:25:12.823593+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:25:12.823593+0000","last_undegraded":"2024-05-08T09:25:12.823593+0000","last_fullsized":"2024-05-08T09:25:12.823593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.823468+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.142119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.080764+0000","last_change":"2024-05-08T09:25:45.080764+0000","last_active":"2024-05-08T09:25:45.080764+0000","last_peered":"2024-05-08T09:25:45.080764+0000","last_clean":"2024-05-08T09:25:45.080764+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:25:45.080764+0000","last_undegraded":"2024-05-08T09:25:45.080764+0000","last_fullsized":"2024-05-08T09:25:45.080764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:45.080643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:45.080643+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.080643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:59.033533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.337550+0000","last_change":"2024-05-08T09:25:15.337550+0000","last_active":"2024-05-08T09:25:15.337550+0000","last_peered":"2024-05-08T09:25:15.337550+0000","last_clean":"2024-05-08T09:25:15.337550+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:25:15.337550+0000","last_undegraded":"2024-05-08T09:25:15.337550+0000","last_fullsized":"2024-05-08T09:25:15.337550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.337431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:48.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.247454+0000","last_change":"2024-05-08T09:25:44.247454+0000","last_active":"2024-05-08T09:25:44.247454+0000","last_peered":"2024-05-08T09:25:44.247454+0000","last_clean":"2024-05-08T09:25:44.247454+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:25:44.247454+0000","last_undegraded":"2024-05-08T09:25:44.247454+0000","last_fullsized":"2024-05-08T09:25:44.247454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:44.247287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:44.247287+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.247287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:58.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.809344+0000","last_change":"2024-05-08T09:25:10.809344+0000","last_active":"2024-05-08T09:25:10.809344+0000","last_peered":"2024-05-08T09:25:10.809344+0000","last_clean":"2024-05-08T09:25:10.809344+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:25:10.809344+0000","last_undegraded":"2024-05-08T09:25:10.809344+0000","last_fullsized":"2024-05-08T09:25:10.809344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.809216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:37.851520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'66","reported_seq":140,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.217666+0000","last_change":"2024-05-08T09:25:20.217666+0000","last_active":"2024-05-08T09:25:20.217666+0000","last_peered":"2024-05-08T09:25:20.217666+0000","last_clean":"2024-05-08T09:25:20.217666+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:25:20.217666+0000","last_undegraded":"2024-05-08T09:25:20.217666+0000","last_fullsized":"2024-05-08T09:25:20.217666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.217529+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:21.026949+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.818545+0000","last_change":"2024-05-08T09:24:48.818545+0000","last_active":"2024-05-08T09:24:48.818545+0000","last_peered":"2024-05-08T09:24:48.818545+0000","last_clean":"2024-05-08T09:24:48.818545+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:24:48.818545+0000","last_undegraded":"2024-05-08T09:24:48.818545+0000","last_fullsized":"2024-05-08T09:24:48.818545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.818433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:36.182911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.118057+0000","last_change":"2024-05-08T09:25:48.118057+0000","last_active":"2024-05-08T09:25:48.118057+0000","last_peered":"2024-05-08T09:25:48.118057+0000","last_clean":"2024-05-08T09:25:48.118057+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:25:48.118057+0000","last_undegraded":"2024-05-08T09:25:48.118057+0000","last_fullsized":"2024-05-08T09:25:48.118057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:48.117860+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:48.117860+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.117860+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:45.429985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.730752+0000","last_change":"2024-05-08T09:25:11.730752+0000","last_active":"2024-05-08T09:25:11.730752+0000","last_peered":"2024-05-08T09:25:11.730752+0000","last_clean":"2024-05-08T09:25:11.730752+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:25:11.730752+0000","last_undegraded":"2024-05-08T09:25:11.730752+0000","last_fullsized":"2024-05-08T09:25:11.730752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.730568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:38.772872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.928071+0000","last_change":"2024-05-08T09:25:23.928071+0000","last_active":"2024-05-08T09:25:23.928071+0000","last_peered":"2024-05-08T09:25:23.928071+0000","last_clean":"2024-05-08T09:25:23.928071+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:25:23.928071+0000","last_undegraded":"2024-05-08T09:25:23.928071+0000","last_fullsized":"2024-05-08T09:25:23.928071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.927879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:23.412115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.322535+0000","last_change":"2024-05-08T09:25:03.322535+0000","last_active":"2024-05-08T09:25:03.322535+0000","last_peered":"2024-05-08T09:25:03.322535+0000","last_clean":"2024-05-08T09:25:03.322535+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:25:03.322535+0000","last_undegraded":"2024-05-08T09:25:03.322535+0000","last_fullsized":"2024-05-08T09:25:03.322535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.322403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:06.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.739783+0000","last_change":"2024-05-08T09:24:57.739783+0000","last_active":"2024-05-08T09:24:57.739783+0000","last_peered":"2024-05-08T09:24:57.739783+0000","last_clean":"2024-05-08T09:24:57.739783+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:24:57.739783+0000","last_undegraded":"2024-05-08T09:24:57.739783+0000","last_fullsized":"2024-05-08T09:24:57.739783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.739657+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:25.965876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.255684+0000","last_change":"2024-05-08T09:25:14.255684+0000","last_active":"2024-05-08T09:25:14.255684+0000","last_peered":"2024-05-08T09:25:14.255684+0000","last_clean":"2024-05-08T09:25:14.255684+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:25:14.255684+0000","last_undegraded":"2024-05-08T09:25:14.255684+0000","last_fullsized":"2024-05-08T09:25:14.255684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.255525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:04.947242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'3","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.179879+0000","last_change":"2024-05-08T09:21:38.982090+0000","last_active":"2024-05-08T09:24:49.179879+0000","last_peered":"2024-05-08T09:24:49.179879+0000","last_clean":"2024-05-08T09:24:49.179879+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:24:49.179879+0000","last_undegraded":"2024-05-08T09:24:49.179879+0000","last_fullsized":"2024-05-08T09:24:49.179879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.020191+0000","last_change":"2024-05-08T09:25:01.020191+0000","last_active":"2024-05-08T09:25:01.020191+0000","last_peered":"2024-05-08T09:25:01.020191+0000","last_clean":"2024-05-08T09:25:01.020191+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:25:01.020191+0000","last_undegraded":"2024-05-08T09:25:01.020191+0000","last_fullsized":"2024-05-08T09:25:01.020191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.020070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:37.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.259475+0000","last_change":"2024-05-08T09:25:49.259522+0000","last_active":"2024-05-08T09:25:49.259475+0000","last_peered":"2024-05-08T09:25:49.259475+0000","last_clean":"2024-05-08T09:25:49.259475+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:25:49.259475+0000","last_undegraded":"2024-05-08T09:25:49.259475+0000","last_fullsized":"2024-05-08T09:25:49.259475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:49.259357+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:49.259357+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.259357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:45:08.549467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'5","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.795024+0000","last_change":"2024-05-08T09:25:09.795024+0000","last_active":"2024-05-08T09:25:09.795024+0000","last_peered":"2024-05-08T09:25:09.795024+0000","last_clean":"2024-05-08T09:25:09.795024+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:25:09.795024+0000","last_undegraded":"2024-05-08T09:25:09.795024+0000","last_fullsized":"2024-05-08T09:25:09.795024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.794854+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.624478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.303194+0000","last_change":"2024-05-08T09:25:02.303194+0000","last_active":"2024-05-08T09:25:02.303194+0000","last_peered":"2024-05-08T09:25:02.303194+0000","last_clean":"2024-05-08T09:25:02.303194+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:25:02.303194+0000","last_undegraded":"2024-05-08T09:25:02.303194+0000","last_fullsized":"2024-05-08T09:25:02.303194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.303063+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:10.132225+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.302402+0000","last_change":"2024-05-08T09:24:53.302402+0000","last_active":"2024-05-08T09:24:53.302402+0000","last_peered":"2024-05-08T09:24:53.302402+0000","last_clean":"2024-05-08T09:24:53.302402+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:53.302402+0000","last_undegraded":"2024-05-08T09:24:53.302402+0000","last_fullsized":"2024-05-08T09:24:53.302402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.302236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:25.305583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'19","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.129495+0000","last_change":"2024-05-08T09:25:47.129495+0000","last_active":"2024-05-08T09:25:47.129495+0000","last_peered":"2024-05-08T09:25:47.129495+0000","last_clean":"2024-05-08T09:25:47.129495+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:25:47.129495+0000","last_undegraded":"2024-05-08T09:25:47.129495+0000","last_fullsized":"2024-05-08T09:25:47.129495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-05-08T09:25:47.129306+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-05-08T09:25:47.129306+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.129306+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.798873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.381403+0000","last_change":"2024-05-08T09:25:35.381403+0000","last_active":"2024-05-08T09:25:35.381403+0000","last_peered":"2024-05-08T09:25:35.381403+0000","last_clean":"2024-05-08T09:25:35.381403+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:25:35.381403+0000","last_undegraded":"2024-05-08T09:25:35.381403+0000","last_fullsized":"2024-05-08T09:25:35.381403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.381285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:07.823236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.216318+0000","last_change":"2024-05-08T09:25:40.216318+0000","last_active":"2024-05-08T09:25:40.216318+0000","last_peered":"2024-05-08T09:25:40.216318+0000","last_clean":"2024-05-08T09:25:40.216318+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:25:40.216318+0000","last_undegraded":"2024-05-08T09:25:40.216318+0000","last_fullsized":"2024-05-08T09:25:40.216318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.216203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:38.399582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.758612+0000","last_change":"2024-05-08T09:25:06.758612+0000","last_active":"2024-05-08T09:25:06.758612+0000","last_peered":"2024-05-08T09:25:06.758612+0000","last_clean":"2024-05-08T09:25:06.758612+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:25:06.758612+0000","last_undegraded":"2024-05-08T09:25:06.758612+0000","last_fullsized":"2024-05-08T09:25:06.758612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.758460+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:49.545574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.255329+0000","last_change":"2024-05-08T09:25:15.255329+0000","last_active":"2024-05-08T09:25:15.255329+0000","last_peered":"2024-05-08T09:25:15.255329+0000","last_clean":"2024-05-08T09:25:15.255329+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:25:15.255329+0000","last_undegraded":"2024-05-08T09:25:15.255329+0000","last_fullsized":"2024-05-08T09:25:15.255329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.255201+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:23.835791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.722856+0000","last_change":"2024-05-08T09:24:48.722856+0000","last_active":"2024-05-08T09:24:48.722856+0000","last_peered":"2024-05-08T09:24:48.722856+0000","last_clean":"2024-05-08T09:24:48.722856+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:48.722856+0000","last_undegraded":"2024-05-08T09:24:48.722856+0000","last_fullsized":"2024-05-08T09:24:48.722856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.722702+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:43.871307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.320604+0000","last_change":"2024-05-08T09:25:05.320604+0000","last_active":"2024-05-08T09:25:05.320604+0000","last_peered":"2024-05-08T09:25:05.320604+0000","last_clean":"2024-05-08T09:25:05.320604+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:25:05.320604+0000","last_undegraded":"2024-05-08T09:25:05.320604+0000","last_fullsized":"2024-05-08T09:25:05.320604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.320491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:51.978731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.748318+0000","last_change":"2024-05-08T09:25:10.748318+0000","last_active":"2024-05-08T09:25:10.748318+0000","last_peered":"2024-05-08T09:25:10.748318+0000","last_clean":"2024-05-08T09:25:10.748318+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:25:10.748318+0000","last_undegraded":"2024-05-08T09:25:10.748318+0000","last_fullsized":"2024-05-08T09:25:10.748318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.748214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:58.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.197723+0000","last_change":"2024-05-08T09:25:43.197723+0000","last_active":"2024-05-08T09:25:43.197723+0000","last_peered":"2024-05-08T09:25:43.197723+0000","last_clean":"2024-05-08T09:25:43.197723+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:25:43.197723+0000","last_undegraded":"2024-05-08T09:25:43.197723+0000","last_fullsized":"2024-05-08T09:25:43.197723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.197608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:33.612547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.047846+0000","last_change":"2024-05-08T09:24:54.047846+0000","last_active":"2024-05-08T09:24:54.047846+0000","last_peered":"2024-05-08T09:24:54.047846+0000","last_clean":"2024-05-08T09:24:54.047846+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:24:54.047846+0000","last_undegraded":"2024-05-08T09:24:54.047846+0000","last_fullsized":"2024-05-08T09:24:54.047846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.047713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:28.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.765651+0000","last_change":"2024-05-08T09:24:59.765651+0000","last_active":"2024-05-08T09:24:59.765651+0000","last_peered":"2024-05-08T09:24:59.765651+0000","last_clean":"2024-05-08T09:24:59.765651+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:24:59.765651+0000","last_undegraded":"2024-05-08T09:24:59.765651+0000","last_fullsized":"2024-05-08T09:24:59.765651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.765502+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:46.174195+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.320607+0000","last_change":"2024-05-08T09:24:57.320607+0000","last_active":"2024-05-08T09:24:57.320607+0000","last_peered":"2024-05-08T09:24:57.320607+0000","last_clean":"2024-05-08T09:24:57.320607+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:24:57.320607+0000","last_undegraded":"2024-05-08T09:24:57.320607+0000","last_fullsized":"2024-05-08T09:24:57.320607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.320468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:09.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.786877+0000","last_change":"2024-05-08T09:25:04.786877+0000","last_active":"2024-05-08T09:25:04.786877+0000","last_peered":"2024-05-08T09:25:04.786877+0000","last_clean":"2024-05-08T09:25:04.786877+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:25:04.786877+0000","last_undegraded":"2024-05-08T09:25:04.786877+0000","last_fullsized":"2024-05-08T09:25:04.786877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.786748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:38.042528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.000502+0000","last_change":"2024-05-08T09:25:03.000502+0000","last_active":"2024-05-08T09:25:03.000502+0000","last_peered":"2024-05-08T09:25:03.000502+0000","last_clean":"2024-05-08T09:25:03.000502+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:25:03.000502+0000","last_undegraded":"2024-05-08T09:25:03.000502+0000","last_fullsized":"2024-05-08T09:25:03.000502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.000386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:27.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.770914+0000","last_change":"2024-05-08T09:25:34.770949+0000","last_active":"2024-05-08T09:25:34.770914+0000","last_peered":"2024-05-08T09:25:34.770914+0000","last_clean":"2024-05-08T09:25:34.770914+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:25:34.770914+0000","last_undegraded":"2024-05-08T09:25:34.770914+0000","last_fullsized":"2024-05-08T09:25:34.770914+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.770818+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:46.514009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:04.480855+0000","last_change":"2024-05-08T09:26:04.480883+0000","last_active":"2024-05-08T09:26:04.480855+0000","last_peered":"2024-05-08T09:26:04.480855+0000","last_clean":"2024-05-08T09:26:04.480855+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:26:04.480855+0000","last_undegraded":"2024-05-08T09:26:04.480855+0000","last_fullsized":"2024-05-08T09:26:04.480855+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:04.480749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:04.480749+0000","last_clean_scrub_stamp":"2024-05-08T09:26:04.480749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:21.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:58.408320+0000","last_change":"2024-05-08T09:25:58.408350+0000","last_active":"2024-05-08T09:25:58.408320+0000","last_peered":"2024-05-08T09:25:58.408320+0000","last_clean":"2024-05-08T09:25:58.408320+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:25:58.408320+0000","last_undegraded":"2024-05-08T09:25:58.408320+0000","last_fullsized":"2024-05-08T09:25:58.408320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:58.408222+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:58.408222+0000","last_clean_scrub_stamp":"2024-05-08T09:25:58.408222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:08:50.729817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.755062+0000","last_change":"2024-05-08T09:25:07.755062+0000","last_active":"2024-05-08T09:25:07.755062+0000","last_peered":"2024-05-08T09:25:07.755062+0000","last_clean":"2024-05-08T09:25:07.755062+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:25:07.755062+0000","last_undegraded":"2024-05-08T09:25:07.755062+0000","last_fullsized":"2024-05-08T09:25:07.755062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.754913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:46.567445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.062932+0000","last_change":"2024-05-08T09:24:56.062932+0000","last_active":"2024-05-08T09:24:56.062932+0000","last_peered":"2024-05-08T09:24:56.062932+0000","last_clean":"2024-05-08T09:24:56.062932+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:24:56.062932+0000","last_undegraded":"2024-05-08T09:24:56.062932+0000","last_fullsized":"2024-05-08T09:24:56.062932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.062751+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:23.610342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.720522+0000","last_change":"2024-05-08T09:24:56.720522+0000","last_active":"2024-05-08T09:24:56.720522+0000","last_peered":"2024-05-08T09:24:56.720522+0000","last_clean":"2024-05-08T09:24:56.720522+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:24:56.720522+0000","last_undegraded":"2024-05-08T09:24:56.720522+0000","last_fullsized":"2024-05-08T09:24:56.720522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.720398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:12.622377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.309632+0000","last_change":"2024-05-08T09:25:09.309632+0000","last_active":"2024-05-08T09:25:09.309632+0000","last_peered":"2024-05-08T09:25:09.309632+0000","last_clean":"2024-05-08T09:25:09.309632+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:25:09.309632+0000","last_undegraded":"2024-05-08T09:25:09.309632+0000","last_fullsized":"2024-05-08T09:25:09.309632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.309508+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:50.697197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.254017+0000","last_change":"2024-05-08T09:25:35.254017+0000","last_active":"2024-05-08T09:25:35.254017+0000","last_peered":"2024-05-08T09:25:35.254017+0000","last_clean":"2024-05-08T09:25:35.254017+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:25:35.254017+0000","last_undegraded":"2024-05-08T09:25:35.254017+0000","last_fullsized":"2024-05-08T09:25:35.254017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.253888+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:26.962382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:00.446234+0000","last_change":"2024-05-08T09:26:00.446257+0000","last_active":"2024-05-08T09:26:00.446234+0000","last_peered":"2024-05-08T09:26:00.446234+0000","last_clean":"2024-05-08T09:26:00.446234+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:26:00.446234+0000","last_undegraded":"2024-05-08T09:26:00.446234+0000","last_fullsized":"2024-05-08T09:26:00.446234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:00.446123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:00.446123+0000","last_clean_scrub_stamp":"2024-05-08T09:26:00.446123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:39.129715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.887978+0000","last_change":"2024-05-08T09:25:19.887978+0000","last_active":"2024-05-08T09:25:19.887978+0000","last_peered":"2024-05-08T09:25:19.887978+0000","last_clean":"2024-05-08T09:25:19.887978+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:25:19.887978+0000","last_undegraded":"2024-05-08T09:25:19.887978+0000","last_fullsized":"2024-05-08T09:25:19.887978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.887845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:19.515572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.124896+0000","last_change":"2024-05-08T09:24:50.124896+0000","last_active":"2024-05-08T09:24:50.124896+0000","last_peered":"2024-05-08T09:24:50.124896+0000","last_clean":"2024-05-08T09:24:50.124896+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:24:50.124896+0000","last_undegraded":"2024-05-08T09:24:50.124896+0000","last_fullsized":"2024-05-08T09:24:50.124896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.124732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:35.398499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.697104+0000","last_change":"2024-05-08T09:24:53.697104+0000","last_active":"2024-05-08T09:24:53.697104+0000","last_peered":"2024-05-08T09:24:53.697104+0000","last_clean":"2024-05-08T09:24:53.697104+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:53.697104+0000","last_undegraded":"2024-05-08T09:24:53.697104+0000","last_fullsized":"2024-05-08T09:24:53.697104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.696956+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:53.816751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.235958+0000","last_change":"2024-05-08T09:25:22.235958+0000","last_active":"2024-05-08T09:25:22.235958+0000","last_peered":"2024-05-08T09:25:22.235958+0000","last_clean":"2024-05-08T09:25:22.235958+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:25:22.235958+0000","last_undegraded":"2024-05-08T09:25:22.235958+0000","last_fullsized":"2024-05-08T09:25:22.235958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.235783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:01.285711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.610862+0000","last_change":"2024-05-08T09:25:43.610862+0000","last_active":"2024-05-08T09:25:43.610862+0000","last_peered":"2024-05-08T09:25:43.610862+0000","last_clean":"2024-05-08T09:25:43.610862+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:25:43.610862+0000","last_undegraded":"2024-05-08T09:25:43.610862+0000","last_fullsized":"2024-05-08T09:25:43.610862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.610735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:19:53.132295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.882929+0000","last_change":"2024-05-08T09:25:24.882929+0000","last_active":"2024-05-08T09:25:24.882929+0000","last_peered":"2024-05-08T09:25:24.882929+0000","last_clean":"2024-05-08T09:25:24.882929+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:25:24.882929+0000","last_undegraded":"2024-05-08T09:25:24.882929+0000","last_fullsized":"2024-05-08T09:25:24.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.882795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:04.277203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.290947+0000","last_change":"2024-05-08T09:25:27.290947+0000","last_active":"2024-05-08T09:25:27.290947+0000","last_peered":"2024-05-08T09:25:27.290947+0000","last_clean":"2024-05-08T09:25:27.290947+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:25:27.290947+0000","last_undegraded":"2024-05-08T09:25:27.290947+0000","last_fullsized":"2024-05-08T09:25:27.290947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.290724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.933110+0000","last_change":"2024-05-08T09:25:25.933110+0000","last_active":"2024-05-08T09:25:25.933110+0000","last_peered":"2024-05-08T09:25:25.933110+0000","last_clean":"2024-05-08T09:25:25.933110+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:25:25.933110+0000","last_undegraded":"2024-05-08T09:25:25.933110+0000","last_fullsized":"2024-05-08T09:25:25.933110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.932974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:54.375768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.315030+0000","last_change":"2024-05-08T09:25:07.315030+0000","last_active":"2024-05-08T09:25:07.315030+0000","last_peered":"2024-05-08T09:25:07.315030+0000","last_clean":"2024-05-08T09:25:07.315030+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:25:07.315030+0000","last_undegraded":"2024-05-08T09:25:07.315030+0000","last_fullsized":"2024-05-08T09:25:07.315030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.314876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:51.934749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.284595+0000","last_change":"2024-05-08T09:25:00.284595+0000","last_active":"2024-05-08T09:25:00.284595+0000","last_peered":"2024-05-08T09:25:00.284595+0000","last_clean":"2024-05-08T09:25:00.284595+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:25:00.284595+0000","last_undegraded":"2024-05-08T09:25:00.284595+0000","last_fullsized":"2024-05-08T09:25:00.284595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.284405+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:11:16.757164+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.743937+0000","last_change":"2024-05-08T09:25:04.743937+0000","last_active":"2024-05-08T09:25:04.743937+0000","last_peered":"2024-05-08T09:25:04.743937+0000","last_clean":"2024-05-08T09:25:04.743937+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:25:04.743937+0000","last_undegraded":"2024-05-08T09:25:04.743937+0000","last_fullsized":"2024-05-08T09:25:04.743937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.743814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:55.764703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.255444+0000","last_change":"2024-05-08T09:25:38.255444+0000","last_active":"2024-05-08T09:25:38.255444+0000","last_peered":"2024-05-08T09:25:38.255444+0000","last_clean":"2024-05-08T09:25:38.255444+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:25:38.255444+0000","last_undegraded":"2024-05-08T09:25:38.255444+0000","last_fullsized":"2024-05-08T09:25:38.255444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.255280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:02:43.030188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.997209+0000","last_change":"2024-05-08T09:25:32.997209+0000","last_active":"2024-05-08T09:25:32.997209+0000","last_peered":"2024-05-08T09:25:32.997209+0000","last_clean":"2024-05-08T09:25:32.997209+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:25:32.997209+0000","last_undegraded":"2024-05-08T09:25:32.997209+0000","last_fullsized":"2024-05-08T09:25:32.997209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.997014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:41.577605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:01.469249+0000","last_change":"2024-05-08T09:26:01.469271+0000","last_active":"2024-05-08T09:26:01.469249+0000","last_peered":"2024-05-08T09:26:01.469249+0000","last_clean":"2024-05-08T09:26:01.469249+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:26:01.469249+0000","last_undegraded":"2024-05-08T09:26:01.469249+0000","last_fullsized":"2024-05-08T09:26:01.469249+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:01.469153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:01.469153+0000","last_clean_scrub_stamp":"2024-05-08T09:26:01.469153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:48:39.377300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.348367+0000","last_change":"2024-05-08T09:25:18.348367+0000","last_active":"2024-05-08T09:25:18.348367+0000","last_peered":"2024-05-08T09:25:18.348367+0000","last_clean":"2024-05-08T09:25:18.348367+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:25:18.348367+0000","last_undegraded":"2024-05-08T09:25:18.348367+0000","last_fullsized":"2024-05-08T09:25:18.348367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.348203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:24.290463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.703314+0000","last_change":"2024-05-08T09:25:02.703314+0000","last_active":"2024-05-08T09:25:02.703314+0000","last_peered":"2024-05-08T09:25:02.703314+0000","last_clean":"2024-05-08T09:25:02.703314+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:25:02.703314+0000","last_undegraded":"2024-05-08T09:25:02.703314+0000","last_fullsized":"2024-05-08T09:25:02.703314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.703179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:19.071013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.065155+0000","last_change":"2024-05-08T09:24:58.065155+0000","last_active":"2024-05-08T09:24:58.065155+0000","last_peered":"2024-05-08T09:24:58.065155+0000","last_clean":"2024-05-08T09:24:58.065155+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:58.065155+0000","last_undegraded":"2024-05-08T09:24:58.065155+0000","last_fullsized":"2024-05-08T09:24:58.065155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.065021+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:41.445580+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.225915+0000","last_change":"2024-05-08T09:25:18.225915+0000","last_active":"2024-05-08T09:25:18.225915+0000","last_peered":"2024-05-08T09:25:18.225915+0000","last_clean":"2024-05-08T09:25:18.225915+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:25:18.225915+0000","last_undegraded":"2024-05-08T09:25:18.225915+0000","last_fullsized":"2024-05-08T09:25:18.225915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.225797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:51.835449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.735709+0000","last_change":"2024-05-08T09:25:08.735709+0000","last_active":"2024-05-08T09:25:08.735709+0000","last_peered":"2024-05-08T09:25:08.735709+0000","last_clean":"2024-05-08T09:25:08.735709+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:25:08.735709+0000","last_undegraded":"2024-05-08T09:25:08.735709+0000","last_fullsized":"2024-05-08T09:25:08.735709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.735600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:33.339447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.776797+0000","last_change":"2024-05-08T09:25:17.776797+0000","last_active":"2024-05-08T09:25:17.776797+0000","last_peered":"2024-05-08T09:25:17.776797+0000","last_clean":"2024-05-08T09:25:17.776797+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:25:17.776797+0000","last_undegraded":"2024-05-08T09:25:17.776797+0000","last_fullsized":"2024-05-08T09:25:17.776797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.776647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:35.577142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.356418+0000","last_change":"2024-05-08T09:25:14.356418+0000","last_active":"2024-05-08T09:25:14.356418+0000","last_peered":"2024-05-08T09:25:14.356418+0000","last_clean":"2024-05-08T09:25:14.356418+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:25:14.356418+0000","last_undegraded":"2024-05-08T09:25:14.356418+0000","last_fullsized":"2024-05-08T09:25:14.356418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.356288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:30.724123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.052956+0000","last_change":"2024-05-08T09:25:35.052987+0000","last_active":"2024-05-08T09:25:35.052956+0000","last_peered":"2024-05-08T09:25:35.052956+0000","last_clean":"2024-05-08T09:25:35.052956+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:25:35.052956+0000","last_undegraded":"2024-05-08T09:25:35.052956+0000","last_fullsized":"2024-05-08T09:25:35.052956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.052855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.695413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.733784+0000","last_change":"2024-05-08T09:25:03.733784+0000","last_active":"2024-05-08T09:25:03.733784+0000","last_peered":"2024-05-08T09:25:03.733784+0000","last_clean":"2024-05-08T09:25:03.733784+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:25:03.733784+0000","last_undegraded":"2024-05-08T09:25:03.733784+0000","last_fullsized":"2024-05-08T09:25:03.733784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.733661+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:36.989441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'73","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.773109+0000","last_change":"2024-05-08T09:24:57.773109+0000","last_active":"2024-05-08T09:24:57.773109+0000","last_peered":"2024-05-08T09:24:57.773109+0000","last_clean":"2024-05-08T09:24:57.773109+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:24:57.773109+0000","last_undegraded":"2024-05-08T09:24:57.773109+0000","last_fullsized":"2024-05-08T09:24:57.773109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.772960+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:39.160649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.236766+0000","last_change":"2024-05-08T09:24:49.236766+0000","last_active":"2024-05-08T09:24:49.236766+0000","last_peered":"2024-05-08T09:24:49.236766+0000","last_clean":"2024-05-08T09:24:49.236766+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:24:49.236766+0000","last_undegraded":"2024-05-08T09:24:49.236766+0000","last_fullsized":"2024-05-08T09:24:49.236766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.236605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:51.830567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.071817+0000","last_change":"2024-05-08T09:25:49.071817+0000","last_active":"2024-05-08T09:25:49.071817+0000","last_peered":"2024-05-08T09:25:49.071817+0000","last_clean":"2024-05-08T09:25:49.071817+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:25:49.071817+0000","last_undegraded":"2024-05-08T09:25:49.071817+0000","last_fullsized":"2024-05-08T09:25:49.071817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-08T09:25:49.071654+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-08T09:25:49.071654+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.071654+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:22.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.839615+0000","last_change":"2024-05-08T09:25:15.839615+0000","last_active":"2024-05-08T09:25:15.839615+0000","last_peered":"2024-05-08T09:25:15.839615+0000","last_clean":"2024-05-08T09:25:15.839615+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:25:15.839615+0000","last_undegraded":"2024-05-08T09:25:15.839615+0000","last_fullsized":"2024-05-08T09:25:15.839615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.839497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.088807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.030733+0000","last_change":"2024-05-08T09:25:38.030733+0000","last_active":"2024-05-08T09:25:38.030733+0000","last_peered":"2024-05-08T09:25:38.030733+0000","last_clean":"2024-05-08T09:25:38.030733+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:25:38.030733+0000","last_undegraded":"2024-05-08T09:25:38.030733+0000","last_fullsized":"2024-05-08T09:25:38.030733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.030617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:38.840037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:02.476597+0000","last_change":"2024-05-08T09:26:02.476625+0000","last_active":"2024-05-08T09:26:02.476597+0000","last_peered":"2024-05-08T09:26:02.476597+0000","last_clean":"2024-05-08T09:26:02.476597+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:26:02.476597+0000","last_undegraded":"2024-05-08T09:26:02.476597+0000","last_fullsized":"2024-05-08T09:26:02.476597+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:02.476502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:02.476502+0000","last_clean_scrub_stamp":"2024-05-08T09:26:02.476502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:52:21.674859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.124254+0000","last_change":"2024-05-08T09:24:51.124254+0000","last_active":"2024-05-08T09:24:51.124254+0000","last_peered":"2024-05-08T09:24:51.124254+0000","last_clean":"2024-05-08T09:24:51.124254+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:24:51.124254+0000","last_undegraded":"2024-05-08T09:24:51.124254+0000","last_fullsized":"2024-05-08T09:24:51.124254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.124097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:45.345946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.719272+0000","last_change":"2024-05-08T09:24:54.719272+0000","last_active":"2024-05-08T09:24:54.719272+0000","last_peered":"2024-05-08T09:24:54.719272+0000","last_clean":"2024-05-08T09:24:54.719272+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:24:54.719272+0000","last_undegraded":"2024-05-08T09:24:54.719272+0000","last_fullsized":"2024-05-08T09:24:54.719272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.719066+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.377306+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":369,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.668807+0000","last_change":"2024-05-08T09:24:50.668807+0000","last_active":"2024-05-08T09:24:50.668807+0000","last_peered":"2024-05-08T09:24:50.668807+0000","last_clean":"2024-05-08T09:24:50.668807+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:50.668807+0000","last_undegraded":"2024-05-08T09:24:50.668807+0000","last_fullsized":"2024-05-08T09:24:50.668807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.668685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:49.401297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.179910+0000","last_change":"2024-05-08T09:21:38.979372+0000","last_active":"2024-05-08T09:24:49.179910+0000","last_peered":"2024-05-08T09:24:49.179910+0000","last_clean":"2024-05-08T09:24:49.179910+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:24:49.179910+0000","last_undegraded":"2024-05-08T09:24:49.179910+0000","last_fullsized":"2024-05-08T09:24:49.179910+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.152804+0000","last_change":"2024-05-08T09:25:28.152804+0000","last_active":"2024-05-08T09:25:28.152804+0000","last_peered":"2024-05-08T09:25:28.152804+0000","last_clean":"2024-05-08T09:25:28.152804+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:25:28.152804+0000","last_undegraded":"2024-05-08T09:25:28.152804+0000","last_fullsized":"2024-05-08T09:25:28.152804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.152679+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:10.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:53.312221+0000","last_change":"2024-05-08T09:25:53.312247+0000","last_active":"2024-05-08T09:25:53.312221+0000","last_peered":"2024-05-08T09:25:53.312221+0000","last_clean":"2024-05-08T09:25:53.312221+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:25:53.312221+0000","last_undegraded":"2024-05-08T09:25:53.312221+0000","last_fullsized":"2024-05-08T09:25:53.312221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:53.312126+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:53.312126+0000","last_clean_scrub_stamp":"2024-05-08T09:25:53.312126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:18.983438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.064673+0000","last_change":"2024-05-08T09:25:36.064673+0000","last_active":"2024-05-08T09:25:36.064673+0000","last_peered":"2024-05-08T09:25:36.064673+0000","last_clean":"2024-05-08T09:25:36.064673+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:25:36.064673+0000","last_undegraded":"2024-05-08T09:25:36.064673+0000","last_fullsized":"2024-05-08T09:25:36.064673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.064555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:09.674206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.073177+0000","last_change":"2024-05-08T09:24:57.073177+0000","last_active":"2024-05-08T09:24:57.073177+0000","last_peered":"2024-05-08T09:24:57.073177+0000","last_clean":"2024-05-08T09:24:57.073177+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:24:57.073177+0000","last_undegraded":"2024-05-08T09:24:57.073177+0000","last_fullsized":"2024-05-08T09:24:57.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.073058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:35.322368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.226059+0000","last_change":"2024-05-08T09:25:23.226059+0000","last_active":"2024-05-08T09:25:23.226059+0000","last_peered":"2024-05-08T09:25:23.226059+0000","last_clean":"2024-05-08T09:25:23.226059+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:25:23.226059+0000","last_undegraded":"2024-05-08T09:25:23.226059+0000","last_fullsized":"2024-05-08T09:25:23.226059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.225893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:55.821357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.762592+0000","last_change":"2024-05-08T09:24:53.762592+0000","last_active":"2024-05-08T09:24:53.762592+0000","last_peered":"2024-05-08T09:24:53.762592+0000","last_clean":"2024-05-08T09:24:53.762592+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:53.762592+0000","last_undegraded":"2024-05-08T09:24:53.762592+0000","last_fullsized":"2024-05-08T09:24:53.762592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.762413+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:17.292293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.729008+0000","last_change":"2024-05-08T09:25:00.729008+0000","last_active":"2024-05-08T09:25:00.729008+0000","last_peered":"2024-05-08T09:25:00.729008+0000","last_clean":"2024-05-08T09:25:00.729008+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:25:00.729008+0000","last_undegraded":"2024-05-08T09:25:00.729008+0000","last_fullsized":"2024-05-08T09:25:00.729008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.728878+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:46.558237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'16","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.273892+0000","last_change":"2024-05-08T09:25:23.273892+0000","last_active":"2024-05-08T09:25:23.273892+0000","last_peered":"2024-05-08T09:25:23.273892+0000","last_clean":"2024-05-08T09:25:23.273892+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:25:23.273892+0000","last_undegraded":"2024-05-08T09:25:23.273892+0000","last_fullsized":"2024-05-08T09:25:23.273892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.273754+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:57.512051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.750165+0000","last_change":"2024-05-08T09:25:33.750165+0000","last_active":"2024-05-08T09:25:33.750165+0000","last_peered":"2024-05-08T09:25:33.750165+0000","last_clean":"2024-05-08T09:25:33.750165+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:25:33.750165+0000","last_undegraded":"2024-05-08T09:25:33.750165+0000","last_fullsized":"2024-05-08T09:25:33.750165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.750034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:38.390790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:03.451743+0000","last_change":"2024-05-08T09:26:03.451765+0000","last_active":"2024-05-08T09:26:03.451743+0000","last_peered":"2024-05-08T09:26:03.451743+0000","last_clean":"2024-05-08T09:26:03.451743+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:26:03.451743+0000","last_undegraded":"2024-05-08T09:26:03.451743+0000","last_fullsized":"2024-05-08T09:26:03.451743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:03.451653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:03.451653+0000","last_clean_scrub_stamp":"2024-05-08T09:26:03.451653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:09:37.664513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.067152+0000","last_change":"2024-05-08T09:25:00.067152+0000","last_active":"2024-05-08T09:25:00.067152+0000","last_peered":"2024-05-08T09:25:00.067152+0000","last_clean":"2024-05-08T09:25:00.067152+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:25:00.067152+0000","last_undegraded":"2024-05-08T09:25:00.067152+0000","last_fullsized":"2024-05-08T09:25:00.067152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.067020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:54.239410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.290105+0000","last_change":"2024-05-08T09:24:56.290105+0000","last_active":"2024-05-08T09:24:56.290105+0000","last_peered":"2024-05-08T09:24:56.290105+0000","last_clean":"2024-05-08T09:24:56.290105+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:24:56.290105+0000","last_undegraded":"2024-05-08T09:24:56.290105+0000","last_fullsized":"2024-05-08T09:24:56.290105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.289983+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:24.762692+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.755671+0000","last_change":"2024-05-08T09:24:52.755671+0000","last_active":"2024-05-08T09:24:52.755671+0000","last_peered":"2024-05-08T09:24:52.755671+0000","last_clean":"2024-05-08T09:24:52.755671+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:24:52.755671+0000","last_undegraded":"2024-05-08T09:24:52.755671+0000","last_fullsized":"2024-05-08T09:24:52.755671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.755558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:37:21.018669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.335831+0000","last_change":"2024-05-08T09:25:37.335831+0000","last_active":"2024-05-08T09:25:37.335831+0000","last_peered":"2024-05-08T09:25:37.335831+0000","last_clean":"2024-05-08T09:25:37.335831+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:25:37.335831+0000","last_undegraded":"2024-05-08T09:25:37.335831+0000","last_fullsized":"2024-05-08T09:25:37.335831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.335715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:16.730123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.340043+0000","last_change":"2024-05-08T09:25:39.340043+0000","last_active":"2024-05-08T09:25:39.340043+0000","last_peered":"2024-05-08T09:25:39.340043+0000","last_clean":"2024-05-08T09:25:39.340043+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:25:39.340043+0000","last_undegraded":"2024-05-08T09:25:39.340043+0000","last_fullsized":"2024-05-08T09:25:39.340043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.339896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:32.696620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.264300+0000","last_change":"2024-05-08T09:25:10.264323+0000","last_active":"2024-05-08T09:25:10.264300+0000","last_peered":"2024-05-08T09:25:10.264300+0000","last_clean":"2024-05-08T09:25:10.264300+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:25:10.264300+0000","last_undegraded":"2024-05-08T09:25:10.264300+0000","last_fullsized":"2024-05-08T09:25:10.264300+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.264214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:56.672907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:50.306302+0000","last_change":"2024-05-08T09:25:50.306302+0000","last_active":"2024-05-08T09:25:50.306302+0000","last_peered":"2024-05-08T09:25:50.306302+0000","last_clean":"2024-05-08T09:25:50.306302+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:25:50.306302+0000","last_undegraded":"2024-05-08T09:25:50.306302+0000","last_fullsized":"2024-05-08T09:25:50.306302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:50.306182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:50.306182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:50.306182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:29.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.738977+0000","last_change":"2024-05-08T09:25:03.739001+0000","last_active":"2024-05-08T09:25:03.738977+0000","last_peered":"2024-05-08T09:25:03.738977+0000","last_clean":"2024-05-08T09:25:03.738977+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:25:03.738977+0000","last_undegraded":"2024-05-08T09:25:03.738977+0000","last_fullsized":"2024-05-08T09:25:03.738977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.738886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:20.106720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.129955+0000","last_change":"2024-05-08T09:25:10.129988+0000","last_active":"2024-05-08T09:25:10.129955+0000","last_peered":"2024-05-08T09:25:10.129955+0000","last_clean":"2024-05-08T09:25:10.129955+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:25:10.129955+0000","last_undegraded":"2024-05-08T09:25:10.129955+0000","last_fullsized":"2024-05-08T09:25:10.129955+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.129867+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:03.675404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.234399+0000","last_change":"2024-05-08T09:25:30.234422+0000","last_active":"2024-05-08T09:25:30.234399+0000","last_peered":"2024-05-08T09:25:30.234399+0000","last_clean":"2024-05-08T09:25:30.234399+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:25:30.234399+0000","last_undegraded":"2024-05-08T09:25:30.234399+0000","last_fullsized":"2024-05-08T09:25:30.234399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.234277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:27.546403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:50.112454+0000","last_change":"2024-05-08T09:25:50.112480+0000","last_active":"2024-05-08T09:25:50.112454+0000","last_peered":"2024-05-08T09:25:50.112454+0000","last_clean":"2024-05-08T09:25:50.112454+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:25:50.112454+0000","last_undegraded":"2024-05-08T09:25:50.112454+0000","last_fullsized":"2024-05-08T09:25:50.112454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:50.112363+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:50.112363+0000","last_clean_scrub_stamp":"2024-05-08T09:25:50.112363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:14.873705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.525876+0000","last_change":"2024-05-08T09:25:49.525902+0000","last_active":"2024-05-08T09:25:49.525876+0000","last_peered":"2024-05-08T09:25:49.525876+0000","last_clean":"2024-05-08T09:25:49.525876+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:25:49.525876+0000","last_undegraded":"2024-05-08T09:25:49.525876+0000","last_fullsized":"2024-05-08T09:25:49.525876+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:49.525751+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:49.525751+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.525751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:46.837877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.324870+0000","last_change":"2024-05-08T09:25:16.324894+0000","last_active":"2024-05-08T09:25:16.324870+0000","last_peered":"2024-05-08T09:25:16.324870+0000","last_clean":"2024-05-08T09:25:16.324870+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:25:16.324870+0000","last_undegraded":"2024-05-08T09:25:16.324870+0000","last_fullsized":"2024-05-08T09:25:16.324870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.324762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:07.345651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.092621+0000","last_change":"2024-05-08T09:24:59.092649+0000","last_active":"2024-05-08T09:24:59.092621+0000","last_peered":"2024-05-08T09:24:59.092621+0000","last_clean":"2024-05-08T09:24:59.092621+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:24:59.092621+0000","last_undegraded":"2024-05-08T09:24:59.092621+0000","last_fullsized":"2024-05-08T09:24:59.092621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.092531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:16.893025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.726480+0000","last_change":"2024-05-08T09:25:01.726515+0000","last_active":"2024-05-08T09:25:01.726480+0000","last_peered":"2024-05-08T09:25:01.726480+0000","last_clean":"2024-05-08T09:25:01.726480+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:25:01.726480+0000","last_undegraded":"2024-05-08T09:25:01.726480+0000","last_fullsized":"2024-05-08T09:25:01.726480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.726389+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:39.682934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.262975+0000","last_change":"2024-05-08T09:24:50.262998+0000","last_active":"2024-05-08T09:24:50.262975+0000","last_peered":"2024-05-08T09:24:50.262975+0000","last_clean":"2024-05-08T09:24:50.262975+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:24:50.262975+0000","last_undegraded":"2024-05-08T09:24:50.262975+0000","last_fullsized":"2024-05-08T09:24:50.262975+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.262889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:10.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.112972+0000","last_change":"2024-05-08T09:25:46.112997+0000","last_active":"2024-05-08T09:25:46.112972+0000","last_peered":"2024-05-08T09:25:46.112972+0000","last_clean":"2024-05-08T09:25:46.112972+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:25:46.112972+0000","last_undegraded":"2024-05-08T09:25:46.112972+0000","last_fullsized":"2024-05-08T09:25:46.112972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:46.112873+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:46.112873+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.112873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:28.133766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.877397+0000","last_change":"2024-05-08T09:25:14.877426+0000","last_active":"2024-05-08T09:25:14.877397+0000","last_peered":"2024-05-08T09:25:14.877397+0000","last_clean":"2024-05-08T09:25:14.877397+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:25:14.877397+0000","last_undegraded":"2024-05-08T09:25:14.877397+0000","last_fullsized":"2024-05-08T09:25:14.877397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.877308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:53.126619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.369985+0000","last_change":"2024-05-08T09:25:33.370010+0000","last_active":"2024-05-08T09:25:33.369985+0000","last_peered":"2024-05-08T09:25:33.369985+0000","last_clean":"2024-05-08T09:25:33.369985+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:25:33.369985+0000","last_undegraded":"2024-05-08T09:25:33.369985+0000","last_fullsized":"2024-05-08T09:25:33.369985+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.369888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:36.532509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.328695+0000","last_change":"2024-05-08T09:25:06.328721+0000","last_active":"2024-05-08T09:25:06.328695+0000","last_peered":"2024-05-08T09:25:06.328695+0000","last_clean":"2024-05-08T09:25:06.328695+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:25:06.328695+0000","last_undegraded":"2024-05-08T09:25:06.328695+0000","last_fullsized":"2024-05-08T09:25:06.328695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.328595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:24.990182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":119,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.742554+0000","last_change":"2024-05-08T09:24:54.742594+0000","last_active":"2024-05-08T09:24:54.742554+0000","last_peered":"2024-05-08T09:24:54.742554+0000","last_clean":"2024-05-08T09:24:54.742554+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:54.742554+0000","last_undegraded":"2024-05-08T09:24:54.742554+0000","last_fullsized":"2024-05-08T09:24:54.742554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.742456+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:50.767894+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.658943+0000","last_change":"2024-05-08T09:24:51.658969+0000","last_active":"2024-05-08T09:24:51.658943+0000","last_peered":"2024-05-08T09:24:51.658943+0000","last_clean":"2024-05-08T09:24:51.658943+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:24:51.658943+0000","last_undegraded":"2024-05-08T09:24:51.658943+0000","last_fullsized":"2024-05-08T09:24:51.658943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.658847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:21:59.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.232278+0000","last_change":"2024-05-08T09:25:34.232307+0000","last_active":"2024-05-08T09:25:34.232278+0000","last_peered":"2024-05-08T09:25:34.232278+0000","last_clean":"2024-05-08T09:25:34.232278+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:25:34.232278+0000","last_undegraded":"2024-05-08T09:25:34.232278+0000","last_fullsized":"2024-05-08T09:25:34.232278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.232174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:46.890740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.305095+0000","last_change":"2024-05-08T09:25:42.305165+0000","last_active":"2024-05-08T09:25:42.305095+0000","last_peered":"2024-05-08T09:25:42.305095+0000","last_clean":"2024-05-08T09:25:42.305095+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:25:42.305095+0000","last_undegraded":"2024-05-08T09:25:42.305095+0000","last_fullsized":"2024-05-08T09:25:42.305095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.304979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:28.049765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.759058+0000","last_change":"2024-05-08T09:25:23.759086+0000","last_active":"2024-05-08T09:25:23.759058+0000","last_peered":"2024-05-08T09:25:23.759058+0000","last_clean":"2024-05-08T09:25:23.759058+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:25:23.759058+0000","last_undegraded":"2024-05-08T09:25:23.759058+0000","last_fullsized":"2024-05-08T09:25:23.759058+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.758963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:56.200915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.045028+0000","last_change":"2024-05-08T09:24:55.045049+0000","last_active":"2024-05-08T09:24:55.045028+0000","last_peered":"2024-05-08T09:24:55.045028+0000","last_clean":"2024-05-08T09:24:55.045028+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:24:55.045028+0000","last_undegraded":"2024-05-08T09:24:55.045028+0000","last_fullsized":"2024-05-08T09:24:55.045028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.044956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:28.363607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'38","reported_seq":93,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.255638+0000","last_change":"2024-05-08T09:24:59.255686+0000","last_active":"2024-05-08T09:24:59.255638+0000","last_peered":"2024-05-08T09:24:59.255638+0000","last_clean":"2024-05-08T09:24:59.255638+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:24:59.255638+0000","last_undegraded":"2024-05-08T09:24:59.255638+0000","last_fullsized":"2024-05-08T09:24:59.255638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.255555+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:18:31.061439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.260222+0000","last_change":"2024-05-08T09:24:51.260245+0000","last_active":"2024-05-08T09:24:51.260222+0000","last_peered":"2024-05-08T09:24:51.260222+0000","last_clean":"2024-05-08T09:24:51.260222+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:24:51.260222+0000","last_undegraded":"2024-05-08T09:24:51.260222+0000","last_fullsized":"2024-05-08T09:24:51.260222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.260133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:11.715270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.220779+0000","last_change":"2024-05-08T09:25:36.220779+0000","last_active":"2024-05-08T09:25:36.220779+0000","last_peered":"2024-05-08T09:25:36.220779+0000","last_clean":"2024-05-08T09:25:36.220779+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:25:36.220779+0000","last_undegraded":"2024-05-08T09:25:36.220779+0000","last_fullsized":"2024-05-08T09:25:36.220779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.220667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:18.540821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.180602+0000","last_change":"2024-05-08T09:25:41.180625+0000","last_active":"2024-05-08T09:25:41.180602+0000","last_peered":"2024-05-08T09:25:41.180602+0000","last_clean":"2024-05-08T09:25:41.180602+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:25:41.180602+0000","last_undegraded":"2024-05-08T09:25:41.180602+0000","last_fullsized":"2024-05-08T09:25:41.180602+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.120542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.798715+0000","last_change":"2024-05-08T09:25:07.798715+0000","last_active":"2024-05-08T09:25:07.798715+0000","last_peered":"2024-05-08T09:25:07.798715+0000","last_clean":"2024-05-08T09:25:07.798715+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:25:07.798715+0000","last_undegraded":"2024-05-08T09:25:07.798715+0000","last_fullsized":"2024-05-08T09:25:07.798715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.798584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.402432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.736974+0000","last_change":"2024-05-08T09:24:58.737020+0000","last_active":"2024-05-08T09:24:58.736974+0000","last_peered":"2024-05-08T09:24:58.736974+0000","last_clean":"2024-05-08T09:24:58.736974+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:24:58.736974+0000","last_undegraded":"2024-05-08T09:24:58.736974+0000","last_fullsized":"2024-05-08T09:24:58.736974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.736875+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:49.606990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.304313+0000","last_change":"2024-05-08T09:24:52.304336+0000","last_active":"2024-05-08T09:24:52.304313+0000","last_peered":"2024-05-08T09:24:52.304313+0000","last_clean":"2024-05-08T09:24:52.304313+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:24:52.304313+0000","last_undegraded":"2024-05-08T09:24:52.304313+0000","last_fullsized":"2024-05-08T09:24:52.304313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.304223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:48.209866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.063646+0000","last_change":"2024-05-08T09:25:44.063710+0000","last_active":"2024-05-08T09:25:44.063646+0000","last_peered":"2024-05-08T09:25:44.063646+0000","last_clean":"2024-05-08T09:25:44.063646+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:25:44.063646+0000","last_undegraded":"2024-05-08T09:25:44.063646+0000","last_fullsized":"2024-05-08T09:25:44.063646+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:44.063537+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:44.063537+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.063537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:52:04.912659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.968858+0000","last_change":"2024-05-08T09:25:22.968858+0000","last_active":"2024-05-08T09:25:22.968858+0000","last_peered":"2024-05-08T09:25:22.968858+0000","last_clean":"2024-05-08T09:25:22.968858+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:25:22.968858+0000","last_undegraded":"2024-05-08T09:25:22.968858+0000","last_fullsized":"2024-05-08T09:25:22.968858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.968709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:43.854555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.790495+0000","last_change":"2024-05-08T09:25:36.790527+0000","last_active":"2024-05-08T09:25:36.790495+0000","last_peered":"2024-05-08T09:25:36.790495+0000","last_clean":"2024-05-08T09:25:36.790495+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:25:36.790495+0000","last_undegraded":"2024-05-08T09:25:36.790495+0000","last_fullsized":"2024-05-08T09:25:36.790495+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.790389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:10.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.316305+0000","last_change":"2024-05-08T09:25:08.316305+0000","last_active":"2024-05-08T09:25:08.316305+0000","last_peered":"2024-05-08T09:25:08.316305+0000","last_clean":"2024-05-08T09:25:08.316305+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:25:08.316305+0000","last_undegraded":"2024-05-08T09:25:08.316305+0000","last_fullsized":"2024-05-08T09:25:08.316305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.316182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:36.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.028482+0000","last_change":"2024-05-08T09:25:04.028522+0000","last_active":"2024-05-08T09:25:04.028482+0000","last_peered":"2024-05-08T09:25:04.028482+0000","last_clean":"2024-05-08T09:25:04.028482+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:25:04.028482+0000","last_undegraded":"2024-05-08T09:25:04.028482+0000","last_fullsized":"2024-05-08T09:25:04.028482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.028381+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:37.084622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.696777+0000","last_change":"2024-05-08T09:24:52.696803+0000","last_active":"2024-05-08T09:24:52.696777+0000","last_peered":"2024-05-08T09:24:52.696777+0000","last_clean":"2024-05-08T09:24:52.696777+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:24:52.696777+0000","last_undegraded":"2024-05-08T09:24:52.696777+0000","last_fullsized":"2024-05-08T09:24:52.696777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.696677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:55.771440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.211191+0000","last_change":"2024-05-08T09:25:42.211221+0000","last_active":"2024-05-08T09:25:42.211191+0000","last_peered":"2024-05-08T09:25:42.211191+0000","last_clean":"2024-05-08T09:25:42.211191+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:25:42.211191+0000","last_undegraded":"2024-05-08T09:25:42.211191+0000","last_fullsized":"2024-05-08T09:25:42.211191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.211101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:08.820703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.978022+0000","last_change":"2024-05-08T09:25:04.978073+0000","last_active":"2024-05-08T09:25:04.978022+0000","last_peered":"2024-05-08T09:25:04.978022+0000","last_clean":"2024-05-08T09:25:04.978022+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:25:04.978022+0000","last_undegraded":"2024-05-08T09:25:04.978022+0000","last_fullsized":"2024-05-08T09:25:04.978022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.977922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:25.863768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.827635+0000","last_change":"2024-05-08T09:25:25.827659+0000","last_active":"2024-05-08T09:25:25.827635+0000","last_peered":"2024-05-08T09:25:25.827635+0000","last_clean":"2024-05-08T09:25:25.827635+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:25:25.827635+0000","last_undegraded":"2024-05-08T09:25:25.827635+0000","last_fullsized":"2024-05-08T09:25:25.827635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.827542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:05.221950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.308936+0000","last_change":"2024-05-08T09:25:41.308979+0000","last_active":"2024-05-08T09:25:41.308936+0000","last_peered":"2024-05-08T09:25:41.308936+0000","last_clean":"2024-05-08T09:25:41.308936+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:25:41.308936+0000","last_undegraded":"2024-05-08T09:25:41.308936+0000","last_fullsized":"2024-05-08T09:25:41.308936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.308821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:15.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.696268+0000","last_change":"2024-05-08T09:24:59.696268+0000","last_active":"2024-05-08T09:24:59.696268+0000","last_peered":"2024-05-08T09:24:59.696268+0000","last_clean":"2024-05-08T09:24:59.696268+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:24:59.696268+0000","last_undegraded":"2024-05-08T09:24:59.696268+0000","last_fullsized":"2024-05-08T09:24:59.696268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.696053+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:13:58.776407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.838408+0000","last_change":"2024-05-08T09:24:47.838408+0000","last_active":"2024-05-08T09:24:47.838408+0000","last_peered":"2024-05-08T09:24:47.838408+0000","last_clean":"2024-05-08T09:24:47.838408+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:24:47.838408+0000","last_undegraded":"2024-05-08T09:24:47.838408+0000","last_fullsized":"2024-05-08T09:24:47.838408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_clean_scrub_stamp":"2024-05-08T09:24:47.838309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:42.986914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'5","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:38.350051+0000","last_change":"2024-05-08T09:21:38.983547+0000","last_active":"2024-05-08T09:24:38.350051+0000","last_peered":"2024-05-08T09:24:38.350051+0000","last_clean":"2024-05-08T09:24:38.350051+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:24:38.350051+0000","last_undegraded":"2024-05-08T09:24:38.350051+0000","last_fullsized":"2024-05-08T09:24:38.350051+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.888001+0000","last_change":"2024-05-08T09:25:28.888031+0000","last_active":"2024-05-08T09:25:28.888001+0000","last_peered":"2024-05-08T09:25:28.888001+0000","last_clean":"2024-05-08T09:25:28.888001+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:25:28.888001+0000","last_undegraded":"2024-05-08T09:25:28.888001+0000","last_fullsized":"2024-05-08T09:25:28.888001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.887905+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:55.699403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:07.513781+0000","last_change":"2024-05-08T09:26:07.513810+0000","last_active":"2024-05-08T09:26:07.513781+0000","last_peered":"2024-05-08T09:26:07.513781+0000","last_clean":"2024-05-08T09:26:07.513781+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:26:07.513781+0000","last_undegraded":"2024-05-08T09:26:07.513781+0000","last_fullsized":"2024-05-08T09:26:07.513781+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:07.513677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:07.513677+0000","last_clean_scrub_stamp":"2024-05-08T09:26:07.513677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:18.143185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.548811+0000","last_change":"2024-05-08T09:25:46.548867+0000","last_active":"2024-05-08T09:25:46.548811+0000","last_peered":"2024-05-08T09:25:46.548811+0000","last_clean":"2024-05-08T09:25:46.548811+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:25:46.548811+0000","last_undegraded":"2024-05-08T09:25:46.548811+0000","last_fullsized":"2024-05-08T09:25:46.548811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:46.548709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:46.548709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.548709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:28.569601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.221077+0000","last_change":"2024-05-08T09:25:19.221077+0000","last_active":"2024-05-08T09:25:19.221077+0000","last_peered":"2024-05-08T09:25:19.221077+0000","last_clean":"2024-05-08T09:25:19.221077+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:25:19.221077+0000","last_undegraded":"2024-05-08T09:25:19.221077+0000","last_fullsized":"2024-05-08T09:25:19.221077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.220927+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:19.461415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.309897+0000","last_change":"2024-05-08T09:25:01.309897+0000","last_active":"2024-05-08T09:25:01.309897+0000","last_peered":"2024-05-08T09:25:01.309897+0000","last_clean":"2024-05-08T09:25:01.309897+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:25:01.309897+0000","last_undegraded":"2024-05-08T09:25:01.309897+0000","last_fullsized":"2024-05-08T09:25:01.309897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.309733+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:23.863794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916533+0000","last_change":"2024-05-08T09:21:38.980192+0000","last_active":"2024-05-08T09:23:58.916533+0000","last_peered":"2024-05-08T09:23:58.916533+0000","last_clean":"2024-05-08T09:23:58.916533+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:23:58.916533+0000","last_undegraded":"2024-05-08T09:23:58.916533+0000","last_fullsized":"2024-05-08T09:23:58.916533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.354967+0000","last_change":"2024-05-08T09:25:17.354994+0000","last_active":"2024-05-08T09:25:17.354967+0000","last_peered":"2024-05-08T09:25:17.354967+0000","last_clean":"2024-05-08T09:25:17.354967+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:25:17.354967+0000","last_undegraded":"2024-05-08T09:25:17.354967+0000","last_fullsized":"2024-05-08T09:25:17.354967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.354872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:43:36.638892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'6","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.811884+0000","last_change":"2024-05-08T09:25:35.811937+0000","last_active":"2024-05-08T09:25:35.811884+0000","last_peered":"2024-05-08T09:25:35.811884+0000","last_clean":"2024-05-08T09:25:35.811884+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:25:35.811884+0000","last_undegraded":"2024-05-08T09:25:35.811884+0000","last_fullsized":"2024-05-08T09:25:35.811884+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.811764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:18.454322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.708229+0000","last_change":"2024-05-08T09:25:02.708273+0000","last_active":"2024-05-08T09:25:02.708229+0000","last_peered":"2024-05-08T09:25:02.708229+0000","last_clean":"2024-05-08T09:25:02.708229+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:25:02.708229+0000","last_undegraded":"2024-05-08T09:25:02.708229+0000","last_fullsized":"2024-05-08T09:25:02.708229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.708109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:40.664654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'47","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.785230+0000","last_change":"2024-05-08T09:24:58.785302+0000","last_active":"2024-05-08T09:24:58.785230+0000","last_peered":"2024-05-08T09:24:58.785230+0000","last_clean":"2024-05-08T09:24:58.785230+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:58.785230+0000","last_undegraded":"2024-05-08T09:24:58.785230+0000","last_fullsized":"2024-05-08T09:24:58.785230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.785128+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:40.172817+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.715808+0000","last_change":"2024-05-08T09:25:00.715835+0000","last_active":"2024-05-08T09:25:00.715808+0000","last_peered":"2024-05-08T09:25:00.715808+0000","last_clean":"2024-05-08T09:25:00.715808+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:25:00.715808+0000","last_undegraded":"2024-05-08T09:25:00.715808+0000","last_fullsized":"2024-05-08T09:25:00.715808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.715715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.307803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.607112+0000","last_change":"2024-05-08T09:25:44.607135+0000","last_active":"2024-05-08T09:25:44.607112+0000","last_peered":"2024-05-08T09:25:44.607112+0000","last_clean":"2024-05-08T09:25:44.607112+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:25:44.607112+0000","last_undegraded":"2024-05-08T09:25:44.607112+0000","last_fullsized":"2024-05-08T09:25:44.607112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:44.607026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:44.607026+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.607026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:07.868199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.293530+0000","last_change":"2024-05-08T09:25:12.293561+0000","last_active":"2024-05-08T09:25:12.293530+0000","last_peered":"2024-05-08T09:25:12.293530+0000","last_clean":"2024-05-08T09:25:12.293530+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:25:12.293530+0000","last_undegraded":"2024-05-08T09:25:12.293530+0000","last_fullsized":"2024-05-08T09:25:12.293530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.293425+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:22:06.522385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.224871+0000","last_change":"2024-05-08T09:25:48.224899+0000","last_active":"2024-05-08T09:25:48.224871+0000","last_peered":"2024-05-08T09:25:48.224871+0000","last_clean":"2024-05-08T09:25:48.224871+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:25:48.224871+0000","last_undegraded":"2024-05-08T09:25:48.224871+0000","last_fullsized":"2024-05-08T09:25:48.224871+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:48.224772+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:48.224772+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.224772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:25:47.449327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.325599+0000","last_change":"2024-05-08T09:25:04.325623+0000","last_active":"2024-05-08T09:25:04.325599+0000","last_peered":"2024-05-08T09:25:04.325599+0000","last_clean":"2024-05-08T09:25:04.325599+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:25:04.325599+0000","last_undegraded":"2024-05-08T09:25:04.325599+0000","last_fullsized":"2024-05-08T09:25:04.325599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.325510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:21:04.445305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":91,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.725148+0000","last_change":"2024-05-08T09:24:55.725187+0000","last_active":"2024-05-08T09:24:55.725148+0000","last_peered":"2024-05-08T09:24:55.725148+0000","last_clean":"2024-05-08T09:24:55.725148+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:24:55.725148+0000","last_undegraded":"2024-05-08T09:24:55.725148+0000","last_fullsized":"2024-05-08T09:24:55.725148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.725057+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:11.134393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.242609+0000","last_change":"2024-05-08T09:25:13.242631+0000","last_active":"2024-05-08T09:25:13.242609+0000","last_peered":"2024-05-08T09:25:13.242609+0000","last_clean":"2024-05-08T09:25:13.242609+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:25:13.242609+0000","last_undegraded":"2024-05-08T09:25:13.242609+0000","last_fullsized":"2024-05-08T09:25:13.242609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.242515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:24.570077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":18,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917812+0000","last_change":"2024-05-08T09:21:38.986851+0000","last_active":"2024-05-08T09:24:03.917812+0000","last_peered":"2024-05-08T09:24:03.917812+0000","last_clean":"2024-05-08T09:24:03.917812+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:24:03.917812+0000","last_undegraded":"2024-05-08T09:24:03.917812+0000","last_fullsized":"2024-05-08T09:24:03.917812+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.227623+0000","last_change":"2024-05-08T09:25:39.227646+0000","last_active":"2024-05-08T09:25:39.227623+0000","last_peered":"2024-05-08T09:25:39.227623+0000","last_clean":"2024-05-08T09:25:39.227623+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:25:39.227623+0000","last_undegraded":"2024-05-08T09:25:39.227623+0000","last_fullsized":"2024-05-08T09:25:39.227623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.227532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:48:33.902172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.018533+0000","last_change":"2024-05-08T09:25:42.018579+0000","last_active":"2024-05-08T09:25:42.018533+0000","last_peered":"2024-05-08T09:25:42.018533+0000","last_clean":"2024-05-08T09:25:42.018533+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:25:42.018533+0000","last_undegraded":"2024-05-08T09:25:42.018533+0000","last_fullsized":"2024-05-08T09:25:42.018533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.018441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:20.667622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.710549+0000","last_change":"2024-05-08T09:25:09.710589+0000","last_active":"2024-05-08T09:25:09.710549+0000","last_peered":"2024-05-08T09:25:09.710549+0000","last_clean":"2024-05-08T09:25:09.710549+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:25:09.710549+0000","last_undegraded":"2024-05-08T09:25:09.710549+0000","last_fullsized":"2024-05-08T09:25:09.710549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.710445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:39.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.024510+0000","last_change":"2024-05-08T09:25:06.024545+0000","last_active":"2024-05-08T09:25:06.024510+0000","last_peered":"2024-05-08T09:25:06.024510+0000","last_clean":"2024-05-08T09:25:06.024510+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:25:06.024510+0000","last_undegraded":"2024-05-08T09:25:06.024510+0000","last_fullsized":"2024-05-08T09:25:06.024510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.024416+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:05.508652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.219331+0000","last_change":"2024-05-08T09:25:12.219351+0000","last_active":"2024-05-08T09:25:12.219331+0000","last_peered":"2024-05-08T09:25:12.219331+0000","last_clean":"2024-05-08T09:25:12.219331+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:25:12.219331+0000","last_undegraded":"2024-05-08T09:25:12.219331+0000","last_fullsized":"2024-05-08T09:25:12.219331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.219227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:57.964012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:03.917702+0000","last_change":"2024-05-08T09:21:38.986798+0000","last_active":"2024-05-08T09:24:03.917702+0000","last_peered":"2024-05-08T09:24:03.917702+0000","last_clean":"2024-05-08T09:24:03.917702+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:24:03.917702+0000","last_undegraded":"2024-05-08T09:24:03.917702+0000","last_fullsized":"2024-05-08T09:24:03.917702+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":78,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.291187+0000","last_change":"2024-05-08T09:25:11.291213+0000","last_active":"2024-05-08T09:25:11.291187+0000","last_peered":"2024-05-08T09:25:11.291187+0000","last_clean":"2024-05-08T09:25:11.291187+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:25:11.291187+0000","last_undegraded":"2024-05-08T09:25:11.291187+0000","last_fullsized":"2024-05-08T09:25:11.291187+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.291068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:14:10.371422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.760346+0000","last_change":"2024-05-08T09:25:29.760346+0000","last_active":"2024-05-08T09:25:29.760346+0000","last_peered":"2024-05-08T09:25:29.760346+0000","last_clean":"2024-05-08T09:25:29.760346+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:25:29.760346+0000","last_undegraded":"2024-05-08T09:25:29.760346+0000","last_fullsized":"2024-05-08T09:25:29.760346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.760187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:56.571684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.744081+0000","last_change":"2024-05-08T09:25:05.744126+0000","last_active":"2024-05-08T09:25:05.744081+0000","last_peered":"2024-05-08T09:25:05.744081+0000","last_clean":"2024-05-08T09:25:05.744081+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:25:05.744081+0000","last_undegraded":"2024-05-08T09:25:05.744081+0000","last_fullsized":"2024-05-08T09:25:05.744081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.743972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:56.764860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.247188+0000","last_change":"2024-05-08T09:25:21.247244+0000","last_active":"2024-05-08T09:25:21.247188+0000","last_peered":"2024-05-08T09:25:21.247188+0000","last_clean":"2024-05-08T09:25:21.247188+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:25:21.247188+0000","last_undegraded":"2024-05-08T09:25:21.247188+0000","last_fullsized":"2024-05-08T09:25:21.247188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.247063+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:06.940266+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.806517+0000","last_change":"2024-05-08T09:25:08.806540+0000","last_active":"2024-05-08T09:25:08.806517+0000","last_peered":"2024-05-08T09:25:08.806517+0000","last_clean":"2024-05-08T09:25:08.806517+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:25:08.806517+0000","last_undegraded":"2024-05-08T09:25:08.806517+0000","last_fullsized":"2024-05-08T09:25:08.806517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.806424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:38.700044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:23:58.916792+0000","last_change":"2024-05-08T09:21:38.980351+0000","last_active":"2024-05-08T09:23:58.916792+0000","last_peered":"2024-05-08T09:23:58.916792+0000","last_clean":"2024-05-08T09:23:58.916792+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:23:58.916792+0000","last_undegraded":"2024-05-08T09:23:58.916792+0000","last_fullsized":"2024-05-08T09:23:58.916792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:21:37.954677+0000","last_clean_scrub_stamp":"2024-05-08T09:21:37.954677+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.775263+0000","last_change":"2024-05-08T09:25:13.775263+0000","last_active":"2024-05-08T09:25:13.775263+0000","last_peered":"2024-05-08T09:25:13.775263+0000","last_clean":"2024-05-08T09:25:13.775263+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:25:13.775263+0000","last_undegraded":"2024-05-08T09:25:13.775263+0000","last_fullsized":"2024-05-08T09:25:13.775263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.775111+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:47.093763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.313018+0000","last_change":"2024-05-08T09:25:22.313018+0000","last_active":"2024-05-08T09:25:22.313018+0000","last_peered":"2024-05-08T09:25:22.313018+0000","last_clean":"2024-05-08T09:25:22.313018+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:25:22.313018+0000","last_undegraded":"2024-05-08T09:25:22.313018+0000","last_fullsized":"2024-05-08T09:25:22.313018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.312893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:44.206369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.981937+0000","last_change":"2024-05-08T09:25:30.981937+0000","last_active":"2024-05-08T09:25:30.981937+0000","last_peered":"2024-05-08T09:25:30.981937+0000","last_clean":"2024-05-08T09:25:30.981937+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:25:30.981937+0000","last_undegraded":"2024-05-08T09:25:30.981937+0000","last_fullsized":"2024-05-08T09:25:30.981937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.981798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:42.309360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.933548+0000","last_change":"2024-05-08T09:25:29.933548+0000","last_active":"2024-05-08T09:25:29.933548+0000","last_peered":"2024-05-08T09:25:29.933548+0000","last_clean":"2024-05-08T09:25:29.933548+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:25:29.933548+0000","last_undegraded":"2024-05-08T09:25:29.933548+0000","last_fullsized":"2024-05-08T09:25:29.933548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.933418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:15.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.095458+0000","last_change":"2024-05-08T09:25:08.095458+0000","last_active":"2024-05-08T09:25:08.095458+0000","last_peered":"2024-05-08T09:25:08.095458+0000","last_clean":"2024-05-08T09:25:08.095458+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:25:08.095458+0000","last_undegraded":"2024-05-08T09:25:08.095458+0000","last_fullsized":"2024-05-08T09:25:08.095458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.095295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:36.538089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:56.365377+0000","last_change":"2024-05-08T09:25:56.365418+0000","last_active":"2024-05-08T09:25:56.365377+0000","last_peered":"2024-05-08T09:25:56.365377+0000","last_clean":"2024-05-08T09:25:56.365377+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:25:56.365377+0000","last_undegraded":"2024-05-08T09:25:56.365377+0000","last_fullsized":"2024-05-08T09:25:56.365377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:56.365265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:56.365265+0000","last_clean_scrub_stamp":"2024-05-08T09:25:56.365265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:58.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.024069+0000","last_change":"2024-05-08T09:25:43.024069+0000","last_active":"2024-05-08T09:25:43.024069+0000","last_peered":"2024-05-08T09:25:43.024069+0000","last_clean":"2024-05-08T09:25:43.024069+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:25:43.024069+0000","last_undegraded":"2024-05-08T09:25:43.024069+0000","last_fullsized":"2024-05-08T09:25:43.024069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.023920+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:28.250979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.935517+0000","last_change":"2024-05-08T09:25:27.935517+0000","last_active":"2024-05-08T09:25:27.935517+0000","last_peered":"2024-05-08T09:25:27.935517+0000","last_clean":"2024-05-08T09:25:27.935517+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:25:27.935517+0000","last_undegraded":"2024-05-08T09:25:27.935517+0000","last_fullsized":"2024-05-08T09:25:27.935517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.935400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:21.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.864386+0000","last_change":"2024-05-08T09:25:15.864386+0000","last_active":"2024-05-08T09:25:15.864386+0000","last_peered":"2024-05-08T09:25:15.864386+0000","last_clean":"2024-05-08T09:25:15.864386+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:25:15.864386+0000","last_undegraded":"2024-05-08T09:25:15.864386+0000","last_fullsized":"2024-05-08T09:25:15.864386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.864275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:59.244834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.043863+0000","last_change":"2024-05-08T09:25:37.043863+0000","last_active":"2024-05-08T09:25:37.043863+0000","last_peered":"2024-05-08T09:25:37.043863+0000","last_clean":"2024-05-08T09:25:37.043863+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:25:37.043863+0000","last_undegraded":"2024-05-08T09:25:37.043863+0000","last_fullsized":"2024-05-08T09:25:37.043863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.043737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.284226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.793928+0000","last_change":"2024-05-08T09:25:14.793928+0000","last_active":"2024-05-08T09:25:14.793928+0000","last_peered":"2024-05-08T09:25:14.793928+0000","last_clean":"2024-05-08T09:25:14.793928+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:25:14.793928+0000","last_undegraded":"2024-05-08T09:25:14.793928+0000","last_fullsized":"2024-05-08T09:25:14.793928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.793800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:42.341391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.686004+0000","last_change":"2024-05-08T09:25:39.686004+0000","last_active":"2024-05-08T09:25:39.686004+0000","last_peered":"2024-05-08T09:25:39.686004+0000","last_clean":"2024-05-08T09:25:39.686004+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:25:39.686004+0000","last_undegraded":"2024-05-08T09:25:39.686004+0000","last_fullsized":"2024-05-08T09:25:39.686004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.685820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:49:08.938034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.897362+0000","last_change":"2024-05-08T09:25:20.897362+0000","last_active":"2024-05-08T09:25:20.897362+0000","last_peered":"2024-05-08T09:25:20.897362+0000","last_clean":"2024-05-08T09:25:20.897362+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:25:20.897362+0000","last_undegraded":"2024-05-08T09:25:20.897362+0000","last_fullsized":"2024-05-08T09:25:20.897362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.897248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:45.128802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.310379+0000","last_change":"2024-05-08T09:25:20.310379+0000","last_active":"2024-05-08T09:25:20.310379+0000","last_peered":"2024-05-08T09:25:20.310379+0000","last_clean":"2024-05-08T09:25:20.310379+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:25:20.310379+0000","last_undegraded":"2024-05-08T09:25:20.310379+0000","last_fullsized":"2024-05-08T09:25:20.310379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.310253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:13:14.532102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'10","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.739969+0000","last_change":"2024-05-08T09:25:30.739969+0000","last_active":"2024-05-08T09:25:30.739969+0000","last_peered":"2024-05-08T09:25:30.739969+0000","last_clean":"2024-05-08T09:25:30.739969+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:25:30.739969+0000","last_undegraded":"2024-05-08T09:25:30.739969+0000","last_fullsized":"2024-05-08T09:25:30.739969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.739841+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:16.484626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.034958+0000","last_change":"2024-05-08T09:25:40.034958+0000","last_active":"2024-05-08T09:25:40.034958+0000","last_peered":"2024-05-08T09:25:40.034958+0000","last_clean":"2024-05-08T09:25:40.034958+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:25:40.034958+0000","last_undegraded":"2024-05-08T09:25:40.034958+0000","last_fullsized":"2024-05-08T09:25:40.034958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.034807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.084734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.805431+0000","last_change":"2024-05-08T09:25:24.805478+0000","last_active":"2024-05-08T09:25:24.805431+0000","last_peered":"2024-05-08T09:25:24.805431+0000","last_clean":"2024-05-08T09:25:24.805431+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:25:24.805431+0000","last_undegraded":"2024-05-08T09:25:24.805431+0000","last_fullsized":"2024-05-08T09:25:24.805431+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.805324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:24.289560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:08.513654+0000","last_change":"2024-05-08T09:26:08.513684+0000","last_active":"2024-05-08T09:26:08.513654+0000","last_peered":"2024-05-08T09:26:08.513654+0000","last_clean":"2024-05-08T09:26:08.513654+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:26:08.513654+0000","last_undegraded":"2024-05-08T09:26:08.513654+0000","last_fullsized":"2024-05-08T09:26:08.513654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:26:08.513558+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:26:08.513558+0000","last_clean_scrub_stamp":"2024-05-08T09:26:08.513558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:08:05.531156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.202764+0000","last_change":"2024-05-08T09:25:29.202792+0000","last_active":"2024-05-08T09:25:29.202764+0000","last_peered":"2024-05-08T09:25:29.202764+0000","last_clean":"2024-05-08T09:25:29.202764+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:25:29.202764+0000","last_undegraded":"2024-05-08T09:25:29.202764+0000","last_fullsized":"2024-05-08T09:25:29.202764+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.202666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:43.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.005000+0000","last_change":"2024-05-08T09:25:34.005000+0000","last_active":"2024-05-08T09:25:34.005000+0000","last_peered":"2024-05-08T09:25:34.005000+0000","last_clean":"2024-05-08T09:25:34.005000+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:25:34.005000+0000","last_undegraded":"2024-05-08T09:25:34.005000+0000","last_fullsized":"2024-05-08T09:25:34.005000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.004850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:45.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.880714+0000","last_change":"2024-05-08T09:25:17.880714+0000","last_active":"2024-05-08T09:25:17.880714+0000","last_peered":"2024-05-08T09:25:17.880714+0000","last_clean":"2024-05-08T09:25:17.880714+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:25:17.880714+0000","last_undegraded":"2024-05-08T09:25:17.880714+0000","last_fullsized":"2024-05-08T09:25:17.880714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.880592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.052981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.707011+0000","last_change":"2024-05-08T09:25:38.707011+0000","last_active":"2024-05-08T09:25:38.707011+0000","last_peered":"2024-05-08T09:25:38.707011+0000","last_clean":"2024-05-08T09:25:38.707011+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:25:38.707011+0000","last_undegraded":"2024-05-08T09:25:38.707011+0000","last_fullsized":"2024-05-08T09:25:38.707011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.706857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:39.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'18","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.831519+0000","last_change":"2024-05-08T09:25:20.831519+0000","last_active":"2024-05-08T09:25:20.831519+0000","last_peered":"2024-05-08T09:25:20.831519+0000","last_clean":"2024-05-08T09:25:20.831519+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:25:20.831519+0000","last_undegraded":"2024-05-08T09:25:20.831519+0000","last_fullsized":"2024-05-08T09:25:20.831519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.831407+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:00:36.603443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.697924+0000","last_change":"2024-05-08T09:25:40.697924+0000","last_active":"2024-05-08T09:25:40.697924+0000","last_peered":"2024-05-08T09:25:40.697924+0000","last_clean":"2024-05-08T09:25:40.697924+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:25:40.697924+0000","last_undegraded":"2024-05-08T09:25:40.697924+0000","last_fullsized":"2024-05-08T09:25:40.697924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.697798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.747725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.534061+0000","last_change":"2024-05-08T09:25:48.534061+0000","last_active":"2024-05-08T09:25:48.534061+0000","last_peered":"2024-05-08T09:25:48.534061+0000","last_clean":"2024-05-08T09:25:48.534061+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:25:48.534061+0000","last_undegraded":"2024-05-08T09:25:48.534061+0000","last_fullsized":"2024-05-08T09:25:48.534061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:48.533944+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:48.533944+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.533944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:22.810576+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.273362+0000","last_change":"2024-05-08T09:25:47.273362+0000","last_active":"2024-05-08T09:25:47.273362+0000","last_peered":"2024-05-08T09:25:47.273362+0000","last_clean":"2024-05-08T09:25:47.273362+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:25:47.273362+0000","last_undegraded":"2024-05-08T09:25:47.273362+0000","last_fullsized":"2024-05-08T09:25:47.273362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:47.273233+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:47.273233+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.273233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:56.758718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.842788+0000","last_change":"2024-05-08T09:25:26.842788+0000","last_active":"2024-05-08T09:25:26.842788+0000","last_peered":"2024-05-08T09:25:26.842788+0000","last_clean":"2024-05-08T09:25:26.842788+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:25:26.842788+0000","last_undegraded":"2024-05-08T09:25:26.842788+0000","last_fullsized":"2024-05-08T09:25:26.842788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.842617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:55.285411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:52.301182+0000","last_change":"2024-05-08T09:25:52.301182+0000","last_active":"2024-05-08T09:25:52.301182+0000","last_peered":"2024-05-08T09:25:52.301182+0000","last_clean":"2024-05-08T09:25:52.301182+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:25:52.301182+0000","last_undegraded":"2024-05-08T09:25:52.301182+0000","last_fullsized":"2024-05-08T09:25:52.301182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:52.301017+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:52.301017+0000","last_clean_scrub_stamp":"2024-05-08T09:25:52.301017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:20:52.755879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.262733+0000","last_change":"2024-05-08T09:25:37.262733+0000","last_active":"2024-05-08T09:25:37.262733+0000","last_peered":"2024-05-08T09:25:37.262733+0000","last_clean":"2024-05-08T09:25:37.262733+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:25:37.262733+0000","last_undegraded":"2024-05-08T09:25:37.262733+0000","last_fullsized":"2024-05-08T09:25:37.262733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.262592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:56.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.308585+0000","last_change":"2024-05-08T09:25:31.308585+0000","last_active":"2024-05-08T09:25:31.308585+0000","last_peered":"2024-05-08T09:25:31.308585+0000","last_clean":"2024-05-08T09:25:31.308585+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:25:31.308585+0000","last_undegraded":"2024-05-08T09:25:31.308585+0000","last_fullsized":"2024-05-08T09:25:31.308585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.308462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:24.993949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.634475+0000","last_change":"2024-05-08T09:25:42.634475+0000","last_active":"2024-05-08T09:25:42.634475+0000","last_peered":"2024-05-08T09:25:42.634475+0000","last_clean":"2024-05-08T09:25:42.634475+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:25:42.634475+0000","last_undegraded":"2024-05-08T09:25:42.634475+0000","last_fullsized":"2024-05-08T09:25:42.634475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.634357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:42.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:06.483413+0000","last_change":"2024-05-08T09:26:06.483413+0000","last_active":"2024-05-08T09:26:06.483413+0000","last_peered":"2024-05-08T09:26:06.483413+0000","last_clean":"2024-05-08T09:26:06.483413+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:26:06.483413+0000","last_undegraded":"2024-05-08T09:26:06.483413+0000","last_fullsized":"2024-05-08T09:26:06.483413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:06.483261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:06.483261+0000","last_clean_scrub_stamp":"2024-05-08T09:26:06.483261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:55:03.871425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:05.465938+0000","last_change":"2024-05-08T09:26:05.465938+0000","last_active":"2024-05-08T09:26:05.465938+0000","last_peered":"2024-05-08T09:26:05.465938+0000","last_clean":"2024-05-08T09:26:05.465938+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:26:05.465938+0000","last_undegraded":"2024-05-08T09:26:05.465938+0000","last_fullsized":"2024-05-08T09:26:05.465938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:26:05.465764+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:26:05.465764+0000","last_clean_scrub_stamp":"2024-05-08T09:26:05.465764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:48:25.114806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.956390+0000","last_change":"2024-05-08T09:25:26.956419+0000","last_active":"2024-05-08T09:25:26.956390+0000","last_peered":"2024-05-08T09:25:26.956390+0000","last_clean":"2024-05-08T09:25:26.956390+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:25:26.956390+0000","last_undegraded":"2024-05-08T09:25:26.956390+0000","last_fullsized":"2024-05-08T09:25:26.956390+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.956297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:20.313021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.008527+0000","last_change":"2024-05-08T09:25:32.008527+0000","last_active":"2024-05-08T09:25:32.008527+0000","last_peered":"2024-05-08T09:25:32.008527+0000","last_clean":"2024-05-08T09:25:32.008527+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:25:32.008527+0000","last_undegraded":"2024-05-08T09:25:32.008527+0000","last_fullsized":"2024-05-08T09:25:32.008527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.008402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:22.700119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'6","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.534951+0000","last_change":"2024-05-08T09:25:47.534995+0000","last_active":"2024-05-08T09:25:47.534951+0000","last_peered":"2024-05-08T09:25:47.534951+0000","last_clean":"2024-05-08T09:25:47.534951+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:25:47.534951+0000","last_undegraded":"2024-05-08T09:25:47.534951+0000","last_fullsized":"2024-05-08T09:25:47.534951+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:47.534865+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:47.534865+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.534865+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:18.037793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705726,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705725,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":962560,"data_stored":723288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705725,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705726,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:26:11.048 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.049 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.050 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.050 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.050 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.050 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.051 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-05-08T09:21:37.954677+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=21, tm_sec=37, tm_wday=2, tm_yday=129, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=8, tm_hour=9, tm_min=24, tm_sec=46, tm_wday=2, tm_yday=129, tm_isdst=0) 2024-05-08T09:26:11.051 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-08T09:26:31.052 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T09:26:31.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.168+0000 7f57780e4640 1 Processor -- start 2024-05-08T09:26:31.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.168+0000 7f57780e4640 1 -- start start 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f57780e4640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577006e6d0 0x7f577006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f57780e4640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f577006cfa0 con 0x7f577006eff0 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f57780e4640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7f577006fe00 con 0x7f577006e6d0 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f5775e80640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577006e6d0 0x7f577006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f5775e80640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f577006e6d0 0x7f577006eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55574/0 (socket says 172.21.15.45:55574) 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f577567f640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f577006eff0 0x7f577012e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32960/0 (socket says 172.21.15.45:32960) 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f5775e80640 1 -- 172.21.15.45:0/423922648 learned_addr learned my addr 172.21.15.45:0/423922648 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f5775e80640 1 -- 172.21.15.45:0/423922648 >> v1:172.21.15.45:6789/0 conn(0x7f577006eff0 legacy=0x7f577012e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.169+0000 7f5775e80640 1 -- 172.21.15.45:0/423922648 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f577006f9c0 con 0x7f577006e6d0 2024-05-08T09:26:31.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.170+0000 7f5775e80640 1 --2- 172.21.15.45:0/423922648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f577006eab0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e50 tx=0x7f576c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ecfd662a2fd847 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.170+0000 7f5774e7e640 1 -- 172.21.15.45:0/423922648 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c02c930 con 0x7f577006e6d0 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.170+0000 7f5774e7e640 1 -- 172.21.15.45:0/423922648 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c02cad0 con 0x7f577006e6d0 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.170+0000 7f5774e7e640 1 -- 172.21.15.45:0/423922648 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c02cdd0 con 0x7f577006e6d0 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 -- 172.21.15.45:0/423922648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 msgr2=0x7f577006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 --2- 172.21.15.45:0/423922648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f577006eab0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f576c009e50 tx=0x7f576c02c010 comp rx=0 tx=0).stop 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 -- 172.21.15.45:0/423922648 shutdown_connections 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 --2- 172.21.15.45:0/423922648 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f577006eab0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 -- 172.21.15.45:0/423922648 >> 172.21.15.45:0/423922648 conn(0x7f577009da30 msgr2=0x7f577009de40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 -- 172.21.15.45:0/423922648 shutdown_connections 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.171+0000 7f57780e4640 1 -- 172.21.15.45:0/423922648 wait complete. 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f57780e4640 1 Processor -- start 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f57780e4640 1 -- start start 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f57780e4640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f57780e4640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7f5770072450 con 0x7f577006e6d0 2024-05-08T09:26:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f5775e80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f5775e80640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55590/0 (socket says 172.21.15.45:55590) 2024-05-08T09:26:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.172+0000 7f5775e80640 1 -- 172.21.15.45:0/2683892953 learned_addr learned my addr 172.21.15.45:0/2683892953 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:26:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f5775e80640 1 -- 172.21.15.45:0/2683892953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57701a95e0 con 0x7f577006e6d0 2024-05-08T09:26:31.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f5775e80640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f576c036040 tx=0x7f576c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c043020 con 0x7f577006e6d0 2024-05-08T09:26:31.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f576c03e660 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57701a9cf0 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f576c03e940 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.173+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57700972a0 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.174+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7f576c046020 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.174+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5770062e90 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.174+0000 7f57667fc640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 0x7f575403a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.174+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7f576c03a040 con 0x7f577006e6d0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.175+0000 7f577567f640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 0x7f575403a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.175+0000 7f577567f640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 0x7f575403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5760000f60 tx=0x7f5760007a80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.179+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7f576c04d030 con 0x7f577006e6d0 2024-05-08T09:26:31.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.357+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 --> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f57701aa0f0 con 0x7f5754038060 2024-05-08T09:26:31.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.374+0000 7f57667fc640 1 -- 172.21.15.45:0/2683892953 <== mgr.4102 v2:172.21.15.161:6824/2277433962 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666299 (secure 0 0 0) 0x7f57701aa0f0 con 0x7f5754038060 2024-05-08T09:26:31.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-05-08T09:26:31.386 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-05-08T09:26:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 msgr2=0x7f575403a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 0x7f575403a520 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5760000f60 tx=0x7f5760007a80 comp rx=0 tx=0).stop 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 msgr2=0x7f57701a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f576c036040 tx=0x7f576c004a40 comp rx=0 tx=0).stop 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 shutdown_connections 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7f5754038060 0x7f575403a520 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 --2- 172.21.15.45:0/2683892953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f577006e6d0 0x7f57701a7620 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 >> 172.21.15.45:0/2683892953 conn(0x7f577009da30 msgr2=0x7f57701b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 shutdown_connections 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.378+0000 7f57780e4640 1 -- 172.21.15.45:0/2683892953 wait complete. 2024-05-08T09:26:31.389 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-05-08T09:26:30.928858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605383,"num_objects":220,"num_object_clones":0,"num_object_copies":440,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":220,"num_whiteouts":0,"num_read":5100,"num_read_kb":4681,"num_write":2177,"num_write_kb":61373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3041,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4785,"ondisk_log_size":4785,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152408,"kb_used_data":2744,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334952,"statfs":{"total":386547056640,"available":386390990848,"internally_reserved":0,"allocated":2809856,"data_stored":1719982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6377,"internal_metadata":153216791},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003540"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.351112+0000","last_change":"2024-05-08T09:25:32.351112+0000","last_active":"2024-05-08T09:25:32.351112+0000","last_peered":"2024-05-08T09:25:32.351112+0000","last_clean":"2024-05-08T09:25:32.351112+0000","last_became_active":"2024-05-08T09:21:28.968207+0000","last_became_peered":"2024-05-08T09:21:28.968207+0000","last_unstale":"2024-05-08T09:25:32.351112+0000","last_undegraded":"2024-05-08T09:25:32.351112+0000","last_fullsized":"2024-05-08T09:25:32.351112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.350996+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.350996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:31.978723+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"29'4","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.758284+0000","last_change":"2024-05-08T09:25:32.758312+0000","last_active":"2024-05-08T09:25:32.758284+0000","last_peered":"2024-05-08T09:25:32.758284+0000","last_clean":"2024-05-08T09:25:32.758284+0000","last_became_active":"2024-05-08T09:21:30.948663+0000","last_became_peered":"2024-05-08T09:21:30.948663+0000","last_unstale":"2024-05-08T09:25:32.758284+0000","last_undegraded":"2024-05-08T09:25:32.758284+0000","last_fullsized":"2024-05-08T09:25:32.758284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:32.758203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.758203+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:23.449919+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.057033+0000","last_change":"2024-05-08T09:25:41.057108+0000","last_active":"2024-05-08T09:25:41.057033+0000","last_peered":"2024-05-08T09:25:41.057033+0000","last_clean":"2024-05-08T09:25:41.057033+0000","last_became_active":"2024-05-08T09:21:28.957239+0000","last_became_peered":"2024-05-08T09:21:28.957239+0000","last_unstale":"2024-05-08T09:25:41.057033+0000","last_undegraded":"2024-05-08T09:25:41.057033+0000","last_fullsized":"2024-05-08T09:25:41.057033+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.056917+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.056917+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:01:13.652381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.164166+0000","last_change":"2024-05-08T09:25:25.164192+0000","last_active":"2024-05-08T09:25:25.164166+0000","last_peered":"2024-05-08T09:25:25.164166+0000","last_clean":"2024-05-08T09:25:25.164166+0000","last_became_active":"2024-05-08T09:21:30.958691+0000","last_became_peered":"2024-05-08T09:21:30.958691+0000","last_unstale":"2024-05-08T09:25:25.164166+0000","last_undegraded":"2024-05-08T09:25:25.164166+0000","last_fullsized":"2024-05-08T09:25:25.164166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:25.164078+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.164078+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:10.391138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.292774+0000","last_change":"2024-05-08T09:25:46.292798+0000","last_active":"2024-05-08T09:25:46.292774+0000","last_peered":"2024-05-08T09:25:46.292774+0000","last_clean":"2024-05-08T09:25:46.292774+0000","last_became_active":"2024-05-08T09:21:28.967684+0000","last_became_peered":"2024-05-08T09:21:28.967684+0000","last_unstale":"2024-05-08T09:25:46.292774+0000","last_undegraded":"2024-05-08T09:25:46.292774+0000","last_fullsized":"2024-05-08T09:25:46.292774+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:46.292702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:46.292702+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.292702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:29:49.576427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"29'30","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.172663+0000","last_change":"2024-05-08T09:25:11.172689+0000","last_active":"2024-05-08T09:25:11.172663+0000","last_peered":"2024-05-08T09:25:11.172663+0000","last_clean":"2024-05-08T09:25:11.172663+0000","last_became_active":"2024-05-08T09:21:30.959465+0000","last_became_peered":"2024-05-08T09:21:30.959465+0000","last_unstale":"2024-05-08T09:25:11.172663+0000","last_undegraded":"2024-05-08T09:25:11.172663+0000","last_fullsized":"2024-05-08T09:25:11.172663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:11.172569+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.172569+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:37.984066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":93,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.262678+0000","last_change":"2024-05-08T09:25:24.262678+0000","last_active":"2024-05-08T09:25:24.262678+0000","last_peered":"2024-05-08T09:25:24.262678+0000","last_clean":"2024-05-08T09:25:24.262678+0000","last_became_active":"2024-05-08T09:21:28.972096+0000","last_became_peered":"2024-05-08T09:21:28.972096+0000","last_unstale":"2024-05-08T09:25:24.262678+0000","last_undegraded":"2024-05-08T09:25:24.262678+0000","last_fullsized":"2024-05-08T09:25:24.262678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:24.262520+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.262520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.902721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"29'10","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.201206+0000","last_change":"2024-05-08T09:25:32.201233+0000","last_active":"2024-05-08T09:25:32.201206+0000","last_peered":"2024-05-08T09:25:32.201206+0000","last_clean":"2024-05-08T09:25:32.201206+0000","last_became_active":"2024-05-08T09:21:30.955395+0000","last_became_peered":"2024-05-08T09:21:30.955395+0000","last_unstale":"2024-05-08T09:25:32.201206+0000","last_undegraded":"2024-05-08T09:25:32.201206+0000","last_fullsized":"2024-05-08T09:25:32.201206+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.201119+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.201119+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:09:56.962461+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:57.380678+0000","last_change":"2024-05-08T09:25:57.380678+0000","last_active":"2024-05-08T09:25:57.380678+0000","last_peered":"2024-05-08T09:25:57.380678+0000","last_clean":"2024-05-08T09:25:57.380678+0000","last_became_active":"2024-05-08T09:21:28.964133+0000","last_became_peered":"2024-05-08T09:21:28.964133+0000","last_unstale":"2024-05-08T09:25:57.380678+0000","last_undegraded":"2024-05-08T09:25:57.380678+0000","last_fullsized":"2024-05-08T09:25:57.380678+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:57.380522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:57.380522+0000","last_clean_scrub_stamp":"2024-05-08T09:25:57.380522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:24:52.831638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"29'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.826663+0000","last_change":"2024-05-08T09:25:18.826663+0000","last_active":"2024-05-08T09:25:18.826663+0000","last_peered":"2024-05-08T09:25:18.826663+0000","last_clean":"2024-05-08T09:25:18.826663+0000","last_became_active":"2024-05-08T09:21:30.942688+0000","last_became_peered":"2024-05-08T09:21:30.942688+0000","last_unstale":"2024-05-08T09:25:18.826663+0000","last_undegraded":"2024-05-08T09:25:18.826663+0000","last_fullsized":"2024-05-08T09:25:18.826663+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:18.826549+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.826549+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.998939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.333560+0000","last_change":"2024-05-08T09:25:28.333560+0000","last_active":"2024-05-08T09:25:28.333560+0000","last_peered":"2024-05-08T09:25:28.333560+0000","last_clean":"2024-05-08T09:25:28.333560+0000","last_became_active":"2024-05-08T09:21:28.957467+0000","last_became_peered":"2024-05-08T09:21:28.957467+0000","last_unstale":"2024-05-08T09:25:28.333560+0000","last_undegraded":"2024-05-08T09:25:28.333560+0000","last_fullsized":"2024-05-08T09:25:28.333560+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.333344+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.333344+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:11.713903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.114273+0000","last_change":"2024-05-08T09:25:09.114273+0000","last_active":"2024-05-08T09:25:09.114273+0000","last_peered":"2024-05-08T09:25:09.114273+0000","last_clean":"2024-05-08T09:25:09.114273+0000","last_became_active":"2024-05-08T09:21:30.959011+0000","last_became_peered":"2024-05-08T09:21:30.959011+0000","last_unstale":"2024-05-08T09:25:09.114273+0000","last_undegraded":"2024-05-08T09:25:09.114273+0000","last_fullsized":"2024-05-08T09:25:09.114273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:09.114110+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.114110+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:02.470835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.246487+0000","last_change":"2024-05-08T09:25:45.246487+0000","last_active":"2024-05-08T09:25:45.246487+0000","last_peered":"2024-05-08T09:25:45.246487+0000","last_clean":"2024-05-08T09:25:45.246487+0000","last_became_active":"2024-05-08T09:21:28.966553+0000","last_became_peered":"2024-05-08T09:21:28.966553+0000","last_unstale":"2024-05-08T09:25:45.246487+0000","last_undegraded":"2024-05-08T09:25:45.246487+0000","last_fullsized":"2024-05-08T09:25:45.246487+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:45.246360+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:45.246360+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.246360+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:40:21.564703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.316558+0000","last_change":"2024-05-08T09:25:13.316558+0000","last_active":"2024-05-08T09:25:13.316558+0000","last_peered":"2024-05-08T09:25:13.316558+0000","last_clean":"2024-05-08T09:25:13.316558+0000","last_became_active":"2024-05-08T09:21:30.950368+0000","last_became_peered":"2024-05-08T09:21:30.950368+0000","last_unstale":"2024-05-08T09:25:13.316558+0000","last_undegraded":"2024-05-08T09:25:13.316558+0000","last_fullsized":"2024-05-08T09:25:13.316558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.316411+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.316411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:51.272956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"29'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.931062+0000","last_change":"2024-05-08T09:25:21.931062+0000","last_active":"2024-05-08T09:25:21.931062+0000","last_peered":"2024-05-08T09:25:21.931062+0000","last_clean":"2024-05-08T09:25:21.931062+0000","last_became_active":"2024-05-08T09:21:28.961476+0000","last_became_peered":"2024-05-08T09:21:28.961476+0000","last_unstale":"2024-05-08T09:25:21.931062+0000","last_undegraded":"2024-05-08T09:25:21.931062+0000","last_fullsized":"2024-05-08T09:25:21.931062+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:21.930918+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.930918+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:54.987159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.305844+0000","last_change":"2024-05-08T09:25:21.305844+0000","last_active":"2024-05-08T09:25:21.305844+0000","last_peered":"2024-05-08T09:25:21.305844+0000","last_clean":"2024-05-08T09:25:21.305844+0000","last_became_active":"2024-05-08T09:21:30.953636+0000","last_became_peered":"2024-05-08T09:21:30.953636+0000","last_unstale":"2024-05-08T09:25:21.305844+0000","last_undegraded":"2024-05-08T09:25:21.305844+0000","last_fullsized":"2024-05-08T09:25:21.305844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:21.305723+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.305723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:35:01.811529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.197143+0000","last_change":"2024-05-08T09:25:24.197143+0000","last_active":"2024-05-08T09:25:24.197143+0000","last_peered":"2024-05-08T09:25:24.197143+0000","last_clean":"2024-05-08T09:25:24.197143+0000","last_became_active":"2024-05-08T09:21:30.958674+0000","last_became_peered":"2024-05-08T09:21:30.958674+0000","last_unstale":"2024-05-08T09:25:24.197143+0000","last_undegraded":"2024-05-08T09:25:24.197143+0000","last_fullsized":"2024-05-08T09:25:24.197143+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:24.197029+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.197029+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:02.846210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.797909+0000","last_change":"2024-05-08T09:25:27.797909+0000","last_active":"2024-05-08T09:25:27.797909+0000","last_peered":"2024-05-08T09:25:27.797909+0000","last_clean":"2024-05-08T09:25:27.797909+0000","last_became_active":"2024-05-08T09:21:28.975600+0000","last_became_peered":"2024-05-08T09:21:28.975600+0000","last_unstale":"2024-05-08T09:25:27.797909+0000","last_undegraded":"2024-05-08T09:25:27.797909+0000","last_fullsized":"2024-05-08T09:25:27.797909+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:27.797770+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.797770+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:21.154495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.781804+0000","last_change":"2024-05-08T09:25:22.781804+0000","last_active":"2024-05-08T09:25:22.781804+0000","last_peered":"2024-05-08T09:25:22.781804+0000","last_clean":"2024-05-08T09:25:22.781804+0000","last_became_active":"2024-05-08T09:21:30.945494+0000","last_became_peered":"2024-05-08T09:21:30.945494+0000","last_unstale":"2024-05-08T09:25:22.781804+0000","last_undegraded":"2024-05-08T09:25:22.781804+0000","last_fullsized":"2024-05-08T09:25:22.781804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.781682+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.781682+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:55.837923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.344041+0000","last_change":"2024-05-08T09:25:30.344041+0000","last_active":"2024-05-08T09:25:30.344041+0000","last_peered":"2024-05-08T09:25:30.344041+0000","last_clean":"2024-05-08T09:25:30.344041+0000","last_became_active":"2024-05-08T09:21:28.967044+0000","last_became_peered":"2024-05-08T09:21:28.967044+0000","last_unstale":"2024-05-08T09:25:30.344041+0000","last_undegraded":"2024-05-08T09:25:30.344041+0000","last_fullsized":"2024-05-08T09:25:30.344041+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.343910+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.343910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:24.516299+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'4","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.748130+0000","last_change":"2024-05-08T09:25:28.748130+0000","last_active":"2024-05-08T09:25:28.748130+0000","last_peered":"2024-05-08T09:25:28.748130+0000","last_clean":"2024-05-08T09:25:28.748130+0000","last_became_active":"2024-05-08T09:21:30.946946+0000","last_became_peered":"2024-05-08T09:21:30.946946+0000","last_unstale":"2024-05-08T09:25:28.748130+0000","last_undegraded":"2024-05-08T09:25:28.748130+0000","last_fullsized":"2024-05-08T09:25:28.748130+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:28.748024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.748024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:22.963514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.654848+0000","last_change":"2024-05-08T09:25:41.654848+0000","last_active":"2024-05-08T09:25:41.654848+0000","last_peered":"2024-05-08T09:25:41.654848+0000","last_clean":"2024-05-08T09:25:41.654848+0000","last_became_active":"2024-05-08T09:21:28.974197+0000","last_became_peered":"2024-05-08T09:21:28.974197+0000","last_unstale":"2024-05-08T09:25:41.654848+0000","last_undegraded":"2024-05-08T09:25:41.654848+0000","last_fullsized":"2024-05-08T09:25:41.654848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:41.654716+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.654716+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:19:53.492400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"29'20","reported_seq":90,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.846147+0000","last_change":"2024-05-08T09:25:13.846147+0000","last_active":"2024-05-08T09:25:13.846147+0000","last_peered":"2024-05-08T09:25:13.846147+0000","last_clean":"2024-05-08T09:25:13.846147+0000","last_became_active":"2024-05-08T09:21:30.954863+0000","last_became_peered":"2024-05-08T09:21:30.954863+0000","last_unstale":"2024-05-08T09:25:13.846147+0000","last_undegraded":"2024-05-08T09:25:13.846147+0000","last_fullsized":"2024-05-08T09:25:13.846147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:25:13.846024+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.846024+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:41.393615+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":71,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"29'3","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.745949+0000","last_change":"2024-05-08T09:25:37.745949+0000","last_active":"2024-05-08T09:25:37.745949+0000","last_peered":"2024-05-08T09:25:37.745949+0000","last_clean":"2024-05-08T09:25:37.745949+0000","last_became_active":"2024-05-08T09:21:28.970402+0000","last_became_peered":"2024-05-08T09:21:28.970402+0000","last_unstale":"2024-05-08T09:25:37.745949+0000","last_undegraded":"2024-05-08T09:25:37.745949+0000","last_fullsized":"2024-05-08T09:25:37.745949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:37.745832+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.745832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"29'4","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.237119+0000","last_change":"2024-05-08T09:25:25.237119+0000","last_active":"2024-05-08T09:25:25.237119+0000","last_peered":"2024-05-08T09:25:25.237119+0000","last_clean":"2024-05-08T09:25:25.237119+0000","last_became_active":"2024-05-08T09:21:30.954879+0000","last_became_peered":"2024-05-08T09:21:30.954879+0000","last_unstale":"2024-05-08T09:25:25.237119+0000","last_undegraded":"2024-05-08T09:25:25.237119+0000","last_fullsized":"2024-05-08T09:25:25.237119+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:25.236991+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.236991+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:09:23.829920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.020148+0000","last_change":"2024-05-08T09:25:39.020148+0000","last_active":"2024-05-08T09:25:39.020148+0000","last_peered":"2024-05-08T09:25:39.020148+0000","last_clean":"2024-05-08T09:25:39.020148+0000","last_became_active":"2024-05-08T09:21:28.953772+0000","last_became_peered":"2024-05-08T09:21:28.953772+0000","last_unstale":"2024-05-08T09:25:39.020148+0000","last_undegraded":"2024-05-08T09:25:39.020148+0000","last_fullsized":"2024-05-08T09:25:39.020148+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.019981+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.019981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:24.713184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"29'10","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.830341+0000","last_change":"2024-05-08T09:25:21.830341+0000","last_active":"2024-05-08T09:25:21.830341+0000","last_peered":"2024-05-08T09:25:21.830341+0000","last_clean":"2024-05-08T09:25:21.830341+0000","last_became_active":"2024-05-08T09:21:30.941313+0000","last_became_peered":"2024-05-08T09:21:30.941313+0000","last_unstale":"2024-05-08T09:25:21.830341+0000","last_undegraded":"2024-05-08T09:25:21.830341+0000","last_fullsized":"2024-05-08T09:25:21.830341+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:21.830191+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.830191+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:46.061745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:55.317220+0000","last_change":"2024-05-08T09:25:55.317220+0000","last_active":"2024-05-08T09:25:55.317220+0000","last_peered":"2024-05-08T09:25:55.317220+0000","last_clean":"2024-05-08T09:25:55.317220+0000","last_became_active":"2024-05-08T09:21:28.965841+0000","last_became_peered":"2024-05-08T09:21:28.965841+0000","last_unstale":"2024-05-08T09:25:55.317220+0000","last_undegraded":"2024-05-08T09:25:55.317220+0000","last_fullsized":"2024-05-08T09:25:55.317220+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:55.317064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:55.317064+0000","last_clean_scrub_stamp":"2024-05-08T09:25:55.317064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:36:47.398629+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"29'36","reported_seq":110,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.761456+0000","last_change":"2024-05-08T09:25:12.761456+0000","last_active":"2024-05-08T09:25:12.761456+0000","last_peered":"2024-05-08T09:25:12.761456+0000","last_clean":"2024-05-08T09:25:12.761456+0000","last_became_active":"2024-05-08T09:21:38.980999+0000","last_became_peered":"2024-05-08T09:21:38.980999+0000","last_unstale":"2024-05-08T09:25:12.761456+0000","last_undegraded":"2024-05-08T09:25:12.761456+0000","last_fullsized":"2024-05-08T09:25:12.761456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:25:12.761304+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.761304+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:25.524875+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":170,"num_read_kb":170,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"29'22","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.236908+0000","last_change":"2024-05-08T09:25:31.236908+0000","last_active":"2024-05-08T09:25:31.236908+0000","last_peered":"2024-05-08T09:25:31.236908+0000","last_clean":"2024-05-08T09:25:31.236908+0000","last_became_active":"2024-05-08T09:21:30.955955+0000","last_became_peered":"2024-05-08T09:21:30.955955+0000","last_unstale":"2024-05-08T09:25:31.236908+0000","last_undegraded":"2024-05-08T09:25:31.236908+0000","last_fullsized":"2024-05-08T09:25:31.236908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:25:31.236783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.236783+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:04.221673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":45,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:59.417975+0000","last_change":"2024-05-08T09:25:59.417975+0000","last_active":"2024-05-08T09:25:59.417975+0000","last_peered":"2024-05-08T09:25:59.417975+0000","last_clean":"2024-05-08T09:25:59.417975+0000","last_became_active":"2024-05-08T09:21:28.965015+0000","last_became_peered":"2024-05-08T09:21:28.965015+0000","last_unstale":"2024-05-08T09:25:59.417975+0000","last_undegraded":"2024-05-08T09:25:59.417975+0000","last_fullsized":"2024-05-08T09:25:59.417975+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:59.417806+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:59.417806+0000","last_clean_scrub_stamp":"2024-05-08T09:25:59.417806+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:40:21.889200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.080213+0000","last_change":"2024-05-08T09:24:52.080213+0000","last_active":"2024-05-08T09:24:52.080213+0000","last_peered":"2024-05-08T09:24:52.080213+0000","last_clean":"2024-05-08T09:24:52.080213+0000","last_became_active":"2024-05-08T09:21:32.954047+0000","last_became_peered":"2024-05-08T09:21:32.954047+0000","last_unstale":"2024-05-08T09:24:52.080213+0000","last_undegraded":"2024-05-08T09:24:52.080213+0000","last_fullsized":"2024-05-08T09:24:52.080213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.080065+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.080065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:28:14.528132+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.264747+0000","last_change":"2024-05-08T09:25:17.264747+0000","last_active":"2024-05-08T09:25:17.264747+0000","last_peered":"2024-05-08T09:25:17.264747+0000","last_clean":"2024-05-08T09:25:17.264747+0000","last_became_active":"2024-05-08T09:21:34.968340+0000","last_became_peered":"2024-05-08T09:21:34.968340+0000","last_unstale":"2024-05-08T09:25:17.264747+0000","last_undegraded":"2024-05-08T09:25:17.264747+0000","last_fullsized":"2024-05-08T09:25:17.264747+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:17.264579+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.264579+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:07:59.907138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.718169+0000","last_change":"2024-05-08T09:24:56.718169+0000","last_active":"2024-05-08T09:24:56.718169+0000","last_peered":"2024-05-08T09:24:56.718169+0000","last_clean":"2024-05-08T09:24:56.718169+0000","last_became_active":"2024-05-08T09:21:36.976965+0000","last_became_peered":"2024-05-08T09:21:36.976965+0000","last_unstale":"2024-05-08T09:24:56.718169+0000","last_undegraded":"2024-05-08T09:24:56.718169+0000","last_fullsized":"2024-05-08T09:24:56.718169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.718047+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.718047+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:41.337920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"29'7","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.813454+0000","last_change":"2024-05-08T09:25:16.813454+0000","last_active":"2024-05-08T09:25:16.813454+0000","last_peered":"2024-05-08T09:25:16.813454+0000","last_clean":"2024-05-08T09:25:16.813454+0000","last_became_active":"2024-05-08T09:21:38.983930+0000","last_became_peered":"2024-05-08T09:21:38.983930+0000","last_unstale":"2024-05-08T09:25:16.813454+0000","last_undegraded":"2024-05-08T09:25:16.813454+0000","last_fullsized":"2024-05-08T09:25:16.813454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:16.813330+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.813330+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:00.193889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"29'8","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.069725+0000","last_change":"2024-05-08T09:25:07.069725+0000","last_active":"2024-05-08T09:25:07.069725+0000","last_peered":"2024-05-08T09:25:07.069725+0000","last_clean":"2024-05-08T09:25:07.069725+0000","last_became_active":"2024-05-08T09:21:30.959952+0000","last_became_peered":"2024-05-08T09:21:30.959952+0000","last_unstale":"2024-05-08T09:25:07.069725+0000","last_undegraded":"2024-05-08T09:25:07.069725+0000","last_fullsized":"2024-05-08T09:25:07.069725+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:07.069574+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.069574+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:36:46.463982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.341616+0000","last_change":"2024-05-08T09:25:29.341616+0000","last_active":"2024-05-08T09:25:29.341616+0000","last_peered":"2024-05-08T09:25:29.341616+0000","last_clean":"2024-05-08T09:25:29.341616+0000","last_became_active":"2024-05-08T09:21:28.958543+0000","last_became_peered":"2024-05-08T09:21:28.958543+0000","last_unstale":"2024-05-08T09:25:29.341616+0000","last_undegraded":"2024-05-08T09:25:29.341616+0000","last_fullsized":"2024-05-08T09:25:29.341616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.341497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.341497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:47.141991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.811118+0000","last_change":"2024-05-08T09:25:06.811118+0000","last_active":"2024-05-08T09:25:06.811118+0000","last_peered":"2024-05-08T09:25:06.811118+0000","last_clean":"2024-05-08T09:25:06.811118+0000","last_became_active":"2024-05-08T09:21:32.955806+0000","last_became_peered":"2024-05-08T09:21:32.955806+0000","last_unstale":"2024-05-08T09:25:06.811118+0000","last_undegraded":"2024-05-08T09:25:06.811118+0000","last_fullsized":"2024-05-08T09:25:06.811118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.810982+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.810982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:45.623514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"29'10","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.687547+0000","last_change":"2024-05-08T09:24:55.687547+0000","last_active":"2024-05-08T09:24:55.687547+0000","last_peered":"2024-05-08T09:24:55.687547+0000","last_clean":"2024-05-08T09:24:55.687547+0000","last_became_active":"2024-05-08T09:21:34.967722+0000","last_became_peered":"2024-05-08T09:21:34.967722+0000","last_unstale":"2024-05-08T09:24:55.687547+0000","last_undegraded":"2024-05-08T09:24:55.687547+0000","last_fullsized":"2024-05-08T09:24:55.687547+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:24:55.687356+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.687356+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:29.151994+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.701793+0000","last_change":"2024-05-08T09:24:49.701793+0000","last_active":"2024-05-08T09:24:49.701793+0000","last_peered":"2024-05-08T09:24:49.701793+0000","last_clean":"2024-05-08T09:24:49.701793+0000","last_became_active":"2024-05-08T09:21:36.971323+0000","last_became_peered":"2024-05-08T09:21:36.971323+0000","last_unstale":"2024-05-08T09:24:49.701793+0000","last_undegraded":"2024-05-08T09:24:49.701793+0000","last_fullsized":"2024-05-08T09:24:49.701793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.701660+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.701660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:37.066138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.910474+0000","last_change":"2024-05-08T09:25:16.910503+0000","last_active":"2024-05-08T09:25:16.910474+0000","last_peered":"2024-05-08T09:25:16.910474+0000","last_clean":"2024-05-08T09:25:16.910474+0000","last_became_active":"2024-05-08T09:21:38.970554+0000","last_became_peered":"2024-05-08T09:21:38.970554+0000","last_unstale":"2024-05-08T09:25:16.910474+0000","last_undegraded":"2024-05-08T09:25:16.910474+0000","last_fullsized":"2024-05-08T09:25:16.910474+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:16.910378+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.910378+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:34.710873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"29'10","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.226050+0000","last_change":"2024-05-08T09:25:33.226050+0000","last_active":"2024-05-08T09:25:33.226050+0000","last_peered":"2024-05-08T09:25:33.226050+0000","last_clean":"2024-05-08T09:25:33.226050+0000","last_became_active":"2024-05-08T09:21:30.955066+0000","last_became_peered":"2024-05-08T09:21:30.955066+0000","last_unstale":"2024-05-08T09:25:33.226050+0000","last_undegraded":"2024-05-08T09:25:33.226050+0000","last_fullsized":"2024-05-08T09:25:33.226050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:33.225927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.225927+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:00.191310+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:51.333974+0000","last_change":"2024-05-08T09:25:51.333974+0000","last_active":"2024-05-08T09:25:51.333974+0000","last_peered":"2024-05-08T09:25:51.333974+0000","last_clean":"2024-05-08T09:25:51.333974+0000","last_became_active":"2024-05-08T09:21:28.966021+0000","last_became_peered":"2024-05-08T09:21:28.966021+0000","last_unstale":"2024-05-08T09:25:51.333974+0000","last_undegraded":"2024-05-08T09:25:51.333974+0000","last_fullsized":"2024-05-08T09:25:51.333974+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:51.333778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:51.333778+0000","last_clean_scrub_stamp":"2024-05-08T09:25:51.333778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:57:57.114000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.311903+0000","last_change":"2024-05-08T09:25:40.311928+0000","last_active":"2024-05-08T09:25:40.311903+0000","last_peered":"2024-05-08T09:25:40.311903+0000","last_clean":"2024-05-08T09:25:40.311903+0000","last_became_active":"2024-05-08T09:22:16.003515+0000","last_became_peered":"2024-05-08T09:22:16.003515+0000","last_unstale":"2024-05-08T09:25:40.311903+0000","last_undegraded":"2024-05-08T09:25:40.311903+0000","last_fullsized":"2024-05-08T09:25:40.311903+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.311808+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.311808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:21:34.527299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.328519+0000","last_change":"2024-05-08T09:24:54.328519+0000","last_active":"2024-05-08T09:24:54.328519+0000","last_peered":"2024-05-08T09:24:54.328519+0000","last_clean":"2024-05-08T09:24:54.328519+0000","last_became_active":"2024-05-08T09:21:34.969766+0000","last_became_peered":"2024-05-08T09:21:34.969766+0000","last_unstale":"2024-05-08T09:24:54.328519+0000","last_undegraded":"2024-05-08T09:24:54.328519+0000","last_fullsized":"2024-05-08T09:24:54.328519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:24:54.328362+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.328362+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:05.483598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'286","reported_seq":435,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.130779+0000","last_change":"2024-05-08T09:25:26.130779+0000","last_active":"2024-05-08T09:25:26.130779+0000","last_peered":"2024-05-08T09:25:26.130779+0000","last_clean":"2024-05-08T09:25:26.130779+0000","last_became_active":"2024-05-08T09:21:36.985032+0000","last_became_peered":"2024-05-08T09:21:36.985032+0000","last_unstale":"2024-05-08T09:25:26.130779+0000","last_undegraded":"2024-05-08T09:25:26.130779+0000","last_fullsized":"2024-05-08T09:25:26.130779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'286","last_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_deep_scrub":"29'286","last_deep_scrub_stamp":"2024-05-08T09:25:26.130675+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.130675+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:51:46.979797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.306963+0000","last_change":"2024-05-08T09:25:38.306988+0000","last_active":"2024-05-08T09:25:38.306963+0000","last_peered":"2024-05-08T09:25:38.306963+0000","last_clean":"2024-05-08T09:25:38.306963+0000","last_became_active":"2024-05-08T09:21:38.980019+0000","last_became_peered":"2024-05-08T09:21:38.980019+0000","last_unstale":"2024-05-08T09:25:38.306963+0000","last_undegraded":"2024-05-08T09:25:38.306963+0000","last_fullsized":"2024-05-08T09:25:38.306963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.306873+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.306873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:57:06.749667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"29'14","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.913395+0000","last_change":"2024-05-08T09:25:18.913395+0000","last_active":"2024-05-08T09:25:18.913395+0000","last_peered":"2024-05-08T09:25:18.913395+0000","last_clean":"2024-05-08T09:25:18.913395+0000","last_became_active":"2024-05-08T09:21:30.943264+0000","last_became_peered":"2024-05-08T09:21:30.943264+0000","last_unstale":"2024-05-08T09:25:18.913395+0000","last_undegraded":"2024-05-08T09:25:18.913395+0000","last_fullsized":"2024-05-08T09:25:18.913395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:18.913278+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.913278+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:55.872761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":62,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.782462+0000","last_change":"2024-05-08T09:25:31.782462+0000","last_active":"2024-05-08T09:25:31.782462+0000","last_peered":"2024-05-08T09:25:31.782462+0000","last_clean":"2024-05-08T09:25:31.782462+0000","last_became_active":"2024-05-08T09:21:28.975548+0000","last_became_peered":"2024-05-08T09:21:28.975548+0000","last_unstale":"2024-05-08T09:25:31.782462+0000","last_undegraded":"2024-05-08T09:25:31.782462+0000","last_fullsized":"2024-05-08T09:25:31.782462+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:31.782326+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.782326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:43.109888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.084847+0000","last_change":"2024-05-08T09:24:53.084847+0000","last_active":"2024-05-08T09:24:53.084847+0000","last_peered":"2024-05-08T09:24:53.084847+0000","last_clean":"2024-05-08T09:24:53.084847+0000","last_became_active":"2024-05-08T09:21:32.953699+0000","last_became_peered":"2024-05-08T09:21:32.953699+0000","last_unstale":"2024-05-08T09:24:53.084847+0000","last_undegraded":"2024-05-08T09:24:53.084847+0000","last_fullsized":"2024-05-08T09:24:53.084847+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:53.084720+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.084720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:14.978196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.309760+0000","last_change":"2024-05-08T09:24:55.309760+0000","last_active":"2024-05-08T09:24:55.309760+0000","last_peered":"2024-05-08T09:24:55.309760+0000","last_clean":"2024-05-08T09:24:55.309760+0000","last_became_active":"2024-05-08T09:21:34.968796+0000","last_became_peered":"2024-05-08T09:21:34.968796+0000","last_unstale":"2024-05-08T09:24:55.309760+0000","last_undegraded":"2024-05-08T09:24:55.309760+0000","last_fullsized":"2024-05-08T09:24:55.309760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.309641+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.309641+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:30:28.625772+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"29'285","reported_seq":414,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.838092+0000","last_change":"2024-05-08T09:24:50.838092+0000","last_active":"2024-05-08T09:24:50.838092+0000","last_peered":"2024-05-08T09:24:50.838092+0000","last_clean":"2024-05-08T09:24:50.838092+0000","last_became_active":"2024-05-08T09:21:36.964438+0000","last_became_peered":"2024-05-08T09:21:36.964438+0000","last_unstale":"2024-05-08T09:24:50.838092+0000","last_undegraded":"2024-05-08T09:24:50.838092+0000","last_fullsized":"2024-05-08T09:24:50.838092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.837975+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.837975+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:13.392037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"29'8","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.165615+0000","last_change":"2024-05-08T09:25:27.165615+0000","last_active":"2024-05-08T09:25:27.165615+0000","last_peered":"2024-05-08T09:25:27.165615+0000","last_clean":"2024-05-08T09:25:27.165615+0000","last_became_active":"2024-05-08T09:21:30.958333+0000","last_became_peered":"2024-05-08T09:21:30.958333+0000","last_unstale":"2024-05-08T09:25:27.165615+0000","last_undegraded":"2024-05-08T09:25:27.165615+0000","last_fullsized":"2024-05-08T09:25:27.165615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:27.165476+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.165476+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:41.118366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.343622+0000","last_change":"2024-05-08T09:25:34.343622+0000","last_active":"2024-05-08T09:25:34.343622+0000","last_peered":"2024-05-08T09:25:34.343622+0000","last_clean":"2024-05-08T09:25:34.343622+0000","last_became_active":"2024-05-08T09:21:28.970012+0000","last_became_peered":"2024-05-08T09:21:28.970012+0000","last_unstale":"2024-05-08T09:25:34.343622+0000","last_undegraded":"2024-05-08T09:25:34.343622+0000","last_fullsized":"2024-05-08T09:25:34.343622+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.343478+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.343478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:44.337362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.708663+0000","last_change":"2024-05-08T09:25:01.708663+0000","last_active":"2024-05-08T09:25:01.708663+0000","last_peered":"2024-05-08T09:25:01.708663+0000","last_clean":"2024-05-08T09:25:01.708663+0000","last_became_active":"2024-05-08T09:21:32.958418+0000","last_became_peered":"2024-05-08T09:21:32.958418+0000","last_unstale":"2024-05-08T09:25:01.708663+0000","last_undegraded":"2024-05-08T09:25:01.708663+0000","last_fullsized":"2024-05-08T09:25:01.708663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:01.708527+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.708527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:21:55.937487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"29'51","reported_seq":112,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.295107+0000","last_change":"2024-05-08T09:24:58.295107+0000","last_active":"2024-05-08T09:24:58.295107+0000","last_peered":"2024-05-08T09:24:58.295107+0000","last_clean":"2024-05-08T09:24:58.295107+0000","last_became_active":"2024-05-08T09:21:34.966194+0000","last_became_peered":"2024-05-08T09:21:34.966194+0000","last_unstale":"2024-05-08T09:24:58.295107+0000","last_undegraded":"2024-05-08T09:24:58.295107+0000","last_fullsized":"2024-05-08T09:24:58.295107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'51","last_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_deep_scrub":"29'51","last_deep_scrub_stamp":"2024-05-08T09:24:58.294960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.294960+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:44.289112+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.790127+0000","last_change":"2024-05-08T09:24:51.790127+0000","last_active":"2024-05-08T09:24:51.790127+0000","last_peered":"2024-05-08T09:24:51.790127+0000","last_clean":"2024-05-08T09:24:51.790127+0000","last_became_active":"2024-05-08T09:21:36.964365+0000","last_became_peered":"2024-05-08T09:21:36.964365+0000","last_unstale":"2024-05-08T09:24:51.790127+0000","last_undegraded":"2024-05-08T09:24:51.790127+0000","last_fullsized":"2024-05-08T09:24:51.790127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.789971+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.789971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:11:01.201509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"29'7","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.361302+0000","last_change":"2024-05-08T09:25:36.361302+0000","last_active":"2024-05-08T09:25:36.361302+0000","last_peered":"2024-05-08T09:25:36.361302+0000","last_clean":"2024-05-08T09:25:36.361302+0000","last_became_active":"2024-05-08T09:21:38.971326+0000","last_became_peered":"2024-05-08T09:21:38.971326+0000","last_unstale":"2024-05-08T09:25:36.361302+0000","last_undegraded":"2024-05-08T09:25:36.361302+0000","last_fullsized":"2024-05-08T09:25:36.361302+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:36.361192+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.361192+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:16:02.992029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"29'4","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.785250+0000","last_change":"2024-05-08T09:25:19.785250+0000","last_active":"2024-05-08T09:25:19.785250+0000","last_peered":"2024-05-08T09:25:19.785250+0000","last_clean":"2024-05-08T09:25:19.785250+0000","last_became_active":"2024-05-08T09:21:30.941657+0000","last_became_peered":"2024-05-08T09:21:30.941657+0000","last_unstale":"2024-05-08T09:25:19.785250+0000","last_undegraded":"2024-05-08T09:25:19.785250+0000","last_fullsized":"2024-05-08T09:25:19.785250+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:19.785121+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.785121+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:56.744605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.245875+0000","last_change":"2024-05-08T09:25:26.245875+0000","last_active":"2024-05-08T09:25:26.245875+0000","last_peered":"2024-05-08T09:25:26.245875+0000","last_clean":"2024-05-08T09:25:26.245875+0000","last_became_active":"2024-05-08T09:21:28.971178+0000","last_became_peered":"2024-05-08T09:21:28.971178+0000","last_unstale":"2024-05-08T09:25:26.245875+0000","last_undegraded":"2024-05-08T09:25:26.245875+0000","last_fullsized":"2024-05-08T09:25:26.245875+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:26.245734+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.245734+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:53.793325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.840940+0000","last_change":"2024-05-08T09:25:11.840940+0000","last_active":"2024-05-08T09:25:11.840940+0000","last_peered":"2024-05-08T09:25:11.840940+0000","last_clean":"2024-05-08T09:25:11.840940+0000","last_became_active":"2024-05-08T09:21:32.955867+0000","last_became_peered":"2024-05-08T09:21:32.955867+0000","last_unstale":"2024-05-08T09:25:11.840940+0000","last_undegraded":"2024-05-08T09:25:11.840940+0000","last_fullsized":"2024-05-08T09:25:11.840940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:11.840802+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.840802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:46:24.604373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.225238+0000","last_change":"2024-05-08T09:25:16.225238+0000","last_active":"2024-05-08T09:25:16.225238+0000","last_peered":"2024-05-08T09:25:16.225238+0000","last_clean":"2024-05-08T09:25:16.225238+0000","last_became_active":"2024-05-08T09:21:34.968271+0000","last_became_peered":"2024-05-08T09:21:34.968271+0000","last_unstale":"2024-05-08T09:25:16.225238+0000","last_undegraded":"2024-05-08T09:25:16.225238+0000","last_fullsized":"2024-05-08T09:25:16.225238+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:25:16.225076+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.225076+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:27.968267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.808113+0000","last_change":"2024-05-08T09:24:49.808113+0000","last_active":"2024-05-08T09:24:49.808113+0000","last_peered":"2024-05-08T09:24:49.808113+0000","last_clean":"2024-05-08T09:24:49.808113+0000","last_became_active":"2024-05-08T09:21:36.965855+0000","last_became_peered":"2024-05-08T09:21:36.965855+0000","last_unstale":"2024-05-08T09:24:49.808113+0000","last_undegraded":"2024-05-08T09:24:49.808113+0000","last_fullsized":"2024-05-08T09:24:49.808113+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.807955+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.807955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:48.540567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"29'6","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.560775+0000","last_change":"2024-05-08T09:25:45.560775+0000","last_active":"2024-05-08T09:25:45.560775+0000","last_peered":"2024-05-08T09:25:45.560775+0000","last_clean":"2024-05-08T09:25:45.560775+0000","last_became_active":"2024-05-08T09:21:38.986993+0000","last_became_peered":"2024-05-08T09:21:38.986993+0000","last_unstale":"2024-05-08T09:25:45.560775+0000","last_undegraded":"2024-05-08T09:25:45.560775+0000","last_fullsized":"2024-05-08T09:25:45.560775+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:45.560617+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:45.560617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.560617+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:59.513507+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.303783+0000","last_change":"2024-05-08T09:25:19.303783+0000","last_active":"2024-05-08T09:25:19.303783+0000","last_peered":"2024-05-08T09:25:19.303783+0000","last_clean":"2024-05-08T09:25:19.303783+0000","last_became_active":"2024-05-08T09:21:30.952997+0000","last_became_peered":"2024-05-08T09:21:30.952997+0000","last_unstale":"2024-05-08T09:25:19.303783+0000","last_undegraded":"2024-05-08T09:25:19.303783+0000","last_fullsized":"2024-05-08T09:25:19.303783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:19.303658+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.303658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:34:04.577425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:54.360848+0000","last_change":"2024-05-08T09:25:54.360848+0000","last_active":"2024-05-08T09:25:54.360848+0000","last_peered":"2024-05-08T09:25:54.360848+0000","last_clean":"2024-05-08T09:25:54.360848+0000","last_became_active":"2024-05-08T09:21:28.969227+0000","last_became_peered":"2024-05-08T09:21:28.969227+0000","last_unstale":"2024-05-08T09:25:54.360848+0000","last_undegraded":"2024-05-08T09:25:54.360848+0000","last_fullsized":"2024-05-08T09:25:54.360848+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:54.360672+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:54.360672+0000","last_clean_scrub_stamp":"2024-05-08T09:25:54.360672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:07:19.832656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.784665+0000","last_change":"2024-05-08T09:25:05.784665+0000","last_active":"2024-05-08T09:25:05.784665+0000","last_peered":"2024-05-08T09:25:05.784665+0000","last_clean":"2024-05-08T09:25:05.784665+0000","last_became_active":"2024-05-08T09:21:32.956901+0000","last_became_peered":"2024-05-08T09:21:32.956901+0000","last_unstale":"2024-05-08T09:25:05.784665+0000","last_undegraded":"2024-05-08T09:25:05.784665+0000","last_fullsized":"2024-05-08T09:25:05.784665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:05.784544+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:48.571658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"29'46","reported_seq":105,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.027279+0000","last_change":"2024-05-08T09:25:02.027279+0000","last_active":"2024-05-08T09:25:02.027279+0000","last_peered":"2024-05-08T09:25:02.027279+0000","last_clean":"2024-05-08T09:25:02.027279+0000","last_became_active":"2024-05-08T09:21:34.962389+0000","last_became_peered":"2024-05-08T09:21:34.962389+0000","last_unstale":"2024-05-08T09:25:02.027279+0000","last_undegraded":"2024-05-08T09:25:02.027279+0000","last_fullsized":"2024-05-08T09:25:02.027279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2024-05-08T09:25:02.027147+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.027147+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:01.654874+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"29'285","reported_seq":389,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.823593+0000","last_change":"2024-05-08T09:25:12.823593+0000","last_active":"2024-05-08T09:25:12.823593+0000","last_peered":"2024-05-08T09:25:12.823593+0000","last_clean":"2024-05-08T09:25:12.823593+0000","last_became_active":"2024-05-08T09:21:36.978484+0000","last_became_peered":"2024-05-08T09:21:36.978484+0000","last_unstale":"2024-05-08T09:25:12.823593+0000","last_undegraded":"2024-05-08T09:25:12.823593+0000","last_fullsized":"2024-05-08T09:25:12.823593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:12.823468+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.823468+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:46.142119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"27'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:45.080764+0000","last_change":"2024-05-08T09:25:45.080764+0000","last_active":"2024-05-08T09:25:45.080764+0000","last_peered":"2024-05-08T09:25:45.080764+0000","last_clean":"2024-05-08T09:25:45.080764+0000","last_became_active":"2024-05-08T09:21:38.973675+0000","last_became_peered":"2024-05-08T09:21:38.973675+0000","last_unstale":"2024-05-08T09:25:45.080764+0000","last_undegraded":"2024-05-08T09:25:45.080764+0000","last_fullsized":"2024-05-08T09:25:45.080764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:45.080643+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:45.080643+0000","last_clean_scrub_stamp":"2024-05-08T09:25:45.080643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:33:59.033533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.337550+0000","last_change":"2024-05-08T09:25:15.337550+0000","last_active":"2024-05-08T09:25:15.337550+0000","last_peered":"2024-05-08T09:25:15.337550+0000","last_clean":"2024-05-08T09:25:15.337550+0000","last_became_active":"2024-05-08T09:21:30.951182+0000","last_became_peered":"2024-05-08T09:21:30.951182+0000","last_unstale":"2024-05-08T09:25:15.337550+0000","last_undegraded":"2024-05-08T09:25:15.337550+0000","last_fullsized":"2024-05-08T09:25:15.337550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.337431+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.337431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:48.593211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.247454+0000","last_change":"2024-05-08T09:25:44.247454+0000","last_active":"2024-05-08T09:25:44.247454+0000","last_peered":"2024-05-08T09:25:44.247454+0000","last_clean":"2024-05-08T09:25:44.247454+0000","last_became_active":"2024-05-08T09:21:28.966934+0000","last_became_peered":"2024-05-08T09:21:28.966934+0000","last_unstale":"2024-05-08T09:25:44.247454+0000","last_undegraded":"2024-05-08T09:25:44.247454+0000","last_fullsized":"2024-05-08T09:25:44.247454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:44.247287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:44.247287+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.247287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:58.316822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.809344+0000","last_change":"2024-05-08T09:25:10.809344+0000","last_active":"2024-05-08T09:25:10.809344+0000","last_peered":"2024-05-08T09:25:10.809344+0000","last_clean":"2024-05-08T09:25:10.809344+0000","last_became_active":"2024-05-08T09:21:32.956552+0000","last_became_peered":"2024-05-08T09:21:32.956552+0000","last_unstale":"2024-05-08T09:25:10.809344+0000","last_undegraded":"2024-05-08T09:25:10.809344+0000","last_fullsized":"2024-05-08T09:25:10.809344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:10.809216+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.809216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:37.851520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"29'66","reported_seq":140,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.217666+0000","last_change":"2024-05-08T09:25:20.217666+0000","last_active":"2024-05-08T09:25:20.217666+0000","last_peered":"2024-05-08T09:25:20.217666+0000","last_clean":"2024-05-08T09:25:20.217666+0000","last_became_active":"2024-05-08T09:21:34.966242+0000","last_became_peered":"2024-05-08T09:21:34.966242+0000","last_unstale":"2024-05-08T09:25:20.217666+0000","last_undegraded":"2024-05-08T09:25:20.217666+0000","last_fullsized":"2024-05-08T09:25:20.217666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'66","last_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_deep_scrub":"29'66","last_deep_scrub_stamp":"2024-05-08T09:25:20.217529+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.217529+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:21.026949+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.818545+0000","last_change":"2024-05-08T09:24:48.818545+0000","last_active":"2024-05-08T09:24:48.818545+0000","last_peered":"2024-05-08T09:24:48.818545+0000","last_clean":"2024-05-08T09:24:48.818545+0000","last_became_active":"2024-05-08T09:21:36.970962+0000","last_became_peered":"2024-05-08T09:21:36.970962+0000","last_unstale":"2024-05-08T09:24:48.818545+0000","last_undegraded":"2024-05-08T09:24:48.818545+0000","last_fullsized":"2024-05-08T09:24:48.818545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:48.818433+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.818433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:36.182911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"29'23","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.118057+0000","last_change":"2024-05-08T09:25:48.118057+0000","last_active":"2024-05-08T09:25:48.118057+0000","last_peered":"2024-05-08T09:25:48.118057+0000","last_clean":"2024-05-08T09:25:48.118057+0000","last_became_active":"2024-05-08T09:21:38.976431+0000","last_became_peered":"2024-05-08T09:21:38.976431+0000","last_unstale":"2024-05-08T09:25:48.118057+0000","last_undegraded":"2024-05-08T09:25:48.118057+0000","last_fullsized":"2024-05-08T09:25:48.118057+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:48.117860+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:48.117860+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.117860+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:45.429985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":48,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.730752+0000","last_change":"2024-05-08T09:25:11.730752+0000","last_active":"2024-05-08T09:25:11.730752+0000","last_peered":"2024-05-08T09:25:11.730752+0000","last_clean":"2024-05-08T09:25:11.730752+0000","last_became_active":"2024-05-08T09:21:30.954811+0000","last_became_peered":"2024-05-08T09:21:30.954811+0000","last_unstale":"2024-05-08T09:25:11.730752+0000","last_undegraded":"2024-05-08T09:25:11.730752+0000","last_fullsized":"2024-05-08T09:25:11.730752+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:11.730568+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.730568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:41:38.772872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.928071+0000","last_change":"2024-05-08T09:25:23.928071+0000","last_active":"2024-05-08T09:25:23.928071+0000","last_peered":"2024-05-08T09:25:23.928071+0000","last_clean":"2024-05-08T09:25:23.928071+0000","last_became_active":"2024-05-08T09:21:28.961541+0000","last_became_peered":"2024-05-08T09:21:28.961541+0000","last_unstale":"2024-05-08T09:25:23.928071+0000","last_undegraded":"2024-05-08T09:25:23.928071+0000","last_fullsized":"2024-05-08T09:25:23.928071+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.927879+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.927879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:23.412115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.322535+0000","last_change":"2024-05-08T09:25:03.322535+0000","last_active":"2024-05-08T09:25:03.322535+0000","last_peered":"2024-05-08T09:25:03.322535+0000","last_clean":"2024-05-08T09:25:03.322535+0000","last_became_active":"2024-05-08T09:21:32.958548+0000","last_became_peered":"2024-05-08T09:21:32.958548+0000","last_unstale":"2024-05-08T09:25:03.322535+0000","last_undegraded":"2024-05-08T09:25:03.322535+0000","last_fullsized":"2024-05-08T09:25:03.322535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.322403+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.322403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:57:06.397165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.739783+0000","last_change":"2024-05-08T09:24:57.739783+0000","last_active":"2024-05-08T09:24:57.739783+0000","last_peered":"2024-05-08T09:24:57.739783+0000","last_clean":"2024-05-08T09:24:57.739783+0000","last_became_active":"2024-05-08T09:21:34.965147+0000","last_became_peered":"2024-05-08T09:21:34.965147+0000","last_unstale":"2024-05-08T09:24:57.739783+0000","last_undegraded":"2024-05-08T09:24:57.739783+0000","last_fullsized":"2024-05-08T09:24:57.739783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:24:57.739657+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.739657+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:25.965876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.255684+0000","last_change":"2024-05-08T09:25:14.255684+0000","last_active":"2024-05-08T09:25:14.255684+0000","last_peered":"2024-05-08T09:25:14.255684+0000","last_clean":"2024-05-08T09:25:14.255684+0000","last_became_active":"2024-05-08T09:21:36.980591+0000","last_became_peered":"2024-05-08T09:21:36.980591+0000","last_unstale":"2024-05-08T09:25:14.255684+0000","last_undegraded":"2024-05-08T09:25:14.255684+0000","last_fullsized":"2024-05-08T09:25:14.255684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:14.255525+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.255525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:04.947242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:12.560279+0000","last_change":"2024-05-08T09:26:12.560309+0000","last_active":"2024-05-08T09:26:12.560279+0000","last_peered":"2024-05-08T09:26:12.560279+0000","last_clean":"2024-05-08T09:26:12.560279+0000","last_became_active":"2024-05-08T09:21:38.981821+0000","last_became_peered":"2024-05-08T09:21:38.981821+0000","last_unstale":"2024-05-08T09:26:12.560279+0000","last_undegraded":"2024-05-08T09:26:12.560279+0000","last_fullsized":"2024-05-08T09:26:12.560279+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:26:12.560181+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:26:12.560181+0000","last_clean_scrub_stamp":"2024-05-08T09:26:12.560181+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:18:33.735285+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'10","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.020191+0000","last_change":"2024-05-08T09:25:01.020191+0000","last_active":"2024-05-08T09:25:01.020191+0000","last_peered":"2024-05-08T09:25:01.020191+0000","last_clean":"2024-05-08T09:25:01.020191+0000","last_became_active":"2024-05-08T09:21:30.960710+0000","last_became_peered":"2024-05-08T09:21:30.960710+0000","last_unstale":"2024-05-08T09:25:01.020191+0000","last_undegraded":"2024-05-08T09:25:01.020191+0000","last_fullsized":"2024-05-08T09:25:01.020191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-08T09:25:01.020070+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.020070+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:02:37.979554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.259475+0000","last_change":"2024-05-08T09:25:49.259522+0000","last_active":"2024-05-08T09:25:49.259475+0000","last_peered":"2024-05-08T09:25:49.259475+0000","last_clean":"2024-05-08T09:25:49.259475+0000","last_became_active":"2024-05-08T09:21:28.965108+0000","last_became_peered":"2024-05-08T09:21:28.965108+0000","last_unstale":"2024-05-08T09:25:49.259475+0000","last_undegraded":"2024-05-08T09:25:49.259475+0000","last_fullsized":"2024-05-08T09:25:49.259475+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:49.259357+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:49.259357+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.259357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:45:08.549467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"29'5","reported_seq":239,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.795024+0000","last_change":"2024-05-08T09:25:09.795024+0000","last_active":"2024-05-08T09:25:09.795024+0000","last_peered":"2024-05-08T09:25:09.795024+0000","last_clean":"2024-05-08T09:25:09.795024+0000","last_became_active":"2024-05-08T09:21:32.956644+0000","last_became_peered":"2024-05-08T09:21:32.956644+0000","last_unstale":"2024-05-08T09:25:09.795024+0000","last_undegraded":"2024-05-08T09:25:09.795024+0000","last_fullsized":"2024-05-08T09:25:09.795024+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:09.794854+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.794854+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:57.624478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"29'45","reported_seq":104,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.303194+0000","last_change":"2024-05-08T09:25:02.303194+0000","last_active":"2024-05-08T09:25:02.303194+0000","last_peered":"2024-05-08T09:25:02.303194+0000","last_clean":"2024-05-08T09:25:02.303194+0000","last_became_active":"2024-05-08T09:21:34.957755+0000","last_became_peered":"2024-05-08T09:21:34.957755+0000","last_unstale":"2024-05-08T09:25:02.303194+0000","last_undegraded":"2024-05-08T09:25:02.303194+0000","last_fullsized":"2024-05-08T09:25:02.303194+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:02.303063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.303063+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:22:10.132225+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'285","reported_seq":416,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.302402+0000","last_change":"2024-05-08T09:24:53.302402+0000","last_active":"2024-05-08T09:24:53.302402+0000","last_peered":"2024-05-08T09:24:53.302402+0000","last_clean":"2024-05-08T09:24:53.302402+0000","last_became_active":"2024-05-08T09:21:36.971301+0000","last_became_peered":"2024-05-08T09:21:36.971301+0000","last_unstale":"2024-05-08T09:24:53.302402+0000","last_undegraded":"2024-05-08T09:24:53.302402+0000","last_fullsized":"2024-05-08T09:24:53.302402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.302236+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.302236+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:25:25.305583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"29'19","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.129495+0000","last_change":"2024-05-08T09:25:47.129495+0000","last_active":"2024-05-08T09:25:47.129495+0000","last_peered":"2024-05-08T09:25:47.129495+0000","last_clean":"2024-05-08T09:25:47.129495+0000","last_became_active":"2024-05-08T09:21:38.976046+0000","last_became_peered":"2024-05-08T09:21:38.976046+0000","last_unstale":"2024-05-08T09:25:47.129495+0000","last_undegraded":"2024-05-08T09:25:47.129495+0000","last_fullsized":"2024-05-08T09:25:47.129495+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'19","last_scrub_stamp":"2024-05-08T09:25:47.129306+0000","last_deep_scrub":"29'19","last_deep_scrub_stamp":"2024-05-08T09:25:47.129306+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.129306+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:01.798873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.381403+0000","last_change":"2024-05-08T09:25:35.381403+0000","last_active":"2024-05-08T09:25:35.381403+0000","last_peered":"2024-05-08T09:25:35.381403+0000","last_clean":"2024-05-08T09:25:35.381403+0000","last_became_active":"2024-05-08T09:21:30.955629+0000","last_became_peered":"2024-05-08T09:21:30.955629+0000","last_unstale":"2024-05-08T09:25:35.381403+0000","last_undegraded":"2024-05-08T09:25:35.381403+0000","last_fullsized":"2024-05-08T09:25:35.381403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:35.381285+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.381285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:07.823236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.216318+0000","last_change":"2024-05-08T09:25:40.216318+0000","last_active":"2024-05-08T09:25:40.216318+0000","last_peered":"2024-05-08T09:25:40.216318+0000","last_clean":"2024-05-08T09:25:40.216318+0000","last_became_active":"2024-05-08T09:21:28.979559+0000","last_became_peered":"2024-05-08T09:21:28.979559+0000","last_unstale":"2024-05-08T09:25:40.216318+0000","last_undegraded":"2024-05-08T09:25:40.216318+0000","last_fullsized":"2024-05-08T09:25:40.216318+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.216203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.216203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:48:38.399582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"29'5","reported_seq":429,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.758612+0000","last_change":"2024-05-08T09:25:06.758612+0000","last_active":"2024-05-08T09:25:06.758612+0000","last_peered":"2024-05-08T09:25:06.758612+0000","last_clean":"2024-05-08T09:25:06.758612+0000","last_became_active":"2024-05-08T09:21:32.954308+0000","last_became_peered":"2024-05-08T09:21:32.954308+0000","last_unstale":"2024-05-08T09:25:06.758612+0000","last_undegraded":"2024-05-08T09:25:06.758612+0000","last_fullsized":"2024-05-08T09:25:06.758612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:06.758460+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.758460+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:27:49.545574+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.255329+0000","last_change":"2024-05-08T09:25:15.255329+0000","last_active":"2024-05-08T09:25:15.255329+0000","last_peered":"2024-05-08T09:25:15.255329+0000","last_clean":"2024-05-08T09:25:15.255329+0000","last_became_active":"2024-05-08T09:21:34.969334+0000","last_became_peered":"2024-05-08T09:21:34.969334+0000","last_unstale":"2024-05-08T09:25:15.255329+0000","last_undegraded":"2024-05-08T09:25:15.255329+0000","last_fullsized":"2024-05-08T09:25:15.255329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:15.255201+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.255201+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:23.835791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'285","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:48.722856+0000","last_change":"2024-05-08T09:24:48.722856+0000","last_active":"2024-05-08T09:24:48.722856+0000","last_peered":"2024-05-08T09:24:48.722856+0000","last_clean":"2024-05-08T09:24:48.722856+0000","last_became_active":"2024-05-08T09:21:36.971415+0000","last_became_peered":"2024-05-08T09:21:36.971415+0000","last_unstale":"2024-05-08T09:24:48.722856+0000","last_undegraded":"2024-05-08T09:24:48.722856+0000","last_fullsized":"2024-05-08T09:24:48.722856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:48.722702+0000","last_clean_scrub_stamp":"2024-05-08T09:24:48.722702+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:43.871307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.320604+0000","last_change":"2024-05-08T09:25:05.320604+0000","last_active":"2024-05-08T09:25:05.320604+0000","last_peered":"2024-05-08T09:25:05.320604+0000","last_clean":"2024-05-08T09:25:05.320604+0000","last_became_active":"2024-05-08T09:21:38.969002+0000","last_became_peered":"2024-05-08T09:21:38.969002+0000","last_unstale":"2024-05-08T09:25:05.320604+0000","last_undegraded":"2024-05-08T09:25:05.320604+0000","last_fullsized":"2024-05-08T09:25:05.320604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:05.320491+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.320491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:51.978731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"29'12","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.748318+0000","last_change":"2024-05-08T09:25:10.748318+0000","last_active":"2024-05-08T09:25:10.748318+0000","last_peered":"2024-05-08T09:25:10.748318+0000","last_clean":"2024-05-08T09:25:10.748318+0000","last_became_active":"2024-05-08T09:21:30.954095+0000","last_became_peered":"2024-05-08T09:21:30.954095+0000","last_unstale":"2024-05-08T09:25:10.748318+0000","last_undegraded":"2024-05-08T09:25:10.748318+0000","last_fullsized":"2024-05-08T09:25:10.748318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:10.748214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.748214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:14:58.577838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.197723+0000","last_change":"2024-05-08T09:25:43.197723+0000","last_active":"2024-05-08T09:25:43.197723+0000","last_peered":"2024-05-08T09:25:43.197723+0000","last_clean":"2024-05-08T09:25:43.197723+0000","last_became_active":"2024-05-08T09:21:28.977719+0000","last_became_peered":"2024-05-08T09:21:28.977719+0000","last_unstale":"2024-05-08T09:25:43.197723+0000","last_undegraded":"2024-05-08T09:25:43.197723+0000","last_fullsized":"2024-05-08T09:25:43.197723+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:43.197608+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.197608+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:33.612547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.047846+0000","last_change":"2024-05-08T09:24:54.047846+0000","last_active":"2024-05-08T09:24:54.047846+0000","last_peered":"2024-05-08T09:24:54.047846+0000","last_clean":"2024-05-08T09:24:54.047846+0000","last_became_active":"2024-05-08T09:21:32.958437+0000","last_became_peered":"2024-05-08T09:21:32.958437+0000","last_unstale":"2024-05-08T09:24:54.047846+0000","last_undegraded":"2024-05-08T09:24:54.047846+0000","last_fullsized":"2024-05-08T09:24:54.047846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:54.047713+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.047713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:28.286010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"29'48","reported_seq":108,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.765651+0000","last_change":"2024-05-08T09:24:59.765651+0000","last_active":"2024-05-08T09:24:59.765651+0000","last_peered":"2024-05-08T09:24:59.765651+0000","last_clean":"2024-05-08T09:24:59.765651+0000","last_became_active":"2024-05-08T09:21:34.959985+0000","last_became_peered":"2024-05-08T09:21:34.959985+0000","last_unstale":"2024-05-08T09:24:59.765651+0000","last_undegraded":"2024-05-08T09:24:59.765651+0000","last_fullsized":"2024-05-08T09:24:59.765651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2024-05-08T09:24:59.765502+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.765502+0000","objects_scrubbed":8,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:46.174195+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.320607+0000","last_change":"2024-05-08T09:24:57.320607+0000","last_active":"2024-05-08T09:24:57.320607+0000","last_peered":"2024-05-08T09:24:57.320607+0000","last_clean":"2024-05-08T09:24:57.320607+0000","last_became_active":"2024-05-08T09:21:36.974970+0000","last_became_peered":"2024-05-08T09:21:36.974970+0000","last_unstale":"2024-05-08T09:24:57.320607+0000","last_undegraded":"2024-05-08T09:24:57.320607+0000","last_fullsized":"2024-05-08T09:24:57.320607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.320468+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.320468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:25:09.992130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"29'6","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.786877+0000","last_change":"2024-05-08T09:25:04.786877+0000","last_active":"2024-05-08T09:25:04.786877+0000","last_peered":"2024-05-08T09:25:04.786877+0000","last_clean":"2024-05-08T09:25:04.786877+0000","last_became_active":"2024-05-08T09:21:38.977159+0000","last_became_peered":"2024-05-08T09:21:38.977159+0000","last_unstale":"2024-05-08T09:25:04.786877+0000","last_undegraded":"2024-05-08T09:25:04.786877+0000","last_fullsized":"2024-05-08T09:25:04.786877+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:04.786748+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.786748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:38.042528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"29'10","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.000502+0000","last_change":"2024-05-08T09:25:03.000502+0000","last_active":"2024-05-08T09:25:03.000502+0000","last_peered":"2024-05-08T09:25:03.000502+0000","last_clean":"2024-05-08T09:25:03.000502+0000","last_became_active":"2024-05-08T09:21:30.960259+0000","last_became_peered":"2024-05-08T09:21:30.960259+0000","last_unstale":"2024-05-08T09:25:03.000502+0000","last_undegraded":"2024-05-08T09:25:03.000502+0000","last_fullsized":"2024-05-08T09:25:03.000502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:03.000386+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.000386+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:27.231940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":208,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.770914+0000","last_change":"2024-05-08T09:25:34.770949+0000","last_active":"2024-05-08T09:25:34.770914+0000","last_peered":"2024-05-08T09:25:34.770914+0000","last_clean":"2024-05-08T09:25:34.770914+0000","last_became_active":"2024-05-08T09:21:20.672234+0000","last_became_peered":"2024-05-08T09:21:20.672234+0000","last_unstale":"2024-05-08T09:25:34.770914+0000","last_undegraded":"2024-05-08T09:25:34.770914+0000","last_fullsized":"2024-05-08T09:25:34.770914+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2024-05-08T09:25:34.770818+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.770818+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:46.514009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:04.480855+0000","last_change":"2024-05-08T09:26:04.480883+0000","last_active":"2024-05-08T09:26:04.480855+0000","last_peered":"2024-05-08T09:26:04.480855+0000","last_clean":"2024-05-08T09:26:04.480855+0000","last_became_active":"2024-05-08T09:21:20.673058+0000","last_became_peered":"2024-05-08T09:21:20.673058+0000","last_unstale":"2024-05-08T09:26:04.480855+0000","last_undegraded":"2024-05-08T09:26:04.480855+0000","last_fullsized":"2024-05-08T09:26:04.480855+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:04.480749+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:04.480749+0000","last_clean_scrub_stamp":"2024-05-08T09:26:04.480749+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:59:21.951032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"27'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:58.408320+0000","last_change":"2024-05-08T09:25:58.408350+0000","last_active":"2024-05-08T09:25:58.408320+0000","last_peered":"2024-05-08T09:25:58.408320+0000","last_clean":"2024-05-08T09:25:58.408320+0000","last_became_active":"2024-05-08T09:21:28.977909+0000","last_became_peered":"2024-05-08T09:21:28.977909+0000","last_unstale":"2024-05-08T09:25:58.408320+0000","last_undegraded":"2024-05-08T09:25:58.408320+0000","last_fullsized":"2024-05-08T09:25:58.408320+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:58.408222+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:58.408222+0000","last_clean_scrub_stamp":"2024-05-08T09:25:58.408222+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:08:50.729817+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.755062+0000","last_change":"2024-05-08T09:25:07.755062+0000","last_active":"2024-05-08T09:25:07.755062+0000","last_peered":"2024-05-08T09:25:07.755062+0000","last_clean":"2024-05-08T09:25:07.755062+0000","last_became_active":"2024-05-08T09:21:32.954657+0000","last_became_peered":"2024-05-08T09:21:32.954657+0000","last_unstale":"2024-05-08T09:25:07.755062+0000","last_undegraded":"2024-05-08T09:25:07.755062+0000","last_fullsized":"2024-05-08T09:25:07.755062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.754913+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.754913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:22:46.567445+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"29'87","reported_seq":178,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.062932+0000","last_change":"2024-05-08T09:24:56.062932+0000","last_active":"2024-05-08T09:24:56.062932+0000","last_peered":"2024-05-08T09:24:56.062932+0000","last_clean":"2024-05-08T09:24:56.062932+0000","last_became_active":"2024-05-08T09:21:34.957956+0000","last_became_peered":"2024-05-08T09:21:34.957956+0000","last_unstale":"2024-05-08T09:24:56.062932+0000","last_undegraded":"2024-05-08T09:24:56.062932+0000","last_fullsized":"2024-05-08T09:24:56.062932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'87","last_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_deep_scrub":"29'87","last_deep_scrub_stamp":"2024-05-08T09:24:56.062751+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.062751+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:23.610342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.720522+0000","last_change":"2024-05-08T09:24:56.720522+0000","last_active":"2024-05-08T09:24:56.720522+0000","last_peered":"2024-05-08T09:24:56.720522+0000","last_clean":"2024-05-08T09:24:56.720522+0000","last_became_active":"2024-05-08T09:21:36.973118+0000","last_became_peered":"2024-05-08T09:21:36.973118+0000","last_unstale":"2024-05-08T09:24:56.720522+0000","last_undegraded":"2024-05-08T09:24:56.720522+0000","last_fullsized":"2024-05-08T09:24:56.720522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:56.720398+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.720398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:56:12.622377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"29'81","reported_seq":172,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.309632+0000","last_change":"2024-05-08T09:25:09.309632+0000","last_active":"2024-05-08T09:25:09.309632+0000","last_peered":"2024-05-08T09:25:09.309632+0000","last_clean":"2024-05-08T09:25:09.309632+0000","last_became_active":"2024-05-08T09:21:38.970155+0000","last_became_peered":"2024-05-08T09:21:38.970155+0000","last_unstale":"2024-05-08T09:25:09.309632+0000","last_undegraded":"2024-05-08T09:25:09.309632+0000","last_fullsized":"2024-05-08T09:25:09.309632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'81","last_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_deep_scrub":"29'81","last_deep_scrub_stamp":"2024-05-08T09:25:09.309508+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.309508+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:50.697197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":211,"num_write":155,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.254017+0000","last_change":"2024-05-08T09:25:35.254017+0000","last_active":"2024-05-08T09:25:35.254017+0000","last_peered":"2024-05-08T09:25:35.254017+0000","last_clean":"2024-05-08T09:25:35.254017+0000","last_became_active":"2024-05-08T09:21:30.954775+0000","last_became_peered":"2024-05-08T09:21:30.954775+0000","last_unstale":"2024-05-08T09:25:35.254017+0000","last_undegraded":"2024-05-08T09:25:35.254017+0000","last_fullsized":"2024-05-08T09:25:35.254017+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.253888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.253888+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:52:26.962382+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:00.446234+0000","last_change":"2024-05-08T09:26:00.446257+0000","last_active":"2024-05-08T09:26:00.446234+0000","last_peered":"2024-05-08T09:26:00.446234+0000","last_clean":"2024-05-08T09:26:00.446234+0000","last_became_active":"2024-05-08T09:21:20.670688+0000","last_became_peered":"2024-05-08T09:21:20.670688+0000","last_unstale":"2024-05-08T09:26:00.446234+0000","last_undegraded":"2024-05-08T09:26:00.446234+0000","last_fullsized":"2024-05-08T09:26:00.446234+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:00.446123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:00.446123+0000","last_clean_scrub_stamp":"2024-05-08T09:26:00.446123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:48:39.129715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.887978+0000","last_change":"2024-05-08T09:25:19.887978+0000","last_active":"2024-05-08T09:25:19.887978+0000","last_peered":"2024-05-08T09:25:19.887978+0000","last_clean":"2024-05-08T09:25:19.887978+0000","last_became_active":"2024-05-08T09:21:28.962992+0000","last_became_peered":"2024-05-08T09:21:28.962992+0000","last_unstale":"2024-05-08T09:25:19.887978+0000","last_undegraded":"2024-05-08T09:25:19.887978+0000","last_fullsized":"2024-05-08T09:25:19.887978+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:19.887845+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.887845+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:55:19.515572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.124896+0000","last_change":"2024-05-08T09:24:50.124896+0000","last_active":"2024-05-08T09:24:50.124896+0000","last_peered":"2024-05-08T09:24:50.124896+0000","last_clean":"2024-05-08T09:24:50.124896+0000","last_became_active":"2024-05-08T09:21:32.955744+0000","last_became_peered":"2024-05-08T09:21:32.955744+0000","last_unstale":"2024-05-08T09:24:50.124896+0000","last_undegraded":"2024-05-08T09:24:50.124896+0000","last_fullsized":"2024-05-08T09:24:50.124896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.124732+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.124732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:33:35.398499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"29'290","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.697104+0000","last_change":"2024-05-08T09:24:53.697104+0000","last_active":"2024-05-08T09:24:53.697104+0000","last_peered":"2024-05-08T09:24:53.697104+0000","last_clean":"2024-05-08T09:24:53.697104+0000","last_became_active":"2024-05-08T09:21:34.968161+0000","last_became_peered":"2024-05-08T09:21:34.968161+0000","last_unstale":"2024-05-08T09:24:53.697104+0000","last_undegraded":"2024-05-08T09:24:53.697104+0000","last_fullsized":"2024-05-08T09:24:53.697104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'290","last_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_deep_scrub":"29'290","last_deep_scrub_stamp":"2024-05-08T09:24:53.696956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.696956+0000","objects_scrubbed":10,"log_size":290,"log_dups_size":0,"ondisk_log_size":290,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:20:53.816751+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.235958+0000","last_change":"2024-05-08T09:25:22.235958+0000","last_active":"2024-05-08T09:25:22.235958+0000","last_peered":"2024-05-08T09:25:22.235958+0000","last_clean":"2024-05-08T09:25:22.235958+0000","last_became_active":"2024-05-08T09:21:36.982193+0000","last_became_peered":"2024-05-08T09:21:36.982193+0000","last_unstale":"2024-05-08T09:25:22.235958+0000","last_undegraded":"2024-05-08T09:25:22.235958+0000","last_fullsized":"2024-05-08T09:25:22.235958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.235783+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.235783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:01.285711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"29'3","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.610862+0000","last_change":"2024-05-08T09:25:43.610862+0000","last_active":"2024-05-08T09:25:43.610862+0000","last_peered":"2024-05-08T09:25:43.610862+0000","last_clean":"2024-05-08T09:25:43.610862+0000","last_became_active":"2024-05-08T09:21:38.986490+0000","last_became_peered":"2024-05-08T09:21:38.986490+0000","last_unstale":"2024-05-08T09:25:43.610862+0000","last_undegraded":"2024-05-08T09:25:43.610862+0000","last_fullsized":"2024-05-08T09:25:43.610862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:43.610735+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.610735+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:19:53.132295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'8","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.882929+0000","last_change":"2024-05-08T09:25:24.882929+0000","last_active":"2024-05-08T09:25:24.882929+0000","last_peered":"2024-05-08T09:25:24.882929+0000","last_clean":"2024-05-08T09:25:24.882929+0000","last_became_active":"2024-05-08T09:21:30.946382+0000","last_became_peered":"2024-05-08T09:21:30.946382+0000","last_unstale":"2024-05-08T09:25:24.882929+0000","last_undegraded":"2024-05-08T09:25:24.882929+0000","last_fullsized":"2024-05-08T09:25:24.882929+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.882795+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.882795+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:04.277203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.290947+0000","last_change":"2024-05-08T09:25:27.290947+0000","last_active":"2024-05-08T09:25:27.290947+0000","last_peered":"2024-05-08T09:25:27.290947+0000","last_clean":"2024-05-08T09:25:27.290947+0000","last_became_active":"2024-05-08T09:21:20.670607+0000","last_became_peered":"2024-05-08T09:21:20.670607+0000","last_unstale":"2024-05-08T09:25:27.290947+0000","last_undegraded":"2024-05-08T09:25:27.290947+0000","last_fullsized":"2024-05-08T09:25:27.290947+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.290724+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.290724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:33:05.540034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.933110+0000","last_change":"2024-05-08T09:25:25.933110+0000","last_active":"2024-05-08T09:25:25.933110+0000","last_peered":"2024-05-08T09:25:25.933110+0000","last_clean":"2024-05-08T09:25:25.933110+0000","last_became_active":"2024-05-08T09:21:28.961542+0000","last_became_peered":"2024-05-08T09:21:28.961542+0000","last_unstale":"2024-05-08T09:25:25.933110+0000","last_undegraded":"2024-05-08T09:25:25.933110+0000","last_fullsized":"2024-05-08T09:25:25.933110+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.932974+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.932974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:54.375768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"29'2","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.315030+0000","last_change":"2024-05-08T09:25:07.315030+0000","last_active":"2024-05-08T09:25:07.315030+0000","last_peered":"2024-05-08T09:25:07.315030+0000","last_clean":"2024-05-08T09:25:07.315030+0000","last_became_active":"2024-05-08T09:21:32.953179+0000","last_became_peered":"2024-05-08T09:21:32.953179+0000","last_unstale":"2024-05-08T09:25:07.315030+0000","last_undegraded":"2024-05-08T09:25:07.315030+0000","last_fullsized":"2024-05-08T09:25:07.315030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:07.314876+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.314876+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:51.934749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"29'23","reported_seq":101,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.284595+0000","last_change":"2024-05-08T09:25:00.284595+0000","last_active":"2024-05-08T09:25:00.284595+0000","last_peered":"2024-05-08T09:25:00.284595+0000","last_clean":"2024-05-08T09:25:00.284595+0000","last_became_active":"2024-05-08T09:21:34.961331+0000","last_became_peered":"2024-05-08T09:21:34.961331+0000","last_unstale":"2024-05-08T09:25:00.284595+0000","last_undegraded":"2024-05-08T09:25:00.284595+0000","last_fullsized":"2024-05-08T09:25:00.284595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2024-05-08T09:25:00.284405+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.284405+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:11:16.757164+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.743937+0000","last_change":"2024-05-08T09:25:04.743937+0000","last_active":"2024-05-08T09:25:04.743937+0000","last_peered":"2024-05-08T09:25:04.743937+0000","last_clean":"2024-05-08T09:25:04.743937+0000","last_became_active":"2024-05-08T09:21:36.973176+0000","last_became_peered":"2024-05-08T09:21:36.973176+0000","last_unstale":"2024-05-08T09:25:04.743937+0000","last_undegraded":"2024-05-08T09:25:04.743937+0000","last_fullsized":"2024-05-08T09:25:04.743937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.743814+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.743814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:55.764703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.255444+0000","last_change":"2024-05-08T09:25:38.255444+0000","last_active":"2024-05-08T09:25:38.255444+0000","last_peered":"2024-05-08T09:25:38.255444+0000","last_clean":"2024-05-08T09:25:38.255444+0000","last_became_active":"2024-05-08T09:21:38.977258+0000","last_became_peered":"2024-05-08T09:21:38.977258+0000","last_unstale":"2024-05-08T09:25:38.255444+0000","last_undegraded":"2024-05-08T09:25:38.255444+0000","last_fullsized":"2024-05-08T09:25:38.255444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.255280+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.255280+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:02:43.030188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"29'10","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.997209+0000","last_change":"2024-05-08T09:25:32.997209+0000","last_active":"2024-05-08T09:25:32.997209+0000","last_peered":"2024-05-08T09:25:32.997209+0000","last_clean":"2024-05-08T09:25:32.997209+0000","last_became_active":"2024-05-08T09:21:30.949078+0000","last_became_peered":"2024-05-08T09:21:30.949078+0000","last_unstale":"2024-05-08T09:25:32.997209+0000","last_undegraded":"2024-05-08T09:25:32.997209+0000","last_fullsized":"2024-05-08T09:25:32.997209+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:32.997014+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.997014+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:03:41.577605+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:01.469249+0000","last_change":"2024-05-08T09:26:01.469271+0000","last_active":"2024-05-08T09:26:01.469249+0000","last_peered":"2024-05-08T09:26:01.469249+0000","last_clean":"2024-05-08T09:26:01.469249+0000","last_became_active":"2024-05-08T09:21:20.670850+0000","last_became_peered":"2024-05-08T09:21:20.670850+0000","last_unstale":"2024-05-08T09:26:01.469249+0000","last_undegraded":"2024-05-08T09:26:01.469249+0000","last_fullsized":"2024-05-08T09:26:01.469249+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:01.469153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:01.469153+0000","last_clean_scrub_stamp":"2024-05-08T09:26:01.469153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:48:39.377300+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.348367+0000","last_change":"2024-05-08T09:25:18.348367+0000","last_active":"2024-05-08T09:25:18.348367+0000","last_peered":"2024-05-08T09:25:18.348367+0000","last_clean":"2024-05-08T09:25:18.348367+0000","last_became_active":"2024-05-08T09:21:28.975191+0000","last_became_peered":"2024-05-08T09:21:28.975191+0000","last_unstale":"2024-05-08T09:25:18.348367+0000","last_undegraded":"2024-05-08T09:25:18.348367+0000","last_fullsized":"2024-05-08T09:25:18.348367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:18.348203+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.348203+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:23:24.290463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.703314+0000","last_change":"2024-05-08T09:25:02.703314+0000","last_active":"2024-05-08T09:25:02.703314+0000","last_peered":"2024-05-08T09:25:02.703314+0000","last_clean":"2024-05-08T09:25:02.703314+0000","last_became_active":"2024-05-08T09:21:32.958455+0000","last_became_peered":"2024-05-08T09:21:32.958455+0000","last_unstale":"2024-05-08T09:25:02.703314+0000","last_undegraded":"2024-05-08T09:25:02.703314+0000","last_fullsized":"2024-05-08T09:25:02.703314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:02.703179+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.703179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:19.071013+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"29'20","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.065155+0000","last_change":"2024-05-08T09:24:58.065155+0000","last_active":"2024-05-08T09:24:58.065155+0000","last_peered":"2024-05-08T09:24:58.065155+0000","last_clean":"2024-05-08T09:24:58.065155+0000","last_became_active":"2024-05-08T09:21:34.957840+0000","last_became_peered":"2024-05-08T09:21:34.957840+0000","last_unstale":"2024-05-08T09:24:58.065155+0000","last_undegraded":"2024-05-08T09:24:58.065155+0000","last_fullsized":"2024-05-08T09:24:58.065155+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'20","last_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_deep_scrub":"29'20","last_deep_scrub_stamp":"2024-05-08T09:24:58.065021+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.065021+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:41.445580+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:18.225915+0000","last_change":"2024-05-08T09:25:18.225915+0000","last_active":"2024-05-08T09:25:18.225915+0000","last_peered":"2024-05-08T09:25:18.225915+0000","last_clean":"2024-05-08T09:25:18.225915+0000","last_became_active":"2024-05-08T09:21:36.980661+0000","last_became_peered":"2024-05-08T09:21:36.980661+0000","last_unstale":"2024-05-08T09:25:18.225915+0000","last_undegraded":"2024-05-08T09:25:18.225915+0000","last_fullsized":"2024-05-08T09:25:18.225915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:18.225797+0000","last_clean_scrub_stamp":"2024-05-08T09:25:18.225797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:25:51.835449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.735709+0000","last_change":"2024-05-08T09:25:08.735709+0000","last_active":"2024-05-08T09:25:08.735709+0000","last_peered":"2024-05-08T09:25:08.735709+0000","last_clean":"2024-05-08T09:25:08.735709+0000","last_became_active":"2024-05-08T09:21:38.979059+0000","last_became_peered":"2024-05-08T09:21:38.979059+0000","last_unstale":"2024-05-08T09:25:08.735709+0000","last_undegraded":"2024-05-08T09:25:08.735709+0000","last_fullsized":"2024-05-08T09:25:08.735709+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:08.735600+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.735600+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:33.339447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"29'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.776797+0000","last_change":"2024-05-08T09:25:17.776797+0000","last_active":"2024-05-08T09:25:17.776797+0000","last_peered":"2024-05-08T09:25:17.776797+0000","last_clean":"2024-05-08T09:25:17.776797+0000","last_became_active":"2024-05-08T09:21:30.954030+0000","last_became_peered":"2024-05-08T09:21:30.954030+0000","last_unstale":"2024-05-08T09:25:17.776797+0000","last_undegraded":"2024-05-08T09:25:17.776797+0000","last_fullsized":"2024-05-08T09:25:17.776797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.776647+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.776647+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:35.577142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'4","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.356418+0000","last_change":"2024-05-08T09:25:14.356418+0000","last_active":"2024-05-08T09:25:14.356418+0000","last_peered":"2024-05-08T09:25:14.356418+0000","last_clean":"2024-05-08T09:25:14.356418+0000","last_became_active":"2024-05-08T09:21:28.976742+0000","last_became_peered":"2024-05-08T09:21:28.976742+0000","last_unstale":"2024-05-08T09:25:14.356418+0000","last_undegraded":"2024-05-08T09:25:14.356418+0000","last_fullsized":"2024-05-08T09:25:14.356418+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:14.356288+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.356288+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:30.724123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.052956+0000","last_change":"2024-05-08T09:25:35.052987+0000","last_active":"2024-05-08T09:25:35.052956+0000","last_peered":"2024-05-08T09:25:35.052956+0000","last_clean":"2024-05-08T09:25:35.052956+0000","last_became_active":"2024-05-08T09:21:20.671567+0000","last_became_peered":"2024-05-08T09:21:20.671567+0000","last_unstale":"2024-05-08T09:25:35.052956+0000","last_undegraded":"2024-05-08T09:25:35.052956+0000","last_fullsized":"2024-05-08T09:25:35.052956+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:35.052855+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.052855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.695413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'1","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.733784+0000","last_change":"2024-05-08T09:25:03.733784+0000","last_active":"2024-05-08T09:25:03.733784+0000","last_peered":"2024-05-08T09:25:03.733784+0000","last_clean":"2024-05-08T09:25:03.733784+0000","last_became_active":"2024-05-08T09:21:32.956781+0000","last_became_peered":"2024-05-08T09:21:32.956781+0000","last_unstale":"2024-05-08T09:25:03.733784+0000","last_undegraded":"2024-05-08T09:25:03.733784+0000","last_fullsized":"2024-05-08T09:25:03.733784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2024-05-08T09:25:03.733661+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.733661+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:45:36.989441+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"29'73","reported_seq":150,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.773109+0000","last_change":"2024-05-08T09:24:57.773109+0000","last_active":"2024-05-08T09:24:57.773109+0000","last_peered":"2024-05-08T09:24:57.773109+0000","last_clean":"2024-05-08T09:24:57.773109+0000","last_became_active":"2024-05-08T09:21:34.962316+0000","last_became_peered":"2024-05-08T09:21:34.962316+0000","last_unstale":"2024-05-08T09:24:57.773109+0000","last_undegraded":"2024-05-08T09:24:57.773109+0000","last_fullsized":"2024-05-08T09:24:57.773109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'73","last_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_deep_scrub":"29'73","last_deep_scrub_stamp":"2024-05-08T09:24:57.772960+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.772960+0000","objects_scrubbed":9,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:39.160649+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":71,"num_read_kb":59,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":292,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:49.236766+0000","last_change":"2024-05-08T09:24:49.236766+0000","last_active":"2024-05-08T09:24:49.236766+0000","last_peered":"2024-05-08T09:24:49.236766+0000","last_clean":"2024-05-08T09:24:49.236766+0000","last_became_active":"2024-05-08T09:21:36.970674+0000","last_became_peered":"2024-05-08T09:21:36.970674+0000","last_unstale":"2024-05-08T09:24:49.236766+0000","last_undegraded":"2024-05-08T09:24:49.236766+0000","last_fullsized":"2024-05-08T09:24:49.236766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:49.236605+0000","last_clean_scrub_stamp":"2024-05-08T09:24:49.236605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:20:51.830567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"29'13","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.071817+0000","last_change":"2024-05-08T09:25:49.071817+0000","last_active":"2024-05-08T09:25:49.071817+0000","last_peered":"2024-05-08T09:25:49.071817+0000","last_clean":"2024-05-08T09:25:49.071817+0000","last_became_active":"2024-05-08T09:21:38.978196+0000","last_became_peered":"2024-05-08T09:21:38.978196+0000","last_unstale":"2024-05-08T09:25:49.071817+0000","last_undegraded":"2024-05-08T09:25:49.071817+0000","last_fullsized":"2024-05-08T09:25:49.071817+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2024-05-08T09:25:49.071654+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2024-05-08T09:25:49.071654+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.071654+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:22.056545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":25,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"29'4","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.839615+0000","last_change":"2024-05-08T09:25:15.839615+0000","last_active":"2024-05-08T09:25:15.839615+0000","last_peered":"2024-05-08T09:25:15.839615+0000","last_clean":"2024-05-08T09:25:15.839615+0000","last_became_active":"2024-05-08T09:21:30.954207+0000","last_became_peered":"2024-05-08T09:21:30.954207+0000","last_unstale":"2024-05-08T09:25:15.839615+0000","last_undegraded":"2024-05-08T09:25:15.839615+0000","last_fullsized":"2024-05-08T09:25:15.839615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:15.839497+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.839497+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:54.088807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.030733+0000","last_change":"2024-05-08T09:25:38.030733+0000","last_active":"2024-05-08T09:25:38.030733+0000","last_peered":"2024-05-08T09:25:38.030733+0000","last_clean":"2024-05-08T09:25:38.030733+0000","last_became_active":"2024-05-08T09:21:28.949507+0000","last_became_peered":"2024-05-08T09:21:28.949507+0000","last_unstale":"2024-05-08T09:25:38.030733+0000","last_undegraded":"2024-05-08T09:25:38.030733+0000","last_fullsized":"2024-05-08T09:25:38.030733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:38.030617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.030617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:38.840037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:02.476597+0000","last_change":"2024-05-08T09:26:02.476625+0000","last_active":"2024-05-08T09:26:02.476597+0000","last_peered":"2024-05-08T09:26:02.476597+0000","last_clean":"2024-05-08T09:26:02.476597+0000","last_became_active":"2024-05-08T09:21:20.671115+0000","last_became_peered":"2024-05-08T09:21:20.671115+0000","last_unstale":"2024-05-08T09:26:02.476597+0000","last_undegraded":"2024-05-08T09:26:02.476597+0000","last_fullsized":"2024-05-08T09:26:02.476597+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:02.476502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:02.476502+0000","last_clean_scrub_stamp":"2024-05-08T09:26:02.476502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:52:21.674859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.124254+0000","last_change":"2024-05-08T09:24:51.124254+0000","last_active":"2024-05-08T09:24:51.124254+0000","last_peered":"2024-05-08T09:24:51.124254+0000","last_clean":"2024-05-08T09:24:51.124254+0000","last_became_active":"2024-05-08T09:21:32.955653+0000","last_became_peered":"2024-05-08T09:21:32.955653+0000","last_unstale":"2024-05-08T09:24:51.124254+0000","last_undegraded":"2024-05-08T09:24:51.124254+0000","last_fullsized":"2024-05-08T09:24:51.124254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.124097+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.124097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:45.345946+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"29'22","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.719272+0000","last_change":"2024-05-08T09:24:54.719272+0000","last_active":"2024-05-08T09:24:54.719272+0000","last_peered":"2024-05-08T09:24:54.719272+0000","last_clean":"2024-05-08T09:24:54.719272+0000","last_became_active":"2024-05-08T09:21:34.968138+0000","last_became_peered":"2024-05-08T09:21:34.968138+0000","last_unstale":"2024-05-08T09:24:54.719272+0000","last_undegraded":"2024-05-08T09:24:54.719272+0000","last_fullsized":"2024-05-08T09:24:54.719272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2024-05-08T09:24:54.719066+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.719066+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:04:41.377306+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'285","reported_seq":369,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.668807+0000","last_change":"2024-05-08T09:24:50.668807+0000","last_active":"2024-05-08T09:24:50.668807+0000","last_peered":"2024-05-08T09:24:50.668807+0000","last_clean":"2024-05-08T09:24:50.668807+0000","last_became_active":"2024-05-08T09:21:36.970074+0000","last_became_peered":"2024-05-08T09:21:36.970074+0000","last_unstale":"2024-05-08T09:24:50.668807+0000","last_undegraded":"2024-05-08T09:24:50.668807+0000","last_fullsized":"2024-05-08T09:24:50.668807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:50.668685+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.668685+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:28:49.401297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"27'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:09.536061+0000","last_change":"2024-05-08T09:26:09.536096+0000","last_active":"2024-05-08T09:26:09.536061+0000","last_peered":"2024-05-08T09:26:09.536061+0000","last_clean":"2024-05-08T09:26:09.536061+0000","last_became_active":"2024-05-08T09:21:38.978685+0000","last_became_peered":"2024-05-08T09:21:38.978685+0000","last_unstale":"2024-05-08T09:26:09.536061+0000","last_undegraded":"2024-05-08T09:26:09.536061+0000","last_fullsized":"2024-05-08T09:26:09.536061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:26:09.535961+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:26:09.535961+0000","last_clean_scrub_stamp":"2024-05-08T09:26:09.535961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:58:00.270522+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"29'8","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.152804+0000","last_change":"2024-05-08T09:25:28.152804+0000","last_active":"2024-05-08T09:25:28.152804+0000","last_peered":"2024-05-08T09:25:28.152804+0000","last_clean":"2024-05-08T09:25:28.152804+0000","last_became_active":"2024-05-08T09:21:30.957376+0000","last_became_peered":"2024-05-08T09:21:30.957376+0000","last_unstale":"2024-05-08T09:25:28.152804+0000","last_undegraded":"2024-05-08T09:25:28.152804+0000","last_fullsized":"2024-05-08T09:25:28.152804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:28.152679+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.152679+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:10.173572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:53.312221+0000","last_change":"2024-05-08T09:25:53.312247+0000","last_active":"2024-05-08T09:25:53.312221+0000","last_peered":"2024-05-08T09:25:53.312221+0000","last_clean":"2024-05-08T09:25:53.312221+0000","last_became_active":"2024-05-08T09:21:28.966385+0000","last_became_peered":"2024-05-08T09:21:28.966385+0000","last_unstale":"2024-05-08T09:25:53.312221+0000","last_undegraded":"2024-05-08T09:25:53.312221+0000","last_fullsized":"2024-05-08T09:25:53.312221+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:53.312126+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:53.312126+0000","last_clean_scrub_stamp":"2024-05-08T09:25:53.312126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:53:18.983438+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.064673+0000","last_change":"2024-05-08T09:25:36.064673+0000","last_active":"2024-05-08T09:25:36.064673+0000","last_peered":"2024-05-08T09:25:36.064673+0000","last_clean":"2024-05-08T09:25:36.064673+0000","last_became_active":"2024-05-08T09:21:20.672859+0000","last_became_peered":"2024-05-08T09:21:20.672859+0000","last_unstale":"2024-05-08T09:25:36.064673+0000","last_undegraded":"2024-05-08T09:25:36.064673+0000","last_fullsized":"2024-05-08T09:25:36.064673+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:36.064555+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.064555+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:09.674206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:57.073177+0000","last_change":"2024-05-08T09:24:57.073177+0000","last_active":"2024-05-08T09:24:57.073177+0000","last_peered":"2024-05-08T09:24:57.073177+0000","last_clean":"2024-05-08T09:24:57.073177+0000","last_became_active":"2024-05-08T09:21:32.952914+0000","last_became_peered":"2024-05-08T09:21:32.952914+0000","last_unstale":"2024-05-08T09:24:57.073177+0000","last_undegraded":"2024-05-08T09:24:57.073177+0000","last_fullsized":"2024-05-08T09:24:57.073177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:57.073058+0000","last_clean_scrub_stamp":"2024-05-08T09:24:57.073058+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:35.322368+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.226059+0000","last_change":"2024-05-08T09:25:23.226059+0000","last_active":"2024-05-08T09:25:23.226059+0000","last_peered":"2024-05-08T09:25:23.226059+0000","last_clean":"2024-05-08T09:25:23.226059+0000","last_became_active":"2024-05-08T09:21:34.964068+0000","last_became_peered":"2024-05-08T09:21:34.964068+0000","last_unstale":"2024-05-08T09:25:23.226059+0000","last_undegraded":"2024-05-08T09:25:23.226059+0000","last_fullsized":"2024-05-08T09:25:23.226059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:23.225893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.225893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:55.821357+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"29'285","reported_seq":425,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:53.762592+0000","last_change":"2024-05-08T09:24:53.762592+0000","last_active":"2024-05-08T09:24:53.762592+0000","last_peered":"2024-05-08T09:24:53.762592+0000","last_clean":"2024-05-08T09:24:53.762592+0000","last_became_active":"2024-05-08T09:21:36.964403+0000","last_became_peered":"2024-05-08T09:21:36.964403+0000","last_unstale":"2024-05-08T09:24:53.762592+0000","last_undegraded":"2024-05-08T09:24:53.762592+0000","last_fullsized":"2024-05-08T09:24:53.762592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:24:53.762413+0000","last_clean_scrub_stamp":"2024-05-08T09:24:53.762413+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:52:17.292293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"29'7","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.729008+0000","last_change":"2024-05-08T09:25:00.729008+0000","last_active":"2024-05-08T09:25:00.729008+0000","last_peered":"2024-05-08T09:25:00.729008+0000","last_clean":"2024-05-08T09:25:00.729008+0000","last_became_active":"2024-05-08T09:21:38.976200+0000","last_became_peered":"2024-05-08T09:21:38.976200+0000","last_unstale":"2024-05-08T09:25:00.729008+0000","last_undegraded":"2024-05-08T09:25:00.729008+0000","last_fullsized":"2024-05-08T09:25:00.729008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2024-05-08T09:25:00.728878+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.728878+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:47:46.558237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"29'16","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.273892+0000","last_change":"2024-05-08T09:25:23.273892+0000","last_active":"2024-05-08T09:25:23.273892+0000","last_peered":"2024-05-08T09:25:23.273892+0000","last_clean":"2024-05-08T09:25:23.273892+0000","last_became_active":"2024-05-08T09:21:30.954279+0000","last_became_peered":"2024-05-08T09:21:30.954279+0000","last_unstale":"2024-05-08T09:25:23.273892+0000","last_undegraded":"2024-05-08T09:25:23.273892+0000","last_fullsized":"2024-05-08T09:25:23.273892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:23.273754+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.273754+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:03:57.512051+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.750165+0000","last_change":"2024-05-08T09:25:33.750165+0000","last_active":"2024-05-08T09:25:33.750165+0000","last_peered":"2024-05-08T09:25:33.750165+0000","last_clean":"2024-05-08T09:25:33.750165+0000","last_became_active":"2024-05-08T09:21:28.974155+0000","last_became_peered":"2024-05-08T09:21:28.974155+0000","last_unstale":"2024-05-08T09:25:33.750165+0000","last_undegraded":"2024-05-08T09:25:33.750165+0000","last_fullsized":"2024-05-08T09:25:33.750165+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.750034+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.750034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:59:38.390790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:03.451743+0000","last_change":"2024-05-08T09:26:03.451765+0000","last_active":"2024-05-08T09:26:03.451743+0000","last_peered":"2024-05-08T09:26:03.451743+0000","last_clean":"2024-05-08T09:26:03.451743+0000","last_became_active":"2024-05-08T09:21:20.672485+0000","last_became_peered":"2024-05-08T09:21:20.672485+0000","last_unstale":"2024-05-08T09:26:03.451743+0000","last_undegraded":"2024-05-08T09:26:03.451743+0000","last_fullsized":"2024-05-08T09:26:03.451743+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:03.451653+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:03.451653+0000","last_clean_scrub_stamp":"2024-05-08T09:26:03.451653+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:09:37.664513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.067152+0000","last_change":"2024-05-08T09:25:00.067152+0000","last_active":"2024-05-08T09:25:00.067152+0000","last_peered":"2024-05-08T09:25:00.067152+0000","last_clean":"2024-05-08T09:25:00.067152+0000","last_became_active":"2024-05-08T09:21:32.950522+0000","last_became_peered":"2024-05-08T09:21:32.950522+0000","last_unstale":"2024-05-08T09:25:00.067152+0000","last_undegraded":"2024-05-08T09:25:00.067152+0000","last_fullsized":"2024-05-08T09:25:00.067152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.067020+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.067020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:54.239410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"29'96","reported_seq":190,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:56.290105+0000","last_change":"2024-05-08T09:24:56.290105+0000","last_active":"2024-05-08T09:24:56.290105+0000","last_peered":"2024-05-08T09:24:56.290105+0000","last_clean":"2024-05-08T09:24:56.290105+0000","last_became_active":"2024-05-08T09:21:34.967677+0000","last_became_peered":"2024-05-08T09:21:34.967677+0000","last_unstale":"2024-05-08T09:24:56.290105+0000","last_undegraded":"2024-05-08T09:24:56.290105+0000","last_fullsized":"2024-05-08T09:24:56.290105+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'96","last_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_deep_scrub":"29'96","last_deep_scrub_stamp":"2024-05-08T09:24:56.289983+0000","last_clean_scrub_stamp":"2024-05-08T09:24:56.289983+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:24.762692+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.755671+0000","last_change":"2024-05-08T09:24:52.755671+0000","last_active":"2024-05-08T09:24:52.755671+0000","last_peered":"2024-05-08T09:24:52.755671+0000","last_clean":"2024-05-08T09:24:52.755671+0000","last_became_active":"2024-05-08T09:21:36.971074+0000","last_became_peered":"2024-05-08T09:21:36.971074+0000","last_unstale":"2024-05-08T09:24:52.755671+0000","last_undegraded":"2024-05-08T09:24:52.755671+0000","last_fullsized":"2024-05-08T09:24:52.755671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.755558+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.755558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:37:21.018669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.335831+0000","last_change":"2024-05-08T09:25:37.335831+0000","last_active":"2024-05-08T09:25:37.335831+0000","last_peered":"2024-05-08T09:25:37.335831+0000","last_clean":"2024-05-08T09:25:37.335831+0000","last_became_active":"2024-05-08T09:21:38.972622+0000","last_became_peered":"2024-05-08T09:21:38.972622+0000","last_unstale":"2024-05-08T09:25:37.335831+0000","last_undegraded":"2024-05-08T09:25:37.335831+0000","last_fullsized":"2024-05-08T09:25:37.335831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.335715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.335715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:16.730123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"27'8","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.340043+0000","last_change":"2024-05-08T09:25:39.340043+0000","last_active":"2024-05-08T09:25:39.340043+0000","last_peered":"2024-05-08T09:25:39.340043+0000","last_clean":"2024-05-08T09:25:39.340043+0000","last_became_active":"2024-05-08T09:21:38.980117+0000","last_became_peered":"2024-05-08T09:21:38.980117+0000","last_unstale":"2024-05-08T09:25:39.340043+0000","last_undegraded":"2024-05-08T09:25:39.340043+0000","last_fullsized":"2024-05-08T09:25:39.340043+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:39.339896+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.339896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:32.696620+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"29'10","reported_seq":73,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.264323+0000","last_change":"2024-05-08T09:25:10.264323+0000","last_active":"2024-05-08T09:25:10.264323+0000","last_peered":"2024-05-08T09:25:10.264323+0000","last_clean":"2024-05-08T09:25:10.264323+0000","last_became_active":"2024-05-08T09:21:30.954255+0000","last_became_peered":"2024-05-08T09:21:30.954255+0000","last_unstale":"2024-05-08T09:25:10.264323+0000","last_undegraded":"2024-05-08T09:25:10.264323+0000","last_fullsized":"2024-05-08T09:25:10.264323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:10.264214+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.264214+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:13:56.672907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:50.306302+0000","last_change":"2024-05-08T09:25:50.306302+0000","last_active":"2024-05-08T09:25:50.306302+0000","last_peered":"2024-05-08T09:25:50.306302+0000","last_clean":"2024-05-08T09:25:50.306302+0000","last_became_active":"2024-05-08T09:21:28.967539+0000","last_became_peered":"2024-05-08T09:21:28.967539+0000","last_unstale":"2024-05-08T09:25:50.306302+0000","last_undegraded":"2024-05-08T09:25:50.306302+0000","last_fullsized":"2024-05-08T09:25:50.306302+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:50.306182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:50.306182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:50.306182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:27:29.144141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:03.739001+0000","last_change":"2024-05-08T09:25:03.739001+0000","last_active":"2024-05-08T09:25:03.739001+0000","last_peered":"2024-05-08T09:25:03.739001+0000","last_clean":"2024-05-08T09:25:03.739001+0000","last_became_active":"2024-05-08T09:21:32.957846+0000","last_became_peered":"2024-05-08T09:21:32.957846+0000","last_unstale":"2024-05-08T09:25:03.739001+0000","last_undegraded":"2024-05-08T09:25:03.739001+0000","last_fullsized":"2024-05-08T09:25:03.739001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:03.738886+0000","last_clean_scrub_stamp":"2024-05-08T09:25:03.738886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:45:20.106720+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"29'41","reported_seq":98,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:10.129988+0000","last_change":"2024-05-08T09:25:10.129988+0000","last_active":"2024-05-08T09:25:10.129988+0000","last_peered":"2024-05-08T09:25:10.129988+0000","last_clean":"2024-05-08T09:25:10.129988+0000","last_became_active":"2024-05-08T09:21:34.964423+0000","last_became_peered":"2024-05-08T09:21:34.964423+0000","last_unstale":"2024-05-08T09:25:10.129988+0000","last_undegraded":"2024-05-08T09:25:10.129988+0000","last_fullsized":"2024-05-08T09:25:10.129988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2024-05-08T09:25:10.129867+0000","last_clean_scrub_stamp":"2024-05-08T09:25:10.129867+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:03.675404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":55,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.234422+0000","last_change":"2024-05-08T09:25:30.234422+0000","last_active":"2024-05-08T09:25:30.234422+0000","last_peered":"2024-05-08T09:25:30.234422+0000","last_clean":"2024-05-08T09:25:30.234422+0000","last_became_active":"2024-05-08T09:21:36.985219+0000","last_became_peered":"2024-05-08T09:21:36.985219+0000","last_unstale":"2024-05-08T09:25:30.234422+0000","last_undegraded":"2024-05-08T09:25:30.234422+0000","last_fullsized":"2024-05-08T09:25:30.234422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:30.234277+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.234277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:27.546403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"29'5","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:50.112454+0000","last_change":"2024-05-08T09:25:50.112480+0000","last_active":"2024-05-08T09:25:50.112454+0000","last_peered":"2024-05-08T09:25:50.112454+0000","last_clean":"2024-05-08T09:25:50.112454+0000","last_became_active":"2024-05-08T09:21:38.979666+0000","last_became_peered":"2024-05-08T09:21:38.979666+0000","last_unstale":"2024-05-08T09:25:50.112454+0000","last_undegraded":"2024-05-08T09:25:50.112454+0000","last_fullsized":"2024-05-08T09:25:50.112454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:50.112363+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:50.112363+0000","last_clean_scrub_stamp":"2024-05-08T09:25:50.112363+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:10:14.873705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"29'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:49.525902+0000","last_change":"2024-05-08T09:25:49.525902+0000","last_active":"2024-05-08T09:25:49.525902+0000","last_peered":"2024-05-08T09:25:49.525902+0000","last_clean":"2024-05-08T09:25:49.525902+0000","last_became_active":"2024-05-08T09:22:16.064582+0000","last_became_peered":"2024-05-08T09:22:16.064582+0000","last_unstale":"2024-05-08T09:25:49.525902+0000","last_undegraded":"2024-05-08T09:25:49.525902+0000","last_fullsized":"2024-05-08T09:25:49.525902+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:49.525751+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:49.525751+0000","last_clean_scrub_stamp":"2024-05-08T09:25:49.525751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:13:46.837877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:16.324894+0000","last_change":"2024-05-08T09:25:16.324894+0000","last_active":"2024-05-08T09:25:16.324894+0000","last_peered":"2024-05-08T09:25:16.324894+0000","last_clean":"2024-05-08T09:25:16.324894+0000","last_became_active":"2024-05-08T09:21:28.976274+0000","last_became_peered":"2024-05-08T09:21:28.976274+0000","last_unstale":"2024-05-08T09:25:16.324894+0000","last_undegraded":"2024-05-08T09:25:16.324894+0000","last_fullsized":"2024-05-08T09:25:16.324894+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:16.324762+0000","last_clean_scrub_stamp":"2024-05-08T09:25:16.324762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:31:07.345651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.092649+0000","last_change":"2024-05-08T09:24:59.092649+0000","last_active":"2024-05-08T09:24:59.092649+0000","last_peered":"2024-05-08T09:24:59.092649+0000","last_clean":"2024-05-08T09:24:59.092649+0000","last_became_active":"2024-05-08T09:21:32.950987+0000","last_became_peered":"2024-05-08T09:21:32.950987+0000","last_unstale":"2024-05-08T09:24:59.092649+0000","last_undegraded":"2024-05-08T09:24:59.092649+0000","last_fullsized":"2024-05-08T09:24:59.092649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:59.092531+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.092531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:28:16.893025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"29'8","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.726515+0000","last_change":"2024-05-08T09:25:01.726515+0000","last_active":"2024-05-08T09:25:01.726515+0000","last_peered":"2024-05-08T09:25:01.726515+0000","last_clean":"2024-05-08T09:25:01.726515+0000","last_became_active":"2024-05-08T09:21:34.958231+0000","last_became_peered":"2024-05-08T09:21:34.958231+0000","last_unstale":"2024-05-08T09:25:01.726515+0000","last_undegraded":"2024-05-08T09:25:01.726515+0000","last_fullsized":"2024-05-08T09:25:01.726515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:01.726389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.726389+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:39.682934+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:50.262998+0000","last_change":"2024-05-08T09:24:50.262998+0000","last_active":"2024-05-08T09:24:50.262998+0000","last_peered":"2024-05-08T09:24:50.262998+0000","last_clean":"2024-05-08T09:24:50.262998+0000","last_became_active":"2024-05-08T09:21:36.967464+0000","last_became_peered":"2024-05-08T09:21:36.967464+0000","last_unstale":"2024-05-08T09:24:50.262998+0000","last_undegraded":"2024-05-08T09:24:50.262998+0000","last_fullsized":"2024-05-08T09:24:50.262998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:50.262889+0000","last_clean_scrub_stamp":"2024-05-08T09:24:50.262889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:40:10.696858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.112972+0000","last_change":"2024-05-08T09:25:46.112997+0000","last_active":"2024-05-08T09:25:46.112972+0000","last_peered":"2024-05-08T09:25:46.112972+0000","last_clean":"2024-05-08T09:25:46.112972+0000","last_became_active":"2024-05-08T09:21:38.973662+0000","last_became_peered":"2024-05-08T09:21:38.973662+0000","last_unstale":"2024-05-08T09:25:46.112972+0000","last_undegraded":"2024-05-08T09:25:46.112972+0000","last_fullsized":"2024-05-08T09:25:46.112972+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:46.112873+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:46.112873+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.112873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:28.133766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"29'6","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.877426+0000","last_change":"2024-05-08T09:25:14.877426+0000","last_active":"2024-05-08T09:25:14.877426+0000","last_peered":"2024-05-08T09:25:14.877426+0000","last_clean":"2024-05-08T09:25:14.877426+0000","last_became_active":"2024-05-08T09:21:30.953357+0000","last_became_peered":"2024-05-08T09:21:30.953357+0000","last_unstale":"2024-05-08T09:25:14.877426+0000","last_undegraded":"2024-05-08T09:25:14.877426+0000","last_fullsized":"2024-05-08T09:25:14.877426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.877308+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.877308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:32:53.126619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:33.370010+0000","last_change":"2024-05-08T09:25:33.370010+0000","last_active":"2024-05-08T09:25:33.370010+0000","last_peered":"2024-05-08T09:25:33.370010+0000","last_clean":"2024-05-08T09:25:33.370010+0000","last_became_active":"2024-05-08T09:21:28.969079+0000","last_became_peered":"2024-05-08T09:21:28.969079+0000","last_unstale":"2024-05-08T09:25:33.370010+0000","last_undegraded":"2024-05-08T09:25:33.370010+0000","last_fullsized":"2024-05-08T09:25:33.370010+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:33.369888+0000","last_clean_scrub_stamp":"2024-05-08T09:25:33.369888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:34:36.532509+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.328721+0000","last_change":"2024-05-08T09:25:06.328721+0000","last_active":"2024-05-08T09:25:06.328721+0000","last_peered":"2024-05-08T09:25:06.328721+0000","last_clean":"2024-05-08T09:25:06.328721+0000","last_became_active":"2024-05-08T09:21:32.955856+0000","last_became_peered":"2024-05-08T09:21:32.955856+0000","last_unstale":"2024-05-08T09:25:06.328721+0000","last_undegraded":"2024-05-08T09:25:06.328721+0000","last_fullsized":"2024-05-08T09:25:06.328721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:06.328595+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.328595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:05:24.990182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"29'47","reported_seq":120,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:54.742594+0000","last_change":"2024-05-08T09:24:54.742594+0000","last_active":"2024-05-08T09:24:54.742594+0000","last_peered":"2024-05-08T09:24:54.742594+0000","last_clean":"2024-05-08T09:24:54.742594+0000","last_became_active":"2024-05-08T09:21:34.963970+0000","last_became_peered":"2024-05-08T09:21:34.963970+0000","last_unstale":"2024-05-08T09:24:54.742594+0000","last_undegraded":"2024-05-08T09:24:54.742594+0000","last_fullsized":"2024-05-08T09:24:54.742594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:54.742456+0000","last_clean_scrub_stamp":"2024-05-08T09:24:54.742456+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:19:50.767894+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":70,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":662,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.658969+0000","last_change":"2024-05-08T09:24:51.658969+0000","last_active":"2024-05-08T09:24:51.658969+0000","last_peered":"2024-05-08T09:24:51.658969+0000","last_clean":"2024-05-08T09:24:51.658969+0000","last_became_active":"2024-05-08T09:21:36.969130+0000","last_became_peered":"2024-05-08T09:21:36.969130+0000","last_unstale":"2024-05-08T09:24:51.658969+0000","last_undegraded":"2024-05-08T09:24:51.658969+0000","last_fullsized":"2024-05-08T09:24:51.658969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.658847+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.658847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:21:59.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"27'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.232278+0000","last_change":"2024-05-08T09:25:34.232307+0000","last_active":"2024-05-08T09:25:34.232278+0000","last_peered":"2024-05-08T09:25:34.232278+0000","last_clean":"2024-05-08T09:25:34.232278+0000","last_became_active":"2024-05-08T09:21:38.976187+0000","last_became_peered":"2024-05-08T09:21:38.976187+0000","last_unstale":"2024-05-08T09:25:34.232278+0000","last_undegraded":"2024-05-08T09:25:34.232278+0000","last_fullsized":"2024-05-08T09:25:34.232278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:34.232174+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.232174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:27:46.890740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"29'6","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.305095+0000","last_change":"2024-05-08T09:25:42.305165+0000","last_active":"2024-05-08T09:25:42.305095+0000","last_peered":"2024-05-08T09:25:42.305095+0000","last_clean":"2024-05-08T09:25:42.305095+0000","last_became_active":"2024-05-08T09:22:16.002864+0000","last_became_peered":"2024-05-08T09:22:16.002864+0000","last_unstale":"2024-05-08T09:25:42.305095+0000","last_undegraded":"2024-05-08T09:25:42.305095+0000","last_fullsized":"2024-05-08T09:25:42.305095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:42.304979+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.304979+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:28.049765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:23.759086+0000","last_change":"2024-05-08T09:25:23.759086+0000","last_active":"2024-05-08T09:25:23.759086+0000","last_peered":"2024-05-08T09:25:23.759086+0000","last_clean":"2024-05-08T09:25:23.759086+0000","last_became_active":"2024-05-08T09:21:28.976542+0000","last_became_peered":"2024-05-08T09:21:28.976542+0000","last_unstale":"2024-05-08T09:25:23.759086+0000","last_undegraded":"2024-05-08T09:25:23.759086+0000","last_fullsized":"2024-05-08T09:25:23.759086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:23.758963+0000","last_clean_scrub_stamp":"2024-05-08T09:25:23.758963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:51:56.200915+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.045049+0000","last_change":"2024-05-08T09:24:55.045049+0000","last_active":"2024-05-08T09:24:55.045049+0000","last_peered":"2024-05-08T09:24:55.045049+0000","last_clean":"2024-05-08T09:24:55.045049+0000","last_became_active":"2024-05-08T09:21:32.953182+0000","last_became_peered":"2024-05-08T09:21:32.953182+0000","last_unstale":"2024-05-08T09:24:55.045049+0000","last_undegraded":"2024-05-08T09:24:55.045049+0000","last_fullsized":"2024-05-08T09:24:55.045049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:55.044956+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.044956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:28.363607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"29'38","reported_seq":94,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.255686+0000","last_change":"2024-05-08T09:24:59.255686+0000","last_active":"2024-05-08T09:24:59.255686+0000","last_peered":"2024-05-08T09:24:59.255686+0000","last_clean":"2024-05-08T09:24:59.255686+0000","last_became_active":"2024-05-08T09:21:34.961218+0000","last_became_peered":"2024-05-08T09:21:34.961218+0000","last_unstale":"2024-05-08T09:24:59.255686+0000","last_undegraded":"2024-05-08T09:24:59.255686+0000","last_fullsized":"2024-05-08T09:24:59.255686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2024-05-08T09:24:59.255555+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.255555+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:18:31.061439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:51.260245+0000","last_change":"2024-05-08T09:24:51.260245+0000","last_active":"2024-05-08T09:24:51.260245+0000","last_peered":"2024-05-08T09:24:51.260245+0000","last_clean":"2024-05-08T09:24:51.260245+0000","last_became_active":"2024-05-08T09:21:36.966157+0000","last_became_peered":"2024-05-08T09:21:36.966157+0000","last_unstale":"2024-05-08T09:24:51.260245+0000","last_undegraded":"2024-05-08T09:24:51.260245+0000","last_fullsized":"2024-05-08T09:24:51.260245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:51.260133+0000","last_clean_scrub_stamp":"2024-05-08T09:24:51.260133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:20:11.715270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"27'8","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.220779+0000","last_change":"2024-05-08T09:25:36.220779+0000","last_active":"2024-05-08T09:25:36.220779+0000","last_peered":"2024-05-08T09:25:36.220779+0000","last_clean":"2024-05-08T09:25:36.220779+0000","last_became_active":"2024-05-08T09:21:30.954819+0000","last_became_peered":"2024-05-08T09:21:30.954819+0000","last_unstale":"2024-05-08T09:25:36.220779+0000","last_undegraded":"2024-05-08T09:25:36.220779+0000","last_fullsized":"2024-05-08T09:25:36.220779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-08T09:25:36.220667+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.220667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:59:18.540821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.180625+0000","last_change":"2024-05-08T09:25:41.180625+0000","last_active":"2024-05-08T09:25:41.180625+0000","last_peered":"2024-05-08T09:25:41.180625+0000","last_clean":"2024-05-08T09:25:41.180625+0000","last_became_active":"2024-05-08T09:21:28.978175+0000","last_became_peered":"2024-05-08T09:21:28.978175+0000","last_unstale":"2024-05-08T09:25:41.180625+0000","last_undegraded":"2024-05-08T09:25:41.180625+0000","last_fullsized":"2024-05-08T09:25:41.180625+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.180507+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.180507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:49:53.120542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:07.798715+0000","last_change":"2024-05-08T09:25:07.798715+0000","last_active":"2024-05-08T09:25:07.798715+0000","last_peered":"2024-05-08T09:25:07.798715+0000","last_clean":"2024-05-08T09:25:07.798715+0000","last_became_active":"2024-05-08T09:21:32.957078+0000","last_became_peered":"2024-05-08T09:21:32.957078+0000","last_unstale":"2024-05-08T09:25:07.798715+0000","last_undegraded":"2024-05-08T09:25:07.798715+0000","last_fullsized":"2024-05-08T09:25:07.798715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:07.798584+0000","last_clean_scrub_stamp":"2024-05-08T09:25:07.798584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:03:32.402432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"29'63","reported_seq":136,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.736974+0000","last_change":"2024-05-08T09:24:58.737020+0000","last_active":"2024-05-08T09:24:58.736974+0000","last_peered":"2024-05-08T09:24:58.736974+0000","last_clean":"2024-05-08T09:24:58.736974+0000","last_became_active":"2024-05-08T09:21:34.960747+0000","last_became_peered":"2024-05-08T09:21:34.960747+0000","last_unstale":"2024-05-08T09:24:58.736974+0000","last_undegraded":"2024-05-08T09:24:58.736974+0000","last_fullsized":"2024-05-08T09:24:58.736974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'63","last_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_deep_scrub":"29'63","last_deep_scrub_stamp":"2024-05-08T09:24:58.736875+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.736875+0000","objects_scrubbed":5,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T21:13:49.606990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.304313+0000","last_change":"2024-05-08T09:24:52.304336+0000","last_active":"2024-05-08T09:24:52.304313+0000","last_peered":"2024-05-08T09:24:52.304313+0000","last_clean":"2024-05-08T09:24:52.304313+0000","last_became_active":"2024-05-08T09:21:36.964006+0000","last_became_peered":"2024-05-08T09:21:36.964006+0000","last_unstale":"2024-05-08T09:24:52.304313+0000","last_undegraded":"2024-05-08T09:24:52.304313+0000","last_fullsized":"2024-05-08T09:24:52.304313+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.304223+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.304223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:23:48.209866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"29'16","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.063710+0000","last_change":"2024-05-08T09:25:44.063710+0000","last_active":"2024-05-08T09:25:44.063710+0000","last_peered":"2024-05-08T09:25:44.063710+0000","last_clean":"2024-05-08T09:25:44.063710+0000","last_became_active":"2024-05-08T09:21:38.971761+0000","last_became_peered":"2024-05-08T09:21:38.971761+0000","last_unstale":"2024-05-08T09:25:44.063710+0000","last_undegraded":"2024-05-08T09:25:44.063710+0000","last_fullsized":"2024-05-08T09:25:44.063710+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2024-05-08T09:25:44.063537+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2024-05-08T09:25:44.063537+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.063537+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:52:04.912659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":21,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"27'4","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.968858+0000","last_change":"2024-05-08T09:25:22.968858+0000","last_active":"2024-05-08T09:25:22.968858+0000","last_peered":"2024-05-08T09:25:22.968858+0000","last_clean":"2024-05-08T09:25:22.968858+0000","last_became_active":"2024-05-08T09:21:30.946327+0000","last_became_peered":"2024-05-08T09:21:30.946327+0000","last_unstale":"2024-05-08T09:25:22.968858+0000","last_undegraded":"2024-05-08T09:25:22.968858+0000","last_fullsized":"2024-05-08T09:25:22.968858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:22.968709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.968709+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:43.854555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:36.790527+0000","last_change":"2024-05-08T09:25:36.790527+0000","last_active":"2024-05-08T09:25:36.790527+0000","last_peered":"2024-05-08T09:25:36.790527+0000","last_clean":"2024-05-08T09:25:36.790527+0000","last_became_active":"2024-05-08T09:21:28.966027+0000","last_became_peered":"2024-05-08T09:21:28.966027+0000","last_unstale":"2024-05-08T09:25:36.790527+0000","last_undegraded":"2024-05-08T09:25:36.790527+0000","last_fullsized":"2024-05-08T09:25:36.790527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:36.790389+0000","last_clean_scrub_stamp":"2024-05-08T09:25:36.790389+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:26:10.400040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.316305+0000","last_change":"2024-05-08T09:25:08.316305+0000","last_active":"2024-05-08T09:25:08.316305+0000","last_peered":"2024-05-08T09:25:08.316305+0000","last_clean":"2024-05-08T09:25:08.316305+0000","last_became_active":"2024-05-08T09:21:32.951975+0000","last_became_peered":"2024-05-08T09:21:32.951975+0000","last_unstale":"2024-05-08T09:25:08.316305+0000","last_undegraded":"2024-05-08T09:25:08.316305+0000","last_fullsized":"2024-05-08T09:25:08.316305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.316182+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.316182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:40:36.542401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"29'45","reported_seq":103,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.028482+0000","last_change":"2024-05-08T09:25:04.028522+0000","last_active":"2024-05-08T09:25:04.028482+0000","last_peered":"2024-05-08T09:25:04.028482+0000","last_clean":"2024-05-08T09:25:04.028482+0000","last_became_active":"2024-05-08T09:21:34.963999+0000","last_became_peered":"2024-05-08T09:21:34.963999+0000","last_unstale":"2024-05-08T09:25:04.028482+0000","last_undegraded":"2024-05-08T09:25:04.028482+0000","last_fullsized":"2024-05-08T09:25:04.028482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'45","last_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_deep_scrub":"29'45","last_deep_scrub_stamp":"2024-05-08T09:25:04.028381+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.028381+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:00:37.084622+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:52.696777+0000","last_change":"2024-05-08T09:24:52.696803+0000","last_active":"2024-05-08T09:24:52.696777+0000","last_peered":"2024-05-08T09:24:52.696777+0000","last_clean":"2024-05-08T09:24:52.696777+0000","last_became_active":"2024-05-08T09:21:36.972385+0000","last_became_peered":"2024-05-08T09:21:36.972385+0000","last_unstale":"2024-05-08T09:24:52.696777+0000","last_undegraded":"2024-05-08T09:24:52.696777+0000","last_fullsized":"2024-05-08T09:24:52.696777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:52.696677+0000","last_clean_scrub_stamp":"2024-05-08T09:24:52.696677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:56:55.771440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.211221+0000","last_change":"2024-05-08T09:25:42.211221+0000","last_active":"2024-05-08T09:25:42.211221+0000","last_peered":"2024-05-08T09:25:42.211221+0000","last_clean":"2024-05-08T09:25:42.211221+0000","last_became_active":"2024-05-08T09:21:38.977842+0000","last_became_peered":"2024-05-08T09:21:38.977842+0000","last_unstale":"2024-05-08T09:25:42.211221+0000","last_undegraded":"2024-05-08T09:25:42.211221+0000","last_fullsized":"2024-05-08T09:25:42.211221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:42.211101+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.211101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:55:08.820703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"29'5","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.978022+0000","last_change":"2024-05-08T09:25:04.978073+0000","last_active":"2024-05-08T09:25:04.978022+0000","last_peered":"2024-05-08T09:25:04.978022+0000","last_clean":"2024-05-08T09:25:04.978022+0000","last_became_active":"2024-05-08T09:21:30.960237+0000","last_became_peered":"2024-05-08T09:21:30.960237+0000","last_unstale":"2024-05-08T09:25:04.978022+0000","last_undegraded":"2024-05-08T09:25:04.978022+0000","last_fullsized":"2024-05-08T09:25:04.978022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2024-05-08T09:25:04.977922+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.977922+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:50:25.863768+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:25.827659+0000","last_change":"2024-05-08T09:25:25.827659+0000","last_active":"2024-05-08T09:25:25.827659+0000","last_peered":"2024-05-08T09:25:25.827659+0000","last_clean":"2024-05-08T09:25:25.827659+0000","last_became_active":"2024-05-08T09:21:28.972368+0000","last_became_peered":"2024-05-08T09:21:28.972368+0000","last_unstale":"2024-05-08T09:25:25.827659+0000","last_undegraded":"2024-05-08T09:25:25.827659+0000","last_fullsized":"2024-05-08T09:25:25.827659+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:25.827542+0000","last_clean_scrub_stamp":"2024-05-08T09:25:25.827542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:37:05.221950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:41.308936+0000","last_change":"2024-05-08T09:25:41.308979+0000","last_active":"2024-05-08T09:25:41.308936+0000","last_peered":"2024-05-08T09:25:41.308936+0000","last_clean":"2024-05-08T09:25:41.308936+0000","last_became_active":"2024-05-08T09:22:16.005084+0000","last_became_peered":"2024-05-08T09:22:16.005084+0000","last_unstale":"2024-05-08T09:25:41.308936+0000","last_undegraded":"2024-05-08T09:25:41.308936+0000","last_fullsized":"2024-05-08T09:25:41.308936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:41.308821+0000","last_clean_scrub_stamp":"2024-05-08T09:25:41.308821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:29:15.548516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"29'42","reported_seq":99,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:59.696268+0000","last_change":"2024-05-08T09:24:59.696268+0000","last_active":"2024-05-08T09:24:59.696268+0000","last_peered":"2024-05-08T09:24:59.696268+0000","last_clean":"2024-05-08T09:24:59.696268+0000","last_became_active":"2024-05-08T09:21:34.958996+0000","last_became_peered":"2024-05-08T09:21:34.958996+0000","last_unstale":"2024-05-08T09:24:59.696268+0000","last_undegraded":"2024-05-08T09:24:59.696268+0000","last_fullsized":"2024-05-08T09:24:59.696268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2024-05-08T09:24:59.696053+0000","last_clean_scrub_stamp":"2024-05-08T09:24:59.696053+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:13:58.776407+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":44,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:47.838408+0000","last_change":"2024-05-08T09:24:47.838408+0000","last_active":"2024-05-08T09:24:47.838408+0000","last_peered":"2024-05-08T09:24:47.838408+0000","last_clean":"2024-05-08T09:24:47.838408+0000","last_became_active":"2024-05-08T09:21:36.968141+0000","last_became_peered":"2024-05-08T09:21:36.968141+0000","last_unstale":"2024-05-08T09:24:47.838408+0000","last_undegraded":"2024-05-08T09:24:47.838408+0000","last_fullsized":"2024-05-08T09:24:47.838408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:24:47.838309+0000","last_clean_scrub_stamp":"2024-05-08T09:24:47.838309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:32:42.986914+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"29'6","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:13.533777+0000","last_change":"2024-05-08T09:26:13.533777+0000","last_active":"2024-05-08T09:26:13.533777+0000","last_peered":"2024-05-08T09:26:13.533777+0000","last_clean":"2024-05-08T09:26:13.533777+0000","last_became_active":"2024-05-08T09:21:38.983305+0000","last_became_peered":"2024-05-08T09:21:38.983305+0000","last_unstale":"2024-05-08T09:26:13.533777+0000","last_undegraded":"2024-05-08T09:26:13.533777+0000","last_fullsized":"2024-05-08T09:26:13.533777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:26:13.533661+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:26:13.533661+0000","last_clean_scrub_stamp":"2024-05-08T09:26:13.533661+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:12:00.349502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":413,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"29'2","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:28.888001+0000","last_change":"2024-05-08T09:25:28.888031+0000","last_active":"2024-05-08T09:25:28.888001+0000","last_peered":"2024-05-08T09:25:28.888001+0000","last_clean":"2024-05-08T09:25:28.888001+0000","last_became_active":"2024-05-08T09:21:30.948874+0000","last_became_peered":"2024-05-08T09:21:30.948874+0000","last_unstale":"2024-05-08T09:25:28.888001+0000","last_undegraded":"2024-05-08T09:25:28.888001+0000","last_fullsized":"2024-05-08T09:25:28.888001+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:28.887905+0000","last_clean_scrub_stamp":"2024-05-08T09:25:28.887905+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:55.699403+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:07.513810+0000","last_change":"2024-05-08T09:26:07.513810+0000","last_active":"2024-05-08T09:26:07.513810+0000","last_peered":"2024-05-08T09:26:07.513810+0000","last_clean":"2024-05-08T09:26:07.513810+0000","last_became_active":"2024-05-08T09:21:28.964523+0000","last_became_peered":"2024-05-08T09:21:28.964523+0000","last_unstale":"2024-05-08T09:26:07.513810+0000","last_undegraded":"2024-05-08T09:26:07.513810+0000","last_fullsized":"2024-05-08T09:26:07.513810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:07.513677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:07.513677+0000","last_clean_scrub_stamp":"2024-05-08T09:26:07.513677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:31:18.143185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:46.548811+0000","last_change":"2024-05-08T09:25:46.548867+0000","last_active":"2024-05-08T09:25:46.548811+0000","last_peered":"2024-05-08T09:25:46.548811+0000","last_clean":"2024-05-08T09:25:46.548811+0000","last_became_active":"2024-05-08T09:22:16.002580+0000","last_became_peered":"2024-05-08T09:22:16.002580+0000","last_unstale":"2024-05-08T09:25:46.548811+0000","last_undegraded":"2024-05-08T09:25:46.548811+0000","last_fullsized":"2024-05-08T09:25:46.548811+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:46.548709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:46.548709+0000","last_clean_scrub_stamp":"2024-05-08T09:25:46.548709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:11:28.569601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:19.221077+0000","last_change":"2024-05-08T09:25:19.221077+0000","last_active":"2024-05-08T09:25:19.221077+0000","last_peered":"2024-05-08T09:25:19.221077+0000","last_clean":"2024-05-08T09:25:19.221077+0000","last_became_active":"2024-05-08T09:21:34.967090+0000","last_became_peered":"2024-05-08T09:21:34.967090+0000","last_unstale":"2024-05-08T09:25:19.221077+0000","last_undegraded":"2024-05-08T09:25:19.221077+0000","last_fullsized":"2024-05-08T09:25:19.221077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'15","last_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_deep_scrub":"29'15","last_deep_scrub_stamp":"2024-05-08T09:25:19.220927+0000","last_clean_scrub_stamp":"2024-05-08T09:25:19.220927+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:19.461415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"29'285","reported_seq":388,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:01.309897+0000","last_change":"2024-05-08T09:25:01.309897+0000","last_active":"2024-05-08T09:25:01.309897+0000","last_peered":"2024-05-08T09:25:01.309897+0000","last_clean":"2024-05-08T09:25:01.309897+0000","last_became_active":"2024-05-08T09:21:36.975007+0000","last_became_peered":"2024-05-08T09:21:36.975007+0000","last_unstale":"2024-05-08T09:25:01.309897+0000","last_undegraded":"2024-05-08T09:25:01.309897+0000","last_fullsized":"2024-05-08T09:25:01.309897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'285","last_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_deep_scrub":"29'285","last_deep_scrub_stamp":"2024-05-08T09:25:01.309733+0000","last_clean_scrub_stamp":"2024-05-08T09:25:01.309733+0000","objects_scrubbed":1,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:02:23.863794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:10.557750+0000","last_change":"2024-05-08T09:26:10.557750+0000","last_active":"2024-05-08T09:26:10.557750+0000","last_peered":"2024-05-08T09:26:10.557750+0000","last_clean":"2024-05-08T09:26:10.557750+0000","last_became_active":"2024-05-08T09:21:38.979544+0000","last_became_peered":"2024-05-08T09:21:38.979544+0000","last_unstale":"2024-05-08T09:26:10.557750+0000","last_undegraded":"2024-05-08T09:26:10.557750+0000","last_fullsized":"2024-05-08T09:26:10.557750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:10.557598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:10.557598+0000","last_clean_scrub_stamp":"2024-05-08T09:26:10.557598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:00:43.415145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"29'10","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.354967+0000","last_change":"2024-05-08T09:25:17.354994+0000","last_active":"2024-05-08T09:25:17.354967+0000","last_peered":"2024-05-08T09:25:17.354967+0000","last_clean":"2024-05-08T09:25:17.354967+0000","last_became_active":"2024-05-08T09:21:30.951427+0000","last_became_peered":"2024-05-08T09:21:30.951427+0000","last_unstale":"2024-05-08T09:25:17.354967+0000","last_undegraded":"2024-05-08T09:25:17.354967+0000","last_fullsized":"2024-05-08T09:25:17.354967+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:17.354872+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.354872+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:43:36.638892+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"29'6","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:35.811937+0000","last_change":"2024-05-08T09:25:35.811937+0000","last_active":"2024-05-08T09:25:35.811937+0000","last_peered":"2024-05-08T09:25:35.811937+0000","last_clean":"2024-05-08T09:25:35.811937+0000","last_became_active":"2024-05-08T09:21:28.965945+0000","last_became_peered":"2024-05-08T09:21:28.965945+0000","last_unstale":"2024-05-08T09:25:35.811937+0000","last_undegraded":"2024-05-08T09:25:35.811937+0000","last_fullsized":"2024-05-08T09:25:35.811937+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:35.811764+0000","last_clean_scrub_stamp":"2024-05-08T09:25:35.811764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:18.454322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":10,"num_write":30,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"29'2","reported_seq":230,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:02.708229+0000","last_change":"2024-05-08T09:25:02.708273+0000","last_active":"2024-05-08T09:25:02.708229+0000","last_peered":"2024-05-08T09:25:02.708229+0000","last_clean":"2024-05-08T09:25:02.708229+0000","last_became_active":"2024-05-08T09:21:32.958398+0000","last_became_peered":"2024-05-08T09:21:32.958398+0000","last_unstale":"2024-05-08T09:25:02.708229+0000","last_undegraded":"2024-05-08T09:25:02.708229+0000","last_fullsized":"2024-05-08T09:25:02.708229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:02.708109+0000","last_clean_scrub_stamp":"2024-05-08T09:25:02.708109+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:32:40.664654+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"29'47","reported_seq":106,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:58.785302+0000","last_change":"2024-05-08T09:24:58.785302+0000","last_active":"2024-05-08T09:24:58.785302+0000","last_peered":"2024-05-08T09:24:58.785302+0000","last_clean":"2024-05-08T09:24:58.785302+0000","last_became_active":"2024-05-08T09:21:34.963320+0000","last_became_peered":"2024-05-08T09:21:34.963320+0000","last_unstale":"2024-05-08T09:24:58.785302+0000","last_undegraded":"2024-05-08T09:24:58.785302+0000","last_fullsized":"2024-05-08T09:24:58.785302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'47","last_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_deep_scrub":"29'47","last_deep_scrub_stamp":"2024-05-08T09:24:58.785128+0000","last_clean_scrub_stamp":"2024-05-08T09:24:58.785128+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:47:40.172817+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:00.715835+0000","last_change":"2024-05-08T09:25:00.715835+0000","last_active":"2024-05-08T09:25:00.715835+0000","last_peered":"2024-05-08T09:25:00.715835+0000","last_clean":"2024-05-08T09:25:00.715835+0000","last_became_active":"2024-05-08T09:21:36.973291+0000","last_became_peered":"2024-05-08T09:21:36.973291+0000","last_unstale":"2024-05-08T09:25:00.715835+0000","last_undegraded":"2024-05-08T09:25:00.715835+0000","last_fullsized":"2024-05-08T09:25:00.715835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:00.715715+0000","last_clean_scrub_stamp":"2024-05-08T09:25:00.715715+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:51.307803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:44.607135+0000","last_change":"2024-05-08T09:25:44.607135+0000","last_active":"2024-05-08T09:25:44.607135+0000","last_peered":"2024-05-08T09:25:44.607135+0000","last_clean":"2024-05-08T09:25:44.607135+0000","last_became_active":"2024-05-08T09:21:38.986538+0000","last_became_peered":"2024-05-08T09:21:38.986538+0000","last_unstale":"2024-05-08T09:25:44.607135+0000","last_undegraded":"2024-05-08T09:25:44.607135+0000","last_fullsized":"2024-05-08T09:25:44.607135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:44.607026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:44.607026+0000","last_clean_scrub_stamp":"2024-05-08T09:25:44.607026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:56:07.868199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.293530+0000","last_change":"2024-05-08T09:25:12.293561+0000","last_active":"2024-05-08T09:25:12.293530+0000","last_peered":"2024-05-08T09:25:12.293530+0000","last_clean":"2024-05-08T09:25:12.293530+0000","last_became_active":"2024-05-08T09:21:30.944775+0000","last_became_peered":"2024-05-08T09:21:30.944775+0000","last_unstale":"2024-05-08T09:25:12.293530+0000","last_undegraded":"2024-05-08T09:25:12.293530+0000","last_fullsized":"2024-05-08T09:25:12.293530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:12.293425+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.293425+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:22:06.522385+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.224899+0000","last_change":"2024-05-08T09:25:48.224899+0000","last_active":"2024-05-08T09:25:48.224899+0000","last_peered":"2024-05-08T09:25:48.224899+0000","last_clean":"2024-05-08T09:25:48.224899+0000","last_became_active":"2024-05-08T09:21:28.967779+0000","last_became_peered":"2024-05-08T09:21:28.967779+0000","last_unstale":"2024-05-08T09:25:48.224899+0000","last_undegraded":"2024-05-08T09:25:48.224899+0000","last_fullsized":"2024-05-08T09:25:48.224899+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:48.224772+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:48.224772+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.224772+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:25:47.449327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:04.325599+0000","last_change":"2024-05-08T09:25:04.325623+0000","last_active":"2024-05-08T09:25:04.325599+0000","last_peered":"2024-05-08T09:25:04.325599+0000","last_clean":"2024-05-08T09:25:04.325599+0000","last_became_active":"2024-05-08T09:21:32.955977+0000","last_became_peered":"2024-05-08T09:21:32.955977+0000","last_unstale":"2024-05-08T09:25:04.325599+0000","last_undegraded":"2024-05-08T09:25:04.325599+0000","last_fullsized":"2024-05-08T09:25:04.325599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:04.325510+0000","last_clean_scrub_stamp":"2024-05-08T09:25:04.325510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:21:04.445305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"29'36","reported_seq":92,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:24:55.725187+0000","last_change":"2024-05-08T09:24:55.725187+0000","last_active":"2024-05-08T09:24:55.725187+0000","last_peered":"2024-05-08T09:24:55.725187+0000","last_clean":"2024-05-08T09:24:55.725187+0000","last_became_active":"2024-05-08T09:21:34.962305+0000","last_became_peered":"2024-05-08T09:21:34.962305+0000","last_unstale":"2024-05-08T09:24:55.725187+0000","last_undegraded":"2024-05-08T09:24:55.725187+0000","last_fullsized":"2024-05-08T09:24:55.725187+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2024-05-08T09:24:55.725057+0000","last_clean_scrub_stamp":"2024-05-08T09:24:55.725057+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:15:11.134393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.242631+0000","last_change":"2024-05-08T09:25:13.242631+0000","last_active":"2024-05-08T09:25:13.242631+0000","last_peered":"2024-05-08T09:25:13.242631+0000","last_clean":"2024-05-08T09:25:13.242631+0000","last_became_active":"2024-05-08T09:21:36.975208+0000","last_became_peered":"2024-05-08T09:21:36.975208+0000","last_unstale":"2024-05-08T09:25:13.242631+0000","last_undegraded":"2024-05-08T09:25:13.242631+0000","last_fullsized":"2024-05-08T09:25:13.242631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:13.242515+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.242515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:24.570077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:15.497946+0000","last_change":"2024-05-08T09:26:15.497946+0000","last_active":"2024-05-08T09:26:15.497946+0000","last_peered":"2024-05-08T09:26:15.497946+0000","last_clean":"2024-05-08T09:26:15.497946+0000","last_became_active":"2024-05-08T09:21:38.986395+0000","last_became_peered":"2024-05-08T09:21:38.986395+0000","last_unstale":"2024-05-08T09:26:15.497946+0000","last_undegraded":"2024-05-08T09:26:15.497946+0000","last_fullsized":"2024-05-08T09:26:15.497946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:15.497818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:15.497818+0000","last_clean_scrub_stamp":"2024-05-08T09:26:15.497818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:16:37.420082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.227646+0000","last_change":"2024-05-08T09:25:39.227646+0000","last_active":"2024-05-08T09:25:39.227646+0000","last_peered":"2024-05-08T09:25:39.227646+0000","last_clean":"2024-05-08T09:25:39.227646+0000","last_became_active":"2024-05-08T09:21:30.953346+0000","last_became_peered":"2024-05-08T09:21:30.953346+0000","last_unstale":"2024-05-08T09:25:39.227646+0000","last_undegraded":"2024-05-08T09:25:39.227646+0000","last_fullsized":"2024-05-08T09:25:39.227646+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:39.227532+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.227532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:48:33.902172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.018533+0000","last_change":"2024-05-08T09:25:42.018579+0000","last_active":"2024-05-08T09:25:42.018533+0000","last_peered":"2024-05-08T09:25:42.018533+0000","last_clean":"2024-05-08T09:25:42.018533+0000","last_became_active":"2024-05-08T09:21:28.957242+0000","last_became_peered":"2024-05-08T09:21:28.957242+0000","last_unstale":"2024-05-08T09:25:42.018533+0000","last_undegraded":"2024-05-08T09:25:42.018533+0000","last_fullsized":"2024-05-08T09:25:42.018533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:42.018441+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.018441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:36:20.667622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:09.710589+0000","last_change":"2024-05-08T09:25:09.710589+0000","last_active":"2024-05-08T09:25:09.710589+0000","last_peered":"2024-05-08T09:25:09.710589+0000","last_clean":"2024-05-08T09:25:09.710589+0000","last_became_active":"2024-05-08T09:21:32.952064+0000","last_became_peered":"2024-05-08T09:21:32.952064+0000","last_unstale":"2024-05-08T09:25:09.710589+0000","last_undegraded":"2024-05-08T09:25:09.710589+0000","last_fullsized":"2024-05-08T09:25:09.710589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:09.710445+0000","last_clean_scrub_stamp":"2024-05-08T09:25:09.710445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:39.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"29'30","reported_seq":83,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:06.024510+0000","last_change":"2024-05-08T09:25:06.024545+0000","last_active":"2024-05-08T09:25:06.024510+0000","last_peered":"2024-05-08T09:25:06.024510+0000","last_clean":"2024-05-08T09:25:06.024510+0000","last_became_active":"2024-05-08T09:21:34.964053+0000","last_became_peered":"2024-05-08T09:21:34.964053+0000","last_unstale":"2024-05-08T09:25:06.024510+0000","last_undegraded":"2024-05-08T09:25:06.024510+0000","last_fullsized":"2024-05-08T09:25:06.024510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2024-05-08T09:25:06.024416+0000","last_clean_scrub_stamp":"2024-05-08T09:25:06.024416+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:05.508652+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:12.219331+0000","last_change":"2024-05-08T09:25:12.219351+0000","last_active":"2024-05-08T09:25:12.219331+0000","last_peered":"2024-05-08T09:25:12.219331+0000","last_clean":"2024-05-08T09:25:12.219331+0000","last_became_active":"2024-05-08T09:21:36.978144+0000","last_became_peered":"2024-05-08T09:21:36.978144+0000","last_unstale":"2024-05-08T09:25:12.219331+0000","last_undegraded":"2024-05-08T09:25:12.219331+0000","last_fullsized":"2024-05-08T09:25:12.219331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:12.219227+0000","last_clean_scrub_stamp":"2024-05-08T09:25:12.219227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:56:57.964012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:14.504174+0000","last_change":"2024-05-08T09:26:14.504174+0000","last_active":"2024-05-08T09:26:14.504174+0000","last_peered":"2024-05-08T09:26:14.504174+0000","last_clean":"2024-05-08T09:26:14.504174+0000","last_became_active":"2024-05-08T09:21:38.986489+0000","last_became_peered":"2024-05-08T09:21:38.986489+0000","last_unstale":"2024-05-08T09:26:14.504174+0000","last_undegraded":"2024-05-08T09:26:14.504174+0000","last_fullsized":"2024-05-08T09:26:14.504174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:26:14.504057+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:26:14.504057+0000","last_clean_scrub_stamp":"2024-05-08T09:26:14.504057+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:49:20.716377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"29'12","reported_seq":79,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:11.291213+0000","last_change":"2024-05-08T09:25:11.291213+0000","last_active":"2024-05-08T09:25:11.291213+0000","last_peered":"2024-05-08T09:25:11.291213+0000","last_clean":"2024-05-08T09:25:11.291213+0000","last_became_active":"2024-05-08T09:21:30.945127+0000","last_became_peered":"2024-05-08T09:21:30.945127+0000","last_unstale":"2024-05-08T09:25:11.291213+0000","last_undegraded":"2024-05-08T09:25:11.291213+0000","last_fullsized":"2024-05-08T09:25:11.291213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:11.291068+0000","last_clean_scrub_stamp":"2024-05-08T09:25:11.291068+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:14:10.371422+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":47,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.760346+0000","last_change":"2024-05-08T09:25:29.760346+0000","last_active":"2024-05-08T09:25:29.760346+0000","last_peered":"2024-05-08T09:25:29.760346+0000","last_clean":"2024-05-08T09:25:29.760346+0000","last_became_active":"2024-05-08T09:21:28.974578+0000","last_became_peered":"2024-05-08T09:21:28.974578+0000","last_unstale":"2024-05-08T09:25:29.760346+0000","last_undegraded":"2024-05-08T09:25:29.760346+0000","last_fullsized":"2024-05-08T09:25:29.760346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.760187+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.760187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:41:56.571684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"29'3","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:05.744126+0000","last_change":"2024-05-08T09:25:05.744126+0000","last_active":"2024-05-08T09:25:05.744126+0000","last_peered":"2024-05-08T09:25:05.744126+0000","last_clean":"2024-05-08T09:25:05.744126+0000","last_became_active":"2024-05-08T09:21:32.956706+0000","last_became_peered":"2024-05-08T09:21:32.956706+0000","last_unstale":"2024-05-08T09:25:05.744126+0000","last_undegraded":"2024-05-08T09:25:05.744126+0000","last_fullsized":"2024-05-08T09:25:05.744126+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2024-05-08T09:25:05.743972+0000","last_clean_scrub_stamp":"2024-05-08T09:25:05.743972+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:56.764860+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"29'40","reported_seq":97,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:21.247188+0000","last_change":"2024-05-08T09:25:21.247244+0000","last_active":"2024-05-08T09:25:21.247188+0000","last_peered":"2024-05-08T09:25:21.247188+0000","last_clean":"2024-05-08T09:25:21.247188+0000","last_became_active":"2024-05-08T09:21:34.965537+0000","last_became_peered":"2024-05-08T09:21:34.965537+0000","last_unstale":"2024-05-08T09:25:21.247188+0000","last_undegraded":"2024-05-08T09:25:21.247188+0000","last_fullsized":"2024-05-08T09:25:21.247188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'40","last_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_deep_scrub":"29'40","last_deep_scrub_stamp":"2024-05-08T09:25:21.247063+0000","last_clean_scrub_stamp":"2024-05-08T09:25:21.247063+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:38:06.940266+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1138,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.806517+0000","last_change":"2024-05-08T09:25:08.806540+0000","last_active":"2024-05-08T09:25:08.806517+0000","last_peered":"2024-05-08T09:25:08.806517+0000","last_clean":"2024-05-08T09:25:08.806517+0000","last_became_active":"2024-05-08T09:21:36.973179+0000","last_became_peered":"2024-05-08T09:21:36.973179+0000","last_unstale":"2024-05-08T09:25:08.806517+0000","last_undegraded":"2024-05-08T09:25:08.806517+0000","last_fullsized":"2024-05-08T09:25:08.806517+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:08.806424+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.806424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:51:38.700044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"29'2","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:11.594180+0000","last_change":"2024-05-08T09:26:11.594180+0000","last_active":"2024-05-08T09:26:11.594180+0000","last_peered":"2024-05-08T09:26:11.594180+0000","last_clean":"2024-05-08T09:26:11.594180+0000","last_became_active":"2024-05-08T09:21:38.979652+0000","last_became_peered":"2024-05-08T09:21:38.979652+0000","last_unstale":"2024-05-08T09:26:11.594180+0000","last_undegraded":"2024-05-08T09:26:11.594180+0000","last_fullsized":"2024-05-08T09:26:11.594180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:26:11.594021+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:26:11.594021+0000","last_clean_scrub_stamp":"2024-05-08T09:26:11.594021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:04:10.297732+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"29'14","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:13.775263+0000","last_change":"2024-05-08T09:25:13.775263+0000","last_active":"2024-05-08T09:25:13.775263+0000","last_peered":"2024-05-08T09:25:13.775263+0000","last_clean":"2024-05-08T09:25:13.775263+0000","last_became_active":"2024-05-08T09:21:30.954456+0000","last_became_peered":"2024-05-08T09:21:30.954456+0000","last_unstale":"2024-05-08T09:25:13.775263+0000","last_undegraded":"2024-05-08T09:25:13.775263+0000","last_fullsized":"2024-05-08T09:25:13.775263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'14","last_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_deep_scrub":"29'14","last_deep_scrub_stamp":"2024-05-08T09:25:13.775111+0000","last_clean_scrub_stamp":"2024-05-08T09:25:13.775111+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:52:47.093763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":34,"num_write":17,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:22.313018+0000","last_change":"2024-05-08T09:25:22.313018+0000","last_active":"2024-05-08T09:25:22.313018+0000","last_peered":"2024-05-08T09:25:22.313018+0000","last_clean":"2024-05-08T09:25:22.313018+0000","last_became_active":"2024-05-08T09:21:28.973817+0000","last_became_peered":"2024-05-08T09:21:28.973817+0000","last_unstale":"2024-05-08T09:25:22.313018+0000","last_undegraded":"2024-05-08T09:25:22.313018+0000","last_fullsized":"2024-05-08T09:25:22.313018+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:22.312893+0000","last_clean_scrub_stamp":"2024-05-08T09:25:22.312893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:44.206369+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"29'4","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.981937+0000","last_change":"2024-05-08T09:25:30.981937+0000","last_active":"2024-05-08T09:25:30.981937+0000","last_peered":"2024-05-08T09:25:30.981937+0000","last_clean":"2024-05-08T09:25:30.981937+0000","last_became_active":"2024-05-08T09:21:30.949059+0000","last_became_peered":"2024-05-08T09:21:30.949059+0000","last_unstale":"2024-05-08T09:25:30.981937+0000","last_undegraded":"2024-05-08T09:25:30.981937+0000","last_fullsized":"2024-05-08T09:25:30.981937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:30.981798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.981798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:57:42.309360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.933548+0000","last_change":"2024-05-08T09:25:29.933548+0000","last_active":"2024-05-08T09:25:29.933548+0000","last_peered":"2024-05-08T09:25:29.933548+0000","last_clean":"2024-05-08T09:25:29.933548+0000","last_became_active":"2024-05-08T09:21:28.961416+0000","last_became_peered":"2024-05-08T09:21:28.961416+0000","last_unstale":"2024-05-08T09:25:29.933548+0000","last_undegraded":"2024-05-08T09:25:29.933548+0000","last_fullsized":"2024-05-08T09:25:29.933548+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:29.933418+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.933418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:15.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:08.095458+0000","last_change":"2024-05-08T09:25:08.095458+0000","last_active":"2024-05-08T09:25:08.095458+0000","last_peered":"2024-05-08T09:25:08.095458+0000","last_clean":"2024-05-08T09:25:08.095458+0000","last_became_active":"2024-05-08T09:21:30.959641+0000","last_became_peered":"2024-05-08T09:21:30.959641+0000","last_unstale":"2024-05-08T09:25:08.095458+0000","last_undegraded":"2024-05-08T09:25:08.095458+0000","last_fullsized":"2024-05-08T09:25:08.095458+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:08.095295+0000","last_clean_scrub_stamp":"2024-05-08T09:25:08.095295+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:36.538089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:56.365377+0000","last_change":"2024-05-08T09:25:56.365418+0000","last_active":"2024-05-08T09:25:56.365377+0000","last_peered":"2024-05-08T09:25:56.365377+0000","last_clean":"2024-05-08T09:25:56.365377+0000","last_became_active":"2024-05-08T09:21:28.976392+0000","last_became_peered":"2024-05-08T09:21:28.976392+0000","last_unstale":"2024-05-08T09:25:56.365377+0000","last_undegraded":"2024-05-08T09:25:56.365377+0000","last_fullsized":"2024-05-08T09:25:56.365377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:56.365265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:56.365265+0000","last_clean_scrub_stamp":"2024-05-08T09:25:56.365265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:58.811599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'12","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:43.024069+0000","last_change":"2024-05-08T09:25:43.024069+0000","last_active":"2024-05-08T09:25:43.024069+0000","last_peered":"2024-05-08T09:25:43.024069+0000","last_clean":"2024-05-08T09:25:43.024069+0000","last_became_active":"2024-05-08T09:21:30.949359+0000","last_became_peered":"2024-05-08T09:21:30.949359+0000","last_unstale":"2024-05-08T09:25:43.024069+0000","last_undegraded":"2024-05-08T09:25:43.024069+0000","last_fullsized":"2024-05-08T09:25:43.024069+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'12","last_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_deep_scrub":"29'12","last_deep_scrub_stamp":"2024-05-08T09:25:43.023920+0000","last_clean_scrub_stamp":"2024-05-08T09:25:43.023920+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:20:28.250979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:27.935517+0000","last_change":"2024-05-08T09:25:27.935517+0000","last_active":"2024-05-08T09:25:27.935517+0000","last_peered":"2024-05-08T09:25:27.935517+0000","last_clean":"2024-05-08T09:25:27.935517+0000","last_became_active":"2024-05-08T09:21:28.961336+0000","last_became_peered":"2024-05-08T09:21:28.961336+0000","last_unstale":"2024-05-08T09:25:27.935517+0000","last_undegraded":"2024-05-08T09:25:27.935517+0000","last_fullsized":"2024-05-08T09:25:27.935517+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:27.935400+0000","last_clean_scrub_stamp":"2024-05-08T09:25:27.935400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:36:21.480937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"29'2","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:15.864386+0000","last_change":"2024-05-08T09:25:15.864386+0000","last_active":"2024-05-08T09:25:15.864386+0000","last_peered":"2024-05-08T09:25:15.864386+0000","last_clean":"2024-05-08T09:25:15.864386+0000","last_became_active":"2024-05-08T09:21:30.953120+0000","last_became_peered":"2024-05-08T09:21:30.953120+0000","last_unstale":"2024-05-08T09:25:15.864386+0000","last_undegraded":"2024-05-08T09:25:15.864386+0000","last_fullsized":"2024-05-08T09:25:15.864386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:15.864275+0000","last_clean_scrub_stamp":"2024-05-08T09:25:15.864275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:59.244834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.043863+0000","last_change":"2024-05-08T09:25:37.043863+0000","last_active":"2024-05-08T09:25:37.043863+0000","last_peered":"2024-05-08T09:25:37.043863+0000","last_clean":"2024-05-08T09:25:37.043863+0000","last_became_active":"2024-05-08T09:21:28.949524+0000","last_became_peered":"2024-05-08T09:21:28.949524+0000","last_unstale":"2024-05-08T09:25:37.043863+0000","last_undegraded":"2024-05-08T09:25:37.043863+0000","last_fullsized":"2024-05-08T09:25:37.043863+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:37.043737+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.043737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T19:16:37.284226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:14.793928+0000","last_change":"2024-05-08T09:25:14.793928+0000","last_active":"2024-05-08T09:25:14.793928+0000","last_peered":"2024-05-08T09:25:14.793928+0000","last_clean":"2024-05-08T09:25:14.793928+0000","last_became_active":"2024-05-08T09:21:30.954032+0000","last_became_peered":"2024-05-08T09:21:30.954032+0000","last_unstale":"2024-05-08T09:25:14.793928+0000","last_undegraded":"2024-05-08T09:25:14.793928+0000","last_fullsized":"2024-05-08T09:25:14.793928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:14.793800+0000","last_clean_scrub_stamp":"2024-05-08T09:25:14.793800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:42.341391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"27'2","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:39.686004+0000","last_change":"2024-05-08T09:25:39.686004+0000","last_active":"2024-05-08T09:25:39.686004+0000","last_peered":"2024-05-08T09:25:39.686004+0000","last_clean":"2024-05-08T09:25:39.686004+0000","last_became_active":"2024-05-08T09:21:28.973755+0000","last_became_peered":"2024-05-08T09:21:28.973755+0000","last_unstale":"2024-05-08T09:25:39.686004+0000","last_undegraded":"2024-05-08T09:25:39.686004+0000","last_fullsized":"2024-05-08T09:25:39.686004+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:39.685820+0000","last_clean_scrub_stamp":"2024-05-08T09:25:39.685820+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:49:08.938034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"29'10","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.897362+0000","last_change":"2024-05-08T09:25:20.897362+0000","last_active":"2024-05-08T09:25:20.897362+0000","last_peered":"2024-05-08T09:25:20.897362+0000","last_clean":"2024-05-08T09:25:20.897362+0000","last_became_active":"2024-05-08T09:21:30.943570+0000","last_became_peered":"2024-05-08T09:21:30.943570+0000","last_unstale":"2024-05-08T09:25:20.897362+0000","last_undegraded":"2024-05-08T09:25:20.897362+0000","last_fullsized":"2024-05-08T09:25:20.897362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:20.897248+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.897248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:33:45.128802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"27'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.310379+0000","last_change":"2024-05-08T09:25:20.310379+0000","last_active":"2024-05-08T09:25:20.310379+0000","last_peered":"2024-05-08T09:25:20.310379+0000","last_clean":"2024-05-08T09:25:20.310379+0000","last_became_active":"2024-05-08T09:21:28.973641+0000","last_became_peered":"2024-05-08T09:21:28.973641+0000","last_unstale":"2024-05-08T09:25:20.310379+0000","last_undegraded":"2024-05-08T09:25:20.310379+0000","last_fullsized":"2024-05-08T09:25:20.310379+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:20.310253+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.310253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:13:14.532102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"29'10","reported_seq":88,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:30.739969+0000","last_change":"2024-05-08T09:25:30.739969+0000","last_active":"2024-05-08T09:25:30.739969+0000","last_peered":"2024-05-08T09:25:30.739969+0000","last_clean":"2024-05-08T09:25:30.739969+0000","last_became_active":"2024-05-08T09:21:30.948348+0000","last_became_peered":"2024-05-08T09:21:30.948348+0000","last_unstale":"2024-05-08T09:25:30.739969+0000","last_undegraded":"2024-05-08T09:25:30.739969+0000","last_fullsized":"2024-05-08T09:25:30.739969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:30.739841+0000","last_clean_scrub_stamp":"2024-05-08T09:25:30.739841+0000","objects_scrubbed":1,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:57:16.484626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.034958+0000","last_change":"2024-05-08T09:25:40.034958+0000","last_active":"2024-05-08T09:25:40.034958+0000","last_peered":"2024-05-08T09:25:40.034958+0000","last_clean":"2024-05-08T09:25:40.034958+0000","last_became_active":"2024-05-08T09:21:28.953775+0000","last_became_peered":"2024-05-08T09:21:28.953775+0000","last_unstale":"2024-05-08T09:25:40.034958+0000","last_undegraded":"2024-05-08T09:25:40.034958+0000","last_fullsized":"2024-05-08T09:25:40.034958+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:40.034807+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.034807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.084734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"29'8","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:24.805478+0000","last_change":"2024-05-08T09:25:24.805478+0000","last_active":"2024-05-08T09:25:24.805478+0000","last_peered":"2024-05-08T09:25:24.805478+0000","last_clean":"2024-05-08T09:25:24.805478+0000","last_became_active":"2024-05-08T09:21:30.946142+0000","last_became_peered":"2024-05-08T09:21:30.946142+0000","last_unstale":"2024-05-08T09:25:24.805478+0000","last_undegraded":"2024-05-08T09:25:24.805478+0000","last_fullsized":"2024-05-08T09:25:24.805478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'8","last_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_deep_scrub":"29'8","last_deep_scrub_stamp":"2024-05-08T09:25:24.805324+0000","last_clean_scrub_stamp":"2024-05-08T09:25:24.805324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:08:24.289560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"29'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:08.513654+0000","last_change":"2024-05-08T09:26:08.513684+0000","last_active":"2024-05-08T09:26:08.513654+0000","last_peered":"2024-05-08T09:26:08.513654+0000","last_clean":"2024-05-08T09:26:08.513654+0000","last_became_active":"2024-05-08T09:21:28.977269+0000","last_became_peered":"2024-05-08T09:21:28.977269+0000","last_unstale":"2024-05-08T09:26:08.513654+0000","last_undegraded":"2024-05-08T09:26:08.513654+0000","last_fullsized":"2024-05-08T09:26:08.513654+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:26:08.513558+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:26:08.513558+0000","last_clean_scrub_stamp":"2024-05-08T09:26:08.513558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:08:05.531156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"29'2","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:29.202792+0000","last_change":"2024-05-08T09:25:29.202792+0000","last_active":"2024-05-08T09:25:29.202792+0000","last_peered":"2024-05-08T09:25:29.202792+0000","last_clean":"2024-05-08T09:25:29.202792+0000","last_became_active":"2024-05-08T09:21:30.957472+0000","last_became_peered":"2024-05-08T09:21:30.957472+0000","last_unstale":"2024-05-08T09:25:29.202792+0000","last_undegraded":"2024-05-08T09:25:29.202792+0000","last_fullsized":"2024-05-08T09:25:29.202792+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:29.202666+0000","last_clean_scrub_stamp":"2024-05-08T09:25:29.202666+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:30:43.872232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:34.005000+0000","last_change":"2024-05-08T09:25:34.005000+0000","last_active":"2024-05-08T09:25:34.005000+0000","last_peered":"2024-05-08T09:25:34.005000+0000","last_clean":"2024-05-08T09:25:34.005000+0000","last_became_active":"2024-05-08T09:21:28.960715+0000","last_became_peered":"2024-05-08T09:21:28.960715+0000","last_unstale":"2024-05-08T09:25:34.005000+0000","last_undegraded":"2024-05-08T09:25:34.005000+0000","last_fullsized":"2024-05-08T09:25:34.005000+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:34.004850+0000","last_clean_scrub_stamp":"2024-05-08T09:25:34.004850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:12:45.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"27'2","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:17.880714+0000","last_change":"2024-05-08T09:25:17.880714+0000","last_active":"2024-05-08T09:25:17.880714+0000","last_peered":"2024-05-08T09:25:17.880714+0000","last_clean":"2024-05-08T09:25:17.880714+0000","last_became_active":"2024-05-08T09:21:30.952925+0000","last_became_peered":"2024-05-08T09:21:30.952925+0000","last_unstale":"2024-05-08T09:25:17.880714+0000","last_undegraded":"2024-05-08T09:25:17.880714+0000","last_fullsized":"2024-05-08T09:25:17.880714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:17.880592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:17.880592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:00:12.052981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:38.707011+0000","last_change":"2024-05-08T09:25:38.707011+0000","last_active":"2024-05-08T09:25:38.707011+0000","last_peered":"2024-05-08T09:25:38.707011+0000","last_clean":"2024-05-08T09:25:38.707011+0000","last_became_active":"2024-05-08T09:21:28.972650+0000","last_became_peered":"2024-05-08T09:21:28.972650+0000","last_unstale":"2024-05-08T09:25:38.707011+0000","last_undegraded":"2024-05-08T09:25:38.707011+0000","last_fullsized":"2024-05-08T09:25:38.707011+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:38.706857+0000","last_clean_scrub_stamp":"2024-05-08T09:25:38.706857+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:17:39.516277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"29'18","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:20.831519+0000","last_change":"2024-05-08T09:25:20.831519+0000","last_active":"2024-05-08T09:25:20.831519+0000","last_peered":"2024-05-08T09:25:20.831519+0000","last_clean":"2024-05-08T09:25:20.831519+0000","last_became_active":"2024-05-08T09:21:30.943260+0000","last_became_peered":"2024-05-08T09:21:30.943260+0000","last_unstale":"2024-05-08T09:25:20.831519+0000","last_undegraded":"2024-05-08T09:25:20.831519+0000","last_fullsized":"2024-05-08T09:25:20.831519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'18","last_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_deep_scrub":"29'18","last_deep_scrub_stamp":"2024-05-08T09:25:20.831407+0000","last_clean_scrub_stamp":"2024-05-08T09:25:20.831407+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:00:36.603443+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"29'4","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:40.697924+0000","last_change":"2024-05-08T09:25:40.697924+0000","last_active":"2024-05-08T09:25:40.697924+0000","last_peered":"2024-05-08T09:25:40.697924+0000","last_clean":"2024-05-08T09:25:40.697924+0000","last_became_active":"2024-05-08T09:21:28.972625+0000","last_became_peered":"2024-05-08T09:21:28.972625+0000","last_unstale":"2024-05-08T09:25:40.697924+0000","last_undegraded":"2024-05-08T09:25:40.697924+0000","last_fullsized":"2024-05-08T09:25:40.697924+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:40.697798+0000","last_clean_scrub_stamp":"2024-05-08T09:25:40.697798+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:50:19.747725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:48.534061+0000","last_change":"2024-05-08T09:25:48.534061+0000","last_active":"2024-05-08T09:25:48.534061+0000","last_peered":"2024-05-08T09:25:48.534061+0000","last_clean":"2024-05-08T09:25:48.534061+0000","last_became_active":"2024-05-08T09:22:16.003139+0000","last_became_peered":"2024-05-08T09:22:16.003139+0000","last_unstale":"2024-05-08T09:25:48.534061+0000","last_undegraded":"2024-05-08T09:25:48.534061+0000","last_fullsized":"2024-05-08T09:25:48.534061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:48.533944+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:48.533944+0000","last_clean_scrub_stamp":"2024-05-08T09:25:48.533944+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:22.810576+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"27'2","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.273362+0000","last_change":"2024-05-08T09:25:47.273362+0000","last_active":"2024-05-08T09:25:47.273362+0000","last_peered":"2024-05-08T09:25:47.273362+0000","last_clean":"2024-05-08T09:25:47.273362+0000","last_became_active":"2024-05-08T09:21:28.965487+0000","last_became_peered":"2024-05-08T09:21:28.965487+0000","last_unstale":"2024-05-08T09:25:47.273362+0000","last_undegraded":"2024-05-08T09:25:47.273362+0000","last_fullsized":"2024-05-08T09:25:47.273362+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-08T09:25:47.273233+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-08T09:25:47.273233+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.273233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T20:17:56.758718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"29'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.842788+0000","last_change":"2024-05-08T09:25:26.842788+0000","last_active":"2024-05-08T09:25:26.842788+0000","last_peered":"2024-05-08T09:25:26.842788+0000","last_clean":"2024-05-08T09:25:26.842788+0000","last_became_active":"2024-05-08T09:21:30.946593+0000","last_became_peered":"2024-05-08T09:21:30.946593+0000","last_unstale":"2024-05-08T09:25:26.842788+0000","last_undegraded":"2024-05-08T09:25:26.842788+0000","last_fullsized":"2024-05-08T09:25:26.842788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.842617+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.842617+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:55.285411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:52.301182+0000","last_change":"2024-05-08T09:25:52.301182+0000","last_active":"2024-05-08T09:25:52.301182+0000","last_peered":"2024-05-08T09:25:52.301182+0000","last_clean":"2024-05-08T09:25:52.301182+0000","last_became_active":"2024-05-08T09:21:28.969171+0000","last_became_peered":"2024-05-08T09:21:28.969171+0000","last_unstale":"2024-05-08T09:25:52.301182+0000","last_undegraded":"2024-05-08T09:25:52.301182+0000","last_fullsized":"2024-05-08T09:25:52.301182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:52.301017+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:52.301017+0000","last_clean_scrub_stamp":"2024-05-08T09:25:52.301017+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:20:52.755879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"29'2","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:37.262733+0000","last_change":"2024-05-08T09:25:37.262733+0000","last_active":"2024-05-08T09:25:37.262733+0000","last_peered":"2024-05-08T09:25:37.262733+0000","last_clean":"2024-05-08T09:25:37.262733+0000","last_became_active":"2024-05-08T09:21:30.953387+0000","last_became_peered":"2024-05-08T09:21:30.953387+0000","last_unstale":"2024-05-08T09:25:37.262733+0000","last_undegraded":"2024-05-08T09:25:37.262733+0000","last_fullsized":"2024-05-08T09:25:37.262733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2024-05-08T09:25:37.262592+0000","last_clean_scrub_stamp":"2024-05-08T09:25:37.262592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:07:56.810421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"29'4","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:31.308585+0000","last_change":"2024-05-08T09:25:31.308585+0000","last_active":"2024-05-08T09:25:31.308585+0000","last_peered":"2024-05-08T09:25:31.308585+0000","last_clean":"2024-05-08T09:25:31.308585+0000","last_became_active":"2024-05-08T09:21:28.967616+0000","last_became_peered":"2024-05-08T09:21:28.967616+0000","last_unstale":"2024-05-08T09:25:31.308585+0000","last_undegraded":"2024-05-08T09:25:31.308585+0000","last_fullsized":"2024-05-08T09:25:31.308585+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2024-05-08T09:25:31.308462+0000","last_clean_scrub_stamp":"2024-05-08T09:25:31.308462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:57:24.993949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"29'10","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:42.634475+0000","last_change":"2024-05-08T09:25:42.634475+0000","last_active":"2024-05-08T09:25:42.634475+0000","last_peered":"2024-05-08T09:25:42.634475+0000","last_clean":"2024-05-08T09:25:42.634475+0000","last_became_active":"2024-05-08T09:21:30.948983+0000","last_became_peered":"2024-05-08T09:21:30.948983+0000","last_unstale":"2024-05-08T09:25:42.634475+0000","last_undegraded":"2024-05-08T09:25:42.634475+0000","last_fullsized":"2024-05-08T09:25:42.634475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'10","last_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_deep_scrub":"29'10","last_deep_scrub_stamp":"2024-05-08T09:25:42.634357+0000","last_clean_scrub_stamp":"2024-05-08T09:25:42.634357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T18:48:42.116651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":37,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:06.483413+0000","last_change":"2024-05-08T09:26:06.483413+0000","last_active":"2024-05-08T09:26:06.483413+0000","last_peered":"2024-05-08T09:26:06.483413+0000","last_clean":"2024-05-08T09:26:06.483413+0000","last_became_active":"2024-05-08T09:21:28.964353+0000","last_became_peered":"2024-05-08T09:21:28.964353+0000","last_unstale":"2024-05-08T09:26:06.483413+0000","last_undegraded":"2024-05-08T09:26:06.483413+0000","last_fullsized":"2024-05-08T09:26:06.483413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:26:06.483261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:26:06.483261+0000","last_clean_scrub_stamp":"2024-05-08T09:26:06.483261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:55:03.871425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"29'6","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:26:05.465938+0000","last_change":"2024-05-08T09:26:05.465938+0000","last_active":"2024-05-08T09:26:05.465938+0000","last_peered":"2024-05-08T09:26:05.465938+0000","last_clean":"2024-05-08T09:26:05.465938+0000","last_became_active":"2024-05-08T09:21:28.961876+0000","last_became_peered":"2024-05-08T09:21:28.961876+0000","last_unstale":"2024-05-08T09:26:05.465938+0000","last_undegraded":"2024-05-08T09:26:05.465938+0000","last_fullsized":"2024-05-08T09:26:05.465938+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:26:05.465764+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:26:05.465764+0000","last_clean_scrub_stamp":"2024-05-08T09:26:05.465764+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:48:25.114806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":7,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"27'4","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:26.956419+0000","last_change":"2024-05-08T09:25:26.956419+0000","last_active":"2024-05-08T09:25:26.956419+0000","last_peered":"2024-05-08T09:25:26.956419+0000","last_clean":"2024-05-08T09:25:26.956419+0000","last_became_active":"2024-05-08T09:21:30.948510+0000","last_became_peered":"2024-05-08T09:21:30.948510+0000","last_unstale":"2024-05-08T09:25:26.956419+0000","last_undegraded":"2024-05-08T09:25:26.956419+0000","last_fullsized":"2024-05-08T09:25:26.956419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-08T09:25:26.956297+0000","last_clean_scrub_stamp":"2024-05-08T09:25:26.956297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:20.313021+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:32.008527+0000","last_change":"2024-05-08T09:25:32.008527+0000","last_active":"2024-05-08T09:25:32.008527+0000","last_peered":"2024-05-08T09:25:32.008527+0000","last_clean":"2024-05-08T09:25:32.008527+0000","last_became_active":"2024-05-08T09:21:28.960878+0000","last_became_peered":"2024-05-08T09:21:28.960878+0000","last_unstale":"2024-05-08T09:25:32.008527+0000","last_undegraded":"2024-05-08T09:25:32.008527+0000","last_fullsized":"2024-05-08T09:25:32.008527+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T09:25:32.008402+0000","last_clean_scrub_stamp":"2024-05-08T09:25:32.008402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:03:22.700119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'6","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-05-08T09:25:47.534995+0000","last_change":"2024-05-08T09:25:47.534995+0000","last_active":"2024-05-08T09:25:47.534995+0000","last_peered":"2024-05-08T09:25:47.534995+0000","last_clean":"2024-05-08T09:25:47.534995+0000","last_became_active":"2024-05-08T09:22:16.004049+0000","last_became_peered":"2024-05-08T09:22:16.004049+0000","last_unstale":"2024-05-08T09:25:47.534995+0000","last_undegraded":"2024-05-08T09:25:47.534995+0000","last_fullsized":"2024-05-08T09:25:47.534995+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'6","last_scrub_stamp":"2024-05-08T09:25:47.534865+0000","last_deep_scrub":"29'6","last_deep_scrub_stamp":"2024-05-08T09:25:47.534865+0000","last_clean_scrub_stamp":"2024-05-08T09:25:47.534865+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:30:18.037793+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1541,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":655,"num_read_kb":623,"num_write":558,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2281,"ondisk_log_size":2281,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1600,"num_read_kb":1397,"num_write":597,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1526,"ondisk_log_size":1526,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1612,"num_read_kb":1502,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705730,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39924,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331916,"statfs":{"total":96636764160,"available":96595881984,"internally_reserved":0,"allocated":438272,"data_stored":135604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705729,"num_pgs":153,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40436,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331404,"statfs":{"total":96636764160,"available":96595357696,"internally_reserved":0,"allocated":962560,"data_stored":723288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705729,"num_pgs":156,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40472,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331368,"statfs":{"total":96636764160,"available":96595320832,"internally_reserved":0,"allocated":999424,"data_stored":725474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705730,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":409600,"data_stored":135616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T09:26:31.403 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-08T09:26:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.532+0000 7fbedb921640 1 Processor -- start 2024-05-08T09:26:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.532+0000 7fbedb921640 1 -- start start 2024-05-08T09:26:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbedb921640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbed406d480 0x7fbed406d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbedb921640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbed4098840 con 0x7fbed40710f0 2024-05-08T09:26:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbedb921640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 -- 0x7fbed4072040 con 0x7fbed406d480 2024-05-08T09:26:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbed96bd640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbed406d480 0x7fbed406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbed8ebc640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbed40710f0 0x7fbed4096090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:32966/0 (socket says 172.21.15.45:32966) 2024-05-08T09:26:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbed8ebc640 1 -- 172.21.15.45:0/1865109964 learned_addr learned my addr 172.21.15.45:0/1865109964 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-05-08T09:26:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbed96bd640 1 -- 172.21.15.45:0/1865109964 >> v1:172.21.15.45:6789/0 conn(0x7fbed40710f0 legacy=0x7fbed4096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.533+0000 7fbed96bd640 1 -- 172.21.15.45:0/1865109964 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed4070b20 con 0x7fbed406d480 2024-05-08T09:26:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbed96bd640 1 --2- 172.21.15.45:0/1865109964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed406d860 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009720 tx=0x7fbed002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9dbb5b5c7b5d53 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbecbfff640 1 -- 172.21.15.45:0/1865109964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed00316d0 con 0x7fbed406d480 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbecbfff640 1 -- 172.21.15.45:0/1865109964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0037070 con 0x7fbed406d480 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbecbfff640 1 -- 172.21.15.45:0/1865109964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed00319c0 con 0x7fbed406d480 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbedb921640 1 -- 172.21.15.45:0/1865109964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 msgr2=0x7fbed406d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbedb921640 1 --2- 172.21.15.45:0/1865109964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed406d860 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009720 tx=0x7fbed002b840 comp rx=0 tx=0).stop 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbedb921640 1 -- 172.21.15.45:0/1865109964 shutdown_connections 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbedb921640 1 --2- 172.21.15.45:0/1865109964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed406d860 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.534+0000 7fbedb921640 1 -- 172.21.15.45:0/1865109964 >> 172.21.15.45:0/1865109964 conn(0x7fbed40996c0 msgr2=0x7fbed4099ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.535+0000 7fbedb921640 1 -- 172.21.15.45:0/1865109964 shutdown_connections 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.535+0000 7fbedb921640 1 -- 172.21.15.45:0/1865109964 wait complete. 2024-05-08T09:26:31.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.535+0000 7fbedb921640 1 Processor -- start 2024-05-08T09:26:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.535+0000 7fbedb921640 1 -- start start 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbedb921640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbedb921640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 -- 0x7fbed406df20 con 0x7fbed406d480 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbed96bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbed96bd640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55608/0 (socket says 172.21.15.45:55608) 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbed96bd640 1 -- 172.21.15.45:0/22700751 learned_addr learned my addr 172.21.15.45:0/22700751 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbed96bd640 1 -- 172.21.15.45:0/22700751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbed408fa30 con 0x7fbed406d480 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.536+0000 7fbed96bd640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009840 tx=0x7fbed00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.537+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0032770 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.537+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbed0032910 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.537+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbed4091270 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.537+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbed0032c30 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.537+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbed41c14a0 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.538+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) ==== 45563+0+0 (secure 0 0 0) 0x7fbed004c060 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.538+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbed4062e90 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.538+0000 7fbec9ffb640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 0x7fbeb803a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.538+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6336+0+0 (secure 0 0 0) 0x7fbed002f050 con 0x7fbed406d480 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.538+0000 7fbed8ebc640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 0x7fbeb803a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T09:26:31.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.539+0000 7fbed8ebc640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 0x7fbeb803a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007fd0 tx=0x7fbec4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T09:26:31.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.543+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185023 (secure 0 0 0) 0x7fbed0040070 con 0x7fbed406d480 2024-05-08T09:26:31.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.729+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbed4091050 con 0x7fbed406d480 2024-05-08T09:26:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.731+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fbed006b910 con 0x7fbed406d480 2024-05-08T09:26:31.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.732+0000 7fbec9ffb640 1 -- 172.21.15.45:0/22700751 <== mon.0 v2:172.21.15.45:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fbed0037060 con 0x7fbed406d480 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 msgr2=0x7fbeb803a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 0x7fbeb803a520 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbec4007fd0 tx=0x7fbec4007ac0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 msgr2=0x7fbed41c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009840 tx=0x7fbed00046c0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 shutdown_connections 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.161:6824/2277433962,v1:172.21.15.161:6825/2277433962] conn(0x7fbeb8038060 0x7fbeb803a520 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 --2- 172.21.15.45:0/22700751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbed406d480 0x7fbed41c0f60 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 >> 172.21.15.45:0/22700751 conn(0x7fbed40996c0 msgr2=0x7fbed4123870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 shutdown_connections 2024-05-08T09:26:31.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-05-08T09:26:31.733+0000 7fbedb921640 1 -- 172.21.15.45:0/22700751 wait complete. 2024-05-08T09:26:31.743 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-08T09:26:31.743 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-08T09:26:31.743 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-08T09:26:31.743 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.778 INFO:tasks.ceph.osd.0:Stopped 2024-05-08T09:26:31.779 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-08T09:26:31.779 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.808 INFO:tasks.ceph.osd.1:Stopped 2024-05-08T09:26:31.808 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-08T09:26:31.808 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.890 INFO:tasks.ceph.osd.2:Stopped 2024-05-08T09:26:31.890 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-08T09:26:31.890 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.935 INFO:tasks.ceph.osd.3:Stopped 2024-05-08T09:26:31.935 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-08T09:26:31.935 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-08T09:26:31.935 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.964 INFO:tasks.ceph.mgr.x:Stopped 2024-05-08T09:26:31.964 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-08T09:26:31.964 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-08T09:26:31.964 INFO:teuthology.orchestra.run:waiting for 300 2024-05-08T09:26:31.975 INFO:tasks.ceph.mon.a:Stopped 2024-05-08T09:26:31.975 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-08T09:26:31.975 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-05-08T09:26:32.045 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2024-05-08T09:26:32.045 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-08T09:26:32.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:26:32.192 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-08T09:26:32.414 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:26:32.414 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-08T09:26:32.470 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:26:32.471 DEBUG:teuthology.orchestra.run.smithi161:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-08T09:26:32.521 INFO:tasks.ceph:Archiving mon data... 2024-05-08T09:26:32.523 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/data/mon.a.tgz 2024-05-08T09:26:32.523 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-05-08T09:26:32.542 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.YCTM8Bacdd 2024-05-08T09:26:32.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.YCTM8Bacdd 2024-05-08T09:26:32.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.YCTM8Bacdd 2024-05-08T09:26:32.783 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.YCTM8Bacdd is 266KB 2024-05-08T09:26:32.878 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.YCTM8Bacdd 2024-05-08T09:26:32.894 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-08T09:26:32.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T09:26:32.936 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-08T09:26:33.019 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T09:26:33.037 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-08T09:26:33.037 INFO:tasks.ceph:Archiving crash dumps... 2024-05-08T09:26:33.038 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi045/crash 2024-05-08T09:26:33.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T09:26:33.085 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi161/crash 2024-05-08T09:26:33.086 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-08T09:26:33.126 INFO:tasks.ceph:Compressing logs... 2024-05-08T09:26:33.126 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T09:26:33.129 DEBUG:teuthology.orchestra.run.smithi161:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30100.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31271.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29781.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30100.log.gz 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30599.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31271.log.gz 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30271.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29781.log.gz 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30683.log 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30599.log.gz 2024-05-08T09:26:33.173 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30271.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30271.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31103.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.30683.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29831.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31061.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31103.log: /var/log/ceph/ceph-client.admin.29831.log: gzip -5 --verbose -- 85.7% /var/log/ceph/ceph-client.admin.30041.log -- replaced with /var/log/ceph/ceph-client.admin.31103.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29831.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30377.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.31061.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30041.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30935.log 2024-05-08T09:26:33.174 INFO:teuthology.orchestra.run.smithi045.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30377.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30377.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30809.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30935.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29689.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.30809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30851.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30809.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29689.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28496.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30851.log.gz 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30209.log 2024-05-08T09:26:33.175 INFO:teuthology.orchestra.run.smithi045.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.28496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29933.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28496.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30229.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30209.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29933.log: /var/log/ceph/ceph-client.admin.30229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30893.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29933.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30229.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30767.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29589.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.30893.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30270.log 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29589.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30767.log.gz 2024-05-08T09:26:33.176 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26664.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29589.log.gz 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30270.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.26664.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30270.log.gz 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26664.log.gz 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30725.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30461.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29931.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31019.log 2024-05-08T09:26:33.177 INFO:teuthology.orchestra.run.smithi045.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30725.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30461.log: /var/log/ceph/ceph-client.admin.29931.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30461.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31231.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29931.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30099.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.31019.log: /var/log/ceph/ceph-client.admin.31231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29932.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31019.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31231.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28378.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.30099.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30101.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29932.log.gz 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.28378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30977.log 2024-05-08T09:26:33.178 INFO:teuthology.orchestra.run.smithi045.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28378.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30419.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.30101.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30641.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30977.log: /var/log/ceph/ceph-client.admin.30419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28539.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30977.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.30419.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29731.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30641.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30515.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.28539.log: /var/log/ceph/ceph-client.admin.29731.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.28539.log.gz 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29930.log 2024-05-08T09:26:33.179 INFO:teuthology.orchestra.run.smithi045.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29731.log.gz 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29647.log 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30515.log: /var/log/ceph/ceph-client.admin.29930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30557.log 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.30515.log.gz 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29930.log.gz 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.29647.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.29647.log.gz 2024-05-08T09:26:33.180 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.30557.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.30557.log.gz 2024-05-08T09:26:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35846.log 2024-05-08T09:26:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86037.log 2024-05-08T09:26:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.35846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64880.log 2024-05-08T09:26:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.86037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41890.log 2024-05-08T09:26:33.201 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.64880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30421.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46125.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.41890.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86037.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.35846.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.30421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51570.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.30421.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77585.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.46125.log: /var/log/ceph/ceph-client.0.51570.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64880.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39470.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.41890.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.77585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73955.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.39470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84839.log 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.46125.log.gz 2024-05-08T09:26:33.202 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51570.log.gz 2024-05-08T09:26:33.203 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.73955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88445.log 2024-05-08T09:26:33.203 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77585.log.gz 2024-05-08T09:26:33.203 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.84839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37661.log 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67905.log 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.88445.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.39470.log.gz 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.84839.log.gz 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.37661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35053.log 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.67905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83635.log 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.73955.log.gz 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.35053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63670.log 2024-05-08T09:26:33.240 INFO:teuthology.orchestra.run.smithi161.stderr: 86.4% 91.0% -- replaced with /var/log/ceph/ceph-client.0.88445.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35053.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.83635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57620.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37661.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.63670.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.57620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36451.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83635.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.67905.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34893.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48545.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.36451.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34893.log: /var/log/ceph/ceph-client.0.62460.log 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.48545.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63670.log.gz 2024-05-08T09:26:33.241 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% 86.3% -- replaced with /var/log/ceph/ceph-client.0.57620.log.gz -- replaced with /var/log/ceph/ceph-client.admin.34893.log.gz 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78795.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.62460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54595.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.78795.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.36451.log.gz 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75165.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.48545.log.gz 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.54595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47940.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:gzip/var/log/ceph/ceph-client.0.75165.log: -5 --verbose -- /var/log/ceph/ceph-client.0.89655.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.47940.log: gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.62460.log.gz 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.0.59435.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.89655.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.54595.log.gz 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52175.log 2024-05-08T09:26:33.242 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.78795.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.59435.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53385.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.47940.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.75165.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.52175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87235.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.53385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66090.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89655.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.87235.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.59435.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.66090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81215.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.52175.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66695.log 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53385.log.gz 2024-05-08T09:26:33.243 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.81215.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.66695.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.87235.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82425.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.8% -- replaced with /var/log/ceph/ceph-client.0.66090.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71535.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.82425.log: gzip 92.0% -5 --verbose -- /var/log/ceph/ceph-client.0.60040.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.71535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38871.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.66695.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:gzip 91.5% -- replaced with /var/log/ceph/ceph-client.0.81215.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.60040.log: /var/log/ceph/ceph-client.0.38871.log: gzip -5 --verbose 91.3% -- /var/log/ceph/ceph-client.0.95100.log 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.82425.log.gz 2024-05-08T09:26:33.244 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68510.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.38871.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.95100.log: /var/log/ceph/ceph-client.0.68510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43705.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.60040.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.71535.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65485.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.43705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93285.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95100.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.65485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49150.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.93285.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43705.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74560.log 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.49150.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.68510.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93285.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.65485.log.gz 2024-05-08T09:26:33.245 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49755.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.74560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47335.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49150.log.gz/var/log/ceph/ceph-client.0.49755.log: 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.47335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69115.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.74560.log.gz 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-mgr.x.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49755.log.gz 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56410.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.69115.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47335.log.gz 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42495.log 2024-05-08T09:26:33.246 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64275.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.56410.log: /var/log/ceph/ceph-client.0.42495.log: 91.0% 92.6% -- replaced with /var/log/ceph/ceph-client.0.69115.log.gz 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.42495.log.gz 91.4% -- replaced with /var/log/ceph/ceph-client.0.56410.log.gz 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50360.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.64275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60645.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.50360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80610.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.60645.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50360.log.gz 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.64275.log.gz 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50965.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.80610.log: gzip 90.9% -- replaced with /var/log/ceph/ceph-client.0.60645.log.gz 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.90865.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89050.log 2024-05-08T09:26:33.247 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.90865.log: /var/log/ceph/ceph-client.0.50965.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.80610.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.90865.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.50965.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61855.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.89050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78190.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.61855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44310.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.78190.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89050.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.61855.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30381.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.44310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30501.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.30381.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.78190.log.gz 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.30381.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.55805.log 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:26:33.248 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.30501.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.44310.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.30501.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92680.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.55805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44915.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.92680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30461.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.44915.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55805.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.92680.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43100.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.30461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80005.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.43100.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.30461.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44915.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95757.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.80005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85438.log 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.95757.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43100.log.gz 2024-05-08T09:26:33.249 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80005.log.gz 2024-05-08T09:26:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58225.log 2024-05-08T09:26:33.250 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.85438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72745.log 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.58225.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.85438.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84240.log 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.72745.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58225.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.95757.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35013.log 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.72745.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.0.94495.log 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.35013.log: /var/log/ceph/ceph-client.0.84240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53990.log 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.35013.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.0.84240.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.94495.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94495.log.gz 2024-05-08T09:26:33.265 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70325.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.53990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58830.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.70325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38266.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.58830.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.53990.log.gz 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.70325.log.gz 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73350.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.38266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67300.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.73350.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58830.log.gz 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76375.log 2024-05-08T09:26:33.266 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.67300.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38266.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.73350.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.81820.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.76375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52780.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.81820.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67300.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37056.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr: 91.2%/var/log/ceph/ceph-client.0.52780.log: -- replaced with /var/log/ceph/ceph-client.0.76375.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:gzip 91.3% -- replaced with /var/log/ceph/ceph-client.0.81820.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.91470.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87840.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.91470.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.52780.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76980.log 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37056.log.gz/var/log/ceph/ceph-client.0.87840.log: 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91470.log.gz 2024-05-08T09:26:33.267 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86636.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.76980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79400.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.86636.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.87840.log.gz 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.86636.log.gz 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92075.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76980.log.gz 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57015.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.79400.log: /var/log/ceph/ceph-client.0.92075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72140.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.57015.log: 91.1% 91.1% -- replaced with /var/log/ceph/ceph-client.0.79400.log.gz 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.92075.log.gz 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34973.log 2024-05-08T09:26:33.268 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57015.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75770.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.72140.log: /var/log/ceph/ceph-client.admin.34973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70930.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr: 86.4%/var/log/ceph/ceph-client.0.75770.log: -- replaced with /var/log/ceph/ceph-client.admin.34973.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72140.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.75770.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40075.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69720.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.70930.log: /var/log/ceph/ceph-client.0.40075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41285.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.69720.log: 91.3% 91.0% -- replaced with /var/log/ceph/ceph-client.0.70930.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.40075.log.gz 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55200.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46730.log 2024-05-08T09:26:33.269 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.69720.log.gz 2024-05-08T09:26:33.270 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.41285.log: /var/log/ceph/ceph-client.0.55200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83030.log 2024-05-08T09:26:33.274 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.46730.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.41285.log.gz 2024-05-08T09:26:33.274 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.55200.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45520.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46730.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.83030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61250.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.45520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90260.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.61250.log: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.45520.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93890.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.90260.log: gzip 91.2% -5 -- replaced with /var/log/ceph/ceph-client.0.61250.log.gz --verbose 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr: -- /var/log/ceph/ceph-client.0.63065.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.93890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34933.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83030.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.63065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40680.log 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.admin.34933.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.34933.log.gz 2024-05-08T09:26:33.275 INFO:teuthology.orchestra.run.smithi161.stderr: 91.0% 91.2% -- replaced with /var/log/ceph/ceph-client.0.90260.log.gz 2024-05-08T09:26:33.276 INFO:teuthology.orchestra.run.smithi161.stderr: -- replaced with /var/log/ceph/ceph-client.0.93890.log.gz 2024-05-08T09:26:33.276 INFO:teuthology.orchestra.run.smithi161.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63065.log.gz 2024-05-08T09:26:33.276 INFO:teuthology.orchestra.run.smithi161.stderr:/var/log/ceph/ceph-client.0.40680.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40680.log.gz 2024-05-08T09:26:33.277 INFO:teuthology.orchestra.run.smithi161.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-08T09:26:33.338 INFO:teuthology.orchestra.run.smithi045.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-08T09:26:34.093 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-08T09:26:34.235 INFO:teuthology.orchestra.run.smithi045.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-08T09:26:34.237 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-05-08T09:26:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m1.094s 2024-05-08T09:26:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m1.247s 2024-05-08T09:26:34.237 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m0.071s 2024-05-08T09:26:34.280 INFO:teuthology.orchestra.run.smithi161.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-08T09:26:34.282 INFO:teuthology.orchestra.run.smithi161.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-08T09:26:34.284 INFO:teuthology.orchestra.run.smithi161.stderr: 2024-05-08T09:26:34.284 INFO:teuthology.orchestra.run.smithi161.stderr:real 0m1.098s 2024-05-08T09:26:34.284 INFO:teuthology.orchestra.run.smithi161.stderr:user 0m3.154s 2024-05-08T09:26:34.285 INFO:teuthology.orchestra.run.smithi161.stderr:sys 0m0.240s 2024-05-08T09:26:34.285 INFO:tasks.ceph:Archiving logs... 2024-05-08T09:26:34.285 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi045/log 2024-05-08T09:26:34.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T09:26:34.556 DEBUG:teuthology.misc:Transferring archived files from smithi161:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi161/log 2024-05-08T09:26:34.557 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T09:26:35.190 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T09:26:35.203 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T09:26:35.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T09:26:35.206 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T09:26:35.284 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T09:26:35.293 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T09:26:35.293 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T09:26:35.296 DEBUG:teuthology.orchestra.run.smithi161:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T09:26:35.310 INFO:teuthology.orchestra.run.smithi161.stderr:bash: line 1: ntpq: command not found 2024-05-08T09:26:35.311 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-05-08T09:26:35.314 INFO:teuthology.orchestra.run.smithi161.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T09:26:35.314 INFO:teuthology.orchestra.run.smithi161.stdout:=============================================================================== 2024-05-08T09:26:35.314 INFO:teuthology.orchestra.run.smithi161.stdout:^* hv01.front.sepia.ceph.com 3 6 377 42 -1835us[-1794us] +/- 65ms 2024-05-08T09:26:35.314 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 +1701us[+1701us] +/- 52ms 2024-05-08T09:26:35.315 INFO:teuthology.orchestra.run.smithi161.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 41 -166us[ -166us] +/- 72ms 2024-05-08T09:26:35.315 INFO:teuthology.orchestra.run.smithi161.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 41 -1818us[-1806us] +/- 65ms 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 +1742us[+1742us] +/- 52ms 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 -135us[ -135us] +/- 72ms 2024-05-08T09:26:35.316 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T09:26:35.317 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T09:26:35.328 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T09:26:35.328 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T09:26:35.338 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T09:26:35.422 DEBUG:teuthology.orchestra.run.smithi161:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T09:26:35.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T09:26:35.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:26:35.512 DEBUG:teuthology.orchestra.run.smithi161:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T09:26:35.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:26:35.539 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T09:26:35.549 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T09:26:35.558 INFO:teuthology.task.internal:Duration was 742.288671 seconds 2024-05-08T09:26:35.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T09:26:35.575 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T09:26:35.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T09:26:35.579 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T09:26:35.619 INFO:teuthology.orchestra.run.smithi161.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T09:26:35.620 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T09:26:35.860 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T09:26:35.861 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-05-08T09:26:35.861 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T09:26:35.925 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi161.front.sepia.ceph.com 2024-05-08T09:26:35.925 DEBUG:teuthology.orchestra.run.smithi161:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T09:26:35.953 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T09:26:35.954 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T09:26:35.967 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T09:26:36.020 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T09:26:36.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T09:26:36.036 DEBUG:teuthology.orchestra.run.smithi161:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T09:26:36.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T09:26:36.185 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T09:26:36.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T09:26:36.211 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T09:26:36.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T09:26:36.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T09:26:36.254 DEBUG:teuthology.orchestra.run.smithi161:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T09:26:36.275 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-05-08T09:26:36.299 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = core 2024-05-08T09:26:36.338 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T09:26:36.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:26:36.363 DEBUG:teuthology.orchestra.run.smithi161:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T09:26:36.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T09:26:36.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T09:26:36.404 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T09:26:36.405 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi045 2024-05-08T09:26:36.405 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T09:26:36.440 DEBUG:teuthology.misc:Transferring archived files from smithi161:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-07_21:40:02-rgw-squid-distro-default-smithi/7696039/remote/smithi161 2024-05-08T09:26:36.441 DEBUG:teuthology.orchestra.run.smithi161:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T09:26:36.474 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T09:26:36.474 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T09:26:36.477 DEBUG:teuthology.orchestra.run.smithi161:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T09:26:36.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T09:26:36.535 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T09:26:36.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T09:26:36.548 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T09:26:36.548 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T09:26:36.550 DEBUG:teuthology.orchestra.run.smithi161:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T09:26:36.564 INFO:teuthology.orchestra.run.smithi045.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 09:26 /home/ubuntu/cephtest 2024-05-08T09:26:36.579 INFO:teuthology.orchestra.run.smithi161.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 09:26 /home/ubuntu/cephtest 2024-05-08T09:26:36.580 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T09:26:36.598 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T09:26:36.630 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 742.288670539856 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-05-08T09:26:36.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T09:26:36.707 INFO:teuthology.run:pass